• English Language & Literature Teaching
• /
• v.7 no.2
• /
• pp.55-75
• /
• 2002

The present study examined whether Kang's (1999) model of the relationships among language learning strategy use and language proficiency for the Asian students could be applied to a more heterogeneous group. In Kang's study, he collected information of language learning strategies of 957 foreign students learning English as a second language in American colleges through a questionnaire. He also measured the subjects' language proficiency with the Institutional Testing Program TOEFL (Test of English as a Foreign Language). This study analyzed the same data without the limitation of cultural identity. Structural equation modeling was used to model the relationships among strategy use and language proficiency. Then, the model of the present study was descriptively compared with Kang's (1999) model for the Asian students. The overall flow of the relationship paths appeared to vary very little across the two models, which would have indicated that the generalizability of Kang's (1999) model could be extended more than originally examined. (156)

• Korean Journal of Child Studies
• /
• v.23 no.4
• /
• pp.227-248
• /
• 2002

The purpose of this study aimed at establishing the validity and reliability regarding the instrument of assessing child psychological well-being. The child psychological well-being rating scale contained 3 dimensions (sense of competency, sense of relation, sense of improvement) 8 variables (sense of control, sense of achievement, sense of confidence, sense of acceptance, sense of intimacy, sense of balance, sense of morale, sense of hope) and 4 rating scale of 80 items. After the scale development, the estimates of reliability for the scale were high. Cornbach ${\alpha}$ was .962 and generalizability was .875. And concurrent validity, criteria related validity, and discriminant validity appeared to be evident sufficiently to the validity of child psychological well-being instrument. The significance of the present study was intended to apply scale validity procedure by using generalizability.

• 한국지구과학회:학술대회논문집
• /
• 2004.02a
• /
• pp.18-19
• /
• 2004

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.1
• /
• pp.565-571
• /
• 2017

The purpose of this study is to determine the effects of error sources in emotional intelligence assessment of young children. The emotional intelligence of 198 five years old children was assessed using the Emotional Intelligence Scale developed by Lee[14]. Evaluation results were analyzed using G study for generalizability theory. G study results show that parents can be effective evaluators for emotional intelligence in young children. Strategies to reduce error effects are discussed.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.11
• /
• pp.507-512
• /
• 2016

The purpose of this study is to determine the error sources and effects of each error source in self-control assessment of young children. The self-control of 259 five-year-old children was assessed using the Self-Control Rating Scale(SCRS) developed by Kendall and Wilcox[1]. The evaluation results were analyzed using G study of generalizability theory. The results of G study shows that parents can be effective evaluators for the self-control assessment of young children. The strategies to reduce the effects of error are also discussed.

• The Mathematical Education
• /
• v.57 no.2
• /
• pp.179-196
• /
• 2018

The purpose of this study was to investigate the measurement equivalence and to suggest application ways in teaching aptitude and personality test results for pre-service mathematics teachers between a graduate school of education and a college of education. This study analyzed the scores of the teaching aptitude and personality test of 36 pre-service mathematics teachers enrolled in a graduate school of education and 111 pre-service mathematics teachers in a college of education by performing a multivariate generalizability analysis. The main results were as follows. First, graduate's pre-service mathematics teachers had a higher level of teaching aptitude and personality than that of college's pre-service mathematics teachers based on the total scores. In addition, graduate's pre-service mathematics teachers had higher levels of teaching aptitude and personality than those of college's pre-service mathematics teachers except for a creativity application domain based on the sub-domain scores. Second, cognitive domains were measured more precisely but affective domains were measured less precisely for graduate's pre-service mathematics teachers than for college's pre-service mathematics teachers. Third, regardless of school levels, Cronbach's ${\alpha}$ values, which might be overestimated by applying the classical test theory, were higher than dependability coefficients. Fourth, this study showed a somewhat negative result in ensuring the measurement equivalence for a problem solving exploration domain. However, regardless of school levels, this study indicated that the overall measurement was generally reliable on composite scores. Based on these results, it was confirmed that multivariate generalizability methodologies' approach can be useful for exploring the measurement equivalence issues. Finally, this study suggests how to utilize the results of the test, how to apply a multivariate generalizability analysis for detecting the measurement equivalence, and how to develop future research based on limitations.

• Journal of the Korea Safety Management & Science
• /
• v.13 no.2
• /
• pp.195-202
• /
• 2011

The study focuses on the Repeated Measurements Design (RMD) which observations are periodically made for identical subjects within definite time periods. One of the purposes of this design is to monitor and keep track of replicated records within regular period over years. This paper also presents the classification models of RMD that is developed according to the number of factors in Between-Subject (BS) variates and Within-Subject (WS) variates. The types of models belong to each number of factors: One factor is 0BS 1WS. Two factors are 1BS 1WS and 0BS 2WS. Three factors are 1BS 2WS and 2BS 1WS. Lastly, the four factors include model of 2BS 2WS In addition, the study explains the generation mechanism of models for RMD using Generalizability Design (GD). GD is a useful method for practitioners to identify linear model of experimental design, since it generates a Venn diagram. Lastly, the research develops three types of 1BS 2WS RMDs with crossed factors and nested factors. Those are random models, mixed models and fixed models and they are presented by using Generalizability Design, $(S:A{\times}B){\times}C$. Moreover, the example of applications and its implementation steps of models developed in the study are presented for better comprehension.

• Communications of Mathematical Education
• /
• v.26 no.3
• /
• pp.251-271
• /
• 2012

The purpose of this study is: 1) to determine error sources and the effects of each error source, 2) to investigate optimal measuring conditions from holistic and analytic scoring methods, and 3) to compare the value of reliability between Cronbach's alpha and the generalizability coefficient in self-introduction letter and teacher's recommendation letter based on the generalizability theory in identification of mathematical gifted students by observations and nominations. Data of this study were collected from the science education institute for the gifted attached to the university located within in a capital city for the 2011 academic year. Scores form two raters using holistic and analytic scoring methods in both assessment types were used. The results of this study were as follows. First, as to both assessment types, error sources for people were relatively large regardless of scoring methods. However, error sources for raters in holistic scoring methods had a more significant impact than those of analytic scoring methods. Second, to set optimal measuring conditions in the self-introduction letter and teacher's recommendation letter, if we fixed the number of raters into 2 based on holistic scoring methods, at least 5 and 10 content domains were needed, respectively. In addition, the number of items in teacher's recommendation letter should be more than 3 when we fixed the number of content domains into 4, and the number of items in self-introduction letter should be more than 8 when we fixed the number of content domains into 6 using analytic scoring methods. Third, Cronbach's alpha having only a single source of errors was higher than the generalizability coefficient regardless of assessment types and scoring methods. Hence we recommend that generalizability coefficient based on various error sources such as raters, content domains, and items should be considered to keep a satisfactory level of reliability in both assessment types.

• Journal of the Korean Data and Information Science Society
• /
• v.26 no.4
• /
• pp.947-956
• /
• 2015

In the knowledge and information age, to discover and protect Intellectual Properties would be very important for their economic value as a major growth engine. This study evaluated the reliability of a Delphi survey conducted by experts to assess the value of agricultural resources knowledge obtained from literature reviews and field interviews. Delphi method is collecting the opinions of experts for several rounds repeatedly, in the next round the experts have chance to modify their opinion. Scores between two rounds are highly correlated and standard deviations are declined for second round to imply that some correction of their evaluations are made. To check reliability of Delphi survey of two rounds Cronbach's reliability coefficient and Generalizability coefficient are derived. The Cronbach alpha's supported the reliability of the method, but the Generalizability analysis revealed some unexpected results while checking the variance components of sources of measurement errors. Despite the increased reliability coefficients, the deviations between the raters are increased which means that additional rounds are required to get consensus, the goal of Delphi research.

• Journal of Gifted/Talented Education
• /
• v.23 no.5
• /
• pp.671-695
• /
• 2013

This study provides an illustrative example of using the multivariate generalizability theory. Specifically, it investigates relative effects of each error source, and finds optimal measurement conditions for the number of items within each content domain that maximizes the reliability-like coefficients, such as a generalizability coefficient and an index of dependability. The method is based on teacher recommendation letters and self-introduction letters, using an analytic scoring method in the context of selection of mathematically gifted students by observation and nomination. This study analyzed data from the 2011 academic year in the science education institute for the gifted, which is attached to the university located in the Seoul metropolitan area. It should be noted that the optimal scoring structures of this study are not generalizable to other selection instruments. However, the methodology applied in this study can be utilized to find optimal measurement conditions for the number of raters, the number of content domains, and the number of items in other selection instruments self-developed by many institutions including: the education institutes for the gifted at provincial offices of education, gifted classes, and the science education institutes for the gifted attached to universities in general. In addition, the methodology will provide bases for making informed decisions in selection instruments of the gifted based on measurement traits.