• The Mathematical Education
• /
• v.57 no.1
• /
• pp.55-74
• /
• 2018

The purpose of this study is first to examine the relative influence of each error source and to investigate the optimal measurement conditions to ensure satisfactory multiple reliability coefficients based on the teaching aptitude and personality test for pre-service teachers. Participants were 33 students enrolled in mathematics education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was highest, followed by nesting of items within domains, graduate students, interactions of graduate students with domains, and domains. Second, total 96 items, with 12 domains containing 8 items in each domain, with cut score of 598, and original 210 items, with 14 domains containing 15 items in each domain, with cut scores of 615 or 716 were optimal measurement conditions to reach acceptable reliability levels based on the joint consideration of dependability coefficients, cut score dependability coefficients, adjusted dependability coefficients, and standard errors of measurement. Third, larger deviations between the arithmetic mean and the cut score indicated higher reliability coefficients of the test results. Finally, this study suggests ways for practitioners to consider how to apply generalizability theory for criterion-referenced tests and how to develop future research based on limitations.

• Journal for History of Mathematics
• /
• v.24 no.3
• /
• pp.145-163
• /
• 2011

This study sets the cut points of affective achievement scores based on the criteria referenced assessment. The modified Angoff method is applied to the standardized mathematics affect inventory which had validity and reliability. The cut points are set for 6 factors i.e. learning directivity, self control, anxiety, interest, cognizing value and confidence. As the results, among percentages of factor that middle school 2nd grade students in Korea achieved, the proportion of cognizing value is the highest. And there are no difference of the proportions as for gender, differentiated instruction, and region.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.5
• /
• pp.323-330
• /
• 2018

This study examined the fairness of the teaching aptitude and personality test assigned to pre-service engineering teachers in a graduate school of education based on measurement traits. For this study, we analyzed the teaching aptitude and personality test scores of 99 students enrolled in engineering education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was generally the highest, followed by nesting of items within domains, pre-service engineering teachers, interactions of pre-service engineering teachers with domains, domains, and occasions. Second, dependability coefficients were better indicators than Cronbach's because the latter may have been overestimated by applying the traditional reliability coefficient in inappropriate manners. Third, the teaching aptitude and personality test can be applied to pre-service engineering teachers in a graduate school of education based on empirical evidence considering dependability coefficients. Fourth, a total of 96 items from the original 210 items, with 2 occasions and 12 domains containing 8 items in each domain, were optimal measurement conditions to reach adequate degrees of reliability based on the total number of items. Finally, the results were discussed, the study limitations described and future research directions proposed.