Browse > Article
http://dx.doi.org/10.5762/KAIS.2018.19.5.323

Generalizability Analysis of Teaching Aptitude and Personality Test for Pre-service Engineering Teachers in a Graduate School of Education  

Kim, Sung-Yeun (Graduate School of Education, Incheon National University)
Publication Information
Journal of the Korea Academia-Industrial cooperation Society / v.19, no.5, 2018 , pp. 323-330 More about this Journal
Abstract
This study examined the fairness of the teaching aptitude and personality test assigned to pre-service engineering teachers in a graduate school of education based on measurement traits. For this study, we analyzed the teaching aptitude and personality test scores of 99 students enrolled in engineering education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was generally the highest, followed by nesting of items within domains, pre-service engineering teachers, interactions of pre-service engineering teachers with domains, domains, and occasions. Second, dependability coefficients were better indicators than Cronbach's because the latter may have been overestimated by applying the traditional reliability coefficient in inappropriate manners. Third, the teaching aptitude and personality test can be applied to pre-service engineering teachers in a graduate school of education based on empirical evidence considering dependability coefficients. Fourth, a total of 96 items from the original 210 items, with 2 occasions and 12 domains containing 8 items in each domain, were optimal measurement conditions to reach adequate degrees of reliability based on the total number of items. Finally, the results were discussed, the study limitations described and future research directions proposed.
Keywords
Criterion-referenced test; Dependability coefficients; Generalizability analysis; Pre-service engineering Teacher; Teaching aptitude and personality test;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. S. Lim, Y. C. Jyung, "Relationships among Creativity, Ego-identity and Career Decision Status of Vocational High School Students", Journal of Agricultural Education and Human Resource Development, vol. 42, no. 4, pp. 53-73, 2010. DOI: https://doi.org/10.23840/agehrd.2010.42.4.53
2 H. K. Kang, "Issues and Their Improvement of Specialized High Schoo", The Journal of Educational Research, vol. 2, pp. 1-25, 2004.
3 C. S. Park, "Validation Study of Teaching Aptitude-Personality Test for Alternative Modification of the Test", Journal of Holistic Convergence Education, vol. 19, no. 3, pp. 107-124, 2015.
4 Ministry of Education, Science, and Technology. Official Approval Provision for Teacher Qualification. Seoul: Ministry of Education, Science, and Technology. 2012.
5 J. H. Kim, H. W. Nam, S. C. Yeom, J. Y. Im, The Development of Teaching Aptitude and Personality Test. Seoul: Ministry of Education, Science, and Technology, 2012.
6 S. Y. Kim, "Item Profile Analysis of the Personality Test for Teaching Profession", Second Education Research, vol. 65, no. 4, pp. 705-729, 2017.   DOI
7 W. J. Cho, "Validation and Modification of Teaching Aptitude Test for Pre-service Early Childhood Teachers", Early Childhood Education & Care, vol. 9, no. 2, pp. 101-123, 2014.
8 H. G. Won, S. J. Lee, "Validation of a Short Form of the Aptitude and Personality as a Teacher Scale for Preservice Early Childhood Teachers", Early Childhood Education Research & Review, vol. 21, no. 1, pp. 133-165, 2017.
9 S. H. Kim, Unqualified Candidates were only 0.6% based on Aptitude and Personality Test for Pre-service Teachers, Available From: http://www.shinmoongo.net, (accessed Dec., 15, 2017)
10 L. J. Cronbach, R. L. Linn, R. L. Brennan, E. H. Haertel, "Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness", Educational and Psychological Measurement, vol. 57, no. 3, pp. 373-399, 1997. DOI: https://doi.org/10.1177/0013164497057003001   DOI
11 A. Nussbaum, "Multivariate Generalizability Theory in Educational Measurement: An Empirical Study", Applied Psychological Measurement, vol. 8, no. 2, pp. 219-230, 1984. DOI: https://doi.org/10.1177/014662168400800211   DOI
12 R. J. Shavelson, N. M. Webb, Generalizability theory: A primer, Sage, 1991.
13 A. Vallevand, C. Violato, "A Predictive and Construct Validity Study of a High-stakes Objective Clinical Examination for Assessing the Clinical Competence of International Medical Graduates", Teaching and learning in medicine, vol. 24, no. 2, pp. 168-176, 2012. DOI: https://doi.org/10.1080/10401334.2012.664988   DOI
14 S. B. Dunbar, D. M. Koretz, H. D. Hoover, "Quality Control in the Development and Use of Performance Assessments", Applied Measurement in Education, vol. 4, no. 4, pp. 289-303, 1992. DOI: https://doi.org/10.1207/s15324818ame0404_3   DOI
15 Korea Institute for Curriculum and Evaluation, A Study on Directions to Improve Official Approval Provisions for Teacher Qualification in a Competency-based Educational Environment. Seoul: Korea Institute for Curriculum and Evaluation, 2016.
16 Crick, J. E. Crick, R. L. Brennan, Manual for GENOVA: A Generalized Analysis of Variance System. Research and Development Division, American College Testing Program, 1983.
17 R. L. Brennan, Generalizability Theory, New York, NY: Springer-Verlag, 2001. DOI: https://doi.org/10.1007/978-1-4757-3456-0
18 N. Kim, "A Critical Consideration on the Idea and Implication of the 'Character Education Promotion Law'", Studies on Life and Culture, vol. 39, pp. 55-102, 2016.
19 Ministry of Education, Character Education Promotion Law. Sejong: Ministry of Education, 2015.
20 I. J. Lee, "Systematic Approach of Character Education in School and Competences of Teachers", Journal of Moral & Ethics Education, vol. 39, pp. 271-300, 2016. DOI: https://doi.org/10.18850/JEES.2016.39.11
21 H. K. Park, "Discussions with the Issue of Character Education Promotion", The Journal of Law of Education, vol. 27, no. 3, pp. 77-100, 2015. DOI: http://doi.org/10.17317/tjle.27.3.201512.77
22 J. J. Norcini, Measurement Issues in the Use of Simulation for Testing Professionals: Test Development, Test Scoring, Standard Setting. In A. Tekian, C. H. McGuire, W. C. McGaghie, Innovative Simulations for Assessing Professional Competence, pp. 77-104, Chicago, IL: University of Illinois, 1999.
23 L. J. Fyans, Generalizability theory: Inferences and practical applications, Jossey-Bass Inc Pub, 1983.
24 R. J. Shavelson, G, P. Baxter, X. Gao, "Sampling Variability of Performance Assessments", Journal of Educational Measurement, vol. 30, no. 3, pp. 215-232, 1993. DOI: https://doi.org/10.1111/j.1745-3984.1993.tb00424.x   DOI
25 N. M. Webb, R. J. Shavelson, E. H. Haertel, "4 Reliability Coefficients and Generalizability Theory", Handbook of statistics, vol. 26, pp. 81-124, 2006. DOI: https://doi.org/10.1016/S0169-7161(06)26004-8
26 J. Cohen, Statistical Power Analyses for the Social Sciences, Hillsdale, NJ, Lawrence Erlbauni Associates, 1988.
27 K. M. Bae, "The Analysis of the Cognitive Level of Basic Job Skills of Specialized High School Based on NCS", Journal of Educational Innovation Research, vol. 27, no. 1, pp. 133-158, 2017. DOI: https://doi.org/10.21024/pnuedi.27.1.201703.133   DOI
28 M. W. Kim, J. Y. Park, J. S. Choi, M. J. Kim, T. H. Kim, "The Effect of Social Emotion Learning on Teacher Character of Specialized Pre-service Teacher", Journal of the Korean Institute of Industrial Educators, vol. 42, no. 2, pp. 47-66, 2017.
29 Ministry of Education, Science and Technology, Enforcement Decree of the Elementary and Secondary Education Act, Seoul: Ministry of Education, Science and Technology, 2009.
30 C. R. Go, S. A. Bae, "Development of the Workplace Etiquette Education Program for Strengthen of Employment Capability of Specialized High School Students", Journal of the Korean Institute of industrial educators, vol. 36, no. 2, pp. 201-218, 2011.
31 M. W. Kim, T. H. Kim, "Analysis of Personality Level of Students of Industrial-field Specialized High Schools and Meister High Schools", The Journal of Vocational Education Research, vol. 36, no. 1, pp. 23-46, 2017. DOI: http://doi.org/G704-000975.2017.36.1.004