Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Generalizability Analysis of Teaching Aptitude and Personality Test for Pre-service Engineering Teachers in a Graduate School of Education

교육대학원 예비공학교사의 교직 적성·인성 검사에서 일반화가능도 분석

  • Kim, Sung-Yeun (Graduate School of Education, Incheon National University)
  • 김성연 (인천대학교 교육대학원)
  • Received : 2018.02.27
  • Accepted : 2018.05.04
  • Published : 2018.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study examined the fairness of the teaching aptitude and personality test assigned to pre-service engineering teachers in a graduate school of education based on measurement traits. For this study, we analyzed the teaching aptitude and personality test scores of 99 students enrolled in engineering education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was generally the highest, followed by nesting of items within domains, pre-service engineering teachers, interactions of pre-service engineering teachers with domains, domains, and occasions. Second, dependability coefficients were better indicators than Cronbach's because the latter may have been overestimated by applying the traditional reliability coefficient in inappropriate manners. Third, the teaching aptitude and personality test can be applied to pre-service engineering teachers in a graduate school of education based on empirical evidence considering dependability coefficients. Fourth, a total of 96 items from the original 210 items, with 2 occasions and 12 domains containing 8 items in each domain, were optimal measurement conditions to reach adequate degrees of reliability based on the total number of items. Finally, the results were discussed, the study limitations described and future research directions proposed.

본 연구는 측정학적 특성을 바탕으로 교육과학기술부에서 표준안으로 보급한 교직 적성 인성 검사를 교육대학원의 예비공학교사에게 실시하는 것이 적절한지를 살펴보며, 교직 적성 인성 검사가 적정 수준의 신뢰도에 도달할 수 있는 효율적인 측정 조건을 제시하였다. 이를 위해 수도권에 소재한 한 교육대학원에서 2013년부터 2017년까지 공학교육전공의 예비공학교사 99명을 대상으로 실시한 교직 적성 인성 검사자료에 일반화가능도 분석을 수행하였다. 주요 분석결과는 다음과 같다. 첫째, 교직 적성 인성 검사점수에 미치는 요인의 상대적인 영향력은 일반적으로 잔차, 영역 내 문항, 피험자, 피험자와 영역의 상호작용, 영역, 그리고 시행횟수 크기의 순으로 나타났다. 둘째, 고전검사이론을 바탕으로 한 Cronbach's ${\alpha}$는 측정 구조를 적합하게 반영하지 못함으로써 과대추정 될 수 있으므로 준거참조검사에서는 의존도계수와 같은 보다 정밀한 신뢰도를 추정할 필요가 있다. 셋째, 교직 적성 인성 검사 표준안은 의존도계수를 바탕으로 교육대학원의 예비공학교사에게 적용 가능하다는 경험적 근거를 제시하였다. 넷째, 교직 적성 인성 검사가 적정 수준의 신뢰도에 도달할 수 있는 효율적인 측정 조건은 총 문항 수를 기준으로 시행횟수는 2회, 영역은 12개, 그리고 영역 내 문항은 8개로 원자료인 총 210개 문항을 96개로 축소할 수 있는 것으로 나타났다. 마지막으로 본 연구의 제한점과 후속 연구를 위한 방향을 제시하였다.

Keywords

References

  1. Ministry of Education, Character Education Promotion Law. Sejong: Ministry of Education, 2015.
  2. I. J. Lee, "Systematic Approach of Character Education in School and Competences of Teachers", Journal of Moral & Ethics Education, vol. 39, pp. 271-300, 2016. DOI: https://doi.org/10.18850/JEES.2016.39.11
  3. N. Kim, "A Critical Consideration on the Idea and Implication of the 'Character Education Promotion Law'", Studies on Life and Culture, vol. 39, pp. 55-102, 2016.
  4. H. K. Park, "Discussions with the Issue of Character Education Promotion", The Journal of Law of Education, vol. 27, no. 3, pp. 77-100, 2015. DOI: http://doi.org/10.17317/tjle.27.3.201512.77
  5. M. W. Kim, J. Y. Park, J. S. Choi, M. J. Kim, T. H. Kim, "The Effect of Social Emotion Learning on Teacher Character of Specialized Pre-service Teacher", Journal of the Korean Institute of Industrial Educators, vol. 42, no. 2, pp. 47-66, 2017.
  6. Ministry of Education, Science and Technology, Enforcement Decree of the Elementary and Secondary Education Act, Seoul: Ministry of Education, Science and Technology, 2009.
  7. C. R. Go, S. A. Bae, "Development of the Workplace Etiquette Education Program for Strengthen of Employment Capability of Specialized High School Students", Journal of the Korean Institute of industrial educators, vol. 36, no. 2, pp. 201-218, 2011.
  8. K. M. Bae, "The Analysis of the Cognitive Level of Basic Job Skills of Specialized High School Based on NCS", Journal of Educational Innovation Research, vol. 27, no. 1, pp. 133-158, 2017. DOI: https://doi.org/10.21024/pnuedi.27.1.201703.133
  9. M. W. Kim, T. H. Kim, "Analysis of Personality Level of Students of Industrial-field Specialized High Schools and Meister High Schools", The Journal of Vocational Education Research, vol. 36, no. 1, pp. 23-46, 2017. DOI: http://doi.org/G704-000975.2017.36.1.004
  10. H. S. Lim, Y. C. Jyung, "Relationships among Creativity, Ego-identity and Career Decision Status of Vocational High School Students", Journal of Agricultural Education and Human Resource Development, vol. 42, no. 4, pp. 53-73, 2010. DOI: https://doi.org/10.23840/agehrd.2010.42.4.53
  11. H. K. Kang, "Issues and Their Improvement of Specialized High Schoo", The Journal of Educational Research, vol. 2, pp. 1-25, 2004.
  12. C. S. Park, "Validation Study of Teaching Aptitude-Personality Test for Alternative Modification of the Test", Journal of Holistic Convergence Education, vol. 19, no. 3, pp. 107-124, 2015.
  13. Ministry of Education, Science, and Technology. Official Approval Provision for Teacher Qualification. Seoul: Ministry of Education, Science, and Technology. 2012.
  14. J. H. Kim, H. W. Nam, S. C. Yeom, J. Y. Im, The Development of Teaching Aptitude and Personality Test. Seoul: Ministry of Education, Science, and Technology, 2012.
  15. S. Y. Kim, "Item Profile Analysis of the Personality Test for Teaching Profession", Second Education Research, vol. 65, no. 4, pp. 705-729, 2017. https://doi.org/10.25152/ser.2017.65.4.705
  16. W. J. Cho, "Validation and Modification of Teaching Aptitude Test for Pre-service Early Childhood Teachers", Early Childhood Education & Care, vol. 9, no. 2, pp. 101-123, 2014.
  17. H. G. Won, S. J. Lee, "Validation of a Short Form of the Aptitude and Personality as a Teacher Scale for Preservice Early Childhood Teachers", Early Childhood Education Research & Review, vol. 21, no. 1, pp. 133-165, 2017.
  18. S. H. Kim, Unqualified Candidates were only 0.6% based on Aptitude and Personality Test for Pre-service Teachers, Available From: http://www.shinmoongo.net, (accessed Dec., 15, 2017)
  19. Korea Institute for Curriculum and Evaluation, A Study on Directions to Improve Official Approval Provisions for Teacher Qualification in a Competency-based Educational Environment. Seoul: Korea Institute for Curriculum and Evaluation, 2016.
  20. Crick, J. E. Crick, R. L. Brennan, Manual for GENOVA: A Generalized Analysis of Variance System. Research and Development Division, American College Testing Program, 1983.
  21. R. L. Brennan, Generalizability Theory, New York, NY: Springer-Verlag, 2001. DOI: https://doi.org/10.1007/978-1-4757-3456-0
  22. S. B. Dunbar, D. M. Koretz, H. D. Hoover, "Quality Control in the Development and Use of Performance Assessments", Applied Measurement in Education, vol. 4, no. 4, pp. 289-303, 1992. DOI: https://doi.org/10.1207/s15324818ame0404_3
  23. L. J. Fyans, Generalizability theory: Inferences and practical applications, Jossey-Bass Inc Pub, 1983.
  24. R. J. Shavelson, G, P. Baxter, X. Gao, "Sampling Variability of Performance Assessments", Journal of Educational Measurement, vol. 30, no. 3, pp. 215-232, 1993. DOI: https://doi.org/10.1111/j.1745-3984.1993.tb00424.x
  25. N. M. Webb, R. J. Shavelson, E. H. Haertel, "4 Reliability Coefficients and Generalizability Theory", Handbook of statistics, vol. 26, pp. 81-124, 2006. DOI: https://doi.org/10.1016/S0169-7161(06)26004-8
  26. J. J. Norcini, Measurement Issues in the Use of Simulation for Testing Professionals: Test Development, Test Scoring, Standard Setting. In A. Tekian, C. H. McGuire, W. C. McGaghie, Innovative Simulations for Assessing Professional Competence, pp. 77-104, Chicago, IL: University of Illinois, 1999.
  27. J. Cohen, Statistical Power Analyses for the Social Sciences, Hillsdale, NJ, Lawrence Erlbauni Associates, 1988.
  28. L. J. Cronbach, R. L. Linn, R. L. Brennan, E. H. Haertel, "Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness", Educational and Psychological Measurement, vol. 57, no. 3, pp. 373-399, 1997. DOI: https://doi.org/10.1177/0013164497057003001
  29. A. Nussbaum, "Multivariate Generalizability Theory in Educational Measurement: An Empirical Study", Applied Psychological Measurement, vol. 8, no. 2, pp. 219-230, 1984. DOI: https://doi.org/10.1177/014662168400800211
  30. R. J. Shavelson, N. M. Webb, Generalizability theory: A primer, Sage, 1991.
  31. A. Vallevand, C. Violato, "A Predictive and Construct Validity Study of a High-stakes Objective Clinical Examination for Assessing the Clinical Competence of International Medical Graduates", Teaching and learning in medicine, vol. 24, no. 2, pp. 168-176, 2012. DOI: https://doi.org/10.1080/10401334.2012.664988