Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

An analysis of error sources and reliability estimation in self-control assessment of young children using generalizability theory

일반화가능도 이론 적용 가능성 탐색을 위한 유아 자기통제력 평가도구의 신뢰도와 오차요인 분석

  • Choi, Younchul (Department of Early Childhood Education, Korea National University of Education) ;
  • Kim, Kyung-Chul (Department of Early Childhood Education, Korea National University of Education)
  • 최연철 (한국교원대학교 유아교육과) ;
  • 김경철 (한국교원대학교 유아교육과)
  • Received : 2016.09.28
  • Accepted : 2016.11.10
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to determine the error sources and effects of each error source in self-control assessment of young children. The self-control of 259 five-year-old children was assessed using the Self-Control Rating Scale(SCRS) developed by Kendall and Wilcox[1]. The evaluation results were analyzed using G study of generalizability theory. The results of G study shows that parents can be effective evaluators for the self-control assessment of young children. The strategies to reduce the effects of error are also discussed.

본 연구는 유아 자기통제력 평가도구의 신뢰도와 오차에 대한 분석을 통해 유아 자기통제력 평가도구뿐만 아니라 유아를 대상으로 한 평가도구를 활용할 때 적용할 수 있는 유용한 정보를 제공하고자 하는 목적으로 수행되었다. 본 연구의 연구대상은 만5세 16학급 259명의 담임교사 16명과 어머니가 유아의 자기통제력을 평가한 자료이다. Kendall과 Wilcox[1]가 개발한 자기통제력 평가도구 검사 결과를 활용하여 평가자, 평가문항, 평가대상 유아, 검사도구 그리고 각 요인간의 상호작용에 대한 분산분석을 실시하였으며 각각의 분산추정치에 대한 분석을 수행하였다. 본 연구를 통하여 유아 자기통제력 평가의 경우 유아 각자의 자기통제력 차이가 평가결과에 반영되었음을 알 수 있었다. 또한 평가자 오차변인의 경우, 분산성분이 전혀 나타나지 않은 것으로 보아 부모와 교사의 평가결과가 일치하고 있으며 따라서 부모를 평가자로 활용할 수 있는 가능성이 있는 검사도구라는 것을 알 수 있었다. 그러나 일부 하위 요인 문항의 경우 오차변인의 비율을 줄일 수 있는 방안을 모색해야 할 필요가 있다는 점을 알 수 있었다. 본 연구의 결과는 유아 자기통제력 평가도구가 가지고 있는 문제점에 대한 탐색을 통해 평가도구의 제작 및 활용 시 적용할 수 있는 정보를 마련해줄 수 있다는 점에서 커다란 의의가 있을 것이라고 판단된다.

Keywords

References

  1. P. C. Kendall, L. E. Wilcox, "Self-control in Children: Development of a Rating Scale," Journal of Consulting and Clinical Psychology, vol. 47, no. 6, pp. 1020-1029, 1979. DOI: https://doi.org/10.1037/0022-006X.47.6.1020
  2. R. W. Tyler, Basic Principles of Curriculum and Instruction, University of Chicago Press, 1949.
  3. D. L. Stufflebeam, Educational Evaluation and Decision Making, Peacock, 1971.
  4. S. S. Kim, Y. B. Kim. Generalizability Theory, Kyoyukkwahaksa, 2001.
  5. J. S. Lee. Generalizability Theory, Yonsei University Press, 1988.
  6. R. L. Brennan, Generalizability Theory, Springer Verlag, 2001. DOI: https://doi.org/10.1007/978-1-4757-3456-0
  7. A. Kang, G. Lee, "A Generalizability Theory Approach to Investigating the Generalizability of Performance Assessment Using Student Peer Review," Journal of Educational Evaluation, vol. 19, no. 3, pp. 107-121, 2006.
  8. K. S. Kim, G. Lee, S. H. Kang, "Analysis of Error Sources and Estimation of Reliability in a Korean Speaking Achievement Test by Applying Generalizability, Theory," Journal of Korean Language Education, vol. 21, no. 4, pp. 51-75, 2010. DOI: https://doi.org/10.18209/iakle.2010.21.4.51
  9. S. Kim, "Exploring the Application of Multivariate Generalizability Theory to Teacher Evaluation for Professional Development in Korea Based on the Analysis of Classroom Observations in the U.S.," The Journal of Korean Education, vol. 41, no. 1, pp. 5-29, 2014.
  10. M. Nam, "An Application of the Generalizability Theory to Performance Assessment," Journal of Educational Evaluation, vol. 9, no. 2, pp. 73-93, 1996.
  11. S. Yoo, "Performance Assessment: Issues of Generalizability Theory, Dependability of Scoring, and Relative Information on Student Performance," Journal of Educational Evaluation, vol. 11, no. 2, pp. 23-41, 1998.
  12. Y. S. Lee, S. K. Shin, "An investigation into the dependability of ratings in a German speaking test using the multivariate generalizability theory," Foreign Languages Education, vol. 11, no. 2, pp. 259-265, 2004.
  13. J. Cho, A Study on the Optimal Conditions of Tasks and Raters Facet in Speaking Assessment Using Generalizability Theory. Unpublished Doctoral Dissertation. Korea University, 2008.
  14. Y. Choi, The Effect of Parent Traning about Assessment on the Inter-rater Reliability of Mother/Teacher Judgement. Unpublished Master'S Thesis. Chung-Ang University, 1996.
  15. Y. Choi and K. Kim, "An Analysis of Error Sources and Reliability Estimation in Temperament Assessment of Young Children Using Generalizability Theory," Korean Journal of Child Care and Education Policy, vol. 8, no. 2, pp. 95-109, 2014.
  16. K. Kim and Y. Choi, "An Analysis of Error Sources and Reliability Estimation in Emotional Intelligence Assessment of Young Children Using Generalizability Theory," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol. 6, no. 8, pp. 239-250, 2016. DOI: https://doi.org/10.14257/AJMAHS.2016.08.38
  17. K. Kim and Y. Choi, "An Analysis of Error Sources and Reliability Estimation in Creativity Assessment of Young Children Using Generalizability Theory," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol. 6, no. 8, pp. 287-296, 2016. DOI: https://doi.org/10.14257/AJMAHS.2016.05.40
  18. C. B. Kopp, "Antecedents of Self-regulation: A Developmental Perspective," Developmental Psychology, vol. 18, no. 2, pp. 199-214, 1982. DOI: https://doi.org/10.1037/0012-1649.18.2.199
  19. R. Diaz, C. Neal and M. Williams, The Social Origins of Self-regulation. in Vygotsky and Education: Instructional Implications and Application of Sociohistorical psychology, Edited L. C. Moll, Cambridge University Press, pp. 127-154, 1990. DOI: https://doi.org/10.1017/CBO9781139173674.007
  20. P. C. Kendall, B. A. Zupan and L. Braswell, "Self-control in Children: Further Analyses of the Self-Control Rating Scale," Behavior Therapy, vol. 12, no. 5, pp. 667-681, 1981. DOI: https://doi.org/10.1016/S0005-7894(81)80138-4
  21. A. L. Robin, J. E. Fischel, K, E. Brown, "The Measurement of Self-control in Children: Validation of the Self-Control Rating Scale," Journal of Pediatric Psychology, vol. 9, no. 2, pp. 165-175, 1984. DOI: https://doi.org/10.1093/jpepsy/9.2.165
  22. K. C. Kim and A. R. Oh, "A cross-cultural validation study of SCRS(Self-Control Rating Scale)," The Journal of Korea Open Association for Early Childhood Education, vol. 34, no. 2, pp. 186-206, 2014.