융합정보논문지 (Journal of Convergence for Information Technology)

중소기업융합학회 (Convergence Society for SMB)
권호 표지
DOI QR코드

DOI QR Code

문제중심학습 (Problem-Based Learning) 효과 측정 도구 개발: Rasch 분석을 중심으로

Developing Measurement of Problem-Based Learning Effectiveness: Applying Rasch Analysis

  • 한상우 (광주여자대학교 작업치료학과) ;
  • 최성열 (광주여자대학교 작업치료학과) ;
  • 최인묵 (광주여자대학교 항공서비스학과)
  • Han, Sang-Woo (Department of Occupational Therapy, Kwangju Women's University) ;
  • Choi, Seong-Youl (Department of Occupational Therapy, Kwangju Women's University) ;
  • Choi, In Mook (Department of Airline Service, Kwangju Women's University)
  • 투고 : 2020.02.04
  • 심사 : 2020.03.20
  • 발행 : 2020.03.28
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

최근 사회에서 창의적 문제해결 역량을 갖춘 인재에 대한 요구가 증가하면서 문제중심학습은 교육현장에서 가장 보편적으로 활용되고 있는 새로운 교수법이다. 이러한 교수법 적용에 따른 학습 효과를 수업 현장에서 간편하고 정기적으로 측정할 수 있는 도구를 본 연구를 통해 개발하였다. 기존 문제중심학습 효과 측정 연구에 활용된 문항을 수집하고, 전문가 의견 수렴을 통해 도구 개발을 위한 22개 예비 문항을 구성하였다. 이 문항을 이용하여 문제중심학습을 적용한 교과목을 수강한 학생 124명을 대상으로 데이터를 수집하였다. 이후 Rasch 분석을 통해 타당도와 신뢰도를 검증하였다. 124명의 학생 중 11명이 부적합, 22개 예비 문항 중 1개 문항이 부적합 판정되어 제외하였다. 또한 본 도구 구성을 위한 최적 척도는 4점 척도로 확인되었으며, 대상자와 문항에 대한 분리 신뢰도는 우수한 수준으로 확인되었다. 본 연구를 통해 개발한 문제중심학습의 효과 측정도구가 교육 현장에서 학습효과 측정 및 교육의 질 관리를 위해 적극 활용되길 기대한다.

Problem-Based Learning is the most commonly used teaching method in the field of education as the demand for talented people with creative problem-solving abilities has increased in recent society. In this study, we developed a tool that can simply and regularly measure the learning effects of applying Problem-Based Learning on the classroom. Twenty-two preliminary items for the development were constructed by gathering expert opinions about items collected in existing research of Problem-Based Learning effects measurement. Using this preliminary items, data were collected from 124 students who took the subject-based study. And the validity and reliability were verified through Rash analysis. 11 of 124 students and 1 of 22 items were found to nonconforming and excluded. In addition, the optimal scale for the configuration of this tool was found to be a four-point scale, and the reliability of separation on the subject and the item was found to be excellent. We hope that the assessment tools of Problem-Based Learning effectiveness developed in this study will be actively used to measure learning effectiveness and manage the quality of education.

키워드

참고문헌

  1. S. W. Ree & Y. M. Koh. (2017). The Aims of Education in the Era of AI. Journal for History of Mathematics, 30(6), 341-351. https://doi.org/10.14477/jhm.2017.30.6.341
  2. D. J. Treffinger, S. G. Isaksen & Stead-Dorval, K. B. (2005). Creative problem solving: An introduction. Waco : Prufrock Press Inc..
  3. C. S. Park, S. H. Park & S. Y. Jeong. (2010). Research on applicability of Teaching-Learning Methods for Creative Problem Solving to a course in University. Journal of Engineering Education Research, 13(1), 23-37. https://doi.org/10.18108/jeer.2010.13.1.23
  4. C. H. Kim & S. G. Jeon. (2018). Problem-Based Learning for Enhancing Students Creative Problem-Solving Abilities : Two Cases of Higher Education in. Korean Journal of Resources Development, 21(4), 299-325. https://doi.org/10.24991/kjhrd.2018.12.21.4.299
  5. S. J. Chae. (2005). Study on reliability and validity of student assessment in problem based learning : focused on the case of A medical college. Doctoral dissertation. Sungshin Women's University, Seoul.
  6. H. J. Lee, S. H. Im & S. M. Kang. (2019). Implications for Innovation in Higher Education from Minerva Schools. Journal of Lifelong Learning Society 15(2), 59-84. https://doi.org/10.26857/JLLS.2019.5.15.2.59
  7. S. Glen & K. Wilkie. (2017). Problem-based learning in nursing: A new model for a new context. London : Macmillan International Higher Education.
  8. M. Shon & J. M. Ha. (2008). A Meta-Analysis on the Effects of Problem-Based Learning. The Journal of Educational Information and Media, 14(3), 225-251.
  9. E. H. Yew & K. Goh. (2016). Problem-based learning: An overview of its process and impact on learning. Health Professions Education, 2(2), 75-79. https://doi.org/10.1016/j.hpe.2016.01.004
  10. J. S. Shin. (2004). Study on the Factors Influencing on the Effect of Collaborative Learning in the Problem-based Learning of Medical School. Doctoral dissertation. Hanyang University, Seoul.
  11. S. H. Kim, O. J. Kim, E. H. Park & J. Y. Shin. (2006). Does PBL improve Creativity and Creative Problem Solving Ability?. The Journal of Child Education, 15(3), 285-297.
  12. S. Y. Jung & E. K. Lee. (2006). Educational Needs of Nursing Students about Program Outcomes. Journal of Learner-Centered Curriculum and Instruction, 17(10), 1-25. DOI : 10.22251/jlcci.2017.17.10.1
  13. Y. Y. Hwang, M. S. Chu & C. S. Park. (2007). The Effects of Problem Based Learning(PBL) in Nursing Students Studying through PBL Curriculum. The Journal of Korean Academic Society of Nursing Education, 13(2), 155-161.
  14. J. Y. Park & A. J. Woo. (2017). A meta-analysis on the learning effects in problem based learning(PBL). Journal of Learner-Centered Curriculum and Instruction, 17(11), 69-93. DOI : 10.22251/jlcci.2017.17.11.69
  15. S. E. Lee. (2003). The Development and Implementation of PBL(Problem-Based Learning) Module in Maternity Nursing Based on Clinical Cases. Journal of Korean Academy of Nursing, 9(1), 81-93.
  16. H. S. Kim, I. S. Ko, W. H. Lee, S. Y. Bae & J. O. Shim. (2004). Evaluation of Problem-Based Learning in an Undergraduate Nursing Course. Journal of Korean Academy of Children Health Nursing, 10(4), 395-405.
  17. W. S. Lee, S. H. Park & E. Y. Choi. (2008). Development of a Korean Problem Solving Process Inventory for Adults. Journal of Korean Academy Fundamentals of Nursing, 15(4), 548-557.
  18. C. Y. Lee. et al. (2008). Evaluation research on the application of Problem-Based Learning program in community health nursing. The Journal of Korean Community Nursing, 14(4), 1-8.
  19. J. L. F. Choy, G. O'Grady & J. I. Rotgans. (2012). Is the Study Process Questionnaire (SPQ) a good predictor of academic achievement? Examining the mediating role of achievement-related classroom behaviours. Instructional Science, 40(1), 159-172. https://doi.org/10.1007/s11251-011-9171-8
  20. P. Zeegers. (2002). A revision of the Biggs' study process questionnaire (R-SPQ). Higher Education Research & Development, 21(1), 73-92. https://doi.org/10.1080/07294360220124666
  21. B. R. Belland, B. F. French & P. A. Ertmer. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. Interdisciplinary Journal of Problem-based learning, 3(1), 59-89.
  22. C. H. Lawshe. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. DOI : 10.1111/j.1744-6570.1975.tb01393.x
  23. L. H. Ludlow & S. M. Haley. (1995). Rasch model logits: Interpretation, use, and transformation. Educational and Psychological Measurement, 55(6), 967-975. DOI : 10.1177/0013164495055006005
  24. T. G. Bond & C. M. Fox. (2001). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey: Lawrence Erlbaum associates.
  25. A. Kjellberg, L. Haglund, K. Forsyth & G. Kielhofner. (2003). The measurement properties of the swedish version of the assessment of communication and interaction skills. Scandinavian Journal of Caring Sciences, 17(3), 271-277. DOI : 10.1046/j.1471-6712.2003.00225.x
  26. A. L. Nilsson, K. S. Sunnerhagen & G. Grimby. (2005). Scoring alternatives for FIM in neurological disorders applying Rasch analysis. Acta neurologica Scandinavica, 111(4), 264-273. DOI : 10.1111/j.1600-0404.2005.00404.x
  27. J. M. Linacre. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85-106.
  28. P. W. Duncan, R. K. Bode, S. M. Lai & S. Perera. (2003). Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950-963. DOI : 10.1016/S0003-9993(03)00035-2
  29. R. K. Hambleton. (1991). Fundamentals of item response theory (Vol. 2). Thousand Oaks: Sage publications.
  30. F. M. Lord, M. R. Novick & A. Birnbaum. (1968). Statistical theories of mental test scores. Oxford, England: Addison-Wesley.
  31. V. L. Handa & R. W. Massof. (2004). Measuring the severity of stress urinary incontinence using the Incontinence Impact Questionnaire. Neurourology and Urodynamics, 23(1), 27-32. DOI : 10.1002/nau.10163
  32. B. D. Wright & J. M. Linacre. (1992). Combining and splitting categories. Rasch Measurement Transactions, 6(3), 233-235.
  33. J. S. Lee, C. H. Yi, K. Y. Chang & H. C. Kwon. (2007). The Development of Korean Activities of Daily Living Evaluation Tools for Persons With Stroke Out-patient by Using Rasch Analysis. The Journal of Korean Society of Occupational Therapy, 15(1), 1-11.
  34. J. A. Lee, C. H. Yi, S. Y. Park & S. J. Hwang. (2006). Application of Rasch Analysis to the Korean Berg Balance Scale. Physical Therapy Korea. 13(3), 49-56.
  35. D. G. Hong, J. S. Lee, S. K. Kim & B. J. Jeon. (2013). The Development of Swallowing Function Test of Stroke Victims Using a Rasch Analysis. The Journal of Korean Society of Occupational Therapy, 21(4), 71-89. DOI : 10.14519/jksot.2013.21.4.07
  36. C. MacKnight & K. Rockwood. (2000). Rasch analysis of the hierarchical assessment of balance and mobility (HABAM). Journal of Clinical Epidemiology, 53(12), 1242-1247. DOI : 10.1016/S0895-4356(00)00255-9
  37. J. Funk, C. Fox, M. Chan & K. Curtiss. (2008). The development of the Children's Empathic Attitudes Questionnaire using classical and Rasch analyses. Journal of Applied Developmental Psychology, 29(3), 187-196. DOI : 10.1016/j.appdev.2008.02.005
  38. K. Y. Park. (2014). Applying Rasch Analysis for Validation of School Function Assessment. Journal of The Korea Contents Association, 14(3), 269-276. DOI : 10.5392/JKCA.2014.14.03.269
  39. T. Bond & C. M. Fox. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. London: Routledge.