Browse > Article
http://dx.doi.org/10.22156/CS4SMB.2020.10.03.115

Developing Measurement of Problem-Based Learning Effectiveness: Applying Rasch Analysis  

Han, Sang-Woo (Department of Occupational Therapy, Kwangju Women's University)
Choi, Seong-Youl (Department of Occupational Therapy, Kwangju Women's University)
Choi, In Mook (Department of Airline Service, Kwangju Women's University)
Publication Information
Journal of Convergence for Information Technology / v.10, no.3, 2020 , pp. 115-125 More about this Journal
Abstract
Problem-Based Learning is the most commonly used teaching method in the field of education as the demand for talented people with creative problem-solving abilities has increased in recent society. In this study, we developed a tool that can simply and regularly measure the learning effects of applying Problem-Based Learning on the classroom. Twenty-two preliminary items for the development were constructed by gathering expert opinions about items collected in existing research of Problem-Based Learning effects measurement. Using this preliminary items, data were collected from 124 students who took the subject-based study. And the validity and reliability were verified through Rash analysis. 11 of 124 students and 1 of 22 items were found to nonconforming and excluded. In addition, the optimal scale for the configuration of this tool was found to be a four-point scale, and the reliability of separation on the subject and the item was found to be excellent. We hope that the assessment tools of Problem-Based Learning effectiveness developed in this study will be actively used to measure learning effectiveness and manage the quality of education.
Keywords
Problem-Based Learning; Studying effect; Measurement; Development; Rasch analysis;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 S. W. Ree & Y. M. Koh. (2017). The Aims of Education in the Era of AI. Journal for History of Mathematics, 30(6), 341-351.   DOI
2 D. J. Treffinger, S. G. Isaksen & Stead-Dorval, K. B. (2005). Creative problem solving: An introduction. Waco : Prufrock Press Inc..
3 C. S. Park, S. H. Park & S. Y. Jeong. (2010). Research on applicability of Teaching-Learning Methods for Creative Problem Solving to a course in University. Journal of Engineering Education Research, 13(1), 23-37.   DOI
4 C. H. Kim & S. G. Jeon. (2018). Problem-Based Learning for Enhancing Students Creative Problem-Solving Abilities : Two Cases of Higher Education in. Korean Journal of Resources Development, 21(4), 299-325.   DOI
5 S. J. Chae. (2005). Study on reliability and validity of student assessment in problem based learning : focused on the case of A medical college. Doctoral dissertation. Sungshin Women's University, Seoul.
6 H. J. Lee, S. H. Im & S. M. Kang. (2019). Implications for Innovation in Higher Education from Minerva Schools. Journal of Lifelong Learning Society 15(2), 59-84.   DOI
7 S. Glen & K. Wilkie. (2017). Problem-based learning in nursing: A new model for a new context. London : Macmillan International Higher Education.
8 M. Shon & J. M. Ha. (2008). A Meta-Analysis on the Effects of Problem-Based Learning. The Journal of Educational Information and Media, 14(3), 225-251.
9 E. H. Yew & K. Goh. (2016). Problem-based learning: An overview of its process and impact on learning. Health Professions Education, 2(2), 75-79.   DOI
10 S. H. Kim, O. J. Kim, E. H. Park & J. Y. Shin. (2006). Does PBL improve Creativity and Creative Problem Solving Ability?. The Journal of Child Education, 15(3), 285-297.
11 S. Y. Jung & E. K. Lee. (2006). Educational Needs of Nursing Students about Program Outcomes. Journal of Learner-Centered Curriculum and Instruction, 17(10), 1-25. DOI : 10.22251/jlcci.2017.17.10.1
12 Y. Y. Hwang, M. S. Chu & C. S. Park. (2007). The Effects of Problem Based Learning(PBL) in Nursing Students Studying through PBL Curriculum. The Journal of Korean Academic Society of Nursing Education, 13(2), 155-161.
13 J. Y. Park & A. J. Woo. (2017). A meta-analysis on the learning effects in problem based learning(PBL). Journal of Learner-Centered Curriculum and Instruction, 17(11), 69-93. DOI : 10.22251/jlcci.2017.17.11.69
14 S. E. Lee. (2003). The Development and Implementation of PBL(Problem-Based Learning) Module in Maternity Nursing Based on Clinical Cases. Journal of Korean Academy of Nursing, 9(1), 81-93.
15 H. S. Kim, I. S. Ko, W. H. Lee, S. Y. Bae & J. O. Shim. (2004). Evaluation of Problem-Based Learning in an Undergraduate Nursing Course. Journal of Korean Academy of Children Health Nursing, 10(4), 395-405.
16 W. S. Lee, S. H. Park & E. Y. Choi. (2008). Development of a Korean Problem Solving Process Inventory for Adults. Journal of Korean Academy Fundamentals of Nursing, 15(4), 548-557.
17 C. Y. Lee. et al. (2008). Evaluation research on the application of Problem-Based Learning program in community health nursing. The Journal of Korean Community Nursing, 14(4), 1-8.
18 J. S. Shin. (2004). Study on the Factors Influencing on the Effect of Collaborative Learning in the Problem-based Learning of Medical School. Doctoral dissertation. Hanyang University, Seoul.
19 P. Zeegers. (2002). A revision of the Biggs' study process questionnaire (R-SPQ). Higher Education Research & Development, 21(1), 73-92.   DOI
20 J. L. F. Choy, G. O'Grady & J. I. Rotgans. (2012). Is the Study Process Questionnaire (SPQ) a good predictor of academic achievement? Examining the mediating role of achievement-related classroom behaviours. Instructional Science, 40(1), 159-172.   DOI
21 B. R. Belland, B. F. French & P. A. Ertmer. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. Interdisciplinary Journal of Problem-based learning, 3(1), 59-89.
22 C. H. Lawshe. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. DOI : 10.1111/j.1744-6570.1975.tb01393.x   DOI
23 L. H. Ludlow & S. M. Haley. (1995). Rasch model logits: Interpretation, use, and transformation. Educational and Psychological Measurement, 55(6), 967-975. DOI : 10.1177/0013164495055006005   DOI
24 T. G. Bond & C. M. Fox. (2001). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey: Lawrence Erlbaum associates.
25 F. M. Lord, M. R. Novick & A. Birnbaum. (1968). Statistical theories of mental test scores. Oxford, England: Addison-Wesley.
26 A. Kjellberg, L. Haglund, K. Forsyth & G. Kielhofner. (2003). The measurement properties of the swedish version of the assessment of communication and interaction skills. Scandinavian Journal of Caring Sciences, 17(3), 271-277. DOI : 10.1046/j.1471-6712.2003.00225.x   DOI
27 A. L. Nilsson, K. S. Sunnerhagen & G. Grimby. (2005). Scoring alternatives for FIM in neurological disorders applying Rasch analysis. Acta neurologica Scandinavica, 111(4), 264-273. DOI : 10.1111/j.1600-0404.2005.00404.x   DOI
28 J. M. Linacre. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85-106.
29 P. W. Duncan, R. K. Bode, S. M. Lai & S. Perera. (2003). Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950-963. DOI : 10.1016/S0003-9993(03)00035-2   DOI
30 R. K. Hambleton. (1991). Fundamentals of item response theory (Vol. 2). Thousand Oaks: Sage publications.
31 V. L. Handa & R. W. Massof. (2004). Measuring the severity of stress urinary incontinence using the Incontinence Impact Questionnaire. Neurourology and Urodynamics, 23(1), 27-32. DOI : 10.1002/nau.10163   DOI
32 B. D. Wright & J. M. Linacre. (1992). Combining and splitting categories. Rasch Measurement Transactions, 6(3), 233-235.
33 C. MacKnight & K. Rockwood. (2000). Rasch analysis of the hierarchical assessment of balance and mobility (HABAM). Journal of Clinical Epidemiology, 53(12), 1242-1247. DOI : 10.1016/S0895-4356(00)00255-9   DOI
34 J. S. Lee, C. H. Yi, K. Y. Chang & H. C. Kwon. (2007). The Development of Korean Activities of Daily Living Evaluation Tools for Persons With Stroke Out-patient by Using Rasch Analysis. The Journal of Korean Society of Occupational Therapy, 15(1), 1-11.
35 J. A. Lee, C. H. Yi, S. Y. Park & S. J. Hwang. (2006). Application of Rasch Analysis to the Korean Berg Balance Scale. Physical Therapy Korea. 13(3), 49-56.
36 D. G. Hong, J. S. Lee, S. K. Kim & B. J. Jeon. (2013). The Development of Swallowing Function Test of Stroke Victims Using a Rasch Analysis. The Journal of Korean Society of Occupational Therapy, 21(4), 71-89. DOI : 10.14519/jksot.2013.21.4.07   DOI
37 T. Bond & C. M. Fox. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. London: Routledge.
38 J. Funk, C. Fox, M. Chan & K. Curtiss. (2008). The development of the Children's Empathic Attitudes Questionnaire using classical and Rasch analyses. Journal of Applied Developmental Psychology, 29(3), 187-196. DOI : 10.1016/j.appdev.2008.02.005   DOI
39 K. Y. Park. (2014). Applying Rasch Analysis for Validation of School Function Assessment. Journal of The Korea Contents Association, 14(3), 269-276. DOI : 10.5392/JKCA.2014.14.03.269   DOI