Browse > Article
http://dx.doi.org/10.17496/kmer.2021.23.1.56

Adapting an Integrated Program Evaluation for Promoting Competency-Based Medical Education  

Ju, Hyunjung (Educational Evaluation Committee, Inje University College of Medicine)
Oh, Minkyung (Educational Evaluation Committee, Inje University College of Medicine)
Lee, Jong-Tae (Department of Preventive Medicine, Inje University College of Medicine)
Yoon, Bo Young (Educational Evaluation Committee, Inje University College of Medicine)
Publication Information
Korean Medical Education Review / v.23, no.1, 2021 , pp. 56-67 More about this Journal
Abstract
Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.
Keywords
Competency-based education; Integrated evaluation model; Program evaluation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638-45.   DOI
2 Frye AW, Hemmer PA. Program evaluation models and related theories: AMEE guide no. 67. Med Teach. 2012;34(5):e288-99.   DOI
3 Sung TJ. The basis of educational evaluation. 3rd ed. Seoul: Hakjisa; 2019.
4 Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. 3rd ed. San Francisco (CA): Berrett-Koehler Publishers; 2006.
5 Stufflebeam DL. The CIPP model for evaluation. In: Kellaghan T, Stufflebeam DL, editors. International handbook of educational evaluation. Norwell (MA): Kluwer Academic publishers; 2003. p. 31-61.
6 Stufflebeam DL, Zhang G. The CIPP evaluation model: how to evaluate for improvement and accountability. New York (NY): The Guilford Press; 2017.
7 Lee SY, Shin JS, Lee SH. How to execute Context, Input, Process, and Product evaluation model in medical health education. J Educ Eval Health Prof. 2019;16:40.   DOI
8 Dubrowski A, Morin MP. Evaluating pain education programs: an integrated approach. Pain Res Manag. 2011;16(6):407-10.   DOI
9 Korean Institute of Medical Education and Evaluation. Accreditation Standards of Korean Institute of Medical Education and Evaluation 2019 [Internet]. Seoul: Korean Institute of Medical Education and Evaluation; 2020 [cited 2020 Feb 21]. Available from: https://kimee.or.kr/board/data/?uid=1318&mod=document&pageid=1.
10 Lee JT, Kim DJ, Kim YS, Kim TJ, Rho HR, Yoon BY, et al. Curriculum brochure of Inje University College of Medicine. Busan: Inje Univerisity College of Medicine; 2019.
11 Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick's four levels of training evaluation. Alexandra (VA): ATD Press; 2016.
12 Harden RM, Laidlaw JM. Evaluating the curriculum. In: Harden RM, Laidlaw JM, editors. Essential skills for a medical teacher: an introduction to teaching and learning in medicine. 2nd ed. Edinburgh: Elsevier; 2017. p. 259-66.
13 Educational Evaluation Committee. Educational evaluation report. Busan: Inje University College of Medicine; 2019.
14 Branch RM. Instructional design: the ADDIE approach. New York (NY): Springer; 2009.
15 Gagne RM, Wager WW, Golas KC, Keller JM. Principles of instructional design. 5th ed. Belmont (CA): Wadsworth, Cengage Learning; 2005.