Browse > Article
http://dx.doi.org/10.17496/kmer.2022.24.3.250

Establishment of Cohorts to Evaluate the Performance of Students and Graduates at a Medical School  

Oh, Minkyung (Cohort Subcommittee, Inje University College of Medicine)
Ju, Hyunjung (Educational Evaluation Committee, Inje University College of Medicine)
Yoon, Bo Young (Educational Evaluation Committee, Inje University College of Medicine)
Lee, Jong-Tae (Department of Preventive Medicine, Inje University College of Medicine)
Publication Information
Korean Medical Education Review / v.24, no.3, 2022 , pp. 250-260 More about this Journal
Abstract
Evaluating the effectiveness of educational programs involves measuring learning processes as well as outcomes. It is essential to study cohorts of students and graduates to evaluate the long-term effects of educational programs with data generated both during education and after graduation. The purpose of this study was to establish cohorts of students and graduates to evaluate their performance, thereby providing a basis for evaluating the social accountability of medical education. In this study, student and graduate cohorts were built for both students currently enrolled and graduates at Inje University College of Medicine (IUCM). A model involving the process of cohort establishment and an evaluation indicator framework was developed. In the process of cohort establishment, the following steps were conducted: defining the goals and objectives of the student and graduate cohorts, organizing a cohort committee, developing regulations, registering cohorts, acquiring consent, and building a database. A framework of evaluation indicators according to the graduate roles of IUCM was developed by adapting Kirkpatrick's evaluation model. Next, items to be collected in student and graduate cohorts were selected, and the current status of existing data was analyzed. Moreover, a preliminary analysis was conducted, including analyses of the evaluation indicators and graduates' performance. This study suggests that it is necessary to include additional evaluation indicators considering students' learning environment and well-being in student cohorts and to develop strategies or methods for graduates to continue participating in data collection for a long-term study.
Keywords
Cohort establishment; Medical education; Program effectiveness; Program evaluation; Students and graduates;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ragsdale JW, Berry A, Gibson JW, Herber-Valdez CR, Germain LJ, Engle DL, et al. Evaluating the effectiveness of undergraduate clinical education programs. Med Educ Online. 2020;25(1):1757883.   DOI
2 Paull M, Whitsed C, Girardi A. Applying the Kirkpatrick model: evaluating an 'interaction for learning framework' curriculum intervention. Issues Educ Res. 2016;26(3):490-507.
3 World Federation for Medical Education. Basic Medical Education WFME Global Standards for Quality Improvement: the 2015 revision [Internet]. Ferney-Voltaire: World Federation for Medical Education; 2015 [cited 2022 Mar 20]. Available from: https://wfme.org/download/wfme-global-standards-for-quality-improvement-bme/?wpdmdl=831&refresh=6179f6186bb081635382808%22%3EDownload%3C/a%3E%%%%%%%%%%%%%3C/div%3E%%%%%%%%%3C/div%3E%%%%%3C/div%3E%3C/div%3E%3C/div%3E.
4 Hennekens CH, Buring JE, Mayrent SL. Epidemiology in medicine. Philadelphia (PA): Lippincott Williams & Wilkins; 1987. 383 p.
5 Stufflebeam DL, Zhang G. The CIPP evaluation model: how to evaluate for improvement and accountability. New York (NY): The Guilford Press; 2017. 384 p.
6 Kellaghan T, Stufflebeam DL, Wingate LA. International handbook of educational evaluation. Dordrecht: Kluwer Academic Publishers; 2003.
7 Enforcement Rule of Bioethics and Safety Act, Ministry of Health and Welfare Ordinance No. 143 (Dec 31, 2009) [Internet]. Sejong: Ministry of Government Legislation; 2020 [cited 2021 Dec 30]. Available from: https://www.law.go.kr/LSW/lsInfoP.do?lsiSeq=98198&viewCls=engLsInfoR&urlMode=engLsInfoR#0000.
8 Peters AS, Greenberger-Rosovsky R, Crowder C, Block SD, Moore GT. Long-term outcomes of the New Pathway Program at Harvard Medical School: a randomized controlled trial. Acad Med. 2000;75(5):470-9.   DOI
9 Paffenbarger RS Jr, Wing AL, Hyde RT. Physical activity as an index of heart attack risk in college alumni. Am J Epidemiol. 1978;108(3):161-75.   DOI
10 Santen SA, Feldman M, Weir S, Blondino C, Rawls M, DiGiovanni S. Developing comprehensive strategies to evaluate medical school curricula. Med Sci Educ. 2018;29(1):291-8.
11 Ju H, Oh M, Lee JT, Yoon BY. Adapting an integrated program evaluation for promoting competency-based medical education. Korean Med Educ Rev. 2021;23(1):56-67.   DOI
12 Goldacre M. The role of cohort studies in medical research. Pharmacoepidemiol Drug Saf. 2001;10(1):5-11.   DOI
13 Kim HS. Theory and practice of educational program. Seoul: Kyoyookbook; 2014. 300 p.
14 Harden RM, Laidlaw JM. Essential skills for a medical teacher: an introduction to teaching and learning in medicine. 3rd ed. Edinburgh: Elsevier Health Sciences; 2020. 315 p.
15 Bae HS. Principles of program evaluation. Seoul: Wonmisa; 1994. 458 p.
16 Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs: the four levels. 3rd ed. San Francisco (CA): Berrett-Koehler Publishers; 2006. 568 p.
17 Korean Institute of Medical Education and Evaluation. Accreditation Standards of Korean Institute of Medical Education and Evaluation 2019 [Internet]. Seoul: Korean Institute of Medical Education and Evaluation; 2020 [cited 2020 Dec 30]. Available from: https://kimee.or.kr/board/data/?uid=1318&mod=document&pageid=1.
18 Kelsey JL, Whittemore AS, Evans AS, Thompson WD. Methods in observational epidemiology. 2nd ed. New York (NY): Oxford University Press; 1996. 432 p.
19 Carr SE, Celenza T, Lake FR. Descriptive analysis of junior doctor assessment in the first postgraduate year. Med Teach. 2014;36(11):983-90.   DOI