• 의학교육논단
• /
• 제22권2호
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• 의학교육논단
• /
• 제23권1호
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• 공학교육연구
• /
• 제16권6호
• /
• pp.52-57
• /
• 2013

In this paper, the evaluation system in order to achieve the program education objectives of Accreditaion Board for engineering education of Korea, analyze the educational objectives evaluation tool case studies of programs that are run by each university, the program educational objectives to match the actual situation of university I have developed a distinction between questions the evaluation and assessment system. Configuration, execution, measurement, analysis, is a five-step mooring, the evaluation tool, is a graduate research you are currently using the most in Korea, the employer survey, education target assessment model of the program, employment trends of graduates, I decided to graduate focus group interviews. Distinction between questions, the evaluation also developed a questionnaire to derive the important keywords of education for each objectives. Improvement evaluation tool, the evaluation criteria is required, the University is preparing evaluate (NGR) in South Korea engineering education certification next regularly, requires research on semantic analysis of the results of measurement of the educational goals of the program in the future some.

• 공학교육연구
• /
• 제16권3호
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• 의학교육논단
• /
• 제22권1호
• /
• pp.1-8
• /
• 2020

Following the opening of eleven medical schools in Korea in the 1980s, the issues of standardization and accreditation of medical education came to the forefront in the early 1990s. To address the medical community's concern about the quality of medical education, the Korean Council for University Education and Ministry of Education conducted a compulsory medical school evaluation in 1996 to see whether the medical schools were meeting accreditation standards or not. The evaluation was a "relative evaluation" rather than an "absolute evaluation." The Accreditation Board for Medical Education in Korea (ABMEK), established in 1998, was a mere voluntary organization, but with the full support of the Korean medical community, it successfully completed its first cycle of evaluations on all 41 medical schools from 2000-2004. The history of medical education evaluation activities, including those of ABMEK, was not well recorded. In 2004, ABMEK changed its name to the Korean Institute of Medical Education and Evaluation (KIMEE) as a corporate body and the government paid much attention to its voluntary accreditation activities. In 2014, the Ministry of Education officially recognized the KIMEE as an Institute for Accreditation of Higher Education Evaluation. The most important lesson learned from the history of ABMEK/KIMEE is the importance of cooperation among all medical education-related organizations, including the Korean Medical Association.

• 수산해양교육연구
• /
• 제26권5호
• /
• pp.1108-1118
• /
• 2014

The purpose of this study was to spread the education of human creativity program and its possibility of consistency, and its application to school system by exploring the evaluation system that determines the valuable and useful decisions. This study was based on the evaluation system according to CIPP model regarding the program's general ideas and its role. The interest of the education of human creativity was increasing as well as its progress of program, and we searched 13 figures and 55 evaluation index according to increase the program's effectiveness and nation-wise situation of evaluation model. The conclusion of this study was that the human creativity program's evaluation was composed of six compartments. And the context evaluation was composed of three evaluation models and eleven index, and input evaluation was composed of three evaluation model and 15 index, while process evaluation is composed of three evaluation models and thirteen evaluation index. Lastly, output evaluation had four evaluation model and sixteen index.

• 공학교육연구
• /
• 제20권5호
• /
• pp.74-86
• /
• 2017

The purpose of this study is to analyze the perceptions of college officials about the evaluation of university education on the perspective of industry, to make policy proposals for improvement by analyzing the preparing process of the departments that have received the evaluation of the best universities, In order to achieve the purpose of the study, we conducted literature review, survey studies, and in-depth interviews. The survey was conducted by professors related to this system, and finally the results of 51 responses were used for analysis. The contents of the survey were composed of the recognition, appropriateness, the utilization of the results, the proliferation and improvement plan of the evaluation of university education on the perspective of industry. In-depth interviews conducted 1:1 interviews with 5 professors. The evaluation of university education on the perspective of industry is generally perceived to be a bridge between industry and university education, but there is room for improvement in evaluation criteria, operating methods, and promotion strategies to public.

• 한국수학교육학회지시리즈D:수학교육연구
• /
• 제20권1호
• /
• pp.1-9
• /
• 2016

An accurate evaluation of educational process is a promise for the progress of education, because evaluation provides a meticulous idea of what has actually been achieved as a result of education. However, for all its significance in the educational fields, there are not many discussions about evaluation in South Korea. We believe that in order to overcome this discrepancy, diverse evaluation theories along with a discussion about the merits or demerits or each theory should be introduced in South Korea. We propose that Eisner's educational evaluation model may suggest alternative ways of perceiving evaluation. Eisner's educational evaluation model, named educational connoisseurship and criticism, emerged as an approach to educational evaluation from the methods used in art and literary criticism.

• Journal of Yeungnam Medical Science
• /
• 제40권3호
• /
• pp.233-240
• /
• 2023

The purpose of this study aims to analyze research trends related to 'evaluation' in Korean medical education through a systematic review. This study used a systematic review method, which is a research methodology for research trends and 'literature analysis.' Researchers searched the Korean journal literature published until the end of December 2020 in the Korean research database with keywords related to medicine and evaluation. Thus, 5,205 cases were identified. Based on these data, 143 papers were selected through a logical screening process, requiring 1 month to complete the data search and analysis process. In terms of publications, medical journals overwhelmingly outnumbered nonmedical journals until 2015; however, after 2016, the number of papers published in nonmedical journals increased, and the number of published papers was similar to that of medical journals. In terms of evaluation-related research, research on student and program evaluations has been very active compared to that on accreditation. As the number of evaluation studies has gradually decreased over the past 10 years, preparing a plan to revitalize them in Korean medical education is necessary. Considering that the role of evaluation in education has been emphasized in recent years, research on reestablishing the concept of evaluation; developing evaluation indicators; analyzing the status of student evaluation, program evaluation, and accreditation; and deriving measures to improve medical education through evaluation is required.

• 한국융합학회논문지
• /
• 제10권5호
• /
• pp.221-228
• /
• 2019

대학의 교양교육은 전공교육에 비해 본래의 교육적 의의를 살리지 못하고 있다는 문제에 직면해 있다. 이 문제를 해결하기 위한 가장 시급한 단계는 바로 현재 각 대학이 편성 운영 중인 교양교육에 대한 정확한 진단에서 출발한다고 볼 수 있다. 이에 본 연구는 대학의 교양교육을 평가할 수 있는 교양교육과정 평가도구의 개발에 목적을 두고 있다. 본 연구는 기존 선행연구들이 이론적으로 교양교육과정 평가도구를 단편적으로 나열한 것에서 벗어나, 평가항목 간 상대적 중요도를 AHP 분석기법을 통해 확인함으로써 평가도구의 배점을 결정하였다. AHP 분석 결과 교양교육과정의 편성, 운영, 평가 중 편성의 영역이 가장 중요하다고 나타났으며, 후순위로는 운영과 평가 영역으로 나타났다. 전체 22개 평가 지표 중 가장 높은 가중치로 결정된 지표는 "교과목 편성의 적절성"으로 나타났으며, 2순위로 "교양교육과정 목표의 적절성"이 선정되었다.