• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Journal of Engineering Education Research
• /
• v.16 no.6
• /
• pp.52-57
• /
• 2013

In this paper, the evaluation system in order to achieve the program education objectives of Accreditaion Board for engineering education of Korea, analyze the educational objectives evaluation tool case studies of programs that are run by each university, the program educational objectives to match the actual situation of university I have developed a distinction between questions the evaluation and assessment system. Configuration, execution, measurement, analysis, is a five-step mooring, the evaluation tool, is a graduate research you are currently using the most in Korea, the employer survey, education target assessment model of the program, employment trends of graduates, I decided to graduate focus group interviews. Distinction between questions, the evaluation also developed a questionnaire to derive the important keywords of education for each objectives. Improvement evaluation tool, the evaluation criteria is required, the University is preparing evaluate (NGR) in South Korea engineering education certification next regularly, requires research on semantic analysis of the results of measurement of the educational goals of the program in the future some.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• Korean Medical Education Review
• /
• v.22 no.1
• /
• pp.1-8
• /
• 2020

Following the opening of eleven medical schools in Korea in the 1980s, the issues of standardization and accreditation of medical education came to the forefront in the early 1990s. To address the medical community's concern about the quality of medical education, the Korean Council for University Education and Ministry of Education conducted a compulsory medical school evaluation in 1996 to see whether the medical schools were meeting accreditation standards or not. The evaluation was a "relative evaluation" rather than an "absolute evaluation." The Accreditation Board for Medical Education in Korea (ABMEK), established in 1998, was a mere voluntary organization, but with the full support of the Korean medical community, it successfully completed its first cycle of evaluations on all 41 medical schools from 2000-2004. The history of medical education evaluation activities, including those of ABMEK, was not well recorded. In 2004, ABMEK changed its name to the Korean Institute of Medical Education and Evaluation (KIMEE) as a corporate body and the government paid much attention to its voluntary accreditation activities. In 2014, the Ministry of Education officially recognized the KIMEE as an Institute for Accreditation of Higher Education Evaluation. The most important lesson learned from the history of ABMEK/KIMEE is the importance of cooperation among all medical education-related organizations, including the Korean Medical Association.

• Journal of Fisheries and Marine Sciences Education
• /
• v.26 no.5
• /
• pp.1108-1118
• /
• 2014

The purpose of this study was to spread the education of human creativity program and its possibility of consistency, and its application to school system by exploring the evaluation system that determines the valuable and useful decisions. This study was based on the evaluation system according to CIPP model regarding the program's general ideas and its role. The interest of the education of human creativity was increasing as well as its progress of program, and we searched 13 figures and 55 evaluation index according to increase the program's effectiveness and nation-wise situation of evaluation model. The conclusion of this study was that the human creativity program's evaluation was composed of six compartments. And the context evaluation was composed of three evaluation models and eleven index, and input evaluation was composed of three evaluation model and 15 index, while process evaluation is composed of three evaluation models and thirteen evaluation index. Lastly, output evaluation had four evaluation model and sixteen index.

• Journal of Engineering Education Research
• /
• v.20 no.5
• /
• pp.74-86
• /
• 2017

The purpose of this study is to analyze the perceptions of college officials about the evaluation of university education on the perspective of industry, to make policy proposals for improvement by analyzing the preparing process of the departments that have received the evaluation of the best universities, In order to achieve the purpose of the study, we conducted literature review, survey studies, and in-depth interviews. The survey was conducted by professors related to this system, and finally the results of 51 responses were used for analysis. The contents of the survey were composed of the recognition, appropriateness, the utilization of the results, the proliferation and improvement plan of the evaluation of university education on the perspective of industry. In-depth interviews conducted 1:1 interviews with 5 professors. The evaluation of university education on the perspective of industry is generally perceived to be a bridge between industry and university education, but there is room for improvement in evaluation criteria, operating methods, and promotion strategies to public.

• Research in Mathematical Education
• /
• v.20 no.1
• /
• pp.1-9
• /
• 2016

An accurate evaluation of educational process is a promise for the progress of education, because evaluation provides a meticulous idea of what has actually been achieved as a result of education. However, for all its significance in the educational fields, there are not many discussions about evaluation in South Korea. We believe that in order to overcome this discrepancy, diverse evaluation theories along with a discussion about the merits or demerits or each theory should be introduced in South Korea. We propose that Eisner's educational evaluation model may suggest alternative ways of perceiving evaluation. Eisner's educational evaluation model, named educational connoisseurship and criticism, emerged as an approach to educational evaluation from the methods used in art and literary criticism.

• Journal of Yeungnam Medical Science
• /
• v.40 no.3
• /
• pp.233-240
• /
• 2023

The purpose of this study aims to analyze research trends related to 'evaluation' in Korean medical education through a systematic review. This study used a systematic review method, which is a research methodology for research trends and 'literature analysis.' Researchers searched the Korean journal literature published until the end of December 2020 in the Korean research database with keywords related to medicine and evaluation. Thus, 5,205 cases were identified. Based on these data, 143 papers were selected through a logical screening process, requiring 1 month to complete the data search and analysis process. In terms of publications, medical journals overwhelmingly outnumbered nonmedical journals until 2015; however, after 2016, the number of papers published in nonmedical journals increased, and the number of published papers was similar to that of medical journals. In terms of evaluation-related research, research on student and program evaluations has been very active compared to that on accreditation. As the number of evaluation studies has gradually decreased over the past 10 years, preparing a plan to revitalize them in Korean medical education is necessary. Considering that the role of evaluation in education has been emphasized in recent years, research on reestablishing the concept of evaluation; developing evaluation indicators; analyzing the status of student evaluation, program evaluation, and accreditation; and deriving measures to improve medical education through evaluation is required.

• Journal of the Korea Convergence Society
• /
• v.10 no.5
• /
• pp.221-228
• /
• 2019

General education of university is facing the problem of failing to perform its original educational function compared to major education. The most urgent step in solving this problem lies in the evaluation of general education, which is currently designed and implemented by each university. Therefore, this study is aimed at developing the evaluation tool for university general education. This study determined the allotting of evaluation tools by verifying the relative importance among the evaluation index through the AHP analysis method, away form the simple list of the evaluation index, which is the limit of the precedent researches. The results of AHP showed that the organization of general education was the most important, while the latter was the implementation and evaluation of general education. The index determined to be the highest weighting of the total 22 indexes was "appropriateness of course organization" with "appropriateness of general education's purpose" being ranked second.