• Quality Improvement in Health Care
• /
• v.24 no.1
• /
• pp.30-39
• /
• 2018

Objectives: In Korea, there are many kinds of evaluations for medical institutions. However, evaluations are increasingly burdensome for medical institutions because evaluation agencies, evaluation timing, and evaluation methods are different. The purpose of this study is to improve the efficiency of evaluation for medical institutions and ultimately to provide quality medical services to patients. Methods: In this study, 2,310 indicators of 19 kinds of evaluation for medical institutions were analyzed. Results: 1,424 indicators were available for on-site surveys and 886 indicators were not available for on-site surveys. There were 4 kinds of evaluation that can be integrated in total, 12 kinds of evaluation that can be integrated partially, and 3 kinds of evaluation that need to maintain the current evaluation system. Conclusion: In order to provide patient-centered quality medical services through reduction of burden due to the evaluation for medical institutions, it is necessary to deeply discuss the efficiency of evaluation integration and result utilization.

• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Journal of Yeungnam Medical Science
• /
• v.40 no.3
• /
• pp.233-240
• /
• 2023

The purpose of this study aims to analyze research trends related to 'evaluation' in Korean medical education through a systematic review. This study used a systematic review method, which is a research methodology for research trends and 'literature analysis.' Researchers searched the Korean journal literature published until the end of December 2020 in the Korean research database with keywords related to medicine and evaluation. Thus, 5,205 cases were identified. Based on these data, 143 papers were selected through a logical screening process, requiring 1 month to complete the data search and analysis process. In terms of publications, medical journals overwhelmingly outnumbered nonmedical journals until 2015; however, after 2016, the number of papers published in nonmedical journals increased, and the number of published papers was similar to that of medical journals. In terms of evaluation-related research, research on student and program evaluations has been very active compared to that on accreditation. As the number of evaluation studies has gradually decreased over the past 10 years, preparing a plan to revitalize them in Korean medical education is necessary. Considering that the role of evaluation in education has been emphasized in recent years, research on reestablishing the concept of evaluation; developing evaluation indicators; analyzing the status of student evaluation, program evaluation, and accreditation; and deriving measures to improve medical education through evaluation is required.

• Korean Medical Education Review
• /
• v.15 no.3
• /
• pp.112-119
• /
• 2013

Most medical colleges in Korea have been shifting from traditional education to outcome-based education, which is the general trend in medical education. The purpose of this study was to make some suggestions in light of the reality and challenges of student assessment in medical education from the perspective of outcome- based education. First, those who are responsible for student assessment should be diversified to include faculty, residents, students, and evaluation committee members. They need separate roles in educational evaluation, so evaluation competencies are required for them. Second, various methods for evaluation and score interpretation can be used for effective evaluation. We can adopt diagnostic, formative, and summative evaluation functionally, and the norm-referenced, criterion-referenced, growth-referenced, and ability-referenced evaluation based on criteria for score interpretation. Finally, various evaluation domains and test forms can be administered together in the common lectures in the medical school. We can test not only knowledge but also skills and attitudes, with diverse test forms such as supply and performance types.

• Korean Medical Education Review
• /
• v.22 no.1
• /
• pp.1-8
• /
• 2020

Following the opening of eleven medical schools in Korea in the 1980s, the issues of standardization and accreditation of medical education came to the forefront in the early 1990s. To address the medical community's concern about the quality of medical education, the Korean Council for University Education and Ministry of Education conducted a compulsory medical school evaluation in 1996 to see whether the medical schools were meeting accreditation standards or not. The evaluation was a "relative evaluation" rather than an "absolute evaluation." The Accreditation Board for Medical Education in Korea (ABMEK), established in 1998, was a mere voluntary organization, but with the full support of the Korean medical community, it successfully completed its first cycle of evaluations on all 41 medical schools from 2000-2004. The history of medical education evaluation activities, including those of ABMEK, was not well recorded. In 2004, ABMEK changed its name to the Korean Institute of Medical Education and Evaluation (KIMEE) as a corporate body and the government paid much attention to its voluntary accreditation activities. In 2014, the Ministry of Education officially recognized the KIMEE as an Institute for Accreditation of Higher Education Evaluation. The most important lesson learned from the history of ABMEK/KIMEE is the importance of cooperation among all medical education-related organizations, including the Korean Medical Association.

• Korea Journal of Hospital Management
• /
• v.23 no.1
• /
• pp.1-15
• /
• 2018

Recently, the importance of emergency medical services has emerged, as rapid advances in urbanization and industrial development. Accordingly, the need for effective emergency medical services is increasing, and the evaluation of an emergengy medical services centers is conducted to meet these policy needs. The purpose of this study was to analyse the relationship between the structure and the process domain of the evaluation of an emergency medical services center based on the Donabedian's model and to verify the validity as an index of quality evaluation through the results. As a result of the analysis, there were some indicators that showed a different direction than expected, but generally there was a significant correlation between the structure and process domains of the evaluation of an emergency medical services center. This suggests that the process can be improved by improving the structure. In conclusion, as structure and process indicators in evaluation of an emergency medical services center show significant relationship, it can be evaluated as validity as a tool to measure the quality of emergency medical services.

• Journal of Biomedical Engineering Research
• /
• v.44 no.6
• /
• pp.428-442
• /
• 2023

In this study, we have a goal to develop usability evaluation guidelines for heuristic-based artificial intelligence-based Software as a Medical Device (SaMD) in the medical field. We conducted a gap analysis between medical hardware (H/W) and non-medical software (S/W) based on ten heuristic principles. Through severity assessments, we identified 69 evaluation domains and 112 evaluation criteria aligned with the ten heuristic principles. Subsequently, we categorized each evaluation domain into five types, including user safety, data integrity, regulatory compliance, patient therapeutic effectiveness, and user convenience. We proposed usability evaluation guidelines that apply the newly derived heuristic-based Software as a Medical Device (SaMD) evaluation factors to the risk management process. In the discussion, we also have proposed the potential applications of the research findings and directions for future research. We have emphasized the importance of the judicious application of AI technology in the medical field and the evaluation of usability evaluation and offered valuable guidelines for various stakeholders, including medical device manufacturers, healthcare professionals, and regulatory authorities.

• The Journal of the Korean dental association
• /
• v.57 no.6
• /
• pp.316-324
• /
• 2019

The new medical technology assessment system has a basic goal of protecting the public's health rights and promoting the development of the new medical technology with safe and effective medical technology that has been scientifically proven. The purpose of this study is to contribute to the activation of the new medical technology evaluation system by analyzing the application cases of the dental field after the implementation of the new medical technology evaluation system and proposing an efficient approach to approach the new medical technology evaluation system. The number of related literature and medical technology evaluation results are not significant in dental applications, the number of cases and the length of follow-up period of the relevant medical technology adopted as the new medical technology was far higher. As the speed of medical technology development increases, medical technology is expected to develop in the dental field as well. To introduce the medical technology to the clinical site, access to the correct direction of evidence is required to collect and objectify data at the medical site in order to prepare a literary basis for the medical technology.

• Journal of Biomedical Engineering Research
• /
• v.41 no.6
• /
• pp.256-263
• /
• 2020

The importance of quality control has been emphasized to maintain safety of patients and satisfaction of medical service with medical devices used in clinic. Accordingly, objective evaluation method and standards consistently has been brought up for demand to replace outdated medical devices in appropriate time and to maintain the quality of medical service. Though many studies made suggestions methods to determine what medical devices to be replaced first, these methods were difficult in practice for its complex evaluation criteria and long time to evaluate. Therefore, in this study, a simple evaluation method is developed to identify and prioritize medical devices that are ought to be replaced. For the development of this simple evaluation method, four major characteristics of technology, safety, finance, and user satisfaction, which are considered in clinics to evaluate medical device replacement, and 14 minor attributes are distinctively selected. Each characteristic is assessed in binary form of "YES" or "NO" to minimize its subjective nature. Using this method to evaluate sampled medical devices belonging to four different characteristics, devices are suggested to be replaced in the current financial year or in the following financial year, or re-evaluated by the end of this financial year. Such results of evaluation can amend the subjective nature of existing evaluation method and give objective standards more promptly.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.126-131
• /
• 2023

The aim of this study was to systematically collect data for evaluating short- and long-term outcomes using Kirkpatrick's four-level evaluation model, Chonnam National Medical School has established plans for developing and managing a database of student and graduate cohorts. The Education Evaluation Committee, with assistance from the Medical Education Office, manages the development and maintenance of cohort data. Data collection began in the 2022 academic year with first- through fourth-year medical students and graduates of the year 2022. The collected data include sociodemographic characteristics, admission information, psychological test results, academic performance data, extracurricular activity data, scholarship records, national medical licensing exam results, and post-graduation career paths. The Education Evaluation Committee and the Medical Education Office analyze the annually updated student and graduate cohort data and report the results to the dean and relevant committees. These results are used for admissions processes, curriculum improvement, and the development of educational programs. Applicants interested in using the student and graduate cohort data to evaluate the curriculum or conduct academic research must undergo review by the Educational Evaluation Committee before being granted access to the data. It is expected that the collected data from student and graduate cohorts will provide a sound and scientific basis for evaluating short- and long-term achievements based on student, school, and other characteristics, thereby supporting medical education policies, innovation, and implementation.