• Journal of Multimedia Information System
• /
• v.4 no.3
• /
• pp.115-122
• /
• 2017

Over the years, there has been much research in blended learning. However, research regarding its use and evaluation is inconsistent, not following any specific evaluation method, and may not be applicable to local students. In this research, a case study was conducted to evaluate the environment based on three levels of Kirkpatrick's model. Methodological triangulation was the principle of data collection used in which multiple sources of evidence were triangulated to provide insights into this study. Instruments used include surveys, interviews, questionnaires and pre- and post-tests that are guided by Kirkpatrick's model. The results revealed that students were positive with the learning environment. Students enjoyed learning with multimedia and motivated to learn as well as engaged in the environment. The tests showed significant difference in their learning. Students also perceived that they have transferred their learning from face-to-face lecture into problem-based learning and learning outcome. This research contributes to the field by providing deeper insights into assessments in multimedia-based blended learning environment and empirical evidence on views, attitudes, learning and knowledge transfer of students in higher education.

• The Journal of the Korean dental association
• /
• v.54 no.1
• /
• pp.27-38
• /
• 2016

Objectives: This study evaluated the outcomes of continuing professional education in implant dentistry using Kirkpatrick's four-level evaluation model. Material and methods: The study was carried out through a questionnaire distributed to dentists who attended a continuing professional education in implant dentistry, 2008~2012. They were asked to fill out questionnaires at least 6 months after its completion. Results: Mean ages of total 23 dentist was $44.8^{\circ}{\ae}8.2$. Mean period after completion of education was $2.7^{\circ}{\ae}1.2$. Knowledge (level 2) (r=0.71, p<0.01) and behavior (level 3) (r=0.68, p<0.01) was positively correlated with topic and methods of education in reaction (level 1). Behavior was positively correlated with knowledge (r=0.79, p<0.01). Result (level 4) was positively correlated with knowledge (r=0.64, p<0.01) and behavior (r=0.86, p<0.01). Conclusion: Reaction affects on knowledge, behavior and result in order.

• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• The Journal of Korean Institute for Practical Engineering Education
• /
• v.4 no.2
• /
• pp.98-103
• /
• 2012

Koreatech has recently adopted a long-term co-op program called IPP (Industry Professional Practice) to address problems in engineering education of Korea, but it is anticipated to face many difficulties in implementing the program due to lack of relevant experiences in Korea. In this regard, a performance evaluation scheme is required to improve the operational efficiency and judge the effectiveness of the IPP program at the same time. This study aims to develop a comprehensive performance evaluation model for the Koreatech co-op program on the basis of Kirkpatrick's four stage performance evaluation model for training programs. For this purpose, thorough review on the program evaluation literature and in-depth analyses of overseas cases of co-op performance evaluation were also conducted. The study is expected to help enhance the effectiveness of the IPP program and promote buy-in of a range of stakeholders for the first long-term co-op program in Korea.

• Journal of the Korean Society for information Management
• /
• v.34 no.4
• /
• pp.173-199
• /
• 2017

Evaluation of education and training is the act of measuring and observing contents related to an educational program and evaluating its quality; and thereby providing the basis for the changes in the curriculum. The National Library of Korea (NLK) has urgently needed to introduce an evaluation method that can enhance the performance and quality of its continuing education program. Therefore, this study is aimed at developing an evaluation model that can objectively and comprehensively measure the effectiveness of NLK's job training program for its librarians. To this end, the study applied Kirkpatrick's 4-Level Training Evaluation Model and conducted review of preceding researches, investigation of NLK's librarian continuing education program, along with analysis on the stakeholders' needs. Based on the results, the study suggested evaluation system to establish the directions of the evaluation system. The findings of this study are expected to be used as a practical evaluation system for NLK's librarian education program.

• Journal of Practical Engineering Education
• /
• v.6 no.1
• /
• pp.57-64
• /
• 2014

KOREATECH has introduced a long-term co-op program called IPP (Industry Professional Practice) to address problems in engineering education of Korea since 2012. In order to evaluate and improve the IPP program, the IPP Center of KOREATECH has developed a comprehensive performance evaluation scheme on the basis of the Kirkpatrick's four stage performance evaluation model for training programs. This study aimed to analyze student questionnaire survey data from the IPP performance evaluation scheme, which was acquired before and after IPP terms in 2013 and measured students' perceptions on the five aspects of major competencies, non-major competencies, perception of and satisfaction with the IPP program and attitudes to occupation. The findings showed that the IPP program was effective to a certain degree at enhancing non-major competencies and attitudes to occupation of students. Participating students were quite satisfied with their jobs and companies. In the last part, several directions for improving the effectiveness of the IPP program were discussed.

• Health Policy and Management
• /
• v.26 no.4
• /
• pp.373-381
• /
• 2016

Background: The purpose of this study is to evaluate the outcomes of clinical education program for nurses in regional public hospital, utilizing the Kirkpatrick's model. Methods: Kirkpatrik's 4-level model was applied to this study. Trainees were asked to fill out questionnaires in the middle and at the end of the program. Also administrators of excellent trainees were asked to fill out the questionnaires regarding nursing management performance after 1-2 months from the end of the training course. Results: All trainees had positive reactions to the clinical education program. Not only the results of individual level (satisfaction and achievement scores, academic achievement scores, practical application rate, and educational transition factors) but also the scores of organization level (nursing management performance scores) are improved. Conclusion: By showing a correlation between the effectiveness factors we need to verify the relationship between these factors in a future study. In addition, development of quantitative and qualitative performance indicators are needed. To establish a long-term education system, it is required to applying the excellent trainee's successful experiences.

• Quality Improvement in Health Care
• /
• v.30 no.1
• /
• pp.132-152
• /
• 2024

Purpose: This study aimed to identify and evaluate interprofessional education (IPE) interventions for healthcare professional students in East Asian countries. Methods: The reporting of this study followed the Preferred Reporting Items of Systematic Reviews and Meta-Analysis guidelines. A literature search was conducted using seven electronic databases: PubMed, EMBASE, CINAHL, Scopus, Web of Science, ERIC, and ProQuest Dissertations & Theses Global. Joanna Briggs Institute Critical Appraisal Checklists were also used to appraise the quality of the included studies. The outcomes of IPE interventions were classified based on a modified Kirkpatrick model. Results: This review included 30 studies predominantly conducted in Singapore, South Korea, and Taiwan. The prevalent research design was a one-group pre-posttest design, and most IPE interventions occurred as single events. Approximately 70% of the studies involved students from two healthcare professions, mainly nursing and medicine. Simulations, group discussions, and lectures have emerged as the most common teaching methodologies, with almost half of the studies leveraging a combination of these techniques. The IPE content primarily focused on interprofessional teamwork, communication, and clinical patient care situations; these included the management of septic shock. The effectiveness of the IPE interventions was mainly evaluated through self-reported measures, indicating improvements in attitudes, perceptions, knowledge, and skills, aligning with Level 2 of the modified Kirkpatrick model. Nonetheless, the reviewed studies did not assess changes in the participants' behavior and patient results. Conclusion: IPE interventions promise to enhance interprofessional collaboration and communication skills among health professional students. Future studies should implement rigorous designs to assess the effectiveness of IPE interventions. Moreover, when designing IPE interventions, researchers and educators should consider the role of cultural characteristics in East Asian countries.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.10
• /
• pp.185-192
• /
• 2012

Call Center requires an ability of agents a lot more than face-to-face contact due to being achieved communication by non face-to face channel for contact with customers. In order to improve the ability of agents, Call Center carries out various educational training according to their work experience and function and with the accomplishment of educational training, Call Center is going to fulfill to develop its quality of counseling and productivity. On the other hand, due to investment of a lot of time and budget to educational training, it is needed to grasp and manage about its effectiveness that how helpful the training is for performance of work-site operations through evaluation of educational training. Having Seen researches about evaluation of educational training until these days, most researches have mainstream to measure satisfaction and a level of learning or degree that how the learning transfers to actions. It is found that a research about an entire evaluation model should be required. This study aims to investigate effectiveness of Call Center educational training from the level of recognition by reflecting Kirkpatrick's the four levels of learning evaluation. By the four levels, reaction, learning, behavior and results, the study found out a connection with standards of evaluation about each levels. In addition, by using structural equation modeling, it was examined goodness of fit about the entire model. Furthermore, by an alternative model, considering a direct relation between a factor of reaction and behavior, it was compared and examined goodness of fit of overall model of the study model and the alternative one.

• Journal of Gifted/Talented Education
• /
• v.23 no.2
• /
• pp.133-160
• /
• 2013

The purposes of this research are to develop and to evaluate the teacher training program for enhancing scientific creative problem-solving abilities. For this purpose, by considering previous studies, this study suggested 'scientific creative problem solving process'. In the course of elementary teacher program development, the present study followed Instructional Systems Development stages, where Kirkpatrick's four-step evaluation model was applied for a quality of evaluation. As a result of evaluation, it was found that teachers' recognition of competency to teach the scientific creative problem solving process was increased. In addition, teachers' evalution of the program was positive and their willingness to apply it to the field was found high, which indicated that the training program's applicability to schools would be positive.