• Quality Improvement in Health Care
• /
• v.30 no.1
• /
• pp.132-152
• /
• 2024

Purpose: This study aimed to identify and evaluate interprofessional education (IPE) interventions for healthcare professional students in East Asian countries. Methods: The reporting of this study followed the Preferred Reporting Items of Systematic Reviews and Meta-Analysis guidelines. A literature search was conducted using seven electronic databases: PubMed, EMBASE, CINAHL, Scopus, Web of Science, ERIC, and ProQuest Dissertations & Theses Global. Joanna Briggs Institute Critical Appraisal Checklists were also used to appraise the quality of the included studies. The outcomes of IPE interventions were classified based on a modified Kirkpatrick model. Results: This review included 30 studies predominantly conducted in Singapore, South Korea, and Taiwan. The prevalent research design was a one-group pre-posttest design, and most IPE interventions occurred as single events. Approximately 70% of the studies involved students from two healthcare professions, mainly nursing and medicine. Simulations, group discussions, and lectures have emerged as the most common teaching methodologies, with almost half of the studies leveraging a combination of these techniques. The IPE content primarily focused on interprofessional teamwork, communication, and clinical patient care situations; these included the management of septic shock. The effectiveness of the IPE interventions was mainly evaluated through self-reported measures, indicating improvements in attitudes, perceptions, knowledge, and skills, aligning with Level 2 of the modified Kirkpatrick model. Nonetheless, the reviewed studies did not assess changes in the participants' behavior and patient results. Conclusion: IPE interventions promise to enhance interprofessional collaboration and communication skills among health professional students. Future studies should implement rigorous designs to assess the effectiveness of IPE interventions. Moreover, when designing IPE interventions, researchers and educators should consider the role of cultural characteristics in East Asian countries.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.10
• /
• pp.185-192
• /
• 2012

Call Center requires an ability of agents a lot more than face-to-face contact due to being achieved communication by non face-to face channel for contact with customers. In order to improve the ability of agents, Call Center carries out various educational training according to their work experience and function and with the accomplishment of educational training, Call Center is going to fulfill to develop its quality of counseling and productivity. On the other hand, due to investment of a lot of time and budget to educational training, it is needed to grasp and manage about its effectiveness that how helpful the training is for performance of work-site operations through evaluation of educational training. Having Seen researches about evaluation of educational training until these days, most researches have mainstream to measure satisfaction and a level of learning or degree that how the learning transfers to actions. It is found that a research about an entire evaluation model should be required. This study aims to investigate effectiveness of Call Center educational training from the level of recognition by reflecting Kirkpatrick's the four levels of learning evaluation. By the four levels, reaction, learning, behavior and results, the study found out a connection with standards of evaluation about each levels. In addition, by using structural equation modeling, it was examined goodness of fit about the entire model. Furthermore, by an alternative model, considering a direct relation between a factor of reaction and behavior, it was compared and examined goodness of fit of overall model of the study model and the alternative one.

• Journal of Home Health Care Nursing
• /
• v.25 no.3
• /
• pp.240-248
• /
• 2018

Purpose: The purpose of this study was to evaluate the validity of an educational program developed for geriatric visiting nurses in Seoul by assessing their satisfaction level and level of learning goal achievement. Methods: This descriptive research study was conducted to develop, implement, and evaluate the educational program in accordance with the ADDIE Instructional System Model. Participants were 170 nurses hired for the 2016 Seoul Metropolitan Government visiting service for older people. Based on Kirkpatrick's Training Evaluation Model, reaction and learning evaluations were conducted during and after the educational program. Data were analyzed using descriptive statistics. Results: The developed educational program consisted of basic and professional courses. The evaluations showed that participants were highly satisfied with the lectures and field placement. Over 90% of the participants achieved the learning achievement goals. Conclusion: The program developed for geriatric visiting nurses in Seoul is considered a valid educational program because of the participants' high levels of satisfaction and academic achievement.

• International Journal of Computer Science & Network Security
• /
• v.23 no.2
• /
• pp.39-46
• /
• 2023

The purpose of this study is to introduce a proposed Framework for Evaluating the Return on Investment (ROI) of E-Learning Programs at Saudi Universities. To achieve this goal, the descriptive analysis methodology is used to analyze the literature review about e-learning and its evaluation from different viewpoints, especially from the ROI-related perspective. As well as the literature reviews related to ROI and the methods of calculating it inside society institutes. This study suggests a conceptual framework for evaluating the ROI of E-Learning Programs at Saudi Universities. This framework is based on the merging process among the analyze, design, develop, implement, and evaluate (ADDIE) model for designing e-learning programs, which gives detailed procedures for executing the program, several evaluating models for e-learning, and the Kirkpatrick model for evaluating the ROI of e-learning. It consists of seven stages (analysis, calculating the costs, design, development, implementation, calculation of the benefits, and calculation of the final ROI).

• Journal of Gifted/Talented Education
• /
• v.23 no.2
• /
• pp.133-160
• /
• 2013

The purposes of this research are to develop and to evaluate the teacher training program for enhancing scientific creative problem-solving abilities. For this purpose, by considering previous studies, this study suggested 'scientific creative problem solving process'. In the course of elementary teacher program development, the present study followed Instructional Systems Development stages, where Kirkpatrick's four-step evaluation model was applied for a quality of evaluation. As a result of evaluation, it was found that teachers' recognition of competency to teach the scientific creative problem solving process was increased. In addition, teachers' evalution of the program was positive and their willingness to apply it to the field was found high, which indicated that the training program's applicability to schools would be positive.

• Journal of Digital Convergence
• /
• v.19 no.12
• /
• pp.51-62
• /
• 2021

This study developed the factors capable of systematic/comprehensive evaluation of the task performance in order to strengthen the performance management of the professional career personnel invitation program (PCPIP). To this end, a performance evaluation framework was developed by analyzing existing project evaluation studies based on boundary theory and Kirkpatrick's four-level evaluation model. Afterwords, through two Delphi surveys, evaluation factors that can measure performance in terms of individual and invitation institutions of PCP were derived and validated. With this procedure, five evaluation factors were finally selected: adaptability, connectivity, clarity, compatibility, and expandability. This study has implications suggesting a performance evaluation factors capable of hybrid quantitative/qualitative evaluation for the performance management of PCPIP operated by National Research Foundation of Korea Research since 1994.

• Asian Pacific Journal of Cancer Prevention
• /
• v.16 no.2
• /
• pp.501-506
• /
• 2015

Background: To evaluate the effectiveness of the National Train-the-Trainers Program for Hospice and Palliative Care Experts (TTHPC) sponsored by the National Cancer Center of Korea between 2009 and 2012. This program was developed to improve the teaching skills of those in the field of hospice and palliative care (HPC). Materials and Methods: Training was offered in eight 1-day sessions between 2009 and 2012. The effect of the program was measured using Kirkpatrick's model of educational outcomes. First, levels 1 and 2 were evaluated immediately after the 1-day program (n=120). In 2012, the level-3 evaluation test was administered to trainers who offered at least one HPC training (n=78) as well as to their trainees (n=537). Results: The level-1 evaluation addressed participant reactions to and satisfaction with the program. Participants (n=120) were generally satisfied with the content, the method, and the overall course (mean range: 3.94-4.46 on a five-point Likert scale). The level-2 evaluation (learning) showed that participants gained knowledge and confidence related to teaching HPC (4.24 vs. 4.00). The level-3 evaluation (behavioral), which assessed trainers' application of teaching skills to HPC, showed that trainees rated the teaching methods of trainers (mean range: 4.03-4.08) more positively than did trainers (p<0.05). Female trainers were more likely than were male trainers to plan sessions in consideration of their trainees' characteristics (4.11 vs. 3.58; p<0.05), and nurse trainers were more likely than physician trainers to use a variety of instructional methods (4.05 vs. 3.36; p<0.05) Conclusions: We conducted systematic evaluations based on Kirkpatrick's model to assess the effectiveness of our train-the-trainers program. Our educational program was practical, effective, and followed by our HPC experts, who needed guidance to learn and improve their clinical teaching skills.

• Journal of Practical Engineering Education
• /
• v.12 no.1
• /
• pp.101-108
• /
• 2020

KOREATECH has operated a Co-op program called 'Industry Professional Practice (IPP)' that allows students to work full-time in relevant industries for at least four months since 2012, and also developed a systematic performance evaluation model on the basis of Kirkpatrick's four-stage assessment model. This study aims to share KOREATECH's Levels 3 and 4 evaluation results which are clearly what practitioners and academic investigators of cooperative education want to know the most. For this purpose, a questionnaire survey was conducted for KOREATECH graduates and their superiors to examine influence of IPP experiences on employment and job performance. A total of 730 alumni who graduated within last 5 years participated in the survey, with 213 (29.2%) having IPP experiences, and 162 superiors rated their subordinates on seven performance criteria. The analysis results were mixed. On the one hand, employment rate of IPP participants was 89.7%, compared to 86.8% of alumni without field experiences. Participants of the IPP program were more satisfied with their salary and felt less unfair about their career and promotion opportunities than alumni without field experiences. On the other, superiors rated their subordinates without IPP experiences slightly more positively than IPP participants in terms of job performance. These contrasting results are judged to show strengths and weaknesses of the IPP program at the same time. The limitations of the study and future research directions are discussed at the last part.

• Journal of Agricultural Extension & Community Development
• /
• v.8 no.2
• /
• pp.179-190
• /
• 2001

The purpose of this study was to analysis the education effects of web-based on-line cyber program mesaured by Kirkpatrick’s evaluation process. The average score on satisfaction of the program was 4.28(.59), which was designed to evaluate the level 1, reaction. To test level 2, learning, the average score that students achieved was calculated and it was 86.87(std.=7.05) in the term examinations. The level 3, job months. It was reported that most employees who took the course are utilizing the knowledge that they acquired from the course(mean=3.80, std.=.77). To identify the level 4, business results, the mean score of the number of accidents and near misses that happened in their factories for 3 months before and after the course were compared. There was statistically significant difference between the number of accidents that happened 3 months before the course and 3 months after the course, at the significance level of .01, which was tested by Paired t-test.

• Journal of Welding and Joining
• /
• v.33 no.3
• /
• pp.40-46
• /
• 2015

Welding is one of the most fundamental and necessary work in the industry that demand sophistication of skilled workers. This study is to introduce welding simulator as a training tool, to verify its effectiveness and to measure satisfaction of the trainees. A group of freshman students at a Korea Polytechnics College in their twenties with less experience of welding participated in the study. They were divided into two groups and took a traditional training course (comparison group) and a training course with welding simulator applied reality/haptic technology (experimental group) for same hours respectively. To evaluate training effect, a national certificate test and a survey based on Phillips' ROI (Return on Investment) methodology were conducted by the students and the college respectively. And satisfaction survey among the students based on Kirkpatrick's Four-Level Evaluation Model was also carried out. The results showed that all students in the experimental group passed the national certificate test and the ROI of the experimental group for five years were 110% higher than the comparison group. Furthermore, 25% more students in the experimental group replied "very satisfied" about the overall training course and 75% more students in the same group found that the simulation was very similar to the real welding.