• 한국비블리아학회지
• /
• 제34권2호
• /
• pp.295-311
• /
• 2023

이 연구의 목적은 Kirkpatrick 교육평가모형을 활용하여 사서교사의 계속교육의 효과를 체계적으로 측정하는데 있다. 2022년 하계 『사서교사 1급 정교사 자격연수』에 참여한 사서교사 136명을 대상으로, 3단계의 교육평가를 진행하였다. 1단계는 교육 전반에 관한 만족도 조사이며 교육 후에 조사되었으며, 2단계와 3단계는 교육 전과 교육 후에 조사하였고, 전후 차이 분석으로 실질적인 교육의 효과를 측정하였다. 2단계는 학습평가이며 3단계는 직무역량향상 평가이다. 연구 결과 모든 단계에서 높은 측정 점수가 산출되었고, 2단계 학습평가에서 교육의 전후 효과가 통계적으로 유의한 것으로 나타났다. 3단계 직무역량향상평가에서는 교육 후에 점수가 하락하였으나 통계적으로 유의하지는 않았다. 2단계 평가에서 유의미한 결과를 도출하였으며, 향후 연구에서는 평가모델이 보완되고, 유효한 결과가 나올 수 있는 균형 있는 교육과정의 설계가 필요함을 제언하였다.

• 의학교육논단
• /
• 제23권1호
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Journal of Multimedia Information System
• /
• 제4권3호
• /
• pp.115-122
• /
• 2017

Over the years, there has been much research in blended learning. However, research regarding its use and evaluation is inconsistent, not following any specific evaluation method, and may not be applicable to local students. In this research, a case study was conducted to evaluate the environment based on three levels of Kirkpatrick's model. Methodological triangulation was the principle of data collection used in which multiple sources of evidence were triangulated to provide insights into this study. Instruments used include surveys, interviews, questionnaires and pre- and post-tests that are guided by Kirkpatrick's model. The results revealed that students were positive with the learning environment. Students enjoyed learning with multimedia and motivated to learn as well as engaged in the environment. The tests showed significant difference in their learning. Students also perceived that they have transferred their learning from face-to-face lecture into problem-based learning and learning outcome. This research contributes to the field by providing deeper insights into assessments in multimedia-based blended learning environment and empirical evidence on views, attitudes, learning and knowledge transfer of students in higher education.

• 대한치과의사협회지
• /
• 제54권1호
• /
• pp.27-38
• /
• 2016

Objectives: This study evaluated the outcomes of continuing professional education in implant dentistry using Kirkpatrick's four-level evaluation model. Material and methods: The study was carried out through a questionnaire distributed to dentists who attended a continuing professional education in implant dentistry, 2008~2012. They were asked to fill out questionnaires at least 6 months after its completion. Results: Mean ages of total 23 dentist was $44.8^{\circ}{\ae}8.2$. Mean period after completion of education was $2.7^{\circ}{\ae}1.2$. Knowledge (level 2) (r=0.71, p<0.01) and behavior (level 3) (r=0.68, p<0.01) was positively correlated with topic and methods of education in reaction (level 1). Behavior was positively correlated with knowledge (r=0.79, p<0.01). Result (level 4) was positively correlated with knowledge (r=0.64, p<0.01) and behavior (r=0.86, p<0.01). Conclusion: Reaction affects on knowledge, behavior and result in order.

• 한국실천공학교육학회논문지
• /
• 제4권2호
• /
• pp.98-103
• /
• 2012

우리나라에서 최초로 실행되는 한기대 IPP 제도는 실행과정에서 많은 어려움이 예상되며, 그 효과성 또한 아직 불확실하다. 따라서 한국형 IPP 제도의 실효성을 평가하고 프로그램 운영체계 및 과정에 대한 개선방안을 모색하기 위해 체계적인 성과평가모형의 개발이 절실하게 요구된다. 본 연구에서는 IPP 제도의 성과평가 방안을 Kirkpatrick의 4단계 평가모형에 기반하여 제시한다. 이를 위해 외국의 다양한 Co-op 평가사례를 분석하여 평가방법과 평가지표를 찾아내고, 이를 Kirkpatrick의 4단계(반응평가, 학습평가, 행동평가, 그리고 결과평가)에 매핑한다. 이러한 성과평가모형을 통해 IPP 프로그램의 성과와 문제점을 파악함으로써 고용노동부나 대학 내 학부 과 등 관련 이해관계자 집단들을 설득하고 지원을 얻는데 활용할 수 있을 뿐만 아니라 IPP 제도의 효과를 극대화시키는데 기여할 수 있을 것으로 예상된다.

• 정보관리학회지
• /
• 제34권4호
• /
• pp.173-199
• /
• 2017

교육훈련 평가는 교육프로그램과 관련한 내용을 측정, 관찰하여 품질을 평가하고 이를 통해 교육훈련 변경에 대한 근거를 제공하는 행위이다. 국립중앙도서관은 사서교육 훈련프로그램 교육과정의 성과와 질을 제고할 수 있는 평가방법의 도입이 필요한 시점이다. 이에 본 연구는 국립중앙도서관의 사서교육훈련 직무교육의 효과성을 객관적이고 복합적으로 측정할 수 있는 평가모형을 개발하는 것을 목적으로 하였다. 이를 위해 Kirkpatrick의 4단계 평가모형을 적용하였으며, 선행연구, 국립중앙도서관 사서교육훈련 교육과정 현황조사, 이해관계자 요구분석을 실시하였다. 이를 바탕으로 사서교육훈련 평가체계 방향성을 설정하기 위한 평가체계 및 평가도구를 제시하였다. 본 연구 결과는 실제 국립중앙도서관 사서교육훈련과정의 현실적인 평가체계로 활용될 수 있을 것으로 기대된다.

• 보건교육건강증진학회지
• /
• 제28권4호
• /
• pp.27-37
• /
• 2011

Objectives: This study aims to evaluate the outcomes of an education program for public health service workers in public hospitals, utilizing the Kirkpatrick model. Methods: The study participants were 118 staff in 48 public hospitals. Of the stages in the Kirkpatrick model(reaction, learning, behavior, and result), reaction and learning stages were analyzed in this study. A 10-item self-evaluation questionnaire was used to measure satisfaction level for the reaction, and achievement of learning purposes for the learning. The education program consisted of general courses and special two tract courses(Tract A: chronic diseases, Tract B: health promotion). Results: The highest score for reaction was for Tract A(score=4.4), whilst the lowest score for reaction was for lecture(score=3.0). Learning achievement was significantly different between pre-education and post-education(p<0.01), except for health technicians. Conclusions: The results of this study could be utilized to develop effective systematic education programs for public health service workers in public hospitals.

• 실천공학교육논문지
• /
• 제6권1호
• /
• pp.57-64
• /
• 2014

한국기술교육대학교(이하 한기대)는 학부교육과 전일제 근무를 병행하는 기업 연계형 장기실습제도(IPP)를 마련하여 2012년 8월부터 12월까지 시범사업을 운영하였고, 2013년 봄부터 본 사업을 추진하였다. 또한 IPP 프로그램의 실효성을 평가하고 프로그램 운영체계 및 과정에 대한 개선방안을 찾기 위해 Kirkpatrick의 4단계 평가모형에 기반 하여 IPP 성과평가모형을 개발하였다. 본 연구는 IPP 성과평가모형을 2013년 본 사업에 적용하여 참여학생들을 대상으로 기업체 파견 전과 후에 실시한 설문조사 결과를 분석하여 IPP 프로그램의 효과성을 평가하고, 향후 평가체계의 개선방향을 모색하고자 하였다. 설문조사 분석결과에 따르면, IPP 프로그램이 학생들의 비전공역량과 직업에 대한 태도를 개선하는데 어느 정도 효과적이었고, 학생들의 기업체 및 업무에 대한 만족도가 매우 높았던 반면, 전공역량과 IPP에 대한 인식 측면에서는 의미 있는 향상이 발견되지 않았다. 이러한 분석결과에 기반 하여 한기대 IPP 프로그램의 개선방향을 제시하였다.

• 보건행정학회지
• /
• 제26권4호
• /
• pp.373-381
• /
• 2016

Background: The purpose of this study is to evaluate the outcomes of clinical education program for nurses in regional public hospital, utilizing the Kirkpatrick's model. Methods: Kirkpatrik's 4-level model was applied to this study. Trainees were asked to fill out questionnaires in the middle and at the end of the program. Also administrators of excellent trainees were asked to fill out the questionnaires regarding nursing management performance after 1-2 months from the end of the training course. Results: All trainees had positive reactions to the clinical education program. Not only the results of individual level (satisfaction and achievement scores, academic achievement scores, practical application rate, and educational transition factors) but also the scores of organization level (nursing management performance scores) are improved. Conclusion: By showing a correlation between the effectiveness factors we need to verify the relationship between these factors in a future study. In addition, development of quantitative and qualitative performance indicators are needed. To establish a long-term education system, it is required to applying the excellent trainee's successful experiences.

• 의학교육논단
• /
• 제25권2호
• /
• pp.126-131
• /
• 2023

The aim of this study was to systematically collect data for evaluating short- and long-term outcomes using Kirkpatrick's four-level evaluation model, Chonnam National Medical School has established plans for developing and managing a database of student and graduate cohorts. The Education Evaluation Committee, with assistance from the Medical Education Office, manages the development and maintenance of cohort data. Data collection began in the 2022 academic year with first- through fourth-year medical students and graduates of the year 2022. The collected data include sociodemographic characteristics, admission information, psychological test results, academic performance data, extracurricular activity data, scholarship records, national medical licensing exam results, and post-graduation career paths. The Education Evaluation Committee and the Medical Education Office analyze the annually updated student and graduate cohort data and report the results to the dean and relevant committees. These results are used for admissions processes, curriculum improvement, and the development of educational programs. Applicants interested in using the student and graduate cohort data to evaluate the curriculum or conduct academic research must undergo review by the Educational Evaluation Committee before being granted access to the data. It is expected that the collected data from student and graduate cohorts will provide a sound and scientific basis for evaluating short- and long-term achievements based on student, school, and other characteristics, thereby supporting medical education policies, innovation, and implementation.