• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.24 no.3
• /
• pp.69-79
• /
• 2016

This study examines the awareness of the curriculum of the cabin service major students at 2 year colleges through the CIPP (Context, Input, Process, Product) evaluation model and an empirical analysis on how their awareness affects Service Orientation and Service Hospitality. It was proven that the CIPP evaluation model has a positive effect on the satisfaction of their department, and also has a meaningful effect on Service Hospitality and Service Orientation statistically. However, the satisfaction of their department itself is not associated with the increase of Service Orientation and Service Hospitality so it negatively affected them. Moreover, both the Service Management program(Process) and Service Attitude(Product) have a meaningful effect on Service Hospitality, and Service Hospitality also has a meaningful effect on Service Orientation. So it resulted in a casual relationship among them. As a result, it is desperately necessary to promote an educational environment that will increase the satisfaction of the department and help students to become flight attendants. It is also necessary to increase awareness of the Service Management program(Process) and Service Attitude(Product).

• Journal of Fisheries and Marine Sciences Education
• /
• v.25 no.2
• /
• pp.538-551
• /
• 2013

The purpose of this study is to evaluate policy formation stage of Meister high schools. The study analyzed the differences in the recognition of teachers, students, parents, and vocational education specialists about policy evaluation for policy formation stage of Meister high schools. The conclusions based on the results of the study are as follows: First, in context area the recognition of students showed relatively low level. It reflects that the principle of democracy is needed to the policy formation stage of Meister high schools. The participation of stake holders in the policy formation stage is essential. Second, in input area teachers recognized that the financial resources were sufficient. Vocational education specialists recognized that human resources, such as excellent teachers and Meister teachers, needed to recruited adequately. Third, many policies and institutions need to be established for Meister high schools. The Meister high schools should be selected based on the principle of equity. In the selection process vocational education specialists should be included for the principle of professionalism.

• English Language & Literature Teaching
• /
• v.12 no.4
• /
• pp.253-276
• /
• 2006

The purpose of this study is to compare and analyze the aspects of task-based materials in high school English textbooks for first year students in Korea. Based on the theoretical backgrounds for designing communicative tasks and the basic contents of the 7th national curriculum for English, a total of six different qualitative evaluation categories of task-based materials are constructed. The six categories include input data, settings, activity types, language skills, activity themes, and communicative functions. The results of the data analysis showed that the regulations of the 7th national English curriculum, which were aimed at improving the students' communicative abilities, were properly reflected in the materials of task-based activities of all textbooks. On the other hand, a few problems were found in some textbooks: too many individual tasks; being out of proportion in presenting task types and themes; non-systematic introduction of language skills, etc. To conclude, a few suggestions are made to provide some meaningful considerations for the text material developers in order to produce better textbooks in the future: task goals and rationale that encourage the learner's positive motivation; authenticity of input data based on the real-world context; a collaborative learning environment that enhances communicative interaction; a proportional representation of the various activity types including creative problem-solving procedures; systematic introduction of integrated language skills, etc.

• Korean Journal of Comparative Education
• /
• v.28 no.3
• /
• pp.103-133
• /
• 2018

The modern world stands on the cusp of massive change in connection with the 4th industrial revolution. Following developed countries, developing countries also try to grow and keep up with the flow. Among them, trough the international cooperation government of Kazakhstan decided to include the International Baccalaureate Diploma Programme(IBDP) into the Nazarbayev Intellectual School(NIS) in April 2013. The goal of this study is to analyze the efficiency of introduction and implementation of the IBDP in the NIS and to consider the possibility of implementing this program in regular schools. To achieve the research goal, was applied the CIPP evaluation model(context - input - process - product) to assess IBDP program systematically. The analysis of empirical data collected due to the results of the international school system implementation, also in this study were used the results of questionnaires and interviews with the students and teachers who took part in the IBDP educational program. The results of the analysis showed that the average satisfaction of teachers and students who participated in IBDP was 3.64 points, however they pointed out the problems with management and organizations of the program, the establishment of a variety of subjects, recruitment of IBDP teachers etc. These measures would help to raise the status of school to the internationalization.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.79-88
• /
• 2015

The web search engines are exposed to the issue of uncertainty because of ambiguous queries, being input for retrieving the accurate results. Ambiguous queries constitute a significant fraction of such instances and pose real challenges to web search engines. Moreover, web search has created an interest for the researchers to deal with search by considering context in terms of location perspective. Our proposed disambiguation approach is designed to improve user experience by using context in terms of location relevance with the document relevance. The aim is that providing the user a comprehensive location perspective of a topic is informative than retrieving a result that only contains temporal or context information. The capacity to use this information in a location manner can be, from a user perspective, potentially useful for several tasks, including user query understanding or clustering based on location. In order to carry out the approach, we developed a Java based prototype to derive the contextual information from the web results based on the queries from the well-known datasets. Among those results, queries are further classified in order to perform search in a broad way. After the result provision to users and the selection made by them, feedback is recorded implicitly to improve the web search based on contextual information. The experiment results demonstrate the outstanding performance of our approach in terms of precision 75%, accuracy 73%; recall 81% and f-measure 78% when compared with generic temporal evaluation approach and furthermore achieved precision 86%, accuracy 71%; recall 67% and f-measure 75% when compared with web document clustering approach.

• Nuclear Engineering and Technology
• /
• v.45 no.2
• /
• pp.151-164
• /
• 2013

A key input for the assessment of Human Error Probabilities (HEPs) with Human Reliability Analysis (HRA) methods is the evaluation of the factors influencing the human performance (often referred to as Performance Shaping Factors, PSFs). In general, the definition of these factors and the supporting guidance are such that their evaluation involves significant subjectivity. This affects the repeatability of HRA results as well as the collection of HRA data for model construction and verification. In this context, the present paper considers the TAsk COMplexity (TACOM) measure, developed by one of the authors to quantify the complexity of procedure-guided tasks (by the operating crew of nuclear power plants in emergency situations), and evaluates its use to represent (objectively and quantitatively) task complexity issues relevant to HRA methods. In particular, TACOM scores are calculated for five Human Failure Events (HFEs) for which empirical evidence on the HEPs (albeit with large uncertainty) and influencing factors are available - from the International HRA Empirical Study. The empirical evaluation has shown promising results. The TACOM score increases as the empirical HEP of the selected HFEs increases. Except for one case, TACOM scores are well distinguished if related to different difficulty categories (e.g., "easy" vs. "somewhat difficult"), while values corresponding to tasks within the same category are very close. Despite some important limitations related to the small number of HFEs investigated and the large uncertainty in their HEPs, this paper presents one of few attempts to empirically study the effect of a performance shaping factor on the human error probability. This type of study is important to enhance the empirical basis of HRA methods, to make sure that 1) the definitions of the PSFs cover the influences important for HRA (i.e., influencing the error probability), and 2) the quantitative relationships among PSFs and error probability are adequately represented.

• Journal of Digital Convergence
• /
• v.17 no.2
• /
• pp.9-18
• /
• 2019

This study investigates the factors affecting the educational satisfaction and the transfer of learning of cyber crime prevention education students in order to confirm the effectiveness of the current education. Based on the CIPP model, we confirmed whether the level of social demand and the level of knowledge in the context evaluation, recency of subjects in the input evaluation and interaction in the process evaluation affect the educational satisfaction and the transfer of learning of the students by conducting the survey for the students. As a result of analysis, it was proved that the level of knowledge, recency of subjects and interaction had a significant relationship with the educational satisfaction and recency of subjects, interaction and educational satisfaction significantly affect transfer of learning. Based on the findings, this study provides a few constructive suggestions to improve the effectiveness of the cyber crime prevention education program.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.174-183
• /
• 2023

Educational evaluation involves data collection and the analysis of various education-related factors to make decisions that improve educational quality. Systematic educational evaluation is essential for enhancing the quality of education. This study reports a case of student-conducted process evaluation of a medical school's student support system and the procedure for devising improvement plans. Sixteen Inje University College of Medicine students participated in the Education Evaluation Committee (IUCM-EEC) to understand the educational improvement process as learners and actively achieve improvement. The Quality Improvement Committee of the Inje University College of Medicine (IUCM-QIC) decided to reform its student support system based on a previous educational evaluation in 2019. The evaluation of the student support system was conducted for 10 months in 2021 by the student subcommittee, under the guidance of the IUCM-EEC. The CIPP (context-input-process-product) evaluation model was used for a systematic evaluation. Accordingly, the subcommittee developed evaluation criteria and indicators, and analyzed relevant data collected from surveys and the previous literature. For further recommendations and revision ideas, the student subcommittee members interviewed faculty members from six other medical schools and also conducted a focus group interview with the dean and vice deans of IUCM. Finally, the student subcommittee submitted a report to the IUCM-QIC. Communication with various stakeholders is essential for a successful evaluation process. In this case, students, as key stakeholders in education, evaluated the student support system. Their active participation helped improve their understanding of the evaluation process.