• The Journal of the Korea Contents Association
• /
• v.12 no.10
• /
• pp.510-523
• /
• 2012

The purpose of this study is to evaluate an airline service training program based on the CIPP model. Evaluation areas were divided into context, input, process, and product. We analyzed the factors which influenced program satisfaction and recommendation of the training program. Two hundred and one learners who participated in an airline service training program were selected for a survey. The results of this study are as follows. The factors which positively influenced training satisfaction were educational goals in context evaluation, interaction between learners and instructors, managing programs in process evaluation, and training performance in product evaluation. The factor which negatively influenced training satisfaction was human resources in input evaluation. On the other hand, the factors which positively influenced training recommendation were educational goal, assessing needs in context evaluation, interaction between learners and instructors, supporting programs in process evaluation, and training performance in product evaluation. The factor which negatively influenced training recommendation was assessing needs in context evaluation. The results of this study are expected to make an important contribution to the development of service training programs in airlines.

• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.7 no.5
• /
• pp.369-379
• /
• 2017

The purpose of this study was to improve an university tutoring program qualitatively, evaluating and analyzing the case of tutoring program that students attended in order to strengthen their learning competences through CIPP(Context-Input-Process-Product). To do this, a tutoring survey with satisfaction survey was carried out for 90 students who participated in the final reporting meeting among those who joined the tutoring program at the second semester of 2016 year at the B university. In addition, a tutor interim checking workshop was held for the 49 tutors and qualitative analyses were carried out on the reflection papers submitted by students who were involved in the tutoring program. Tutoring program assessments were carried out in terms of several steps and their view points. They were the necessity of tutoring program for the context evaluation, the appropriacy of human-material resources and program planning for the input evaluation, the teaching and learning activity for the process evaluation and the influence, effectiveness, sustainability, transferability for the product evaluation. Survey results showed that the average scores were presented 4.05 for the context evaluation, 3.88 for the input evaluation, 4.08 for the process evaluation and 3.92 for the product evaluation respectively. Similar analysis results were represented from the tutor workshops and the reflection paper analysis results. Learners were satisfied with all the evaluation items, scoring more than the average level. However, it was necessary for the evaluation items that were rated low range to improve the program through detail modification plans.

• Journal of Forest and Environmental Science
• /
• v.36 no.2
• /
• pp.163-172
• /
• 2020

The objective of this study was to develop evaluation criteria for forest education using the Context, Input, Process, and Product (CIPP) model. To this end, we designed a survey based on expert advice and content analysis of previous studies on the CIPP model and forest education. The survey was conducted on 393 forest education specialists, and Cronbach's α coefficient was set as 0.6 or higher to verify reliability and validity, and to determine reliability by factor. Eventually, 52 out of 57 evaluation items were extracted, and the evaluation indexes were selected through factor analysis as follows: four evaluation indexes for the context dimension, namely "Clarity of goal setting," "Developing conditions for education," "Meeting of requirements," and "Institutional drive"; three evaluation indexes for the input dimension, namely "Acquisition of education infrastructure," "Establishment of operational support," and "Adequacy of assigned manpower"; four evaluation indexes for the process dimension, which were "Adequacy of budget allocation," "Expertise of forest education instructors," "Diversity of programs," and "Public-private academic partnership"; and five evaluation indexes for the product dimension, namely "Effectiveness of perception change," "Influence over the society," "Continuity of improvement in evaluation," "Continuity of education," and "Verification of the effects of education."

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.32 no.3
• /
• pp.59-70
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as 'Good'. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach's a coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

• 대한공업교육학회지
• /
• v.34 no.2
• /
• pp.179-204
• /
• 2009

As the concern with the educational training for human resources development in organizations grows, various programs are being offered in many places. Accordingly, the issue of securing the validity of the education and the importance of its assessment at the level of continuous quality management of the programs draw our attention. The purpose of this study is to offer the basic data of evaluation criteria for human resources development which knowledge-and-information saturated society requires, and also to draw out the greater area of human resources development educational program based on CIPP(Context, Input, Process, Product) model by Stufflebeam, an evaluation model concentrated on process, through literature and case study in and out of Korea. The result of the study is as follows. First, the evaluation areas drawn out by the greater sphere of context evaluation of human resources education program are needs analysis, goal setting, and organizational environment. Second, the evaluation areas drawn out by the greater sphere of input evaluation of human resources education program are educational program strategies, human resources, and physical resources. Third, the evaluation areas drawn out by the greater sphere of process evaluation of human resources education program are educational program management, teaching-learning strategies, and educational support environment. Fourth, the evaluation areas drawn out by the greater sphere of product evaluation of human resources education program are influence, effect, durability, and transference. The author supposes that these results will be able to become the basic materials for the systematic approach to educational programs through the analysis of evaluation criteria for and the greater sphere of educational program of human resources development.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of the Korean Society of Environmental Restoration Technology
• /
• v.14 no.1
• /
• pp.105-119
• /
• 2011

In order to develop the indicators which evaluate the management effectiveness for the protected forest areas in Korea, candidate indicators were listed based on literature and experts interviews, then questionnaire survey on the experts were conducted. 5 elements of context, planning, input, process, output and outcome and 32 indicators were selected. Context element includes 6 indicators of 1) documentation and assessment of values; 2) documentation and assessment of threats, 3) influence of government policy, 4) related regulations, 5) community cooperation and 6) the structure of management organization. 6 indicators of Planning element were 1) the management objective, 2) protected area design, 3) protected area size and number, 4) representation, 5) standards and categories and 6) management planning. Input element of 3 indicators were 1) management staff, 2) funding, 3) establishment and application of information. Process element were consisted of 1) governance, 2) management guidelines, 3) human resource management, 4) law enforcement, 5) eco-management, 6) disaster management, 7) education program and 8) research and monitoring. The element of outputs and outcomes were 1) accomplishment of plan, 2) accomplishment of program, 3) private land management, 4) threats change, 5) biodiversity change, 6) ecosystem health and vitality, 7) impact on community, 8) international management level and 9) visitors' satisfaction and variation in civil compliant. It is recommended to have further research on evaluation methods development by applying those above developed indicators for the protected forest areas to ensure the practicality of the indicators.

• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 한국벤처창업학회:학술대회논문집
• /
• 2009.08a
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.61 no.2
• /
• pp.312-320
• /
• 2012

In this study, we introduce a new design methodology of a granular-oriented self-organizing polynomial neural networks (GoSOPNNs) that is based on multi-layer perceptron with Context-based Polynomial Neurons (CPNs) or Polynomial Neurons (PNs). In contrast to the typical architectures encountered in polynomial neural networks (PNN), our main objective is to develop a methodological design strategy of GoSOPNNs as follows : (a) The 1st layer of the proposed network consists of Context-based Polynomial Neuron (CPN). In here, CPN is fully reflective of the structure encountered in numeric data which are granulated with the aid of Context-based Fuzzy C-Means (C-FCM) clustering method. The context-based clustering supporting the design of information granules is completed in the space of the input data while the build of the clusters is guided by a collection of some predefined fuzzy sets (so-called contexts) defined in the output space. (b) The proposed design procedure being applied at each layer of GoSOPNN leads to the selection of preferred nodes of the network (CPNs or PNs) whose local characteristics (such as the number of contexts, the number of clusters, a collection of the specific subset of input variables, and the order of the polynomial) can be easily adjusted. These options contribute to the flexibility as well as simplicity and compactness of the resulting architecture of the network. For the evaluation of performance of the proposed GoSOPNN network, we describe a detailed characteristic of the proposed model using a well-known learning machine data(Automobile Miles Per Gallon Data, Boston Housing Data, Medical Image System Data).