• Journal of Fisheries and Marine Sciences Education
• /
• v.15 no.1
• /
• pp.1-24
• /
• 2003

This research investigates how teachers evaluate the School Comprehensive Evaluation administered by KEDI from 2000 to 2001. To provide basic data for improvement of the School Comprehensive Evaluation, the following six questions were asked: 1. What are the teachers' evaluations of the School Comprehensive Evaluation? 2. What are the teachers' evaluations of the operation of the School Comprehensive Evaluation? 3. What are the teachers' evaluations of the results of the School Comprehensive Evaluation? 4. What are the teachers' evaluations of the effects of the School Comprehensive Evaluation? 5. What are the teachers' opinions regarding the problems of the School Comprehensive Evaluation and solutions to them? 6. What are the teachers' evaluations of the open classrooms and evaluators? 360 questionnaires were distributed to teachers who had been working at the Busan and Ulsan Metropolitan City schools taken the School Comprehensive Evaluation, and 258 questionnaires were processed by a SPSS WIN. The followings are major findings of the study: 1. The teachers evaluated the School Comprehensive Evaluation to be more desirable compared to the usual School Evaluation. 2. They recognized the need for preliminary training with extended time about the School Comprehensive Evaluation. They evaluated that the procedure and area of the evaluation were quite valid. 3. They evaluated the evaluation reports were objective but not leading changes in the respective schools. 4. The School Comprehensive Evaluation did not much contributed to the improvement of the schools. 5. Stress from interview and class observation was the major problem to the teachers. 6. The teachers did prepare for their open classes, but highly evaluated the evaluator's professionalism.

• Journal of The Korean Association For Science Education
• /
• v.39 no.6
• /
• pp.695-706
• /
• 2019

This study conducted a case study on the process-centered evaluation competency of a middle-school/high-school science teacher using Teacher's Process-centered Evaluation Competency (T-PEC) measurement tool. The case analysis shows that teacher A in a middle school represents high competency of process-centered evaluation planning and cooperative communication while the competency of utilizing process-centered evaluation results is low owing to the characteristics of non-standardized areas. Teacher B in a high school shows high level of cooperative communication competency whereas low level of process-centered evaluation execution competency because the freedom given to students is not enough during the process of evaluation. The teacher also shows very low level of utilizing process-centered evaluation results due to the lack of time and the school culture not giving feedback to the students. According to cross-case analysis, teacher A and B both represent the highest level of collaborative communication competency and the lowest level of utilization process-centered evaluation results competency. And the lack of clear criteria for process-centered evaluation leads to different understanding of process-centered evaluation between the two teachers, and teacher B shows low the level of utilizing process-centered evaluation affects results due to the students not being concerned on feedback, security problem, and the reality focusing on the university entrance examination in high schools. Based on the results, this study suggests providing clear guidelines of process-centered evaluation to teachers, introducing an application in order to solve the time-lack problem pointed out as the biggest problem of process-centered evaluation, ensuring objectivity and security about process-centered evaluation results, and building the school culture such as the expanded application of standardized areas in order to implementing process-centered evaluation.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.2
• /
• pp.229-235
• /
• 2021

Blockchain, recognized as one of the core technologies of the 4th industrial revolution, is an Internet-based distributed data management system which does not require centralized control. Blockchain is characterized by the integrity and reliability of information, and blockchains can be used where such characteristics are required. Typical applications of blockchain include finance, transaction, and evaluation management. In this paper, we designed a blockchain-based evaluation management system that allows users to freely create and manage evaluation instances. Evaluation managers can create an evaluation instance according to their purpose and allocate evaluation items and evaluators. When the evaluators finish evaluating the evaluation items, the evaluation manager can aggregate the evaluation results for the instance. Someone, who want to perform evaluation for various purposes but do not have an evaluation system, can implement the evaluation system relatively simply by using this system. In addition, due to the characteristic of the blockchain, evaluators cannot modify the evaluation scores they have already recorded, and neither the system administrator nor the evaluation administrator can modify the evaluation scores. For this reason, the reliability of the evaluation increases.

• Journal of Korean Society for Quality Management
• /
• v.51 no.2
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• Journal of Navigation and Port Research
• /
• v.43 no.3
• /
• pp.219-230
• /
• 2019

The objective of this study is to suggest the evaluation method, the evaluation index and items, and evaluation criteria for rational and systematic evaluation of the thalassotherapy complex site. Evaluation items and indicators are determined based on overseas cases of thalassotherapy complex, the central governments' thalassotherapy business policy, and the local governments business plan. 3 major evaluation items, 8 middle evaluation items, 5 small evaluation items and 26 evaluation indexes are selected as evaluation items. The evaluation criterion for each evaluation index is then determined. As per the evaluation process, first, weights are assigned to the evaluation items by an evaluation committee composed of experts. Secondly, each committee member assigns a weight and a score to each evaluation indicator for evaluation score calculation. This score is then multiplied by the weight of the evaluation item to determine the final score for each evaluation index. The ultimate scores of all the evaluation indexes are then added to the evaluation score of each committee member. Lastly, the arithmetic mean of the evaluation scores of all committee members becomes the final evaluation result of a site.

• The Journal of Fisheries Business Administration
• /
• v.42 no.3
• /
• pp.15-29
• /
• 2011

The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.9 no.3
• /
• pp.129-144
• /
• 2013

Recognizing a limits on quantitative evaluation of cultural contents' and for its betterment, study aims developing a qualitative evaluation model. For this study, Reception Theory, Semiotics and Psychology were derived for epistemological dimension to contemplate culture contents' essential attribute. To be concrete, cultural contents was examined as experiential products, emotional products, rememberable products and texts. Also, codes of fun, emotion and culture were discussed as intrinsic attributes for cultural contents and how those attributes were expressed or composed in cultural contents was discussed as well. Evaluation items were extracted based on final discussion at the epistemic level, set up the final evaluation model by taking experts' advices on each items. With all those outcomes, qualitative evaluation model for cultural contents was developed. For the importance of each index in the model, priority was granted by weighting on each index. Lastly, evaluation scale was developed for each index. The culture contents' evaluation model developed in study is meaningful not only in drawing qualitative evaluation items of video(image) contents and developing the index and model for the first time, but also its possibility of wide use for other genres.

• Journal of Information Technology Services
• /
• v.17 no.1
• /
• pp.59-77
• /
• 2018

Software process (SP) authentication is a certification system designed in order to improve software process and ensure software reliability of the Korean small and medium enterprises (SMEs). It is composed of 3 grades, 17 evaluation items and 70 detailed evaluation items (software process). In order to certificate grade 2, 42 detailed evaluation items must be satisfied. In order to certificate grade 3, all 70 detailed evaluation items must be satisfied. SMEs are more vulnerable to manpower and material resources than the major company. Therefore, it is difficult for SMEs to invest in the long term to improve the software process. If we can provide the core evaluation items to SMEs, SMEs will be able to improve software quality more efficiently and effectively. It can be used as a short way to acquire SP authentication. The evaluation items of SP are defined as influencing each other. Therefore, the core evaluation items might be established using related techniques. Although we searched for previous researches and related informations, the associated study was insufficient. In this study, ANP (Analytic Network Process) technique was applied, and the core evaluation items of SP authentication were established. SMEs will be able to acquire SP authentication more easily using the core evaluation items. Finally, we expect that this study will be used as a basis material for creating the SP 2.0 version.

• Journal of the Korea Computer Industry Society
• /
• v.8 no.3
• /
• pp.147-154
• /
• 2007

Many studies have reported that each evaluation had a stronger effect on the development of a student's teaming ability. Nevertheless, in reality schools rely on the results of summative evaluation after the lesson only for the purpose of learning evaluation. Such a method of evaluation is a result-oriented learning evaluation, with no consideration of developing process of loaming ability of each student. Existing learning evaluation has been considered difficult to process learning performance ability in a clearer manner, as it examines teaming performance ability by diagnostic evaluation and learning ability improvement by formative evaluation, separately. Therefore, this paper proposes a learning evaluation method incorporating diagnostic and formative evaluation, using a Fuzzy inference, for a more objective assessment of performance ability. The proposed method assessed teaming ability based on different weight values, in order to reflect the level of diagnostic and formative evaluation.