• Journal of The Korean Association For Science Education
• /
• v.39 no.6
• /
• pp.695-706
• /
• 2019

This study conducted a case study on the process-centered evaluation competency of a middle-school/high-school science teacher using Teacher's Process-centered Evaluation Competency (T-PEC) measurement tool. The case analysis shows that teacher A in a middle school represents high competency of process-centered evaluation planning and cooperative communication while the competency of utilizing process-centered evaluation results is low owing to the characteristics of non-standardized areas. Teacher B in a high school shows high level of cooperative communication competency whereas low level of process-centered evaluation execution competency because the freedom given to students is not enough during the process of evaluation. The teacher also shows very low level of utilizing process-centered evaluation results due to the lack of time and the school culture not giving feedback to the students. According to cross-case analysis, teacher A and B both represent the highest level of collaborative communication competency and the lowest level of utilization process-centered evaluation results competency. And the lack of clear criteria for process-centered evaluation leads to different understanding of process-centered evaluation between the two teachers, and teacher B shows low the level of utilizing process-centered evaluation affects results due to the students not being concerned on feedback, security problem, and the reality focusing on the university entrance examination in high schools. Based on the results, this study suggests providing clear guidelines of process-centered evaluation to teachers, introducing an application in order to solve the time-lack problem pointed out as the biggest problem of process-centered evaluation, ensuring objectivity and security about process-centered evaluation results, and building the school culture such as the expanded application of standardized areas in order to implementing process-centered evaluation.

• Journal of Korean Society of Rural Planning
• /
• v.29 no.4
• /
• pp.105-116
• /
• 2023

In this study, evaluation indicators for quantitative and qualitative indicators were presented by resetting the evaluation indicators for the selection of the living conditions renovation project for vulnerable residential areas by reflecting the results of expert importance. The appropriateness of the project selection evaluation index was reviewed by comparing the results of the expert AHP importance survey to make the project sustainable and to discover vulnerable villages. Evaluation items were constructed based on the guidelines for selecting the target site, and AHP importance evaluation was performed using this evaluation item as a proxy variable. Based on the data collected from 152 villages in Gimhae-si for case studies, the evaluation results were derived by applying the existing guideline evaluation indicators and evaluation indicators reflecting the importance proposed in this study. As a result of the study, Overall, there was a positive correlation between the results of the existing guideline evaluation and the results of the AHP importance survey, but in detail, there is a difference in the results evaluated by the two evaluation methods. In the future, if the scope of participating experts is expanded to supplement the importance evaluation, and the evaluation grade is set by analyzing quantitative data from Gyeongsangnam-do or rural areas nationwide, local governments and others will use this evaluation index as basic data when promoting the project.

• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Journal of Korea Technology Innovation Society
• /
• v.3 no.2
• /
• pp.48-60
• /
• 2000

An effort has been made in this paper to measure the project manager's reaction to R&D project evaluation and present the useful information related to rebuilding an R&D evaluation system. Results of this study show that project manager's reaction is related to the selection of reasonable items for evaluation, the rater's expertise, the project manager's participation in evaluation process and so on. Accordingly, managers of the research institute have to set up the evaluation system after deeply considering these results.

• Communications of Mathematical Education
• /
• v.21 no.2 s.30
• /
• pp.331-345
• /
• 2007

This research is aimed to inquiry retention types of middle school students about results of evaluation in school mathematics, For this purpose, we selected evaluation time, problem types, evaluation score, evaluation factors as important factors which influence to students' retention types. Then we classified students' retention types about results of evaluation in school mathematics. From this results, we selected two students as participants, and collected data through depth interviews of them. In depth interviews, we focused on 'what is the core factor influenced to students' evaluation', 'how the core factors reappear in the future'. Through this process, we analyzed middle school students' retention types about results of evaluation in school mathematics.

• Journal of the Korea Safety Management & Science
• /
• v.13 no.2
• /
• pp.83-90
• /
• 2011

It has been very important to have an exact evaluation for risk factors in order to prevent WMSDs(Work-related Musculoskeletal Disorders). However, most WMSDs evaluation methods have always been some problems of possibilities associated with subjective evaluation. Therefore, this study tried to conduct a sort of usability analysis on three major evaluation methods(OWAS, RULA, REBA). Specifically, major subjects in the study consisted of three parts as follows; comparison of the results between experienced and inexperienced observers, analysis for the consistency of the results in terms of different evaluation times, and analysis for the consistency of the results in terms of different job characteristics(based on the part of the automobile). The results of the study were summarized as follows; 1) There was statistically significant difference of the results by RULA and by REBA between experienced and inexperienced observers. This might be due to the fact that experienced observers have had better ability to detect the important working posture during evaluation. However, the results by OWAS did not give any significantly different results between experienced and inexperienced observers, 2) All three checklists applied by experienced subjects did not show any single result significantly different in terms of different evaluation times. This might have to do with high intra-observer reliability from some of previous studies, 3) The five parts of an automobile were selected as five major jobs with different job characteristics in the automobile industry. Specifically, they were door part, front part(hood, etc.), inside part(dash board, seats, etc.), rear part(trunk etc.), and bottom part. All three methods did not show any significant differences for the results from each observers. Further study on this subject would eventually provide a sophisticated evaluating guidelines for WMSDs regarding determination of observer-specific evaluation, identification of repetitive number of evaluations for stable results for each checklist, determination of job-specific evaluation methods, and so on.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.24 no.4
• /
• pp.23-38
• /
• 1997

In this Study, indicators for the evaluation of environmental amenity were determined through the investigation of the resident's consciousness in all thirty one cities and counties of Kyonggi. Also, environmental amenity that the resident feel in terms of recognition level was evaluated and based on the determined environmental indicators, environmental amenity for the physical environmental situation was evaluated. By analyzing the results, basic data for the planning of the future environmental management were prepared. The results of this study can be summarized as follows First, the developed indicators for the evaluation of environmental amenity consist of four intermediate evaluation items and fifteen individual evaluation items, and fifty four evaluation standards in total . Two to five evaluation standards were determined for the respective individual evaluation items. Second, using the developed indicators, the evaluation of environmental amenity were implemented based on both resident's consciousness and statistical data. Third, by analyzing the difference between two evaluation results, future research plan was proposed.

• Korean Journal of Computational Design and Engineering
• /
• v.15 no.1
• /
• pp.51-59
• /
• 2010

People evaluate urban residential regions quite frequently and sensitively, considering issues such as locations or ease of use of in-site facilities or nearby urban facilities, and those results are bound to be reflected to real estate costs quite immediately. However, there have been frequently recurring questions regarding objectivity of evaluations in terms of results and methods reflected on indexes such as land costs for various reasons. RPMS -Residence Performance Management System- which targets currently in most cases on urban residential areas, suggests instrumental methodology of objective approach toward sensitive urban residence performance evaluation. This paper explains and suggests instrumental utilization of RPMS and its implementations, evaluation methodology and quantitative way of evaluation. In terms of implementation we explain issues such as adding target locations into new residence planning sites, quantification of properties on evaluation indexes of residential performance and/or habitability in terms of checklists, formulas for evaluation, delicate adjustment of evaluation results by setting weights on evaluation indexes, as well as reports on results. Research on appropriate weights and weight settings regarding evaluation indexes, however, exceeds the range of this paper so that this paper focuses on explaining residence performance evaluation and management methodology.

• The Journal of Korean Medicine
• /
• v.40 no.3
• /
• pp.21-34
• /
• 2019

Objectives: The purpose of this article is to develop steering of program accreditation system in Korean Medicine Education through meta-evaluation. For this study, the subjects of our research were categorized as the accreditation criteria and system, results and effects, tasks for improvement on Korean Medicine Education. Methods: We conducted Focus Group Interview on 102 full-time professors with experience of participating on accreditation of Korean Medicine Education from 12 college of Korean Medicine Education and we analyzed it by thematic analysis. Results: The accreditation criteria and program evaluation system of Korean Medicine were listed as 'Confusion about the goals of program evaluation', 'High hurdles on accreditation', 'obsession to success cases', 'Small college complaints about applying the same criteria', 'Dilemma of quantitative and qualitative evaluation'. The results and effects of program evaluation in Korean Medicine Education were listed as 'Establishment of base infrastructure for basic medical education', 'Benchmarking and exchanging opinions through evaluation certification', 'Resistance to documents and document-based evaluation', and 'Double-sided of evaluation certification'. As for the tasks for further improvement, the following list is suggested. 'Actively promote evaluation certification', 'Simplification and standardization of forms', 'Requesting for activating about Evaluation committee', 'Need for consulting before regular evaluation'. Conclusion: It is necessary to upgrade the accreditation system and make efforts to improve the issues discovered for better Korean Medicine Education.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10a
• /
• pp.87-90
• /
• 1996

Inherently safe plants are maintained through the systematic identification of potential hazards, and various hazard evaluation methods have been developed. Recently, much effort is given into the development of automated hazard evaluation system by introducing the expert system. An automated system will help to obtain consistency and to make the result more reliable. HAZOP study is one of the most systematic and logical evaluation procedure. However, it has disadvantages: experts should participate at the same time, the detailed study requires much man-hour, and the results depend on the expertise of the experts. Therefore, the automation of hazard evaluation is necessary to reduce the required time and to get the consistent evaluation results. In this study, HAxSYM, an expert system to automate HAZOP study, is developed. The case studies are performed to validate the effectiveness of the developed system, and the results are compared to the results of traditional method.