• Journal of the Korean Data and Information Science Society
• /
• 제19권4호
• /
• pp.1255-1267
• /
• 2008

Evaluation indices for products or services are important to improve the internal process of the company and to compare those with competitive ones. The sigma level in Six Sigma management does important role to evaluate the core characteristic, CTQ(Critical To Quality), derived in the considered product/service or process. In this research, we propose an overall evaluation index for the product/service or process with multiple characteristics, in other words, multiple CTQs. The proposed overall evaluation index is useful for the cases that the single CTQ is not enough to evaluate the practical interests, for example, the final products and services with complex procedures and relatively large scaled processes. This approach is discussed with sigma level for applying Six Sigma Projects, however, it is applicable to indices based on proportion or percentage as well. The practical examples with a manufacturing process and a customer survey based on focus group interview are given for illustrations.

• 한국IT서비스학회지
• /
• 제7권4호
• /
• pp.151-165
• /
• 2008

This study suggests the organization-level standard(model and process) for quality evaluation of information systems(IS) in non-use organizations despite international standards(ISO/IEC 9126 and ISO/IEC 14598) and national standards(KS X 9126 and KS X 14598) related to quality evaluation of IS. The standard in this study is composed of quality evaluation processes, a quality model, and quality metrics. The weights of the attributes and the sub-attributes in the quality model were calculated by an analytic hierarchy process(AHP). The minimum level and the target level of each metrics were determined by brainstorming of the committee. Furthermore, the case study for the investigation of the applicability and the usability of the suggested organizational standard in the real IS development project was performed. For gaining significant benefits of the standard, both the diffusion and the experience accumulation by its continuous use are needed.

• 기술혁신학회지
• /
• 제4권3호
• /
• pp.275-290
• /
• 2001

The frameworks for evaluation of national R&D programs reflect their various political and administrative cultures(Gibbons & Georghiou, 1987), and the structure of national R&D system. In this research the core research questions are : what is god evaluation\ulcorner What is being evaluated, by whom, by which criteria, for whom and what purpose\ulcorner In order to examine these general aims and answer these questions, in detail several objectives can be proposed on the process of this research. In this research, the national R&D programs will be considered in terms of the interface between evaluation and the wider policy-making process. The programs for case study are the Alvey program(UK), the Advanced Technology Program (US) and the Framework program(EU) . One of the characteristics of these programs is the well established evaluation systems they have. From the comparative analysis, we can withdraw some useful implication for Korean evaluation practice for national R&D programs. Evaluation system is social process and the way in which it is organized is critical to its outcome.

• 한국정보시스템학회지:정보시스템연구
• /
• 제16권3호
• /
• pp.109-132
• /
• 2007

In the paper, we builds an advanced new credit evaluation system for Micro-small sized individual firms through appropriate evaluation factors derived by logistic regression analysis for credit evaluation model using in Korean Federation of Credit Guarantee Foundations, and the weights of factors computed by analytic hierarchy process(AHP). Industry characteristics are more applied to previous credit model with the additional the financial fact-information and non-financial judgement-information. Our results show that the financial factors have become more important than three years ago. Moreover, in the non-financial factors, the fact-information factors consider more important then the judgement-information factors. A new credit evaluation system is developed based on this credit evaluation model.

• Journal of Nutrition and Health
• /
• 제39권1호
• /
• pp.74-83
• /
• 2006

The purposes of this study were to (1) identify the evaluation categories, areas, attributes, and criteria of the school food service program using both a qualitative and a quantitative analyses, (2) define the relative importance of the evaluation categories, areas, attributes, and criteria of the school food service program using analytic hierarchy process, (3) organize the evaluation system to improve quality of the school food service in Korea. A survey was conducted from August to October 2004 to collect data from 172 dietitians, 15 school food service officials at the educational board, 10 professionals of school food service. Statistical analyses were performed on the data utilizing the SPSS 12.0 for Windows and Excel, such as Descriptive statistics and analytic hierarchy process was performed. The result of the analytic hierarchy process indicated that relative importance of evaluation category was 0.4319 (food service manage ment), 0.2369 (nutrition education), 0.1455 (satisfaction) and 0.0912 (parent involvement program). 'Sanitation, safety and facility (0.1739)' was the most important area among the subcategories of food service management, followed by nutrition management (0.1581), procurement (0.1375), production (0.1345), organization and personnel management (0.0662), planning (0.0644), food service evaluation (0.0585), financial accountability (0.0555), and information management (0.0554). There existed a relative importance on the three areas of the nutrition program and satisfaction evaluation category: students (0.5281, 0.6221), parents (0.1812, 0.1491), and teachers (0.1838, 0.1618). In the parent involvement program evaluation category, relative importance of committee and monitoring management was 0.4658 and information communication was 0.3724. The quality of food and service to school children can be improved by the appropriate application of the developed evaluation tool for the school food service program.

• 한국산학기술학회논문지
• /
• 제13권1호
• /
• pp.87-98
• /
• 2012

교육과학기술부는 고등교육 프로그램 평가인증기관에 대한 정부 인정 사업을 추진해왔다. 이에 본 연구는 정부가 프로그램 평가인증기관을 인정하는 평가모형을 설정하고, 평가부문 및 평가항목, 평가지표를 개발하는데 목적이 있다. 이를 위해 본 연구는 프로그램 평가인증기관에 대한 정부인정의 개념을 설정하고, 프로그램 평가인증기관에 대한 정부인정 평가모형을 설계하였다. 평가 모형은 고등교육 프로그램 평가인증기관에 대한 정부인정사업의 절차를 반영하여 정부인정기관으로서의 기본적인 요건에 부합되는지 여부에 대한 적격성 검토를 수행하는 예비평가단계, 법령 및 관련 규정에 제시된 평가영역별 지정기준에 대한 충족 여부를 검증하는 본 평가단계의 과정으로 설정하였다. 아울러 평가영역에 따라 평가부문, 평가항목 및 평가지표들을 개발하였고, 심층적 검증을 위해 평가전문가들의 검토를 거쳐 2개 평가영역, 5개 평가부문, 24개 평가항목 및 33개 평가지표를 확정하였다.

• 대한지구과학교육학회지
• /
• 제16권2호
• /
• pp.182-195
• /
• 2023

이 연구에서는 과정중심평가의 특징이 중학교 과학 교육 현장에서는 어떻게 구현되고 있는지를 살펴보기 위해 연구학교 보고서를 분석하였다. 과정중심평가 운영 지표 또는 진단 도구를 제시한 6개의 선행연구 분석을 통해서 과정중심평가의 특징에 대한 분석 관점(수업과 평가의 통합, 평가 요소와 평가 방법, 피드백 내용과 시기, 학습자의 성장 관리)을 추출하였다. 그 분석틀을 이용하여 교육부 및 시·도 교육청 주관으로 운영한 7개 중학교의 과정중심평가 연구학교 결과 보고서를 분석하였다. 연구 결과, 수업과 평가의 통합 측면에서는 과정중심평가를 운영할 때 교육과정의 성취기준에 기반하여 수업과 평가 계획이 잘 구현되고 있었으며, 모든 보고서에서는 과정중심평가를 수행평가로 인식하고 있었다. 평가 요소와 평가 방법 측면에서는 지식에 대한 평가 요소가 주를 이루고 있고, 역량을 계획 단계에서는 제시하고 있으나 수업 실행에서는 다루지 않는 경우가 많았다. 그리고 평가 방법은 교사 중심의 관찰 평가와 보고서 평가에 치우쳐져 있고, 각 평가 요소에 대해 채점 기준의 설정이 미흡했다. 피드백 내용과 시기 측면에서 피드백은 주로 성취도 확인 측면에서 제공하였으며 학습과정에서 부족한 부분에 대한 비계를 적절한 시기에 제공한 사례는 찾지 못하였다. 학습자의 성장 관리 측면에서 과학 수업을 통해 함양된 역량은 생활기록부의 과목별 세부 특기사항에 기재하는 형태로 관리하고 있었으며, 학습자의 역량 성장 과정을 체계적으로 관리하고 평가의 결과를 교사의 수업 개선에 반영하는 내용은 보고서에 거의 나타나지 않았다.

• 상하수도학회지
• /
• 제23권4호
• /
• pp.417-430
• /
• 2009

A BNR comprehensive performance evaluation (BNR CPE) system was established employing system-oriented evaluation methodology for biological nutrient removal (BNR) processes based on the CPE techniques developed by U.S. EPA for evaluation of conventional biological processes. The BNR CPE system applied to five domestic BNR plants adopting $A^2/O$ process confirmed that all target plants except the smallest one had not any serious defective performance and process stability was enhanced with increasing plant size. The system also clearly verified relatively poor performances in anoxic reactors without exception mainly due to influent carbon limit rather than functional defect. Consistent good performances were confirmed even during both winter season and wet weather generally known to be difficult to achieve satisfactory removals. Presentation of evaluation results by modified radar chart system simplified and clarified the evaluation and analysis procedures. The BNR CPE system could not only discover readily the causes of present and prospective poor performances but also facilitate the suggestion of their optimization options. Mutual effect and cause-and-effect among operation parameters and unit processes were also found easily using the evaluation system. The system justified that the adverse effect of defective operating parameters could be compensated by other favorable parameters, especially in anaerobic and anoxic reactors as well as during the winter season.

• 한국식품영양학회지
• /
• 제23권4호
• /
• pp.470-477
• /
• 2010

The purposes of this study were to identify the evaluation categories, areas, attributes of the hospital food service and to define the relative importance of the evaluation categories, areas, attributes of the hospital food service using analytic hierarchy process. A survey was conducted from January 8th to 25th in 2007. Questionnaires were mailed to the 310 directors of dietetic departments of hospitals that included 160 primary hospitals, 107 secondary hospitals, and 43 tertiary hospitals. The result of the analytic hierarchy process indicated that relative importance of evaluation category was 0.5259 for food service management and 0.3407 for nutrition care. The food service management consisted of four subcategories, which are equipment standard, sanitation, production, and delivery service. Sanitation(relative importance: 0.2652) was the most important area among the subcategories and it was followed by equipment standard(0.2067), delivery service(0.1864) and production(0.1848). The nutrition care has two subcategories, menu management and meal management. The relative importance of menu management(0.4174) was higher than that of meal management(0.3555). The quality of food service and nutrition care to inpatients can be improved by the evaluation system based on appropriate applications of the developed evaluation indicators for hospital food service systems.

• Asian Journal of Innovation and Policy
• /
• 제9권3호
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.