• Journal of the Korean Data and Information Science Society
• /
• v.19 no.4
• /
• pp.1255-1267
• /
• 2008

Evaluation indices for products or services are important to improve the internal process of the company and to compare those with competitive ones. The sigma level in Six Sigma management does important role to evaluate the core characteristic, CTQ(Critical To Quality), derived in the considered product/service or process. In this research, we propose an overall evaluation index for the product/service or process with multiple characteristics, in other words, multiple CTQs. The proposed overall evaluation index is useful for the cases that the single CTQ is not enough to evaluate the practical interests, for example, the final products and services with complex procedures and relatively large scaled processes. This approach is discussed with sigma level for applying Six Sigma Projects, however, it is applicable to indices based on proportion or percentage as well. The practical examples with a manufacturing process and a customer survey based on focus group interview are given for illustrations.

• Journal of Information Technology Services
• /
• v.7 no.4
• /
• pp.151-165
• /
• 2008

This study suggests the organization-level standard(model and process) for quality evaluation of information systems(IS) in non-use organizations despite international standards(ISO/IEC 9126 and ISO/IEC 14598) and national standards(KS X 9126 and KS X 14598) related to quality evaluation of IS. The standard in this study is composed of quality evaluation processes, a quality model, and quality metrics. The weights of the attributes and the sub-attributes in the quality model were calculated by an analytic hierarchy process(AHP). The minimum level and the target level of each metrics were determined by brainstorming of the committee. Furthermore, the case study for the investigation of the applicability and the usability of the suggested organizational standard in the real IS development project was performed. For gaining significant benefits of the standard, both the diffusion and the experience accumulation by its continuous use are needed.

• Journal of Korea Technology Innovation Society
• /
• v.4 no.3
• /
• pp.275-290
• /
• 2001

The frameworks for evaluation of national R&D programs reflect their various political and administrative cultures(Gibbons & Georghiou, 1987), and the structure of national R&D system. In this research the core research questions are : what is god evaluation\ulcorner What is being evaluated, by whom, by which criteria, for whom and what purpose\ulcorner In order to examine these general aims and answer these questions, in detail several objectives can be proposed on the process of this research. In this research, the national R&D programs will be considered in terms of the interface between evaluation and the wider policy-making process. The programs for case study are the Alvey program(UK), the Advanced Technology Program (US) and the Framework program(EU) . One of the characteristics of these programs is the well established evaluation systems they have. From the comparative analysis, we can withdraw some useful implication for Korean evaluation practice for national R&D programs. Evaluation system is social process and the way in which it is organized is critical to its outcome.

• The Journal of Information Systems
• /
• v.16 no.3
• /
• pp.109-132
• /
• 2007

In the paper, we builds an advanced new credit evaluation system for Micro-small sized individual firms through appropriate evaluation factors derived by logistic regression analysis for credit evaluation model using in Korean Federation of Credit Guarantee Foundations, and the weights of factors computed by analytic hierarchy process(AHP). Industry characteristics are more applied to previous credit model with the additional the financial fact-information and non-financial judgement-information. Our results show that the financial factors have become more important than three years ago. Moreover, in the non-financial factors, the fact-information factors consider more important then the judgement-information factors. A new credit evaluation system is developed based on this credit evaluation model.

• Journal of Nutrition and Health
• /
• v.39 no.1
• /
• pp.74-83
• /
• 2006

The purposes of this study were to (1) identify the evaluation categories, areas, attributes, and criteria of the school food service program using both a qualitative and a quantitative analyses, (2) define the relative importance of the evaluation categories, areas, attributes, and criteria of the school food service program using analytic hierarchy process, (3) organize the evaluation system to improve quality of the school food service in Korea. A survey was conducted from August to October 2004 to collect data from 172 dietitians, 15 school food service officials at the educational board, 10 professionals of school food service. Statistical analyses were performed on the data utilizing the SPSS 12.0 for Windows and Excel, such as Descriptive statistics and analytic hierarchy process was performed. The result of the analytic hierarchy process indicated that relative importance of evaluation category was 0.4319 (food service manage ment), 0.2369 (nutrition education), 0.1455 (satisfaction) and 0.0912 (parent involvement program). 'Sanitation, safety and facility (0.1739)' was the most important area among the subcategories of food service management, followed by nutrition management (0.1581), procurement (0.1375), production (0.1345), organization and personnel management (0.0662), planning (0.0644), food service evaluation (0.0585), financial accountability (0.0555), and information management (0.0554). There existed a relative importance on the three areas of the nutrition program and satisfaction evaluation category: students (0.5281, 0.6221), parents (0.1812, 0.1491), and teachers (0.1838, 0.1618). In the parent involvement program evaluation category, relative importance of committee and monitoring management was 0.4658 and information communication was 0.3724. The quality of food and service to school children can be improved by the appropriate application of the developed evaluation tool for the school food service program.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.13 no.1
• /
• pp.87-98
• /
• 2012

The Ministry of Education, Science and Technology has been implementing the government's recognition project regarding the program accrediting organizations in Higher Education. This research is to establish an evaluation model for the government's recognition process of the program accrediting organizations, and develop the evaluation categories, items and indices for the model. The research has set the concept for the government's recognition regarding the program accrediting organizations and designed an evaluation model for such organizations. The evaluation model embraces a preliminary evaluation process, assessing an eligibility of the accrediting organizations for the higher education based on the formalities set forth for the government recognition organization accrediting process. It also includes the main evaluation process, which assess the eligibility based on the evaluation standards stipulated in the associated legislation and regulations. In addition, through in-depth verification processes by experts, this research finalized 2 evaluation domains, 5 evaluation categories, 24 evaluation items and 33 evaluation indices.

• Journal of the Korean Society of Earth Science Education
• /
• v.16 no.2
• /
• pp.182-195
• /
• 2023

The purpose of this study was to analyze reports from research middle schools based on the criteria for process-focused assessment to find out how the characteristics of process-focused assessment were being implemented in middle school science classes. The analysis criteria for the characteristics of process-focused assessment (integration of lessons and assessments, evaluation elements and methods, content and timing of feedback, and learner growth management) were extracted. Using the analysis framework, the result reports of seven research middle schools for process-focused assessment were analyzed. In terms of integration of lessons and assessments, when the process-focused assessment was operated, the class and evaluation plan were well implemented based on the curriculum achievement standards, but the process-focused assessment was recognized as a performance evaluation. In terms of evaluation elements and methods, the evaluation element for knowledge was the main component, and competency was presented in the planning stage, but competency was not dealt with in class execution. The evaluation method was biased toward teacher-centered observation evaluation and written test, and the setting of scoring criteria for each evaluation element was insufficient. In terms of the content and timing of feedback, feedback was mainly provided based on achievement confirmation, but no case was found in which scaffolding was provided at an appropriate time for insufficient parts in the learning process. In terms of the learner's growth management, the competencies cultivated through science classes were included in the detailed subject specialties of the school record. However, little was shown in the report on how to systematically manage the process of developing learners' competencies and reflect the evaluation results to teachers' class improvement.

• Journal of Korean Society of Water and Wastewater
• /
• v.23 no.4
• /
• pp.417-430
• /
• 2009

A BNR comprehensive performance evaluation (BNR CPE) system was established employing system-oriented evaluation methodology for biological nutrient removal (BNR) processes based on the CPE techniques developed by U.S. EPA for evaluation of conventional biological processes. The BNR CPE system applied to five domestic BNR plants adopting $A^2/O$ process confirmed that all target plants except the smallest one had not any serious defective performance and process stability was enhanced with increasing plant size. The system also clearly verified relatively poor performances in anoxic reactors without exception mainly due to influent carbon limit rather than functional defect. Consistent good performances were confirmed even during both winter season and wet weather generally known to be difficult to achieve satisfactory removals. Presentation of evaluation results by modified radar chart system simplified and clarified the evaluation and analysis procedures. The BNR CPE system could not only discover readily the causes of present and prospective poor performances but also facilitate the suggestion of their optimization options. Mutual effect and cause-and-effect among operation parameters and unit processes were also found easily using the evaluation system. The system justified that the adverse effect of defective operating parameters could be compensated by other favorable parameters, especially in anaerobic and anoxic reactors as well as during the winter season.

• The Korean Journal of Food And Nutrition
• /
• v.23 no.4
• /
• pp.470-477
• /
• 2010

The purposes of this study were to identify the evaluation categories, areas, attributes of the hospital food service and to define the relative importance of the evaluation categories, areas, attributes of the hospital food service using analytic hierarchy process. A survey was conducted from January 8th to 25th in 2007. Questionnaires were mailed to the 310 directors of dietetic departments of hospitals that included 160 primary hospitals, 107 secondary hospitals, and 43 tertiary hospitals. The result of the analytic hierarchy process indicated that relative importance of evaluation category was 0.5259 for food service management and 0.3407 for nutrition care. The food service management consisted of four subcategories, which are equipment standard, sanitation, production, and delivery service. Sanitation(relative importance: 0.2652) was the most important area among the subcategories and it was followed by equipment standard(0.2067), delivery service(0.1864) and production(0.1848). The nutrition care has two subcategories, menu management and meal management. The relative importance of menu management(0.4174) was higher than that of meal management(0.3555). The quality of food service and nutrition care to inpatients can be improved by the evaluation system based on appropriate applications of the developed evaluation indicators for hospital food service systems.

• Asian Journal of Innovation and Policy
• /
• v.9 no.3
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.