• Journal of Korea Society of Industrial Information Systems
• /
• v.13 no.5
• /
• pp.124-132
• /
• 2008

Most companies in Korea that are implementing six sigma programs evaluate belt's project performance based on their own evaluation systems. Financial performance is a major criterion to evaluate project performance. New project evaluation systems which are based on not only financial performance but also non-financial performance need to be presented for better performance system. The study presents the integration system of balanced scorecard and six sigma project evaluation systems to show balanced view points of performance. Each evaluation index of four view points are presented in the study and could be utilized for alternative project evaluation systems.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.27 no.1
• /
• pp.57-63
• /
• 2004

Evaluating a project is one of the key activities in managing projects, and thus it should be implemented as a part of the entire project management system. However, currently deployed systems suffer from deficiencies such as the lack of supporting distributed environment and integrity problems. Web service technology, which enables applications to work inter-operatively under a distributed computing environment, is said to solve such problems. In this paper, the web service technology is applied to evaluation management systems. The process of evaluation is designed based on the web service, data is modeled and a pilot system is implemented to test the feasibility of the technology to the domain of project evaluation.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.4
• /
• pp.157-169
• /
• 2021

Establishing an investment evaluation system for public ICT projects is ultimately to increase the success rate of public ICT projects in which government finances are invested and to revitalize the projects, thereby establishing a foundation for national economic growth and enhancing the competitiveness of the global ICT industry. This study tried to empirically verify the effect of public ICT project investment evaluation factors established according to the existing evaluation system on actual project success, and to suggest directions for future investment evaluation factors. Five evaluation factors such as public interest, economic feasibility, technology, policy and budget efficiency were derived through prior research, and the effect of these evaluation criteria on actual project success was verified through questionnaires from experts who directly participated in the actual project. In addition, it was confirmed whether the government's support system had a moderating effect between the investment evaluation factors and the project success of the ICT project. The reliability and validity of measurement tools, structural model analysis, and path analysis were empirically analyzed, and the significance of existing ICT investment evaluation factors was verified.

• Journal of Korean Institute of Industrial Engineers
• /
• v.1 no.1
• /
• pp.57-65
• /
• 1975

A perfect evaluation for scientists and engineers is impossible unless the R&D process is fully explored. But the study in this area is being intencified, and consequently progress is being made. In this paper an evaluation method for scientists and engineers in project-oriented R&D organizations is developed. That is, a method that the evaluation for the job performance directly influences personnel management such as promotion, and the evaluation for their potential, characteristics influences indirectly. Further systematization of evaluation process, which is no less importatant than evaluation itself, is attempted.

• Proceedings of the Korean Society of Agricultural Engineers Conference
• /
• 2005.10a
• /
• pp.429-435
• /
• 2005

This study attempts to develop indices in order to make an objective and effective evaluation of achievements in the first stage of operation of the Rural Village Development Project(RVDP) (the first 3 years of its operation). The results are as follows 1. Evaluation purposes are expansion of income-generating bases, improvement of living environments, strengthening of village's competence and establishment of an effective project's management system. 2. Evaluation items for the first three evaluation purposes, which are income-generating bases, improvement of living environments and strengthening of village's competence, are record of performance and substantiality in project's operation, results from operation, and capability in managing the project. Those for establishment of an effective project's management system are participation of habitants and the projects's management system. 3. As this study aims to develop the indices which can evaluate the state of operation in the interim of the project's operation and outcomes generated by then, the evaluation indices are selected by considering those criterions of representativeness, accessibility, usefulness and reliability. 4. As the indices developed in this study efficiency evaluate the process of project's operation and thus evaluate basically the project's operation on the basis of its efficiency. But, considering the purposes of the RVDP, it is included for the overall project's management system and plans for managing activities of the project to be evaluated on the basis of effectiveness.

• Journal of Korean Society of Rural Planning
• /
• v.29 no.4
• /
• pp.105-116
• /
• 2023

In this study, evaluation indicators for quantitative and qualitative indicators were presented by resetting the evaluation indicators for the selection of the living conditions renovation project for vulnerable residential areas by reflecting the results of expert importance. The appropriateness of the project selection evaluation index was reviewed by comparing the results of the expert AHP importance survey to make the project sustainable and to discover vulnerable villages. Evaluation items were constructed based on the guidelines for selecting the target site, and AHP importance evaluation was performed using this evaluation item as a proxy variable. Based on the data collected from 152 villages in Gimhae-si for case studies, the evaluation results were derived by applying the existing guideline evaluation indicators and evaluation indicators reflecting the importance proposed in this study. As a result of the study, Overall, there was a positive correlation between the results of the existing guideline evaluation and the results of the AHP importance survey, but in detail, there is a difference in the results evaluated by the two evaluation methods. In the future, if the scope of participating experts is expanded to supplement the importance evaluation, and the evaluation grade is set by analyzing quantitative data from Gyeongsangnam-do or rural areas nationwide, local governments and others will use this evaluation index as basic data when promoting the project.

• Journal of Information Technology Services
• /
• v.11 no.1
• /
• pp.109-123
• /
• 2012

There are many evaluation models to measure the informatization level of an organization and information system project in the ministry of National Defense of Korea. A information system has to keep up with the environment change as well as the advanced recent information technology (IT). Therefore, the evaluation of an information system project to enhance the performance of the information system should be different from the existing evaluation methods. This study suggests an evaluation case of information system projects to enhance the performance of an information system. In order to achieve the objective of this study, the following steps are taken. First, it reviews the background and the scope of the project to enhance the performance of the Defense Material Information System (DMIS). And it sets up the evaluation logic and develops performance indexes. Then it applies these newly developed performance indexes to the information system project and measures the performance. From this study, we found that both the diffusion and the experience accumulation by its continuous use are significant factors in such evaluations.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• Journal of Engineering Education Research
• /
• v.27 no.1
• /
• pp.63-70
• /
• 2024

The capstone design classes in the College of Engineering are often team project-oriented, and teamwork skills are reported to positively impact problem-solving abilities. While team project courses have various advantages, they also come with challenges such as social loafing and issues related to free riders, which consistently hinder the positive effects of team project courses. To prevent these issues, there is a need to provide a clear evaluation-reward system for team members' contributions. In this study, we examined the reliability of peer evaluation scores for team members' contributions and reviewed methods to incorporate them into team project grades. The review results indicated that peer evaluation scores are deemed to have considerable reliability from a qualitative perspective. However, due to the relatively small team size in team project courses (3 to 6 members per team), using the arithmetic mean of peer evaluation scores is statistically challenging. As a complementary approach, this study proposes limiting the reflection ratio of peer evaluation scores and applying a more macroscopic processing method, not the arithmetic mean, to incorporate peer evaluation scores for team contributions into grades.

• Journal of Korean Society of Rural Planning
• /
• v.12 no.2 s.31
• /
• pp.65-73
• /
• 2006

This study attempts to develop an interim evaluation system for the Integrated Rural Village Cluster Development Project(IRVCDP) which can secure its identity and sustainability, and induce its early settlement, and to derive plans for its steady progress. The evaluation system consists of three levels. The highest-order level is evaluation purposes, which describe IRVCDP's goals. They are expansion of income bases(EIB), improvement of living environments(ILE), strengthening of regional capabilities(SRC) and constructing effective project operation system(CEPOS). The second level is evaluation items, which each characterize the relevant evaluation purposes. The last level is evaluation indices, which observe achievement f3r evaluation purposes. 22 evaluation indices are selected to satisfy the purposes of this study through a brainstorming process and a survey on opinions of experts for those evaluation purposes and evaluation items which are derived from analyzing the IRVCDP's properties. The relative importance of the evaluation indices selected are determined through the AHP analysis. The most intriguing result from the AHP analysis is that strengthening of regional capabilities is found to be the most important one among evaluation purposes. It can be said that this result is parallel to a ultimate goal of the IRVCDP.