• Title/Summary/Keyword: Evaluation of research projects

Search Result 633, Processing Time 0.027 seconds

Exploring Long-Term Performance in Design-Build Best-Value Evaluation Criteria

  • Calahorra-Jimenez, Maria;Poore, Tanner
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.74-82
    • /
    • 2022
  • Improving long-term performance in highway projects is an imperative goal for public administrations. Project delivery and procurement methods might provide an opportunity to align design and construction processes with this goal. Previous studies have explored whether project delivery methods impact the long-term performance of highway projects. However, these studies did not focus specifically on how core elements within the procurement might relate to long-term performance. Thus, this research aims to fill this gap by exploring to what extent and how long-term evaluation criteria are considered in design-build best-value procurement of highway projects. To this end, content analysis was conducted on 100 projects procured between 2009 and 2019 by 19 DOTs across the U.S. The analysis of 365 evaluation criteria found that (1) roughly 11% of them related to long-term performance. (2) The weight given to these criteria in the overall technical proposal was lower than 30%. (3) Sixty-five percent (65%) of long-term evaluation criteria focused on design while 15% related to materials and technology, respectively. The results of this study are a first steppingstone to initiate a deep exploration of the relationship between procurement practices and actual project performance. Currently, with sustainability and life cycle assessments being top concerns in infrastructure projects, this line of research might be of particular interest to DOTs and highway agencies across the U.S. and worldwide.

  • PDF

An Evaluation of Information Systems Services in the Public Sector: Knowledge Management Approach (공공부문 정보화사업평가 - 지식경영 측면의 접근)

  • Lim, Joon Hyoung;Myung, Sung-Jun;Kim, Jae-Young
    • Knowledge Management Research
    • /
    • v.18 no.3
    • /
    • pp.231-246
    • /
    • 2017
  • As an interest in the efficiency of public sector expenditures has spread across the world, Korea has operated a self-evaluation system for government projects as a part of the performance-based budget system. However, an evaluation system for public information technology project has been criticized for its lack of validity, which stems from the uniformity of performance management. This study draws insight from knowledge management literature in an attempt to address the problems with the extant performance evaluation system in public agencies. To realize benefits from IT investment, an agency needs to develop its own performance management model for information systems projects, with a focus on the interaction of IT and organizational system. The knowledge management-based framework for IT projects was verified through a case study, with which we discussed the applicability of knowledge management to the evaluation of public information systems projects.

원자력연구개발사업의 사후평가를 위한 계층화 분석법 (AHP)의 적용

  • 곽승준;유승훈;신철오
    • Journal of Technology Innovation
    • /
    • v.10 no.1
    • /
    • pp.201-217
    • /
    • 2002
  • Researchers, institutes, and government involved in research & development (R&D) are faced with the problem of performing R&D project evaluations. As a real-word case of evaluation, we elicited and reproduced the evaluation process of the national nuclear R&D projects, using a specific case study of Korea. In the methodology, the analytic hierarchy process (AHP) is employed to evaluate and rank the selected nuclear R&D projects which have a wide range of evaluation objectives and characteristics. As a result, we obtained relative ranking for research projects and importance of evaluation criteria. The method and implications can be easily understood and applied by practitioners since it follows naturally the standard practice of evaluating and relative comparisons of performance using evaluation procedures. By applying particular R&D project output to the procedures, project evaluators can compare and prioritize evaluation objectives.

  • PDF

A Comparative Study of Healthy City Project Evaluation in U.K. and Korea: Focusing on Liverpool City and Wonju City (영국과 한국의 건강도시 사업 평가방법 비교 연구: 리버풀과 원주시를 중심으로)

  • Kang, Shin Hee;Nam, Eun Woo;Moon, Ji Young
    • Korean Journal of Health Education and Promotion
    • /
    • v.30 no.2
    • /
    • pp.93-103
    • /
    • 2013
  • Objectives: This study was to compare two healthy cities, Liverpool in England and Wonju in Korea, which evaluated healthy city projects and to reorient evaluation strategy which fits into Korean Healthy cities. Methods: Comparatives analysis was used by reviewing documents, healthy city plan and evaluation report, of two cities. Results: Healthy city projects in two cities, fifteen programs were identical items among twenty-seven but there were differences in seven items for Liverpool and five items for Wonju. In Liverpool evaluation was done by a stakeholder group called Liverpool Local Involvement Network(LINK), while in Wonju by Yonsei Healthy City Research Center. The evaluation tool was two types; quantitative and qualitative analysis. Liverpool mostly used qualitative and added quantitative, vice versa in Wonju. Conclusions: Evaluation plan for Healthy city projects need to be made in the first phase of the projects, instead of in the end. Moreover, it is important to include stakeholder in conducting qualitative analysis for unquantifiable evidence of effectiveness, as well as quantitative analysis.

A DEA/AHP Hybrid Model for Evaluation & Selection of R&D Projects (연구개발사업의 평가 및 선정을 위한 DEA/AHP 통합모형에 관한 연구)

  • 임호순;유석천;김연성
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.24 no.4
    • /
    • pp.1-12
    • /
    • 1999
  • This paper presents a DEA-AHP hybrid model to evaluate and select R&D projects. AHP collects and processes information on the weights of evaluation criteria. The processed information is used as an input for DEA/AR model. Only desirable number of projects are selected by the hybrid model. The model is examined by an example generated from a real data set.

  • PDF

A Design of Cross Effect Evaluation System for Estimating the Effectiveness of R&D Projects (R&D프로젝트군의 효과추정을 위한 복합효과 평가시스템의 설계)

  • 강일중;권철신;박준호
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2003.11a
    • /
    • pp.21-24
    • /
    • 2003
  • $\ulcorner$Cost Effectiveness Analysis$\lrcorner$ has been widely used to evaluate the effectiveness of R&D resources. But, almost of cost effectiveness evaluation systems have some problems, especially the cross effect among R&D projects has not been considered. To solve this problem, we have designed a new $\ulcorner$Cross Effect Evaluation System(CEES)$\lrcorner$, which are able to estimate multi-effects and cross effects by completion time among several projects.

  • PDF

An Intelligent Management System for Evaluating Science Research Projects

  • Chen, Zhi-Yu;Chen, Shi-Quan;Wu, Jin-Pei
    • Industrial Engineering and Management Systems
    • /
    • v.4 no.1
    • /
    • pp.109-116
    • /
    • 2005
  • Proposed in this paper is an intelligent management system for evaluating science research projects based on fuzzy neural networks with genetic algorithms. This system was planned, designed and tested employing theories and approaches of software engineering. This system was then applied to evaluate science research projects of the Natural Science Foundation of Guangdong Province, People’s Republic of China. The outcome / results shows the feasibility and validity of the system and its possible application to other intelligent management systems.

Performance Analysis Framework for Post-Evaluation of Construction Projects through Benchmarking from Advanced Countries (선진국 사례 벤치마킹을 통한 건설공사 사후평가 성과분석 체계 개발)

  • Lee, Kang-Wook
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.25 no.6_2
    • /
    • pp.1017-1027
    • /
    • 2022
  • Development of social overhead capital (SOC) requires huge national finance, and performance issues such as cost-efficiency, safety, and environment have been constantly raised. However, currently each construction client has limited access to its own projects' performance without analytic methodology for industry-level comparisons and benchmarking for improvement. To overcome this problem, this study proposes a comprehensive performance analysis framework for post-evaluation of large-scale construction projects. To this end, this study performed a case study of advanced countries (the U.S., the U.K. and Japan) and consultation with related experts to develop a tailored performance analysis framework for the Post- Construction Evaluation and Management system in Korea. The developed framework covers three categories (project performance, project efficiency, and ripple effect), nine areas (cost, schedule, change, safety, quality, demand, benefit-cost ratio, civil complaint, and defect), and 31 detailed metrics. Using industry-level project performance database and statistical techniques, the proposed framework can be used not only to diagnose excellent and unsatisfactory performance areas for completed construction projects, but also to provide reference data for future similar projects. This study can contribute to the improvement of clients' performance management practices and effectiveness of construction projects.

Teaching-Learning Model of Convergence Project Based on Team Teaching in Engineering Education (공학교육에서의 팀티칭기반 융합프로젝트중심 교수학습모형의 개발)

  • Park, Kyungsun
    • Journal of Engineering Education Research
    • /
    • v.17 no.2
    • /
    • pp.11-24
    • /
    • 2014
  • The purpose of this study is to develop a teaching-learning model of convergence project based on team teaching. Based on development research methodology which explored a university case, the teaching-learning model was developed including three phases such as preparation, planning, and implementation & evaluation. The preparation phase has three steps as follows: to organize team teaching faculty; to develop convergence projects cooperated by industry and university; and to design instructions based on supporting convergence projects. The last step of preparation phase consists of five design activities of: (1) instructions and teaching contents; (2) communication channel among faculty members; (3) feedback system on students' performance; (4) tools to support learners' activity; and (5) evaluation system. The planning phase has two steps to analyze learners and to introduce and modify instruction and themes of convergence projects. The implementation & evaluation phase includes five steps as bellow: (1) to organize project teams and match teams with faculty members; (2) to do team building and assign duties to students of a team; (3) to provide instruction and consulting to teams; (4) to help teams to conduct projects through creative problem solving; and (5) to design mid-term/final presentation and evaluation. Lastly, the research implications and limitations were discussed for future studies.

Study on the Development of an Evaluation Index for the Local Economy Activation of Community Investment Renewable Energy Projects (대규모 주민참여형 재생에너지 사업의 지역경제 활성화 평가지표 개발 연구)

  • Im, Hyunji;Yun, Seonggwon;Yoon, Taehwan;Kim, Yunsoung
    • New & Renewable Energy
    • /
    • v.17 no.2
    • /
    • pp.9-23
    • /
    • 2021
  • In Korea, various community investment renewable project models are being implemented to increase community acceptance of renewable energy. An important factor for enhancing local acceptance is that renewable energy projects have a positive effect on revitalizing the local economy such as income increase or job creation for residents and local companies. To maximize the local economic effect of large-scale community investment renewable energy projects, this study developed an evaluation index for local economy activation, whose indicators are the local return on investment, local companies' participation, local job creation, regional cooperation, transparency, and governance. Analysis of existing evaluation indicators and current renewable projects, financial analysis, and expert interviews were used in this research. The pilot evaluation determined that, the local economic effect was high in the following order: a fund investment wind project (Gangwon), benefit-sharing wind project (Jeju), and general wind project. In particular, residents' investment amount, the number of participating residents, and the amount and transparency of the regional cooperation fund were key factors to expand the effect of local economy activation. This evaluation index could be used in public bidding for renewable energy projects such as offshore wind zoning areas of local government.