• 국제학술발표논문집
• /
• The 1th International Conference on Construction Engineering and Project Management
• /
• pp.397-402
• /
• 2005

Professional Construction Management (PCM) services have become more and more popular in Taiwan in the past decade. However, disputes between PCM consultant and the client on the performance of PCM services are also increasing. The evaluation of PCM performance is a tough task due to the lack of "physical product", such as the drawings finished by the architect. This paper is intended to propose a PCM performance evaluation system (PPES) based on Balanced Scorecard (BSC). A case study of PCM consultancy for a real world design/build project is conducted to demonstrate the applicability of the proposed BSC framework

• 대한안전경영과학회지
• /
• 제15권1호
• /
• pp.293-301
• /
• 2013

The purpose of this study is to introduce the limit of previously used six sigma quality process evaluation metrics, $Z_{st}$ and $P_{pk}$, and a solution to overcome this drawback by using a metric based on performance evaluation of Z-factor quality innovation. Case analysis on projects from national six sigma contest from 2011 to 2012 is performed and literature review on new drug development HTS (High Throughput Screening) is used to propose innovative performance evaluation metrics. This research shows that experimental study on six sigma evaluation metric, $Z_{st}$ and $P_{pk}$, have no significance difference between industrial type (Manufacturing, Semi-Public Institute, Public Institute) and CTQ type (Product Technology Type CTQ, Process Technology Type CTQ). Following discovery characterize this quality improvement as fixed target type project. As newly developed moving target type of quality innovation performance metric Z-Factor is used for evaluating experimental study, hypothetical analysis suggests that $Z_{st}$ and $P_{pk}$ share different relationship or even show reciprocal relationship. Constraints of the study are relatively small sample size of only 37 projects from past 2 years and conflict on having interview and communication with six sigma quality practitioner for qualitative experimental study. Both moving target type six sigma innovation project and fixed target type improvement project or quality circle enables efficient ways for a better understanding and quality practitioner use by applying quality innovation performance metric. Downside of fixed target type quality performance evaluation metric, $Z_{st}$ and $P_{pk}$, is presented through experimental study. In contrast, advantage of this study is that high throughput requiring product technology, process technology and quantum leap typed innovation effect is evaluated based on precision and accuracy and Z-Factor that enables relative comparison between enterprises is proposed and implemented.

• 한국농공학회:학술대회논문집
• /
• 한국농공학회 2005년도 학술발표논문집
• /
• pp.429-435
• /
• 2005

This study attempts to develop indices in order to make an objective and effective evaluation of achievements in the first stage of operation of the Rural Village Development Project(RVDP) (the first 3 years of its operation). The results are as follows 1. Evaluation purposes are expansion of income-generating bases, improvement of living environments, strengthening of village's competence and establishment of an effective project's management system. 2. Evaluation items for the first three evaluation purposes, which are income-generating bases, improvement of living environments and strengthening of village's competence, are record of performance and substantiality in project's operation, results from operation, and capability in managing the project. Those for establishment of an effective project's management system are participation of habitants and the projects's management system. 3. As this study aims to develop the indices which can evaluate the state of operation in the interim of the project's operation and outcomes generated by then, the evaluation indices are selected by considering those criterions of representativeness, accessibility, usefulness and reliability. 4. As the indices developed in this study efficiency evaluate the process of project's operation and thus evaluate basically the project's operation on the basis of its efficiency. But, considering the purposes of the RVDP, it is included for the overall project's management system and plans for managing activities of the project to be evaluated on the basis of effectiveness.

• Journal of information and communication convergence engineering
• /
• 제6권3호
• /
• pp.323-326
• /
• 2008

Data Envelopment Analysis (DEA) is a theoretically sound framework for performance analysis that offers many advantages over traditional methods such as performance ratios and regression analysis. Largely the result of multidisciplinary research during the last three decades in economics, engineering and management, DEA is best described as an effective new way of visualizing and analyzing performance data. Besides, overseas information technology companies have aggressively tried to enter the domestic market. In the age of globalization and high competition, it is imperative that the system integration (SI) companies need to introduce the performance evaluation models of SI projects, including Capability Maturity Model and Software Process Improvement and Capability Determination, to gain a competitive advantage. Therefore, it makes our research regarding evaluation of SI projects very opportune. The purpose of the study is not only to evaluate efficiency of each project by DEA but also to gain insight into various factors such as project complexity, team members' man-months structure, and process index(project management index) that link to the projects performance.

• 기술혁신학회지
• /
• 제1권1호
• /
• pp.117-124
• /
• 1998

Corporations are pursuing maximum returns from their R&D investment. They are also interested in sound measures to quantify returns. In fact, they use various measures and criteria for measuring returns from the R&D investment. But the fundamental problem is that there is no generic and widely acceptable measures and criteria. To make things more complicated, measures are very powerful and influential to the people in the corporations. Herbert Simon already indicated that people do many things but people usually do their best for the only tasks which are measured. Many researchers, like Chester(1995), are interested in R&D productivity measures and risks because what the company measures really influence R&D people and output. This article present design concepts of the R&D project selection and evaluation system in POSCO(Pohang Iron & Steel Company). This is an output extract from the 6-month joint activities with POSRI(POSCO Research Institute) researchers and POSCO R&D personnel. Process changes, new organizations and new selection and evaluation criteria are developed to improve R&D performance and to enhance technology management of the POSCO. This article covers new selection and evaluation criteria only. We would like to share our experience about how we redesign the selection and evaluation of R&D projects. We also bring insights how we seamlessly integrate 4 different project selection and evaluation steps as a whole. We hope that this case will give you a clue to improve your R&D management.

• 수산경영론집
• /
• 제42권3호
• /
• pp.15-29
• /
• 2011

The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.

• 기술혁신연구
• /
• 제10권1호
• /
• pp.201-217
• /
• 2002

Researchers, institutes, and government involved in research & development (R&D) are faced with the problem of performing R&D project evaluations. As a real-word case of evaluation, we elicited and reproduced the evaluation process of the national nuclear R&D projects, using a specific case study of Korea. In the methodology, the analytic hierarchy process (AHP) is employed to evaluate and rank the selected nuclear R&D projects which have a wide range of evaluation objectives and characteristics. As a result, we obtained relative ranking for research projects and importance of evaluation criteria. The method and implications can be easily understood and applied by practitioners since it follows naturally the standard practice of evaluating and relative comparisons of performance using evaluation procedures. By applying particular R&D project output to the procedures, project evaluators can compare and prioritize evaluation objectives.

• 한국원자력학회:학술대회논문집
• /
• 한국원자력학회 2005년도 춘계학술발표회
• /
• pp.9-10
• /
• 2005

• 산업공학
• /
• 제24권4호
• /
• pp.314-322
• /
• 2011

This study analyzes a relationship between Data Envelopment Analysis(DEA) efficiency scores and a normalization index in order to examine the validity of DEA models. A normalization index concerned in this study is 'sales per R&D project fund' which is regarded as a crucial R&D project performance evaluation index in practice. For this correlation analysis, three distinct DEA models are selected such as DEA basic model, DEA/AR-I revised model(i.e. DEA basic model with Acceptance Region Type I constraints) and Super-Efficiency(SE) model. Especially, SE model is adopted where efficient R&D projects(i.e. Decision Making Units, DMU's) with DEA efficiency score of unity from DEA basic model can be further differentiated in ranks. Considering the non-normality and outliers, two rank correlation coefficients such as Spearman's ${\rho}_s$ and Kendall's ${\tau}_B$ are investigated in addition to Pearson's ${\gamma}$. With an up-to-date empirical massive dataset of n = 482 R&D projects associated with R&D Loan Program of Korea Information Communication Promotion Fund in the year of 2011, statistically significant (+) correlations are verified between the normalization index and every model's DEA efficiency scores with all three correlation coefficients. Especially, the congruence verified in this empirical analysis can be a useful reference for enhancing the practitioner's acceptability onto DEA efficiency scores as a real-world R&D project performance evaluation index.

• 기술혁신학회지
• /
• 제8권3호
• /
• pp.1087-1116
• /
• 2005

This research examines performance evaluatees' opinions regarding the institutional performance evaluation systems of Government S&T Research Institutes (GRI). Research methodology is as follows: first, four perspectives of Kaplan & Norton (1992) Balanced Scorecard Model are revised into six perspectives suitable to GRI's characteristics. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI evaluation groups to be compared under the same evaluation measures. Third, GRI's evaluatees are asked to allocate ideal weights on the performance measures. The evaluatees' weights are compared with the weights of current performance measures, and the characteristics of evaluatees' opinions about current performance evaluation systems are analyzed. Results are as follows; first, six perspectives for Korean GRIs are financial, long-term outcome, short-term outcome, strategic direction, project management, human resources perspectives. second, GRI evaluation systems put the most weights on the long- and short-term outcome perspectives and the least weights on the financial perspective. This result complies with theoretical model: in performance evaluation of GRIs, the customer perspective is the most important one while the financial perspective is the least important one. Third, evaluatees think that the long-term outcome perspective of the Basic-technology GRI group and the short-term outcome perspective of the Applied-technology GRI Group needs more weight. Fourth, it is found that the current systems have more weights on the project management and strategic direction perspectives than evaluatees think. The possible explanation of this result would be that since the measures of these perspectives are relatively easier to set up than those of other perspectives, the current systems contains larger number of measures and, accordingly more weights.