• Title/Summary/Keyword: Evaluation Perspectives

Search Result 425, Processing Time 0.029 seconds

Evaluation Criteria of IT Business Value : The Difference Between Ex Ante and Post Implementation Evaluation (IT 비즈니스 가치 평가관점 : 사전-사후 평가시점 및 정보시스템 유형별 차이)

  • Park, So-Hyun;Lee, Kuk-Hie
    • Journal of Information Technology Applications and Management
    • /
    • v.15 no.1
    • /
    • pp.203-224
    • /
    • 2008
  • The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

  • PDF

Relevance Analysis of Performance Evaluation Systems of Government S&T Research Groups (출연연구기관의 연구회 단위 기관평가제도의 적합성 분석)

  • Nam, Yeong-Ho;Kim, Byeong-Tae
    • Journal of Technology Innovation
    • /
    • v.14 no.3
    • /
    • pp.117-154
    • /
    • 2006
  • This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

  • PDF

BSC Analysis of Performance Measurement Systems of Government S&T Research Institutes (BSC 관점을 활용한 출연연구기관 평가제도의 수용성 연구)

  • Kim Byung-Tae;Nam Young-Ho
    • Journal of Korea Technology Innovation Society
    • /
    • v.8 no.3
    • /
    • pp.1087-1116
    • /
    • 2005
  • This research examines performance evaluatees' opinions regarding the institutional performance evaluation systems of Government S&T Research Institutes (GRI). Research methodology is as follows: first, four perspectives of Kaplan & Norton (1992) Balanced Scorecard Model are revised into six perspectives suitable to GRI's characteristics. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI evaluation groups to be compared under the same evaluation measures. Third, GRI's evaluatees are asked to allocate ideal weights on the performance measures. The evaluatees' weights are compared with the weights of current performance measures, and the characteristics of evaluatees' opinions about current performance evaluation systems are analyzed. Results are as follows; first, six perspectives for Korean GRIs are financial, long-term outcome, short-term outcome, strategic direction, project management, human resources perspectives. second, GRI evaluation systems put the most weights on the long- and short-term outcome perspectives and the least weights on the financial perspective. This result complies with theoretical model: in performance evaluation of GRIs, the customer perspective is the most important one while the financial perspective is the least important one. Third, evaluatees think that the long-term outcome perspective of the Basic-technology GRI group and the short-term outcome perspective of the Applied-technology GRI Group needs more weight. Fourth, it is found that the current systems have more weights on the project management and strategic direction perspectives than evaluatees think. The possible explanation of this result would be that since the measures of these perspectives are relatively easier to set up than those of other perspectives, the current systems contains larger number of measures and, accordingly more weights.

  • PDF

Practical Arts(Technology.Home Economics) Textbook Evaluation Criterion based on Perspectives of the National Curriculum (교과 교육과정에 제시된 관점에 근거한 실과(기술.가정) 교과서 평가기준 방향 탐색)

  • Kwon, Yoojin
    • Journal of Korean Home Economics Education Association
    • /
    • v.25 no.3
    • /
    • pp.61-77
    • /
    • 2013
  • Developing textbook evaluation criterion is as important as textbook development in education. Home economics subject has been involved in textbook evaluation since 1995, at which the first home economics textbook was under the national authorization system in South Korea. There has been little research on home economics textbook evaluation criterion even though there were more studies using textbook analysis. The purposes of this study were to explore the reason why subject perspectives were reflected on the textbook evaluation criterion, the relationships between the perspectives presented by national curriculum and technology home economics textbook evaluation criterion, and the future direction for developing textbook evaluation criterion. So this study was related to analyze practical arts(technology home economics) textbook evaluation criterion and the meaning of subject perspectives in textbook evaluation criterion, to drive perspectives consistently presented by the 2007 revised and 2011 revised national curriculum, to analyze the relationships between the perspectives in national curriculum and textbook evaluation criterion, and to provide the future direction for textbook evaluation criterion development. Textbook evaluation criterion is very important because it provides subject perspectives for developing textbook, delivers the core concepts and unique values of our subject, and provides the direction for teacher education. According to the analysis of both national curriculum, the perspectives such as management competency, life competency, practical experience, integrative competency for understanding individual and family, career and life planning, and life problem-solving were presented in this study. Implication for future research would be needed to develop the factors of textbook evaluation criterion based on the perspective presented by national curriculum.

  • PDF

Balanced Scorecard Perspective Analysis of Institutional Performance Evaluation for Government S&T Research Institutes (과학기술계 출연연구기관 기관평가지표의 BSC 관점 분석)

  • Nam Yeong-Ho;Kim Byeong-Tae
    • Journal of Technology Innovation
    • /
    • v.13 no.1
    • /
    • pp.265-293
    • /
    • 2005
  • This research examines the relationship between the characteristics of Government S&T Research Institutes (GRI) and their institutional performance evaluation system. First, based on Kaplan & Norton (1992) Balanced Scorecard Model, six perspectives suitable to Korean GRI are derived. Second, personnel who works on evaluation job classified current performance measures into the six perspectives. Analyzing comparative weights of individual perspectives, the characteristics of performance evaluation systems among institutes are derived and compared with their missions. The results are as follows: First, GRI evaluation systems put most weight on the customer perspective and least weight on the financial perspective. This result complies with Korean GRI's missions and strategies as well as findings of foreign cases. Second, Basic-technology GRI group relatively more priotizes long-term customer perspective, while Applied-technology GRI Group relatively more priotizes short-term customer perspective. Public-technology GRI Group is located in the middle in terms of priority of customer perspectives. Third, for three yews (2000-2002), performance measure weights of Basic-technology Group are changed much less than those of the other two groups. Further research are needed for reasons of drastic changes for Applied-technology and Public-technology groups and some abnormally high and low measure weights.

  • PDF

Performance Evaluation Model for Public-Private Partnership Projects - with Reference to BTO (Build-Transfer-Operate) Road Projects - (민간투자사업 성과평가 모델 개발 및 적용 - 도로 부문 사업을 중심으로 -)

  • Park, Hyeon;Park, Inseok;Lee, Shin
    • Korean Journal of Construction Engineering and Management
    • /
    • v.19 no.2
    • /
    • pp.83-95
    • /
    • 2018
  • The aim of this paper is to develop a performance evaluation model for PPP (Public-Private Partnership) projects that appropriately reflects the important traits that are unique to PPP projects. To this end, 1) it defines a set of distinct perspectives involved in the PPP projects and their associated success factors that might differ amongst the perspectives; 2) it identifies the key performance indicators and suggests the performance evaluation criteria for each indicator; and 3) it builds a performance evaluation model by matching the success factors from each perspective with performance measure criteria as well as applies the model to the two selected BTO road projects in Korea. The process of model construction and its application confirms significant differences between the main stakeholder perspectives typically involved in PPP projects, which highlights the need for an evaluation model tailored for PPP projects by taking into account the distinct perspectives. The results from the PPP evaluation model developed in the study is compared against the results from the existing ex-post evaluation model for construction projects in general. The former shows a closer match with the results from the user satisfaction survey conducted. This new evaluation framework and the performance indicators entailed in it permits a balanced evaluation of PPP projects as it takes into account different perspectives involved in PPP projects as well as an understanding of the factors affecting the success of PPP projects. While the construction of the model is based on transport projects, it is applicable to different types of PPP projects through variation with the weight allocation amongst different success factors and/or additions or other adjustments to the performance evaluation criteria as required.

Evaluation and Selection Framework for a Venture Firm with New Technology in Optical Electronics Industry (BSC관점에서 AHP기법을 이용한 신기술 평가 및 선정에 관한 연구 - 광산업 신기술보육사업을 중심으로 -)

  • Han, Hah-Min;Ko, Il-Sang;Choi, Su-Jeong;Jang, Jeong-Ju
    • The Journal of Information Systems
    • /
    • v.18 no.1
    • /
    • pp.97-115
    • /
    • 2009
  • This study proposes a framework for an evaluation and selection of a venture firm with promising new technology in optical electronics industry to nurture that firm. The framework is intended to help practitioners to evaluate accurately and objectively new technologies. In addition, this study tests the usability and effectiveness of this framework with an actual certain case. More specifically, this study, first proposes that the framework for new technology evaluation is composed of financial perspective, market perspective, internal business perspective, and R&D and growing perspective. They are on the four perspectives of BSC(Balanced Score Card). Each perspective contains specific items. In addition, this study uses AHP(Analytic Hierarchy Process) to assess the comparative importance among the four perspectives and their specific items. Secondly, based on the results of AHP, the usability and effectiveness of the framework suggested in this study have been tested with a real case evaluating and selecting a promising venture firm. The results of the study have the following implications: this study has developed the framework for new technology evaluation which assists practitioners. Our framework offers the four perspectives and their specific items with their respective comparative importance. Furthermore, this study has verified that the proposed framework can be applicable in real situation with more accurate results.

Patient compliance with drug treatment - new perspectives on an old problem

  • Kruse W.
    • 대한예방의학회:학술대회논문집
    • /
    • 1994.02b
    • /
    • pp.332-335
    • /
    • 1994
  • Compared to other variables being considered in therapeutics, patient compliance has long been given minor attention although it affects every aspect of medical care; Limited methodology of compliance measurement, in particular, has hampered major progress in research, and pre-conceptions have been reiterated. However, there is a recent surge in interest derived from new data revealed by reliable methods, i.g. continuous medication (compliance) monitoring. The visualization of dynamics in drug regimen compliance over time offers unique opportunities, both to scientific drug evaluation and therapeutics in medical practice. New perspectives related to the descriptive and explanatory side of the problem are outlined by giving examples from various therapeutic fields.

  • PDF

Evaluating Green IT Initiatives Using the Sustainability Balanced Scorecard (지속가능한 BSC를 사용한 그린 IT 전략 실행과제들의 평가)

  • Park, Jeong-Sun
    • Journal of the Korea Safety Management & Science
    • /
    • v.19 no.3
    • /
    • pp.81-87
    • /
    • 2017
  • Performance evaluation has been done using financial indices which are generally regarded as inappropriate for the organizations which are innovative and progressive. Thus, the Balanced Scorecard(BSC) was developed considering long term performance and invisible performance. This BSC has four perspectives of finance, customer, internal operation, and learning. Based on the BSC, a new BSC has been derived with a fifth view of environmental and social perspective, which is now called as a Sustainability BSC. In this study, we evaluated Green IT initiatives using the Sustainability BSC. The initiatives are categorized as RFID, telepresence, paperless office, logistics management etc. The initiatives were evaluated from the view of five perspectives, resulting in high cor relationships among finance, internal operation, and environmental and social perspectives. Namely, good initiatives from the view of environmental/social perspective are also evaluated as good from the view of finance and internal operation perspectives. In this study, we recommend organizations to introduce Green IT initiatives by showing how Green IT initiatives have contributed to the organizations.