• 제목/요약/키워드: Performance Evaluation Measures

검색결과 539건 처리시간 0.032초

정보화 성과의 사전-사후평가 차이에 관한 사례연구 (A Case Study of the Discrepancy between Ex Ante and Ex Post Evaluation of IS Performance)

  • 이국희;박소현;구본재;이미영
    • Journal of Information Technology Applications and Management
    • /
    • 제19권2호
    • /
    • pp.59-78
    • /
    • 2012
  • The purpose of this longitudinal case study is to shed light on the reliability problems of IS performance evaluation by analyzing the discrepancy between ex ante evaluation in 2011 and ex post evaluation in 2012. Through an information system development project of a public enterprise, the gap between ex ante and ex post evaluation was ascertained and the causes as to why such gap occurs and the success factors that can solve the problems were derived. The ex ante evaluation of IS performance was performed based on both IS success model and BSC model and the ex post evaluation was carried out at the time after the target system has been built up by applying the evaluation measures and process that are similar to the ex ante evaluation. In the ex ante evaluation the business performance improved by the target system was estimated to 18.2%. On the other hand, it was seen as being low at 15.2% in the ex post evaluation and the differences were found to be statistically significant in 6 out of 10 measures. The reasons as to why such gap occurs were diagnosed as being of 2 types : (1) changes in the evaluation psychology according to the differences in the evaluation objectives; and (2) excessive expectation levels of the target system that is formed at the time of the ex ante evaluation. In other words, the users who have excessive expectations tend to overestimate in the ex ante evaluation and, in the ex post evaluation, tend to underestimate lower than the actual performance mainly due to disappointment on the results that do not meet the early expectations. As solutions to overcome the reliability problem of ex ante evaluation, 3 factors were derived : (1) the temperance of excessive expectation levels of the users; (2) a clear definition of the scope and functionality of the target system; and (3) actual commitments for the evaluations of IT performance.

Quantifying Quality: Research Performance Evaluation in Korean Universities

  • Yang, Kiduk;Lee, Hyekyung
    • Journal of Information Science Theory and Practice
    • /
    • 제6권3호
    • /
    • pp.45-60
    • /
    • 2018
  • Research performance evaluation in Korean universities follows strict guidelines that specify scoring systems for publication venue categories and formulas for co-authorship credit allocation. To find out how the standards differ across universities and how they differ from bibliometric research evaluation measures, this study analyzed 25 standards from major Korean universities and rankings produced by applying standards and bibliometric measures such as publication and citation counts, normalized impact score, and h-index to the publication data of 195 tenure-track professors of library and information science departments in 35 Korean universities. The study also introduced a novel impact score normalization method to refine the methodology from prior studies. The results showed the university standards to be mostly similar to one another but quite different from citation-driven measures, which suggests the standards are not quite successful in quantifying the quality of research as originally intended.

내진성능평가에 따른 정밀안전진단 및 내진 보수보강 조치의 개선방안 연구 (A study on the improvement plan for precision safety diagnosis and seismic repair and reinforcement measures according to seismic performance evaluation)

  • 김장욱
    • 한국건축시공학회:학술대회논문집
    • /
    • 한국건축시공학회 2022년도 봄 학술논문 발표대회
    • /
    • pp.87-88
    • /
    • 2022
  • For an earthquake-safe urban environment, the Republic of Korea conducts seismic performance evaluation in accordance with laws and guidelines to assign safety ratings and implement necessary management measures such as repairs and reinforcements. In the seismic performance evaluation result, structures lacking in preparation for earthquakes are prioritized and classified into measures such as repair, reinforcement, or careful observation to respond to physical risks such as earthquakes. Such repair and reinforcement work is not a one-time thing, but it is necessary to further enhance the effect through continuous follow-up observation. In this study, the location of the vertical and horizontal displacement measuring part of the construction part is displayed so that the post-construction status of the reinforcement construction part can be visually checked by identifying the problems in the process of post-monitoring in 2022 for the maintenance and reinforcement work of local governments' public facilities carried out in 2021. We propose a plan to institutionalize the installation of, inspection tools, and crack gauges at certain locations in the construction department, and to have facility managers periodically inspect and manage them with a smartphone program or the 'Facility Autonomous Safety Inspection' app.

  • PDF

대학도서관 평가지표의 다의성과 지향성 (Multiplicity of Moaning and Directivity of Evaluation Indicators for the Academic Libraries)

  • 윤희윤
    • 한국도서관정보학회지
    • /
    • 제32권3호
    • /
    • pp.91-115
    • /
    • 2001
  • 오늘날 대학도서관은 공룡의 화신 내지 예산의 블랙홀로 인식되고 있다. 그럼에도 불구하고 대학 도서관은 디지털시대의 다양한 학술정보를 수집·보존하고 이용시키는 주체가 되어야 한다. 이것은 실물자료의 소장패러다임과 전자출판물의 접근패러다임을 동시에 수용하고 강화해야 한다는 의미이다. 이처럼 대학의 예산부담과 도서관의 기능강화 사이의 간극을 좁히려면 총체적 평가작업이 선행되어야 하고, 그 요체는 평가지표의 개발이다. 그래서 본 연구는 대학도서관 평가지표 또는 성과지표 (척도)의 다의성을 체계적으로 고찰하고, 그 바람직한 지향성을 모색하였다.

  • PDF

실내마감재의 친환경성능 판정기법 및 성능등급의 분류체계에 관한 연구 (A newly-established evaluation methodology of the sustainable performance degree of interior architectural finishes)

  • 이지순;윤정숙
    • KIEAE Journal
    • /
    • 제13권2호
    • /
    • pp.141-149
    • /
    • 2013
  • This paper aims to provide pragmatic application guidelines of the interior finish materials for apartment houses with newly-established evaluation methodology of the sustainable degree of interior products. With reference to the standards and criteria of domestic eco-labeling accreditation schemes for sustainable products in the area of architecture which focus on the sustainable elements classified as the health, recyclability, durability, and energy efficiency, in this study, a systematic evaluation method has been established for interior finish products with quantifiable indicators for sustainable performance. Base on the evaluation system introduced here, most interior finish products can be classified into a database and applied effectively to the realities from the perspective of the sustainability. There are the necessities of enforcement issues with the idea of revising or taking remedial measures of the current performance criteria of domestic eco-labeling accreditation to bolster their reliability. As well as already-commercialized products, hereafter, continued efforts are needed to control the whole process of manufacturing new interior finish products from their designing, constructing, consuming, recycling and to dismantling in terms of sustainability, which promises more pragmatic follow-up measures for the detail embodiment of the environment-friendly spaces.

Evaluation of Information Presentation Methods for a Wearable Braille Display

  • Jung, Ki-Hyo;Lee, Min-Jeong;Chang, Joon-Ho;You, Hee-Cheon
    • 대한인간공학회지
    • /
    • 제30권6호
    • /
    • pp.739-747
    • /
    • 2011
  • Objective: The present study evaluated information presentation methods applicable to a wearable Braille display in terms of performance and satisfaction measures. Background: A Braille display wearable at a finger can improve accessibility of information for the blind by presenting information in real time. Method: A Braille display with six pins operated by DC servomotors was developed to simulate four information presentation methods(active, stationary, simultaneous, and sequential methods). An evaluation experiment was conducted with 16 participants(8 normal and 8 blind participants) by using three objective measures(reaction time, RT, unit: sec; recognition time, CT, unit: sec; correct response percentage, CP) and two subjective measures(overall satisfaction, OS; perception easiness, PE) with a 7-point scale. Results: The average RTs and CTs of the active and stationary methods were significantly shorter than those of the simultaneous and sequential methods for the blind participants. Also, the average CPs, OSs, and PEs of the active and sequential methods were significantly higher than those of the stationary and simultaneous methods. Conclusion: The active and sequential methods were preferred to the other methods for the blind. Application: The performance characteristics identified in the present study for the four braille display methods can be utilized to develop an effective wearable Braille display system.

모멘트 생성 함수 기법을 이용한 유연 제조 셀의 해석적 성능 평가

  • 박용수;김종원
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 1996년도 춘계학술대회 논문집
    • /
    • pp.506-511
    • /
    • 1996
  • The performance evaluation of flexible manufacturing systems or cells at the stages of design and planning is one of important issues in manufacturing. For that reason, Guo has presented an approachbased on moment generating function and generalized stochastic PetriNets for performance analysis. In this paper, Buo's approach is extended tothe cases of flexible manufacturing cell including one machining center with a local buffer, AS/RS(Automatic Storage and Retrieval System), set-up station and AGV(Automated Guided Vehicle). Then the performance measures from this approach is compared with simulation. The major advantage ofthis method over existing performance evaluation methods is the ability to compute analytic solutions for performance measures.

  • PDF

n/m Flow Shop Scheduling에 있어서 최적 Scheduling에 관한 연구 - 평가척도를 중심으로 - (A Study on the Optimal Scheduling in n/m Flow Shop Scheduling : the Measure of Performance)

  • 이근희;김준홍
    • 산업경영시스템학회지
    • /
    • 제4권4호
    • /
    • pp.1-13
    • /
    • 1981
  • This paper analyses the efficiency of performance measures from the point of total cost on the accuracy of due date around various measures of performance be in mainly use in the flow shop scheduling theory. For this purpose, complete enumeration method for small problems seems to be the only possible means of evaluation and analysis. Using of the above technique, calculates the 800 Scheduling Problems, and represents it by the cumulative distributions.

  • PDF

Integrating Balanced Scorecard and Analytic Hierarchy Process Techniques for Evaluating Corporate Performance

  • Sohn, Myung-Ho;Park, Sungbum;Lee, Heeseok
    • 한국경영과학회:학술대회논문집
    • /
    • 한국경영과학회 2001년도 추계학술대회 논문집
    • /
    • pp.111-115
    • /
    • 2001
  • A good business performance measurement system is an effective tool io sustained growth in profits. Although interest in creating performance measurement models is widespread, a well-designed system is rare. To be successful in today's competitive environment, a performance measurement system should incorporate strategic success factors and contain financial and non-financial measuring index to carry out strategic management. In the 1990s, Kaplan & Norton introduced a concept called the Balanced Scorecard. The Balanced Scorecard supplements traditional financial measures with criteria that measured performance from three additional perspectives - those perspectives of customers, internal business processes, and learning and growth. This paper presents five measuring index criteria for each perspective. To calculate the relative priority for These measuring index, we investigate weights investigated by interviews with management consultant. Then, AHP method is employed for calculating priority weight. Our evaluation model may be referred to as the Balanced Analytic Hierarchical Performance Model(BAHPM) in the sense that the analytic hierarchical scheme, along with the AHP, is applied. The BAHPM is the first kind of analytical model to cover a wide variety of measures. In comparison with previous evaluation models, our model shows strengths in structural flexibility, ease of incorporating feedback, group evaluation capacity, participation promotion, sensitivity analysis, and computational simplicity. A prototype based on the BAHPM can be applied to various industry sectors.

  • PDF

복합포아송 수요를 갖는 CONWIP 시스템의 주문관점에서의 성능평가 (Order Based Performance Evaluation of a CONWIP System with Compound Poisson Demands)

  • 박찬우;이효성
    • 한국경영과학회지
    • /
    • 제32권1호
    • /
    • pp.137-146
    • /
    • 2007
  • In this study we consider a CONWIP system studied in Park and Lee [1] in which the processing times at each station follow a Coxian distribution and the demands for the finished products arrive according to a compound Poisson process. The demands that are not satisfied Immediately are either backordered or lost according to the number of demands that exist at their arrival instants. For this system using the results in [1] we develop an approximation method to calculate order based performance measures such as the mean time of fulfilling a customer order and the mean number of customer orders. To test the accuracy of the approximation method, the results obtained from the approximation method are compared with those obtained by simulation. Comparisons with simulation have shown that the approximate method provides fairly good results.