• Title/Summary/Keyword: evaluation indicators development

Search Result 616, Processing Time 0.026 seconds

Development of Methodology for Evaluation Performance Model of Information Systems (정보시스템 성과 평가 모형 방법론 개발에 관한 연구)

  • Kim, Changkyu;Park, Wonhee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.8
    • /
    • pp.527-535
    • /
    • 2016
  • In the information systems literature from Korea, there has not been much research on formative constructs. It is crucial to establish a proper relationship between constructs and indicators. In other words, it is fundamental to specify reflective or formative constructs in evaluating performance as closely as possible to reality, and in testing the appropriateness of a proper causal model. One purpose of this study is that, through a comprehensive literature review, reflective and formative indicators are accurately understood, and a proper specification and development methodology is applied to the information system evaluation field. In addition, this study provides a useful guideline for developing formative indicators for performance evaluation of informatization programs. The following activities were undertaken to achieve the aforementioned purposes. First, the basic theories and preceding study models on successful factors of informatization programs and performance evaluations were reviewed, and a comprehensive interdisciplinary literature review was conducted to better understand the formative constructs. Lastly, we provide a construct for performance evaluation of informatization programs and evaluation indicators, as well as guidelines for specifying them. Therefore, by systematically specifying proper constructs, future domestic researchers can develop better constructs for performance evaluation of informatization programs.

Case Study on the Development of Performance Indicators of Industrial R&D Program (산업 R&D 프로그램의 성과지표개발에 관한 사례연구)

  • Yang, Chun-Hee;Lee, Jae-Ha
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.35 no.2
    • /
    • pp.1-8
    • /
    • 2012
  • The primary goal of this study is to develop proper performance indicators for evaluating the results of industrial R&D program. We define R&D results include output, transfer, outcome, and impact in the performance of R&D program. Performance indicators are focused on the results of R&D commercialization, building the industrial foundations as performance proxy of R&D program of Ministry of Knowledge Economy. And we first try to design the coupled structure as logical model between R&D program goals and performance indicators. The coupled structure is represented with objectives of group unit of R&D program, implementation process, R&D practical stage, and the ultimate goal of R&D program.

A Study on the Development of Eco-cultural City Evaluation Indicator Using AHP(Analytic Hierarchy Process) (AHP를 활용한 생태문화도시 평가지표 개발 연구)

  • Choi, Song-Hun;Koo, Bon-Hak
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.20 no.6
    • /
    • pp.51-66
    • /
    • 2017
  • This study was conducted to develop detailed evaluation indicator as a way for evaluating sustainable urban ecosystem health focused on ecological urban elements from an eco-cultural point of view after the appearance of Eco-cultural City to meet various needs. And this study was also conducted to search for ways to utilize the detailed evaluation indicator like institutionalization. Eco-cultural City was defined as a city where ecological environment and cultural environment coexist and was aimed to derive applicable planning indicators in Korea. For this, FGI was executed, planning indicators were derived, and suitability was examined. The weights were calculated based on the selected indicators through AHP expert survey. After getting the result of FGI, experts reviewed the adequacy of definition from Eco-cultural City and its necessity, and the applicability of planning indicators was examined with evaluation of suitability. As a result of evaluating suitability, it was judged that 41 indicators based on an overall average of 4 areas were relatively high on suitability and also important among sectors. As for the analysis result, the priority order in multistage classification was as followed : harmony between human and environment(B) 0.349, environmental resources(A) 0.266, city environment and quality of culture(C) 0.208, and role division and citizen participation(D) 0.177. In the second level of relative importance, environment protection and infra in the role and citizen participation section was the highest, 0.449, harmonization policy and system in calculating weights was the highest.

A Study on Development of Performance Indicators for Korean Public Libraries (공공도서관의 성과지표 개발에 관한 연구)

  • Kim, Gyu-Hwan;Nam, Young-Joon
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.42 no.4
    • /
    • pp.113-139
    • /
    • 2008
  • Under rapidly changing circumstances, public libraries are required to evaluate the performance with an integrated point of view to cope with a variety of changes. In other words, it is necessary to develop integrated library performance appraisal indicators which are both quantitative and qualitative. Recently, ISO and IFLA attempt to adopt an integrated performance evaluation system based on the Balanced Scorecard(BSC). Therefore, this study defines four aspects of the library appraisal including input, process, output and outcome, and suggests a new library appraisal system and indicators of each appraisal aspect. In the concrete, appraisal aspects were derived from ISO appraisal system, and an appraisal system and indicators were presented based on the comparison and analysis of the ones respectively used inside and outside of Korea. Finally, this study proposes the method of suitability evaluation of those performance indicators by librarians and professors in Korea.

Analysis of Evaluation Indicators for the Development of Evaluation Models of Foreign Academic Journals (대학도서관의 외국학술지 평가모형 개발을 위한 평가지표 분석)

  • 김신영;이창수
    • Journal of the Korean Society for information Management
    • /
    • v.21 no.2
    • /
    • pp.45-67
    • /
    • 2004
  • The purposes of this study are to compare and analyze the evaluation indicators for selection of journal suggested by scholars and organizations and to prepare theoretical background for the ideal model to meet opposing paradigms of collection management in academic libraries. A web survey method was employed to investigate applications of various selection criteria (27 for printed and 37 for electronic academic Journal) from the top 40 academic libraries in Korea. In addition, data were analysed statistically using factor analysis, t-test, Analysis of Variance(ANOVA), and Spearman's Rank Oder Correlation. The mean ranking for 9 evaluation indicators for printed were as follows: subscribing volumes per departments, degree of use, selection authority, electronic/print bundle, ISI impact factor, Internationality and reputation, costs for subscription, ILL & DDS, space considerations for printed materials. But, 11 evaluation indicators for electronic were as follows : costs for subscription, accessibility, electronic/print bundle, consortia, selection authority, access expandability, subscribing volumes per departments, scholarly features of the university, ISI impact factor, ILL & DDS, internationality and reputations.

Development of Evaluation Indicators and Analysis of Usability on Learning with a Robot for the Elderly - the case of Content using the Humanoid Robot 'LiKU' (장노년층을 위한 로봇 활용 교육의 사용성 평가 지표 개발 및 평가 분석 - 휴머노이드 로봇 'LiKU'의 콘텐츠 사례)

  • Sin, Eun-joo;Song, Joo-bong;Lim, Soon-bum
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.11
    • /
    • pp.56-63
    • /
    • 2021
  • To solve the digital divide of the elderly, various institutions are educating how to use various smart devices for the elderly. However, it cannot be expected to have a great effect due to the disadvantages of instructor-to-face education and the learning characteristics of the elderly. Accordingly, educational contents using digital devices using robots for the elderly were developed. In this study, Evaluation Indicators were developed to evaluate the usability of digital education using robots. Also, by using usability evaluation based on the developed Evaluation Indicators, we tried to verify the usability of education using robots and to confirm the possibility of expanding the application area. In order to successfully apply the developing robot technology to various fields, it is essential to verify the usability of contents using robots, and this study on Evaluation Indicators and Evaluation methods is expected to serve as a foundation.

The Development and Application of the Service Evaluation Indicators of Transfer Facilities in the High-speed Railway Stations (고속철도역 환승시설 서비스 평가지표 개발 및 적용)

  • Kim, Cheol-Sun;Kim, Sigon;Kim, Jung-Hwan
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.28 no.4D
    • /
    • pp.533-538
    • /
    • 2008
  • The introduction of KTX (Korea Train Express) has brought an historic change to the overall transit system in Korea. The high-speed railway stations in particular are expanding the scope as public transit centers. However, it is evident that the evaluation on the high-speed railway stations had not been performed successfully thus far. The most important element of the evaluation is the connectivity of the departure point to the arriving stations and also the internal transfer service stations. We developed the service evaluation indicators of transfer facilities in the high-speed railway stations. The indicators are comprised of the level of service (LOS), the propriety of allocation, and the quality of information throughout the facilities in the centers. We examined the 7 stations in Korea that are currently in operation and standardized the methodology of the evaluation process by applying the indicators suggested in this study.

Development of Evaluation Index and Multi-layer Evaluation System for Quality Management of Elderly Long-term Care Institution (노인장기요양기관(시설급여) 평가의 품질관리를 위한 평가지표 개발 및 다층평가시스템 방안)

  • Lee, Sang-Jin;Kim, Yun-Jeong
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.9 no.11
    • /
    • pp.1015-1026
    • /
    • 2019
  • The purpose of this study is to develop evaluation indexes for improving the quality of long-term care institutions (facility salary) evaluation in the sense that the applicability and effectiveness of previous studies related to the development of evaluation indexes for long-term care facilities for elderly are insufficient. There was this. To this end, an analytical review of the 2018 long-term care institution (accommodation benefit) evaluation index, an analysis of Japan's elderly long-term care home evaluation index, and the elderly long-term care facility workers in Korea and the special care home for the elderly in Japan FGI on evaluation indicators and evaluation system was conducted. Based on the results of the research, evaluation indicators were developed in terms of supporting users to receive high quality services. The characteristics of the elderly, that is, the characteristics of elderly diseases that are difficult to maintain and improve, the direction and transparency of institutional operation, and the need for terminal care were reflected. Forty-three evaluation indicators were presented, covering institutional operations, environment and safety, beneficiary rights protection, payroll process, and payroll results. In addition, we proposed a four-step multi-level evaluation system that can improve the efficiency of the evaluation process by improving the redundant and unnecessary evaluation process.

A Study on the Korean Medical Quality Assessment of Spinal Disease -Focusing on Admission Patients- (척추질환의 한의적정성 평가 연구 -입원환자 중심으로-)

  • Park, Jung-Sik;Lim, Hyung-Ho
    • Journal of Korean Medicine Rehabilitation
    • /
    • v.25 no.3
    • /
    • pp.11-26
    • /
    • 2015
  • Objectives The purpose of this study is to assess the quality of spinal disease focusing on Korean medical hospital admission patients. Methods The disease code related to spinal disease was selected based on the contents of development of clinical quality indicators for spinal disease. The assessment analysis of feasibility was conducted through medical history analysis that targets spinal disease patients, current development of clinical quality indicators for spinal disease, and relevant literature. Results The indicator items of structure, process, and results were classified and selected, and so were the detailed indicator entries. After that, the appropriate reference value was chosen. The final selected quality indicators were 3 items from structure, 9 items from process, 4 items from results, including 3 monitoring items, total 16 items was chosen. Conclusions Clinical research for the adequacy assessment should be conducted and the index entry and indicators should be reassessed through an expert group discussion. Training for the evaluation indicators and association with relevant society will motivate hospitals to voluntarily improve their quality.

An evaluation system analysis of 4th master plan for Improvement of Construction Technology (제4차 건설기술진흥기본계획 성과평가체계 분석에 관한 연구)

  • Lee, Du-Heon;Lee, Kyo-Sun;Sohn, Tae-Hong
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2012.05a
    • /
    • pp.177-180
    • /
    • 2012
  • Korean government has developed and implemented a five-year master plan in order to enhance construction technology competitiveness and its level of development. However, without detailed assessment of past plans it is not likely to retain feasibility and sustainability of a new five-year plan, This study analyses adequacy of the 4th five-year master plan in terms of evaluation strategies such as indicators, methods, targeted performance through benchmarking various construction policies utilized by developed countries. In addition, this manuscript provides the basis structure and critical factors for establishing future construction policies or plans.

  • PDF