• Title/Summary/Keyword: system evaluation

Search Result 20,519, Processing Time 0.045 seconds

A Case on the Evaluation of the Information System Project to Enhance the Performance of DIMS(Defense Material Information System) (국방물자정보시스템 성능개선 사업평가에 대한 사례)

  • Cho, Sung-Rim;Lim, Gyoo-Gun;Lee, Dae-Chul
    • Journal of Information Technology Services
    • /
    • v.11 no.1
    • /
    • pp.109-123
    • /
    • 2012
  • There are many evaluation models to measure the informatization level of an organization and information system project in the ministry of National Defense of Korea. A information system has to keep up with the environment change as well as the advanced recent information technology (IT). Therefore, the evaluation of an information system project to enhance the performance of the information system should be different from the existing evaluation methods. This study suggests an evaluation case of information system projects to enhance the performance of an information system. In order to achieve the objective of this study, the following steps are taken. First, it reviews the background and the scope of the project to enhance the performance of the Defense Material Information System (DMIS). And it sets up the evaluation logic and develops performance indexes. Then it applies these newly developed performance indexes to the information system project and measures the performance. From this study, we found that both the diffusion and the experience accumulation by its continuous use are significant factors in such evaluations.

The Efficient Performance Appraisal System for Military Using Median Rank (메디안랭크를 이용한 효율적인 군 인력평가시스템)

  • 김충기;윤덕균
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2000.04a
    • /
    • pp.445-448
    • /
    • 2000
  • Researches about an evaluation system for military officers have been studied because it is one of the most important elements for managing units and improving combat power. This paper proposes an evaluation system that enhance justice of evaluation, accomplish a distintion among evaluating elements and improve synergy effects between higher level officers and lower level officers. The evaluation system in this study not only suggests evaluating items and methods but also determines the final evaluation ranking among the evaluated that have their own evaluation criteria, items and duties using the median rank method used in statistics.

  • PDF

Virtual design evaluation system for and automobile cabin (인공현실감을 이용한 승용차 운전석 디자인 평가시스템)

  • 윤정선;박재희;김철중
    • Journal of the Ergonomics Society of Korea
    • /
    • v.14 no.1
    • /
    • pp.83-90
    • /
    • 1995
  • Virtual reality can be applied well to product design and evaluation. A virtual design evaluation system for an automobile cabin was implemented on a desk-top virtual environment system. It has two frontal seats, a dashboard, a steering wheel, and various displays/controllers. Users can interact with these components as they do that with real ones. To verify the effectiveness of the virtual design evaluation system, 17 subjects participated in the evaluation procedure. The evaluation result showed that the stereoscopic vision enhanced the subjective reality of the virtual automobile cabin. Graphic details, design, and time lag were also related to the subjective feel for reality.

  • PDF

Project Selection & Evaluation System Design and Implementation-Literature Review and Case Study- (연구과제 선정.평가 체계설계에 관한 연구)

  • 용세중;최덕출;한종우;정용훈;이원영
    • Journal of Technology Innovation
    • /
    • v.2 no.1
    • /
    • pp.116-141
    • /
    • 1994
  • This paper presents a model for R&D project selection and evaluation system design developed through literature review. The model emphasizes the fitness between the five elements of the system : evaluation phase and purpose, personnel and organization, evaluation critiria and decision model, evaluation form and procedure, and projects. The model was applied in real situation as a test case. The important findings are that a good project selection and evaluation model contributes only partially to the effectiveness of the project selection and that system development and implementation activity is a dynamic and multi-facetted learning process.

  • PDF

Analysis of the Higher Education Evaluation Accreditation System in Taiwan (대만 고등교육평가체제의 분석)

  • Choi, young-pyo
    • Korean Journal of Comparative Education
    • /
    • v.18 no.4
    • /
    • pp.163-186
    • /
    • 2008
  • This study intends to understand deeply the higher education evaluation accreditation system in Taiwan. Taiwan established newly the Higher Education Evaluation & Accreditation Council in 2005, an independent organization with the exclusive responsibility to execute evaluation. Three kinds of evaluation have been accomplished, including University Program Evaluation which assesses whole university management, Academic Fields Evaluation and Performance Evaluation which compare the superiority and inferiority among universities. The Accreditation system is applied only to Academic Fields Evaluation. For evaluation, each university presents a self-evaluation report, undergoes an visiting evaluation, makes out an evaluation report and lastly is notified of the result. The evaluation is divided into three results : pass, waiting observation and non-pass. According to an announcement in June 2008, the rate of non-pass universities reached the 15.7%. The non-pass universities are supposed to receive the disadvantaged in the admission number limit and take the following evaluation in the following year. Debates still exists concerning the eliminatory nature of the system and the announcement of achievement rankings through evaluation results. Other problems include the improvement of quality of evaluation committee members and the irrational evaluation standards. These problems will be meaningful for the development of the korean higher evaluation system.

Development of Evaluation Indicators for Web-based Agricultural Water Information System using Mandal-Art Method (만다라트(Mandal-Art) 기법을 이용한 웹기반 농업용수 정보시스템 평가지표 개발)

  • Kim, Solhee;Kim, Chanwoo;Jung, Chanhoon;Park, Jinseon;Kim, Jeongdae;Suh, Kyo
    • Journal of Korean Society of Rural Planning
    • /
    • v.23 no.4
    • /
    • pp.49-59
    • /
    • 2017
  • The importance of information system evaluation has increased according to ICT development and this evaluation is required for objective verification. The aim of this study is to develop evaluation indicators for web-based information system and verify the availability of these evaluation indicators through applying to agricultural water integrated information system. This study finds and provides eight evaluation items and 64 indicators for a web-based information system using $3{\times}3$ Mandal-Art matrix that is a tool for creating creative ideas. These evaluation items are design, contents, navigation, stability, community, convenience, usefulness, and accuracy. Total 64 evaluation indicators were presented by deriving eight evaluation items for each using $9{\times}9$ Mandal-Art matrix. When evaluating information system using evaluation indicators, it can be identified the vulnerable items in the information system. Also, the comprehensive results of the information system could be understood when appearing a single score after weighting. In addition, it can also help to prepare a questionnaire for evaluation systematically.

STUDY ON THE OPTIMAL DESIGN OF A VEHICLE INTAKE SYSTEM USING THE BOOMING NOISE AND THE SOUND QUALITY EVALUATION INDEX

  • LEE J. K.;PARK Y. W.;CHAI J. B.
    • International Journal of Automotive Technology
    • /
    • v.7 no.1
    • /
    • pp.43-49
    • /
    • 2006
  • In this paper, an index for the evaluation of a vehicle intake booming noise and intake sound quality were developed through a correlation analysis and a multiple factor regression analysis of objective measurement and subjective evaluation data. At first, an intake orifice noise was measured at the wide-open throttle test condition. And then, an acoustic transfer function between intake orifice noise and interior noise at the steady state condition was estimated. Simultaneously, subjective evaluation was carried out with a 10-scale score by 8 intake noise and vibration expert evaluators. Next, the correlation analysis between the psychoacoustic parameters derived from the measured data and the subjective evaluation was performed. The most critical factor was determined and the corresponding index for intake booming noise and sound quality are obtained from the multiple factor regression method. And, the optimal design of intake system was studied using the booming noise and the sound quality evaluation index for expectation performance of intake system. Conclusively, the optimal designing parameters of intake system from noise level and sound quality whose point of view were extracted by adapting comparative weighting between the booming noise and sound quality evaluation index, which optimized the process. These work could be represented guideline to system engineers, designers and test engineers about optimization procedure of system performance by considering both of noise level and sound quality.

An Experimental Evaluation of the Vehicle Control Algorithm in Personal Rapid Transit System (개인고속이동시스템의 차량제어 알고리즘에 대한 실험적 평가)

  • Lee, Jun-Ho
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.56 no.10
    • /
    • pp.1770-1774
    • /
    • 2007
  • In this paper we deal with a design of the evaluation system to assess the vehicle operational control algorithm for Personal Rapid Transit(PRT) system. PRT system is different from the conventional rail traffic system in such that the station is off-line so as to guarantee a very short headway. In this study we propose an evaluation system to assess the performance of the proposed vehicle control algorithm. The evaluation system is composed of virtual vehicles, central control system, virtual wayside facilities, monitoring equipments. The virtual vehicles are made up by the laptop computers and the central control system employs Power PC process of Motorola Inc. The wayside facilities are implemented by employing the PXI module of the National Instruments Corporation. In order to test the proposed evaluation system a test algorithm is used, which has been simulated in the combined simulation system between Labview Simulation Interface Toolkit and Matlab/Simulink.

Automatic Grading System for Subjective Questions Through Analyzing Question Type (질의문 유형 분석을 통한 서답형 자동 채점 시스템)

  • Kang, Won-Seog
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.2
    • /
    • pp.13-21
    • /
    • 2011
  • It is not easy to develop the system as the subjective-type evaluation has the difficulty in natural language processing. This thesis designs and implements the automatic evaluation system with natural language processing technique. To solve the degradation of general evaluation system, we define the question type and improve the performance of evaluation through the adaptive process for each question type. To evaluate the system, we analyze the correlation between human evaluation and term-based evaluation, and between human evaluation and this system evaluation. We got the better result than term-based evaluation. It needs to expand the question type and improve the adaptive processing technique for each type.

Design and Implementation of a Subjective-type Evaluation System Using Syntactic and Case-Role Information (구문-격의미 정보를 이용한 주관식 문제 채점 시스템 설계 및 구현)

  • Kang, Won-Seog
    • The Journal of Korean Association of Computer Education
    • /
    • v.10 no.5
    • /
    • pp.61-69
    • /
    • 2007
  • The subjective-type evaluation can estimate the high-recognition ability, but has the problem of the objectivity and reliability of the evaluation, and the difficulty of Korean language processing. To solve the problem, this paper designs and implements a subjective-type evaluation system using syntactic and case-role information. This system can reduce the time and endeavor for evaluation and provide the objectivity of the evaluation. The system results the 75% success rate to the instructor evaluation and gets the better precision and recall than the word extraction evaluation system. We expect that this system will become a basis of the research on the subjective-type evaluation.

  • PDF