• Title/Summary/Keyword: Evaluation of System

Search Result 20,622, Processing Time 0.051 seconds

Analyzing the Importance and Performance of Childcare Evaluation System Indicators Using the IPA Technique (IPA기법을 활용한 어린이집 평가제 평가지표의 중요도와 실행도 분석)

  • In Sun Moon;Sung Hee Hong
    • Korean Journal of Childcare and Education
    • /
    • v.19 no.5
    • /
    • pp.65-79
    • /
    • 2023
  • Objective: The purpose of this study was to identify the importance and performance of the evaluation indicators of the childcare center evaluation system among childcare center staff and to find ways to improve the evaluation indicators of the childcare center evaluation system. Methods: A survey was conducted among 296 directors and teachers of childcare centers located in Busan and Gyeongnam. The collected data were analyzed using a paired sample t-test and an IPA analysis with SPSS 23.0 and Excel 2010. Results: There was a difference between the perceived importance and performance of childcare staff for the overall evaluation indicators, and significant differences were found in all areas and nine evaluation indicators except for "childcare environment and operation management". According to the IPA analysis, Health and Safety fell into quadrant 1, Staff into quadrant 2, and Child Care Process, Interaction, Child Care Environment, and Operations into quadrant 3. This distribution resulted in 6 indicators in quadrant 1, 4 in quadrant 2, 7 in quadrant 3, and 1 in quadrant 4. Conclusion/Implications: This study provides essential data for exploring ways to enhance the evaluation indicators of the childcare center evaluation system, with the goal of improving the quality of childcare services. Additionally, it offers policy implications.

A Case Study of the Discrepancy between Ex Ante and Ex Post Evaluation of IS Performance (정보화 성과의 사전-사후평가 차이에 관한 사례연구)

  • Lee, Kuk-Hie;Park, So-Hyun;Gu, Bon-Jae;Lee, Mi-Young
    • Journal of Information Technology Applications and Management
    • /
    • v.19 no.2
    • /
    • pp.59-78
    • /
    • 2012
  • The purpose of this longitudinal case study is to shed light on the reliability problems of IS performance evaluation by analyzing the discrepancy between ex ante evaluation in 2011 and ex post evaluation in 2012. Through an information system development project of a public enterprise, the gap between ex ante and ex post evaluation was ascertained and the causes as to why such gap occurs and the success factors that can solve the problems were derived. The ex ante evaluation of IS performance was performed based on both IS success model and BSC model and the ex post evaluation was carried out at the time after the target system has been built up by applying the evaluation measures and process that are similar to the ex ante evaluation. In the ex ante evaluation the business performance improved by the target system was estimated to 18.2%. On the other hand, it was seen as being low at 15.2% in the ex post evaluation and the differences were found to be statistically significant in 6 out of 10 measures. The reasons as to why such gap occurs were diagnosed as being of 2 types : (1) changes in the evaluation psychology according to the differences in the evaluation objectives; and (2) excessive expectation levels of the target system that is formed at the time of the ex ante evaluation. In other words, the users who have excessive expectations tend to overestimate in the ex ante evaluation and, in the ex post evaluation, tend to underestimate lower than the actual performance mainly due to disappointment on the results that do not meet the early expectations. As solutions to overcome the reliability problem of ex ante evaluation, 3 factors were derived : (1) the temperance of excessive expectation levels of the users; (2) a clear definition of the scope and functionality of the target system; and (3) actual commitments for the evaluations of IT performance.

Automatic Grading System for Subjective Questions Through Analyzing Question Type (질의문 유형 분석을 통한 서답형 자동 채점 시스템)

  • Kang, Won-Seog
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.2
    • /
    • pp.13-21
    • /
    • 2011
  • It is not easy to develop the system as the subjective-type evaluation has the difficulty in natural language processing. This thesis designs and implements the automatic evaluation system with natural language processing technique. To solve the degradation of general evaluation system, we define the question type and improve the performance of evaluation through the adaptive process for each question type. To evaluate the system, we analyze the correlation between human evaluation and term-based evaluation, and between human evaluation and this system evaluation. We got the better result than term-based evaluation. It needs to expand the question type and improve the adaptive processing technique for each type.

The Study on Improvement of Evaluation System for National Defense Core Technology R&D Projects (국방핵심기술 연구개발 사업의 평가 시스템 개선에 관한 연구)

  • Kim, Chan-Soo;Cho, Kyu-Kab
    • Journal of Technology Innovation
    • /
    • v.15 no.1
    • /
    • pp.87-113
    • /
    • 2007
  • For the realization of the national self-defense, the trend of the defense R&D projects becomes global and diverse with the increase of their budget. Thus, for the effective execution of the budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. This study suggests the applicability of a meta-evaluation model for the realization of the successful defense R&D project evaluation system. This study focused on the development of the meta-evaluation model design which can be applicable to the national defense R&D projects. Using the proposed meta-evaluation model, we propose a technique to enhance the fairness and the reliability of the national defense R&D projects evaluation system.

  • PDF

Quality Analysis of the Request for Proposals of Public Information Systems Project : System Operational Concept (공공정보화사업 제안요청서 품질분석 : 시스템 운영 개념을 중심으로)

  • Park, Sanghwi;Kim, Byungcho
    • Journal of Information Technology Services
    • /
    • v.18 no.2
    • /
    • pp.37-54
    • /
    • 2019
  • The purpose of this study is to present an evaluation model to measure the clarification level of stakeholder requirements of public sector software projects in the Republic of Korea. We tried to grasp the quality of proposal request through evaluation model. It also examines the impact of the level of stakeholder requirements on the level of system requirements. To do this, we analyzed existing research models and related standards related to business requirements and stakeholder requirements, and constructed evaluation models for the system operation concept documents in the ISO/IEC/IEEE 29148. The system operation concept document is a document prepared by organizing the requirements of stakeholders in the organization and sharing the intention of the organization. The evaluation model proposed in this study focuses on evaluating whether the contents related to the system operation concept are faithfully written in the request for proposal. The evaluation items consisted of three items: 'organization status', 'desired changes', and 'operational constraints'. The sample extracted 217 RFPs in the national procurement system. As a result of the analysis, the evaluation model proved to be valid and the internal consistency was maintained. The level of system operation concept was very low, and it was also found to affect the quality of system requirements. It is more important to clearly write stakeholders' requirements than the functional requirements. we propose a news classification methods for sentiment analysis that is effective for bankruptcy prediction model.

Development of Priority Evaluation Framework for IT System Consolidation using Global Single Instance in Hightech Industry (하이테크 분양의 GSI 구현 대상 우선순위 평가 방법 및 적용 방안 연구)

  • Lee, Chi-Hun;Chang, Min-Yong;Seo, Jong-Hyen
    • Journal of the Korea Safety Management & Science
    • /
    • v.11 no.1
    • /
    • pp.175-182
    • /
    • 2009
  • The effort for GSI based IT system consolidation has been continued due to the increase of the system and complication increase of system connection, mainly by the global company. Since successful example of GSI realization by part of developed company affect to Korea, global level IT system consolidation has been examined mainly by the domestic company that have great deal of overseas business. Although they have examined consolidation possibility mainly on R&D, finance, operation management part which is the base part of company management, there are limitation for consolidation realization because of the difference between regional business problem of huge cost needed for consolidation. To overcome these realization limitations, it is necessary to lead risk and cost reduction through stepwise part unity and decide Priority Evaluation Framework for Consolidation target and systematic consolidation strategy. For GSI realization, appropriate distributions of unification time according to target system are needed. In this study, based on easiness and usefulness of consolidation and connection between the targets, evaluation methodology for Priority Evaluation Framework of system consolidation has been developed. Priority Evaluation Framework has been decided by applying developed methodology to global production company of high tech industrial part. Through this methodology, companies can realize successful and stable GSI by investing global resources intensively by Priority Evaluation Framework of consolidation target system.

Resources Evaluation System for Rural Planning Purposes(III) - Rating Tabulation for Rural Resources Evaluation Items- (농촌계획지원용 지역자원펑가시스템 구축(III) - 농촌자원평가를 위한 평가등급기준 설정 -)

  • Choe, Su-Myeong;Han, Gyeong-Su;Hwang, Han-Cheol
    • Journal of Korean Society of Rural Planning
    • /
    • v.4 no.1
    • /
    • pp.75-85
    • /
    • 1998
  • This study, a sub-one of comprehensive research works titled under "Rural Resources Evaluation System", tried to propose a rational methodology for development of rating tabulation on evaluation items. Firstly, the database system for handling of original/processed data of each evaluation items was constructed, being mainly focussed on the possibilities of data acquisition and statistical treatment. The rating tabulation system developed in the study has the formalized evaluation classes as 2 or 5 for convenience/simplification of analysis works. For each evaluation item in lower step of the goal system, 5 types of rating technique were arranged, which were based on statistical analysis using mean and standard deviation values(Type I), its existence or not(Type II), relative significance of its holding volume(Type III), synthesized weighting scale of its quality and quantity(Type IV), and the others(Type V). And, standardized 4-steps procedure for rating tabulation was proposed. Finally, the rating tabulation system developed in the study was applied to each evaluation item of goal system, from which the numerically-valued ranking criteria was obtained.

  • PDF

A Study on Evaluation System for Nursing Bachelor Degree Program Outcomes: Focus on Improvement in Nursing Leadership Ability (간호학 학사학위 프로그램 학습성과 평가체계 개발 사례: 간호리더십 능력 향상을 중심으로)

  • Jang, Keum Seong;Kim, Bok Nam;Jeong, Seok Hee;Kim, Yun Min;Kim, Jung Sook
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.22 no.5
    • /
    • pp.540-552
    • /
    • 2016
  • Purpose: This study was conducted to develop a nursing leadership program outcome evaluation system, required for accreditation of nursing education. Methods: A methodological design was used. To ensure the theoretical validity of the evaluation system, learning objectives for nursing education programs and job descriptions for nurses in Korea were verified by analyzing the relationships in the five attributes of the nursing leadership concept. The nursing leadership program outcome evaluation system was developed based on the Kim & Park's developmental model (2008). Results: The nursing leadership program outcome evaluation system was established, including implementation level, education curriculum, level of performance, evaluation method, rubrics, and Close-the-Loop. Conclusion: The developed evaluation system can be actively used in nursing education, and contribute to enhancing the leadership competencies of nursing students and graduate nurses.

Integrity Evaluation System of CANDU Reactor Pressure Tube

  • Kim, Young-Jin;Kwak, Sang-Log;Lee, Joon-Seong;Park, Youn-Won
    • Journal of Mechanical Science and Technology
    • /
    • v.17 no.7
    • /
    • pp.947-957
    • /
    • 2003
  • The pressure tube is a major component of the CANDU reactor, which supports nuclear fuel bundle. In order to complete the integrity evaluation of pressure tube, expert knowledge, iterative calculation procedures and a lot of input data are required. More over, results of integrity assessment may be different according to the evaluation method. For this reason, an integrity evaluation system, which provides efficient way of evaluation with the help of attached database, was developed. The present system was built on the basis of 3D FEM results, ASME Sec. XI, and Fitness For Service Guidelines for CANDU pressure tubes issued by the AECL (Atomic Energy Canada Limited). The present system also covers the delayed hydride cracking and the blister evaluation, which are the characteristics of pressure tube integrity evaluation. In order to verify the present system, several case studies have been performed and the results were compared with those from AECL. A good agreement was observed between those two results.

The Experimental Evaluation and Verification of a 300kW Small Engine Cogeneration System (300kW급 가스엔진 열병합발전시스템 성능평가 및 실증)

  • Choi, Jae-Joon;Park, Hwa-Choon
    • Proceedings of the SAREK Conference
    • /
    • 2009.06a
    • /
    • pp.332-337
    • /
    • 2009
  • The importance of the evaluation and verification of small-size cogeneration system has been emphasized because there is no KS-code related to the small-size cogeneration system. The evaluation method of small-size engine cogeneration system, regarding Japanese standard JIS B-8122 and international standard organization, ISO-8528, was applied to the system. The evaluation methods, start-test, rapid-load-up and rapid-load-down, etc. were executed at the system, and reasonable results were acquired. The electrical and thermal efficiencies were executed and analyzed at various load conditions. The NOx emission at various load condition was also measured. Finally, the gas engine cogeneration system was installed to a site for actual usage and it was continually operated during more than 6 months as the site condition.

  • PDF