• Journal of the Ergonomics Society of Korea
• /
• v.18 no.3
• /
• pp.55-72
• /
• 1999

Evaluation of user interfaces has to be performed in an intuitive and subjective manner by experts especially when the problem comes to the complexity and consistency of sophisticated interface procedures. The manual analysis and evaluation of logical interfaces also tends to be slow and laborious. To make the evaluation more formal and objective, the criteria and the procedure with which the evaluation can proceed must be explicitly prescribed. Furthermore, to make the formal procedure as practical as subjective expert evaluation, the criteria must reflect the user knowledge of the target tasks since the task knowledge plays the role of a basis for users to understand the interface organizations and procedures. This paper describes ESTIM, a support system for task-based evaluation of user interface, that includes the interface evaluation criteria and implies an evaluation procedure. The support system can be used either in an interactive manner by the analyst during the evaluation or in an automatic evaluation mode. It was verified that the result of automatic evaluation by ESTIM matched the results of expert evaluation fairly well.

• Korean Journal of Childcare and Education
• /
• v.19 no.5
• /
• pp.65-79
• /
• 2023

Objective: The purpose of this study was to identify the importance and performance of the evaluation indicators of the childcare center evaluation system among childcare center staff and to find ways to improve the evaluation indicators of the childcare center evaluation system. Methods: A survey was conducted among 296 directors and teachers of childcare centers located in Busan and Gyeongnam. The collected data were analyzed using a paired sample t-test and an IPA analysis with SPSS 23.0 and Excel 2010. Results: There was a difference between the perceived importance and performance of childcare staff for the overall evaluation indicators, and significant differences were found in all areas and nine evaluation indicators except for "childcare environment and operation management". According to the IPA analysis, Health and Safety fell into quadrant 1, Staff into quadrant 2, and Child Care Process, Interaction, Child Care Environment, and Operations into quadrant 3. This distribution resulted in 6 indicators in quadrant 1, 4 in quadrant 2, 7 in quadrant 3, and 1 in quadrant 4. Conclusion/Implications: This study provides essential data for exploring ways to enhance the evaluation indicators of the childcare center evaluation system, with the goal of improving the quality of childcare services. Additionally, it offers policy implications.

• Journal of Information Technology Applications and Management
• /
• v.19 no.2
• /
• pp.59-78
• /
• 2012

The purpose of this longitudinal case study is to shed light on the reliability problems of IS performance evaluation by analyzing the discrepancy between ex ante evaluation in 2011 and ex post evaluation in 2012. Through an information system development project of a public enterprise, the gap between ex ante and ex post evaluation was ascertained and the causes as to why such gap occurs and the success factors that can solve the problems were derived. The ex ante evaluation of IS performance was performed based on both IS success model and BSC model and the ex post evaluation was carried out at the time after the target system has been built up by applying the evaluation measures and process that are similar to the ex ante evaluation. In the ex ante evaluation the business performance improved by the target system was estimated to 18.2%. On the other hand, it was seen as being low at 15.2% in the ex post evaluation and the differences were found to be statistically significant in 6 out of 10 measures. The reasons as to why such gap occurs were diagnosed as being of 2 types : (1) changes in the evaluation psychology according to the differences in the evaluation objectives; and (2) excessive expectation levels of the target system that is formed at the time of the ex ante evaluation. In other words, the users who have excessive expectations tend to overestimate in the ex ante evaluation and, in the ex post evaluation, tend to underestimate lower than the actual performance mainly due to disappointment on the results that do not meet the early expectations. As solutions to overcome the reliability problem of ex ante evaluation, 3 factors were derived : (1) the temperance of excessive expectation levels of the users; (2) a clear definition of the scope and functionality of the target system; and (3) actual commitments for the evaluations of IT performance.

• Journal of Technology Innovation
• /
• v.15 no.2
• /
• pp.177-209
• /
• 2007

This work firstly aims to analyse the balance between tangibles and intangibles as well as among human capital, structural capital and relational capital of evaluation indicators for the research institutes in science and technology sector conducted in 2006, by adopting intellectual capital model. The research question of this work comes from that while the R&D activity can produce both tangibles and intangibles, there have no been methodologies to relevantly measure and rationally judge these, in particular, intangible performance. The result shows that the institute evaluation system in 2006 had given more weight on tangibles and structural capital than intangibles and other intellectual capitals such as human capital and relational capital, in comparison to the past evaluation system, even though, in principle, the current evaluation system has to deal with the intangible research performances as well as tangible ones in economic, social and cultural perspective. Finally, based on these analysis, I will try to suggest some policy directions for overcoming the deficits of indicators in institute evaluation system.

• Journal of Technology Innovation
• /
• v.15 no.1
• /
• pp.87-113
• /
• 2007

For the realization of the national self-defense, the trend of the defense R&D projects becomes global and diverse with the increase of their budget. Thus, for the effective execution of the budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. This study suggests the applicability of a meta-evaluation model for the realization of the successful defense R&D project evaluation system. This study focused on the development of the meta-evaluation model design which can be applicable to the national defense R&D projects. Using the proposed meta-evaluation model, we propose a technique to enhance the fairness and the reliability of the national defense R&D projects evaluation system.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.9 no.2
• /
• pp.401-414
• /
• 2008

The object of quality test for weapons system embedded software is support about implement of high quality system which coincided with requirements of weapons system embedded. There are some examples which developed quality evaluation methodology, evaluation method for general embedded software. But the concrete system for weapons system embedded software was not constructed yet. Recently, various weapons system embedded software were developed and used but they require the effort for the quality. In this paper, we developed the evaluation modules and the quality test tables which can evaluate based on ISO/IEC 12119 for weapons system embedded software evaluation.

• Journal of the Korea Safety Management & Science
• /
• v.11 no.1
• /
• pp.175-182
• /
• 2009

The effort for GSI based IT system consolidation has been continued due to the increase of the system and complication increase of system connection, mainly by the global company. Since successful example of GSI realization by part of developed company affect to Korea, global level IT system consolidation has been examined mainly by the domestic company that have great deal of overseas business. Although they have examined consolidation possibility mainly on R&D, finance, operation management part which is the base part of company management, there are limitation for consolidation realization because of the difference between regional business problem of huge cost needed for consolidation. To overcome these realization limitations, it is necessary to lead risk and cost reduction through stepwise part unity and decide Priority Evaluation Framework for Consolidation target and systematic consolidation strategy. For GSI realization, appropriate distributions of unification time according to target system are needed. In this study, based on easiness and usefulness of consolidation and connection between the targets, evaluation methodology for Priority Evaluation Framework of system consolidation has been developed. Priority Evaluation Framework has been decided by applying developed methodology to global production company of high tech industrial part. Through this methodology, companies can realize successful and stable GSI by investing global resources intensively by Priority Evaluation Framework of consolidation target system.

• Journal of Information Technology Services
• /
• v.18 no.2
• /
• pp.37-54
• /
• 2019

The purpose of this study is to present an evaluation model to measure the clarification level of stakeholder requirements of public sector software projects in the Republic of Korea. We tried to grasp the quality of proposal request through evaluation model. It also examines the impact of the level of stakeholder requirements on the level of system requirements. To do this, we analyzed existing research models and related standards related to business requirements and stakeholder requirements, and constructed evaluation models for the system operation concept documents in the ISO/IEC/IEEE 29148. The system operation concept document is a document prepared by organizing the requirements of stakeholders in the organization and sharing the intention of the organization. The evaluation model proposed in this study focuses on evaluating whether the contents related to the system operation concept are faithfully written in the request for proposal. The evaluation items consisted of three items: 'organization status', 'desired changes', and 'operational constraints'. The sample extracted 217 RFPs in the national procurement system. As a result of the analysis, the evaluation model proved to be valid and the internal consistency was maintained. The level of system operation concept was very low, and it was also found to affect the quality of system requirements. It is more important to clearly write stakeholders' requirements than the functional requirements. we propose a news classification methods for sentiment analysis that is effective for bankruptcy prediction model.

• Proceedings of the SAREK Conference
• /
• 2009.06a
• /
• pp.332-337
• /
• 2009

The importance of the evaluation and verification of small-size cogeneration system has been emphasized because there is no KS-code related to the small-size cogeneration system. The evaluation method of small-size engine cogeneration system, regarding Japanese standard JIS B-8122 and international standard organization, ISO-8528, was applied to the system. The evaluation methods, start-test, rapid-load-up and rapid-load-down, etc. were executed at the system, and reasonable results were acquired. The electrical and thermal efficiencies were executed and analyzed at various load conditions. The NOx emission at various load condition was also measured. Finally, the gas engine cogeneration system was installed to a site for actual usage and it was continually operated during more than 6 months as the site condition.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1191-1192
• /
• 2007

In this paper we deal with a design of the evaluation system to assess the vehicle operational control algorithm for Personal Rapid Transit(PRT) system. PRT system is different from the conventional rail traffic system in such point that the station is off-line so as to guarantee a very short headway. In this study we propose a evaluation system to assess the performance of the proposed vehicle control algorithm. The evaluation system is composed of virtual vehicles, central control system, virtual wayside facilities, monitoring equipments. In order to test the proposed evaluation system a test algorithm is used, which has been simulated in the combined simulation system between Labview Simulation Interface Toolkit and Matlab/Simulink.