• Journal of Information Technology Services
• /
• v.7 no.4
• /
• pp.151-165
• /
• 2008

This study suggests the organization-level standard(model and process) for quality evaluation of information systems(IS) in non-use organizations despite international standards(ISO/IEC 9126 and ISO/IEC 14598) and national standards(KS X 9126 and KS X 14598) related to quality evaluation of IS. The standard in this study is composed of quality evaluation processes, a quality model, and quality metrics. The weights of the attributes and the sub-attributes in the quality model were calculated by an analytic hierarchy process(AHP). The minimum level and the target level of each metrics were determined by brainstorming of the committee. Furthermore, the case study for the investigation of the applicability and the usability of the suggested organizational standard in the real IS development project was performed. For gaining significant benefits of the standard, both the diffusion and the experience accumulation by its continuous use are needed.

• Journal of Information Science Theory and Practice
• /
• v.3 no.4
• /
• pp.19-34
• /
• 2015

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

• Journal of Information Technology Applications and Management
• /
• v.11 no.2
• /
• pp.45-64
• /
• 2004

Many researchers have proved that information systems auditing is a very effective tool for improving information systems quality. However, information system auditing in Korea still includes many subjective judgements. This study deals with applying a quantitative model to improve information system auditing quality on security domain. First of all, we have looked at previous researches on information systems audit, especially on security audit. Based on this survey, we have come up with solutions to improve the evaluation efficiency on security audit. We have merged the security audit guidelines of NCA and KISA, and developed a quantified evaluation scheme. We have proved the validity of this model by interviews with experts and by case studies.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.4
• /
• pp.1020-1027
• /
• 2013

Today, Educational serious games are occupying a large portion of the serious game market but there is a lack of the quality evaluation systems for providing useful quality evaluation information about educational serious game to user or developer. Although the existing metadata management system for serious game is developed, the system had not provided a function to manage the quality evaluation information for educational serious game. Therefor the development of quality evaluation management system of educational serious game is a very important challenge. We proposed design of the system for managing a metadata and a quality evaluation for educational serious game. The advantage of our system is that the system provide a lot of reliable useful information for general users and developers, and support an easy and convenient tool to manage the metadata and quality information to managers.

• Journal of Korea Society of Industrial Information Systems
• /
• v.11 no.5
• /
• pp.119-131
• /
• 2006

This paper proposes a mathematical model for web site service quality evaluation, which first applies analytic hierarchy process(AHP) to determine the weights of evaluation indexes of web site service quality and then analyzes web site service synthetically by means of fuzzy methodology. In this case, experts' knowledge cannot only be used but its subjective component can be eliminated. Hence, the web site service quality can be analyzed and evaluated more reasonably. After establishing this model, the experiment results will be given, which verify the feasibility and validity of the proposed model. The model proposed here is very simple and easy to implement and can provide a useful way to help developers evaluate their web site service quality efficiently.

• Proceedings of the Korea Society for Industrial Systems Conference
• /
• 2000.11a
• /
• pp.265-283
• /
• 2000

Factors influencing the success or failure of information systems(IS) have been discussed in many literature. However, little theoretical development or empirical research has examined effectiveness of hospital information systems(HIS) This study set the research model of influencing factors and consequences of HIS through theoretical studies based on Management Information Systems, and then empirically tested several hypotheses related to this model. Based on a sample of 274 respondents who participated in dealing with the HIS, this research used a multiple regression analysis to test the research model. The results of this study are as follows: system quality, information quality and support of top management are statistically significant influence on user satisfaction. Service quality is a partially significant influence on user satisfaction. Hypothesis 5, proposing that computer self-efficacy would relate positively to user satisfaction, was not supported by the questionnaire results. Based on these results, system quality, information quality and support of top management are very important variables for IS success. And the study's findings indicate DeLone and McLean's model is correct in proposing that the indirect relationship between influencing factors and organizational effectiveness, mediated by user satisfaction, is an important one.

• Journal of Korea Society of Industrial Information Systems
• /
• v.17 no.7
• /
• pp.59-70
• /
• 2012

This paper provides a model which is used for SOA based system's quality evaluation. This model make evaluation with "Reliability, Usability, Efficiency, Usability and Maintainability", these five aspects which were reference from ISO/IEC 9126. A systems based on SOA was tested by this model in these five aspects. As the results of the evaluation this system satisfied 61.45% users including Service Requester and Service Registry.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.22 no.52
• /
• pp.261-273
• /
• 1999

It is booming to use computer and information owing to the information society. Therefore, software demand is increasing rapidly. Enhancing utility value depends upon software quality. Software quality measurement and evaluation are necessary to satisfy the users who are using computers. In the present time, ISO/IEC 9126 define 6 quality characteristics and 21 sub-characteristics including 40 inter quality characteristics. We developed software evaluation technique using the check list in accordance with the ISO/IEC 9126 in analysis phase. We evaluated the software quality in order to verify developing technique at S college. As a result of the evaluation, this college has found it necessary to maintain the software as soon as possible because academic systems are not adequate for users at this present time.

• Information Systems Review
• /
• v.9 no.2
• /
• pp.169-187
• /
• 2007

This study is to propose the characteristics that a desirable quality, especially usability, evaluation method of hospital information systems(HIS) should possess. This study reviews the literature recently published in the academic journals which are in the Science Citation Index or registered by the Korean Research Foundation. Especially, the International Journal of Medical Informatics was the valuable source, providing almost 20 literature. The results reveal the need to develop a domain-specific usability evaluation method that reflects the uniqueness of hospital industry. The results show user-centeredness and context-orientedness are the indispensible characteristics of a HIS quality evaluation method too.

• Journal of Information Technology Services
• /
• v.14 no.4
• /
• pp.105-120
• /
• 2015

Enterprise should determine the adoption and utilization of information systems would be a great help to increase management performance. So, it maintains continually the budget and the investment for informatization. However, there is a limit to clarify whether the investment in informatization is contributed to create business opportunities through corporate competitiveness certainty or not. We tend to recognize the information system as a simple means to support common business rather than being used to achieve the company's business performance and to remain competitive. It is not an easy problem for the quantitative evaluation and analysis on the effect of intangible, such as management performance measurement by introducing computerization project. Informatization level evaluation model for the harsh business environment, specifically the Small and Medium Enterprise is lacking. In this paper, we proposed the audit evaluation model of an Small and Medium Enterprise informatization level based on system quality, information quality, user satisfaction, and IT business contribution. The proposed audit evaluation model was evaluated in the information system users, and verified the suitability throughout the survey of the audit professionals.