• Title/Summary/Keyword: Evaluation of Information Systems(IS) Quality

Search Result 434, Processing Time 0.026 seconds

A Study on Evaluation of Usefulness of the Automated Cataloging Systems (편목시스템의 유용성 평가에 관한 연구)

  • Lee, You-Jeong
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.40 no.1
    • /
    • pp.77-94
    • /
    • 2006
  • The purpose of this study intends to evaluate the usefulness of the automated cataloging systems. For the purpose. this study investigated theoretical methods for the quality criteria and developed 4 evaluation criteria. Also developed were indicators to measure the value of each criteria And the catalogers of academic libraries using three major LAS were carefully chosen to conduct the usefulness tests. The proposed model was verified reliability and validity. This study is suggested guidelines to evaluate and improve the automated cataloging systems.

Evaluation of Information Systems Using Intelligence Density (지능밀도를 이용한 정보시스템의 평가)

  • Kim, Guk;Song, Gi-Won
    • Proceedings of the Korean Society for Quality Management Conference
    • /
    • 2006.04a
    • /
    • pp.86-91
    • /
    • 2006
  • Companies had to be more intelligent in order to survive in the rapidly changing environments. We need to make a decision to build the Information System to support their decision making. But, how can we know the new system would be better than the old system in making us intelligent? The answer is we can do it with the concept of Intelligence Density. In this study, Intelligence Density concept will be introduced, and the way how it can be applied to the information system will be presented. I think Intelligence Density should be studiedmoretohelpmanagersmakerightdecisions.

  • PDF

A Study on the OTT Evaluation Factors Using AHP (AHP를 이용한 OTT 평가요인에 관한 연구)

  • Seo, Chang Gab
    • The Journal of Information Systems
    • /
    • v.29 no.4
    • /
    • pp.193-208
    • /
    • 2020
  • Purpose Due to COVID19, the over-the-top media service (OTT) market is growing faster than expected at an annual average of 26.4%. In Korea, WAVVE, which integrated SKT's Oksusu and POOQ in September 2019, outperformed Netflix in the number of users immediately after its launch, but the number of users gradually decreased. Research on OTT investigated the spread of new media due to changes in regulations or policy, mostly in broadcasting media. On the other hand, OTT research in information systems began after the success of Netflix. It investigated consumers' satisfaction with information technology using the Information Technology Acceptance Model (TAM). This study investigates changes in consumer perceptions in the OTT market, which has grown after the Netflix's entry into Korea, the emergence of WAVVE and new OTT service providers, and the spread of COVID19. Design/methodology/approach This study selects contents, fees, service quality, and additional services as factors to evaluate consumer perception using AHP. Findings According to the 101 respondents, the content was the most important factor, followed by service quality, fees, and additional services. Contrary to previous findings that price is the determining factor in service adoption, this study reveals that consumers are willing to pay a reasonable amount for rich content and excellent service quality. Future research will use demographic analysis to reveal differences in consumer's perceptions of service selection.

The Impact of Service Level Management(SLM) Process Maturity on Information Systems Success in Total Outsourcing: An Analytical Case Study (토털 아웃소싱 환경 하에서 IT서비스 수준관리(Service Level Management) 프로세스 성숙도가 정보시스템 성공에 미치는 영향에 관한 분석적 사례연구)

  • Cho, Geun Su;An, Joon Mo;Min, Hyoung Jin
    • Asia pacific journal of information systems
    • /
    • v.23 no.2
    • /
    • pp.21-39
    • /
    • 2013
  • As the utilization of information technology and the turbulence of technological change increase in organizations, the adoption of IT outsourcing also grows to manage IT resource more effectively and efficiently. In this new way of IT management technique, service level management(SLM) process becomes critical to derive success from the outsourcing in the view of end users in organization. Even though much of the research on service level management or agreement have been done during last decades, the performance of the service level management process have not been evaluated in terms of final objectives of the management efforts or success from the view of end-users. This study explores the relationship between SLM maturity and IT outsourcing success from the users' point of view by a analytical case study in four client organizations under an IT outsourcing vendor, which is a member company of a major Korean conglomerate. For setting up a model for the analysis, previous researches on service level management process maturity and information systems success are reviewed. In particular, information systems success from users' point of view are reviewed based the DeLone and McLean's study, which is argued and accepted as a comprehensively tested model of information systems success currently. The model proposed in this study argues that SLM process maturity influences information systems success, which is evaluated in terms of information quality, systems quality, service quality, and net effect proposed by DeLone and McLean. SLM process maturity can be measured in planning process, implementation process and operation and evaluation process. Instruments for measuring the factors in the proposed constructs of information systems success and SL management process maturity were collected from previous researches and evaluated for securing reliability and validity, utilizing appropriate statistical methods and pilot tests before exploring the case study. Four cases from four different companies under one vendor company were utilized for the analysis. All of the cases had been contracted in SLA(Service Level Agreement) and had implemented ITIL(IT Infrastructure Library), Six Sigma and BSC(Balanced Scored Card) methods since last several years, which means that all the client organizations pursued concerted efforts to acquire quality services from IT outsourcing from the organization and users' point of view. For comparing the differences among the four organizations in IT out-sourcing sucess, T-test and non-parametric analysis have been applied on the data set collected from the organization using survey instruments. The process maturities of planning and implementation phases of SLM are found not to influence on any dimensions of information systems success from users' point of view. It was found that the SLM maturity in the phase of operations and evaluation could influence systems quality only from users' view. This result seems to be quite against the arguments in IT outsourcing practices in the fields, which emphasize usually the importance of planning and implementation processes upfront in IT outsourcing projects. According to after-the-fact observation by an expert in an organization participating in the study, their needs and motivations for outsourcing contracts had been quite familiar already to the vendors as long-term partners under a same conglomerate, so that the maturity in the phases of planning and implementation seems not to be differentiating factors for the success of IT outsourcing. This study will be the foundation for the future research in the area of IT outsourcing management and success, in particular in the service level management. And also, it could guide managers in practice in IT outsourcing management to focus on service level management process in operation and evaluation stage especially for long-term outsourcing contracts under very unique context like Korean IT outsourcing projects. This study has some limitations in generalization because the sample size is small and the context itself is confined in an unique environment. For future exploration, survey based research could be designed and implemented.

  • PDF

Proposal for Government Quality Assurance Risk Assessment System for Military Supplies (군수품 정부품질보증 위험성 평가제도 개선을 위한 제언)

  • Namsu Ahn
    • Journal of Korean Society for Quality Management
    • /
    • v.51 no.2
    • /
    • pp.155-170
    • /
    • 2023
  • Purpose: Nowadays, the risk assessment system is widely used in many industrial and public areas to reduce the possible risks. The system is used to determine the priorities of the government quality assurance works in Defense Agency for Technology and Quality. However, as the risk assessment system is used for other purposes, there are some items that need improvement, and in this study, we propose improvement plans by benchmarking the risk assessment systems of other institutions. Methods: In this paper, first, the procedures of risk assessment system used in many industrial sites were reviewed, and how each institution specialized and applied the system. Afterwards, by benchmarking various risk assessment systems, an improvement plan on how to operate the risk assessment system in the case of government quality assurance for centrally procured military supplies was presented, and practical application cases were presented to prove the usefulness of the improvement plan. Results: The proposed risk assessment system differs from the existing system in five major aspects. First, inputs, outputs, and key performance indicators were specified from the systematic point of view. Second, risk analysis was analyzed in four dimensions: probability of occurrence, impact, detection difficulty. Third, risk mitigation measures were classified, control, transfer, and sharing. Fourth, the risk mitigation measures were realized through document verification, product verification, process verification, and quality system evaluation. Finally, risk mitigation measures were implemented and the effectiveness of the risk mitigation measures was evaluated through effectiveness evaluation. Conclusions: In order for the risk assessment procedure proposed in this study to be applied to actual work, it is necessary to obtain the consent of the person involved in the work due to the increased time for risk identification and preparation of the government quality assurance log, and a change in the information system that performs the actual work is required. Therefore, the authors of this study plan to actively perform internal seminar presentations and work improvement suggestions to apply these research outputs to actual work.

A Study on Developing the Performance Evaluation Indicators of Defense R&D Test Development Projects (국방연구개발 시험개발사업 성과평가지표 개발에 관한 연구)

  • Lee, Hyung-Jun;Kim, Woo-Je;Kim, Chan-Soo
    • IE interfaces
    • /
    • v.23 no.1
    • /
    • pp.78-88
    • /
    • 2010
  • In this paper we develop a model for the performance evaluation of defense R&D test development projects based on analytic hierarchy process. First, evaluation indicators are collected through the related literature survey and a delphi inquiry method. Second, stepwise multiple linear regression is used for developing a hierarchical structure for analytic hierarchy process in the evaluation model, which can make the selected evaluation indicators of the hierarchical structure independent. Also we verify the effectiveness of proposed indicators of the performance evaluation by comparing with the existing evaluation indicators. The developed indicators for the performance evaluation is more reasonable and practical than the previous indicators on defense R&D test development projects.

A Development of Metadata Integration Management System for Serious Game (기능성게임 메타데이터 통합관리시스템 개발)

  • Yoon, Seon-Jeong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.18 no.4
    • /
    • pp.57-64
    • /
    • 2013
  • During the past 10 years, serious game industry has been growing steadily. But the system which could stably and reliably provide metadata information and quality information related to serious game remained unexploited. Existing systems only support the basic management functions of metadata search centered. Therefore, we have developed an integrated system to manage the quality information of serious game as well as to improve the inconvenient details of the existing systems. And we designed quality evaluation elements and quality information supply-methods, and linked up them to the system. Furthermore, we conducted user's satisfaction assessment survey on the use of the system. The advantage of the system is that the system provide a lot of useful information for general users and developers, and support a tool to manage all information related to serious game by easy and convenient method for managers.

A Study the Test Methods and Evaluation Practices of Network Access Control System (NAC 시스템의 시험방법과 평가사례에 관한 연구)

  • Yang, Hyo-Sik;Jeon, In-Oh
    • Journal of Digital Convergence
    • /
    • v.12 no.9
    • /
    • pp.159-168
    • /
    • 2014
  • With the advancement of internet and mobile communication devices, mobile banking such as internet banking, internet loan and smart phones related to the people's economic activities using mobile communication devices is becoming increasingly more popular. Various security systems to prevent such new crimes are being introduced and the security system market is anticipated to continuously increase substantially in the future. Accordingly, qualitative advancement of the security systems are also in continuous demand. Therefore, this thesis proposes the method and system for quality evaluation of the network access control system by proposing testing and evaluating method for the relevant system through surveying and analyzing the tend in the foundation technologies and standards in the area of network access control system, which is one of the security systems, in order to cope with the demands for the evaluation of the quality of the security system as the security system product market is anticipated to grow continuously.

A Development of the Evaluation Index for UTIS Traffic Information Service (UTIS 교통정보 제공서비스 성과평가 인덱스 개발)

  • Kim, Eun-Jeong;Bae, Kwang-Soo;Ahn, Gye-Hyeong;Lee, Chul-Ki
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.9 no.6
    • /
    • pp.13-21
    • /
    • 2010
  • Road Traffic Authority and National Police Agency is currently managing the "development of an integrated metropolitan traffic information infrastructure" that installs of facilities for a traffic information infrastructures, such as Local Traffic Information Center, UTIS(Urban Traffic Information System), CCTV, VMS and etc. CTIC was established in 2005 to act as an traffic information hub and to provide integrated UTIS traffic information without regional barriers. This study was carried out to seek for solution to improve quality of UTIS traffic information service for the Central Traffic Information Center(CTIC). In this study, the Evaluation index for UTIS traffic information service was developed and the implementation plan was established by using requirement analysis method, case study and AHP(Analytic Hierarchy Process) technique. The Evaluation index consist of 5 fields and 20 index, it make possible evaluation of direct/indirect effect for UTIS traffic information service. In conclusion, It is expected that quality of UTIS traffic information service will be improved by using developed evaluation index and also can be applied for performance evaluation of other traffic information systems.

myEvalSVC: an Integrated Simulation Framework for Evaluation of H.264/SVC Transmission

  • Ke, Chih-Heng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.6 no.1
    • /
    • pp.379-394
    • /
    • 2012
  • The ever-increasing demand for H.264 scalable video coding (H.264/SVC) distribution motivates researchers to devise ways to enhance the quality of video delivered on the Internet. Furthermore, researchers and practitioners in general depend on computer simulators to analyze or evaluate their designed network architecture or proposed protocols. Therefore, a complete toolset, which is called myEvalSVC, for evaluating the delivered quality of H.264/SVC transmissions in a simulated environment is proposed to help the network and video coding research communities. The toolset is based on the H.264 Scalable Video coding streaming Evaluation Framework (SVEF) and extended to connect to the NS2 simulator. With this combination, people who work on video coding can simulate the effects of a more realistic network on video sequences resulting from their coding schemes, while people who work on network technology can evaluate the impact of real video streams on the proposed network architecture or protocols. To demonstrate the usefulness of the proposed new toolset, examples of H.264/SVC transmissions over 802.11 and 802.11e are provided.