• Journal of Information Science Theory and Practice
• /
• 제3권4호
• /
• pp.19-34
• /
• 2015

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

• 한국IT서비스학회지
• /
• 제14권4호
• /
• pp.105-120
• /
• 2015

Enterprise should determine the adoption and utilization of information systems would be a great help to increase management performance. So, it maintains continually the budget and the investment for informatization. However, there is a limit to clarify whether the investment in informatization is contributed to create business opportunities through corporate competitiveness certainty or not. We tend to recognize the information system as a simple means to support common business rather than being used to achieve the company's business performance and to remain competitive. It is not an easy problem for the quantitative evaluation and analysis on the effect of intangible, such as management performance measurement by introducing computerization project. Informatization level evaluation model for the harsh business environment, specifically the Small and Medium Enterprise is lacking. In this paper, we proposed the audit evaluation model of an Small and Medium Enterprise informatization level based on system quality, information quality, user satisfaction, and IT business contribution. The proposed audit evaluation model was evaluated in the information system users, and verified the suitability throughout the survey of the audit professionals.

• 보건교육건강증진학회지
• /
• 제22권3호
• /
• pp.83-95
• /
• 2005

Objectives: The aim of this study was to assess the quality of the information and characteristics associated with information packaging, and develop suggestions for how this web site might be improved. Methods: The 50 sites were selected for evaluation. Inclusion criteria for evaluation were the purpose and the popularity of the sites. Two kinds of evaluation tool were employed for the analysis: one that evaluate the quality of information and the design of the web sites, and another that evaluate the covered contents. A scoring system allowed the sites point on yes/no basis on the evaluation items. The association between quality of the web sites on sexuality education and their site characteristics were assessed using ANOVA. Conclusions: Major conclusions were as follows. First, the scope and currency of the selected web sites were found to be appropriate. Second, the authority of the information was found to be the most serious problem of the selected sites. Third, the category of sexual behavior found to be the most frequently mentioned and sexual health was the second. The least mentioned category was personal skills. Finally, sites operated by private organization were found to have more accurate information and better design feature than those operated by public organization and/or individual.

• 한국정보통신학회:학술대회논문집
• /
• 한국정보통신학회 2014년도 추계학술대회
• /
• pp.457-460
• /
• 2014

모바일 기술의 빠른 발전으로 1인 1-스마트폰 시대가 왔다. 스마트폰 앱(Application : App) 또한 이제 없으면 부자연스러운 생활의 일부가 되었다. 현재 모바일 앱에서 가장 많은 사용자 및 커다란 시장 층을 형성하고 있는 것은 모바일 게임, 그 중에서도 모바일 RPG 분야이다. 하지만 모바일 RPG에 기존의 PC용 RPG 품질평가모델을 그대로 적용시킬 경우 정확한 평가 결과가 나올 수 없다. 스마트폰의 특성을 잘 반영한 새로운 모바일 RPG의 품질평가모델에 관한 연구가 필요한 시점이다. 본 연구에서는 소프트웨어품질에 관한 국제 표준인 ISO/IEC 9126을 기반으로 모바일 RPG의 품질평가요소를 도출하였으며 이를 검증하기 위한 매트릭을 재정의하여 새로운 품질평가모델을 제안하였다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권4호
• /
• pp.1820-1840
• /
• 2017

Aiming at the phenomenon of false information issued by service providers in cloud computing environment, a method for service evaluation based on fuzzy theory is put forward in this paper. According to the quality of services provided by cloud service providers and their behavior during interactions, a trust relationship between cloud service providers and cloud service consumers is established, which can be quantified by using fuzzy theory. The quality of services is evaluated by drawing on the trust relationship. In our method, the recommendation credibility of a cloud service consumer is determined through behavior similarity with evaluators and a praise factor. The introduction of the praise factor better suits the phenomenon of a high-quality service getting more repeat customers. The negative impact of dishonest customers is reduced, and the accuracy of trust and cloud service quality evaluation is improved by introducing a confidence factor that can be dynamically adjusted. The experimental results show that our method can effectively and accurately evaluate the trust value and service quality of providers, while weakening the influence of dishonest consumers, and quickly detect dishonest service providers. This is beneficial for consumers trying to find high quality service providers for similar services.

• The International Journal of Costume Culture
• /
• 제3권2호
• /
• pp.136-146
• /
• 2000

The purpose of this study was to investigate the effect of demographic characteristics and general buying characteristics of knitwear consumers on evaluation criteria and information source searching. In this study, a self-administered questionnaire was distributed to young career women and female undergraduate students. Of 580 questionnaires, 496 were used in the following analysis. The data was analyzed with the SPSS package. The research method used factor and reliability analysis to segment consumers by their knitwear evaluation criteria. T-test, one-way ANOVA and χ²were used to characterize the impact of characteristics of the consumer on knitwear evaluation criteria and information source searching in buying knitwear. The results of this study were as follows. First, the information sources of consumers were significantly different depending on their demographic characteristics(age). According to the difference in relationship between the age of consumers and information sources, the younger the consumer, the more information in fashion magazine, the older, in fashion advertisement on catalog. Second, the knitwear evaluation criteria of consumers was classified according to six characteristics - quality, price, aesthetic, situation, self-expression and external. Their knitwear evaluation criteria were significantly different depending on demographic characteristics(job, age, education, marital status) and the general buying characteristics of knitwear(annual knitwear/clothing buying expense and frequency). Career women and married women placed significant importance on practical aspects like quality and price characteristics, while undergraduate students and single women placed significant importance on practical aspects like quality and price characteristics, while undergraduate students and single women placed significant importance on aesthetic and self-expression characteristics. Also, a group with higher annual knitwear/clothing buying expense and frequency considered aesthetic and self-expression characteristics more important. The lower the annual knitwear/clothing buying expense and frequency, the higher a group considered quality and price characteristics more important.

• 한국컴퓨터정보학회논문지
• /
• 제17권4호
• /
• pp.173-184
• /
• 2012

정보시스템 감리의 의무화와 감리수요의 증가에 따라 정보시스템 감리의 품질 향상이 중요시되고 있으나, 현행 정보시스템 감리는 감리원의 경험 및 기술력, 그리고 주관적인 판단에 의존하는 바가 크며, 감리 이해 관계자로부터 감리결과에 대한 객관성및 신뢰성에 대한 불신감을 초래하고 있다. 더구나 지금까지 감리 객관성 및 신뢰성 확보를 위한 관련 연구 활동은 매우 미흡한 실정이다. 이에 본 논문에서는 정보시스템 감리평가를 위한 정량화 방법을 제시함으로써 정보시스템 감리의 준거성 객관성 신뢰성의 확보 및 향상을 통하여 전반적으로 감리의 품질향상에 기여하고자 한다. 본 논문에서 제시한 정량화 방법은 크게 평가영역 및 평가항목, 평가항목 점수산정의 2가지 영역으로 구성되어 있으며, 정보시스템 감리기준을 범용적으로 정보시스템 감리평가에 적용할 수 있는 정량평가 방법이다.

• 한국정보보호학회:학술대회논문집
• /
• 한국정보보호학회 1995년도 종합학술발표회논문집
• /
• pp.41-47
• /
• 1995

This research suggests a criterion, security quality, which is a unifying principle in computer network security that has the lack of a unifying principle. The security quality includes secrecy, integrity, recording, and availability among the factors that represent the security evaluation of the computer system. So, we defined the security quality, which is a basis for determining the security level, as the grand total of evaluation about each factor.

• 한국비블리아학회지
• /
• 제25권1호
• /
• pp.343-361
• /
• 2014

본 연구는 디지털 환경에서 전문도서관의 서비스 품질평가와 이용자 만족도를 측정하기 위해 정부출연 연구소 이용자를 인문사회분야와 과학기술분야로 나누어 '서비스 품질', '공간 품질', '정보 품질'과 '이용자 만족도'에 유의한 관계가 있는지를 7개의 가설을 가지고 검증하였다. 연구결과, '서비스 품질'에서 사서의 능력과 자질이, '공간 품질'에서 도서관 홈페이지 공간이, '정보 품질'에서는 정보의 정확성과 유용성이 만족도에 큰 영향을 미쳤다. 제언으로 전문도서관 사서의 서비스 품질 향상 및 전문교육의 필요성, 사서의 헌신성, 자발성, 태도에 대한 소양교육의 필요성, 차별화되고 특성화된 고품질 정보의 제공, 홈페이지 접근 편리화로 다양한 컨텐츠와 자료검색 지원기능 강화를 제안하였다.

• 한국경영과학회지
• /
• 제28권4호
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.