Browse > Article

Comparative Reliability Evaluation on Semantic Service Platforms  

Jung, Han-Min (한국과학기술정보연구원 정보기술연구실)
Lee, Mi-Kyoung (한국과학기술정보연구원 정보기술연구실)
You, Beom-Jong (한국과학기술정보연구원 정보기술연구실)
Kim, Do-Wan (배제대학교 정보통신공학과)
Publication Information
Journal of KIISE:Computing Practices and Letters / v.16, no.1, 2010 , pp. 105-109 More about this Journal
Abstract
While numerous information services are provided on the Web as a core infrastructure of information society, semantic services using the Semantic Web technologies still stay deployed number and application range. This situation would be mainly originated from the failure of securing reliability to the user. Thus, this paper introduces an evaluation method for measuring reliabilities of the semantic services comparatively. To measure the reliability of the compared systems, the observer assesses 'precision in task performance' as a quantitative analysis and 'reliability of expectation-result' as a qualitative analysis described by the test persons. On the other hand, the test person should rate the functional reliability and reliability of the served information on the vector graph by himself with a scale from 0 to 5. Experimental results show that assessment by the observer is very similar to rating value by test persons, and that the accuracy of the served information has a close effect on the functional reliability. Through this paper, we can verify the essential factors for evaluating the reliability of semantic service systems. These are functional reliability and reliability of served information resulting from function execution. In particular, it has been proven that the reliability of the semantic information services largely influences the "Quality in Use" and therefore determines the major factors of the semantic service reliability.
Keywords
Semantic Service; Reliability Evaluation; Reliability of Expectation-result; Precision in Task Performance; Semantic Web;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 홍서영, 박준아, 서진원, 김진우, "사용자 중심의 웹 사이트 평가 모형의 개발", 제10회 한국 HCI 학회: 학술 대회 논문집, 2001.
2 ISO 15489-2, Information and Documentation - Records Management -, 2001.
3 정혜정, "소프트웨어 신뢰도 품질 평가 메트릭에 대한 연구", 한국인터넷정보학회지, 7(2), 2006.
4 J. Nielsen, Card Sorting: How Many Users to Test, Jakob Nielsen's Alertbox, July 19, 2004.
5 J. Nielsen, Quantitative Studies: How Many Users to Test?, Jakob Nielsen's Alertbox, June 26, 2006.
6 H. Jung, M. Lee, and W. Sung, "Toward Managing and Generating Hyperlinks to External Services," In Proceedings of the 4th International Conference on Networked Computing and Advanced Information Management, 2008.
7 김영기, "웹 사이트의 신뢰성 평가에 영향을 미치는 요인과 각 요인의 중요도에 관한 연구", 한국문헌정보 학회지, 41(4), 2007.
8 ISO 9126-1, Software Engineering, Product Quality, 2001.
9 D. Kieras, "A Guide to GOMS Task Analysis," Technical Report of Univ. of Michigan, 1994.
10 H. Jung, M. Lee, P. Kim, S. Lee, and W. Sung, "Implementation of a Semantic Service Framework with Three Features for Improving Reliability," In Proceedings of the 1st Workshop, Human Factors and the Semantic Web in ASWC 2008, 2009.
11 W. Tsai, "Service-oriented System Engineering: A New Paradigm," In Proceedings of IEEE International Workshop on Service-oriented System Engineering, 2005.
12 W. Sung, H. Jung, P. Kim, I. Kang, S. Lee, M. Lee, D. Park, and S. Hahn, "A Semantic Portal for Researchers Using OntoFrame," In Proceedings of the 6th International Semantic Web Conference and the 2nd Asian Semantic Web Conference, 2007.
13 "청년과학 13호: 설문조사, 좀 제대로 하자!", http://kioku.springnote.com/pages/585547, 2008.
14 J. Tian, S. Rudraraju, and Z. Li, "Evaluating Web Software Reliability Based on Workload and Failure Data Extracted from Server Logs," In Journal of IEEE Transactions on Software Engineering, 30 (11), 2005.