Browse > Article
http://dx.doi.org/10.5392/JKCA.2018.18.05.001

Research on Usability Test for Business Web Site Development using Concurrent Think Aloud Protocol  

Kim, Jayhoon (한국과학기술정보연구원)
Shin, Jaemin (한국과학기술정보연구원)
Kim, Jeong Hwan (한국과학기술정보연구원)
Lim, Seok Jong (한국과학기술정보연구원)
Publication Information
Abstract
The purpose of this study is to provide a cost effective usability test model for business web site development. In this study, we present a usability test model that combines Concurrent Think Aloud, performance measurement, coaching method, and remote test method. Testing target was the consortium website of electronic information joint licensing. Test participants were actual users selected by their task roles and proficiency in different levels. We improved the system by reflecting the results of user test analysis and re-tested usability test again. The result showed that usability of all participants was improved in the aspect of the time required and the complexity of mouse trajectory. It is expected that the usability test model presented in this study can be used to cost-effectively evaluate and analyze business web sites. We suggest that research various usability test model considering the characteristics of websites.
Keywords
Usability; User Test; Think Aloud; Mouse Tracking;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 https://www.nngroup.com/articles/return-on-investment-for-usability/, 2018.1.31.
2 http://www.humanfactors.com/whitepapers/ROI_of_user_experience.asp, 2018.1.31.
3 https://www.nngroup.com/articles/summary-of-usability-inspection-methods/, 2017.11.26.
4 http://usability.jameshom.com, 2017.11.26.
5 김정룡, 이하연, 최영철, "다자 중심적 사용성 평가 방법의 구조화 과정," 대한인간공학회지, 제24권, 제2호, pp.25-33, 2005.
6 A. Fernandez, E. Insfran, and S. Abrahao, "Usability evaluation methods for the web: A systematic mapping study," Information and Software Technology, Vol.53, No.8, pp.789-817, 2011.   DOI
7 M. Haak, M. Jong, and P. J. Schellens, "Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue," Behaviour & Information Technology, Vol.22, No.5, pp.339-351, 2003.   DOI
8 R. Teague, K. Jusus, and M. Nunes-Ueno, "Concurrent Vs. Post-Task Usability Test Ratings," CHI '01 Extended Abstracts on Human Factors in Computing Systems, pp.289-290, 2001.
9 L. Cooke, "Assessing Concurrent Think-Aloud Protocol as a Usability Test Method: A Technical Communication Approach," IEEE Transactions on Professional Communication, Vol.53, No.3, pp.202-215, 2010.   DOI
10 M. Chen, J. Anderson, and M. H. Shon, "What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing," CHI '01 Extended Abstracts on Human Factors in Computing Systems, pp.281-282, 2001.
11 김병주, 이건표, "웹 사용성 평가를 위한 통합평가모형 제안 및 도구 개발," 디자인학연구, 제20권, 제5호, pp.39-50, 2007.
12 L. Cooke, "Is the Mouse a 'Poor Man's Eye Tracker'?," Society for Technical Communication Conference, pp.252-255, 2006.
13 V. Navalpakkam and E. Churchill, "Mouse tracking: measuring and predicting users' experience of web-based content," Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp.2963-2972, 2012.
14 S. C. Yang, "Reconceptualizing think-aloud methodology : refining the encoding and categorization techniques via contextualized perspectives," Computers in Human Behavior, Vol.19, No.1, pp.95-115, 2003.   DOI
15 김영준, 김영진, "탐색경로 일치도 분석을 이용한 웹사이트 사용성 평가," 한국산학기술학회논문지, 제14권, 제2호, pp.793-803, 2013.   DOI
16 S. McMullen, "Usability testing in a library Web site redesign project," Reference Services Review, Vol.29, No.29, pp.7-22, 2001.   DOI
17 유진환, 김승인, 김희연, 이소희, 최용수, 이병희, "NTIS-NDSL 연계서비스 R&D Navigator 사용성 평가," 디지털디자인학연구, 제13권, 제1호, pp.35-46, 2012.
18 M. J. Aamir and A. Mansoor, "Testing Web Application from Usability Perspective," 2013 3rd IEEE International Conference on Computer, Control and Communication (IC4), pp.1-7, 2013.