Browse > Article
http://dx.doi.org/10.5143/JESK.2011.30.6.765

An Exploration of Various Evaluation Methods to Improve Usability of Museum Mobile Device  

Ahn, Mi-Lee (Department of Educational Technology, Hanyang University)
Cha, Hyun-Jin (Department of Educational Technology, Hanyang University)
Hwang, Yun-Ja (Department of Educational Technology, Hanyang University)
Kim, Hee-Jin (Department of Educational Technology, Hanyang University)
Publication Information
Journal of the Ergonomics Society of Korea / v.30, no.6, 2011 , pp. 765-773 More about this Journal
Abstract
Objective: This study aims towards exploring a model of the HCI evaluation methods to improve the usability of mobile device, based on a case of a Mobile PDA system in a Museum context. Background: Mobile PDA systems in a Museum context is widely utilized for the educational purposes, but it is criticized for low usability that the device only play a role in textbooks on legs without any interactive educational activities. Therefore, the usability improvements on the mobile PDA system should be considered. Method 1: This model was developed with a combination of the expert review and the user testing, and with a combination of the qualitative and quantitative studies. In more details, first of all, a qualitative study was conducted as a combination of three different methods: 1) expert review with heuristics, 2) interviews with persons working in a museum, and 3) contextual enquiry. Results 1: The experts review provided with critical usability issues, and the semi-constructive interview helped to understand the background of the mobile device. Lastly, the contextual enquiry showed user experience problems and directions of improving the device from user's perspective. Method 2: Based on the results of the qualitative study, a questionnaire was designed. Results 2: The analysis of the quantitative study was conducted to generalize the problems, and prioritize the direction of improving the device within the limitation of the cost and time in a museum. Conclusion: This study has implications in developing an example of a HCI evaluation model to improve the user experience of the mobile device as well as finding problems and directions of how to improve the mobile PDA systems in the museum. Application: In fact, most of the studies related to the evaluation of the mobile device have been conducted in a laboratory context due to the cost and time. This paper, however, attempted to apply to various HCI research techniques from different constituents in real context.
Keywords
HCI Research Methods; Mobile Device; Usability Evaluation; Museum; Contextual Enquiry;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Patton, M. Q., Qualitative Evaluation and Research Methods, 2nd ed. SAGE Publications, 1990.
2 Preece, J., et. al. Human Computer Interaction, Addison-Wesley, 1994.
3 Preece, J., et al. Interaction Design, John Wiley & Sons, 2002.
4 Preece, J., et al. Interaction Design, John Wiley & Sons, 2007.
5 Ryu, J. H. & Kim, M. J., Understanding Mobile Human-Computer Interaction, HakJiSa, 2010.
6 Thom-Santelli J., et al. "Beyond Just the Facts: Transforming the Museum Learning Experience", CHI 2006, Canada, 2006.
7 Chon, E. H. & Lee, Y. M., "The Analysis on Teaching and Learning Activities Using Mobile Devices in Higher Education", The Korea Contents Association, Seoul, Korea, 11(2), 477-486, 2011.   과학기술학회마을   DOI
8 Dix, A., et al. Human Computer Interaction, 2nd ed. Prentice Hall, 1998.
9 Hall, T. & Bannon, L. "Designing Ubiquitous Computing to Enhance Children's Interaction in Museums", IDC 2005, USA, 2005.
10 Kim, H. M., "Study on mobile digital text-book design for the vitalization educational function of museum", Hanyang Univ. Master's Thesis, 2009.
11 Lehn, D., et al. "Engaging Constable: Revealing Art with New Technology", CHI2007 Proceedings, USA, 2007.
12 Nielsen, J., Usability Engineering, Academic Press. 1993.
13 Olson, J. & Moran, T., Mapping the method muddle: Guidance in using methods for user interface design. In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, Morgan- Kaufmann, 269-300, 1996.
14 Nielsen, J., How to conduct a heuristic evaluation. Jakob Nielsen's Alertbox, 2005, http://www.useit.com/papers/heuristic/heuristic_evaluation.html (Retrieved Septermber 16, 2011).
15 Oh, H. Y., "Soft Keyboard Interface Design for Mobile Device", The Korea Contents Association, Seoul, Korea, 7(6), 79-88, 2007.   과학기술학회마을   DOI
16 Oh, M., "A Study of PDA Phone Interface Design", Ewha Womans Univ. Master Thesis, 2009.
17 Park, M. K., "The Study of the Way for Learning Application using Mobile Devices", Incheon Univ., Incheon, Korea, 2011.
18 Park, Y. S., et al. "Heuristic Evaluation Items for Investigating Usability of a Mobile Phone UI", Proceeding of 2008 Spring Conference of Ergonomics Society of Korea, Kumi, Korea, 2008.
19 Ahn, M. L., et al. "User Centered Design and Development Strategies for Participatory Learning Media", Proceeding of HCI Korea, Kangwon, Korea, 2008b.
20 Ahn, M. L., et al. "Direction of Improving Mobile System to Enhance a Learning Experience", Proceeding of Korean Society for Educational Technology, Seoul, Korea, 2008a.