DOI QR코드

DOI QR Code

An Exploration of Various Evaluation Methods to Improve Usability of Museum Mobile Device

  • Ahn, Mi-Lee (Department of Educational Technology, Hanyang University) ;
  • Cha, Hyun-Jin (Department of Educational Technology, Hanyang University) ;
  • Hwang, Yun-Ja (Department of Educational Technology, Hanyang University) ;
  • Kim, Hee-Jin (Department of Educational Technology, Hanyang University)
  • Received : 2011.07.07
  • Accepted : 2011.11.10
  • Published : 2011.12.31

Abstract

Objective: This study aims towards exploring a model of the HCI evaluation methods to improve the usability of mobile device, based on a case of a Mobile PDA system in a Museum context. Background: Mobile PDA systems in a Museum context is widely utilized for the educational purposes, but it is criticized for low usability that the device only play a role in textbooks on legs without any interactive educational activities. Therefore, the usability improvements on the mobile PDA system should be considered. Method 1: This model was developed with a combination of the expert review and the user testing, and with a combination of the qualitative and quantitative studies. In more details, first of all, a qualitative study was conducted as a combination of three different methods: 1) expert review with heuristics, 2) interviews with persons working in a museum, and 3) contextual enquiry. Results 1: The experts review provided with critical usability issues, and the semi-constructive interview helped to understand the background of the mobile device. Lastly, the contextual enquiry showed user experience problems and directions of improving the device from user's perspective. Method 2: Based on the results of the qualitative study, a questionnaire was designed. Results 2: The analysis of the quantitative study was conducted to generalize the problems, and prioritize the direction of improving the device within the limitation of the cost and time in a museum. Conclusion: This study has implications in developing an example of a HCI evaluation model to improve the user experience of the mobile device as well as finding problems and directions of how to improve the mobile PDA systems in the museum. Application: In fact, most of the studies related to the evaluation of the mobile device have been conducted in a laboratory context due to the cost and time. This paper, however, attempted to apply to various HCI research techniques from different constituents in real context.

Keywords

References

  1. Ahn, M. L., et al. "Direction of Improving Mobile System to Enhance a Learning Experience", Proceeding of Korean Society for Educational Technology, Seoul, Korea, 2008a.
  2. Ahn, M. L., et al. "User Centered Design and Development Strategies for Participatory Learning Media", Proceeding of HCI Korea, Kangwon, Korea, 2008b.
  3. Chon, E. H. & Lee, Y. M., "The Analysis on Teaching and Learning Activities Using Mobile Devices in Higher Education", The Korea Contents Association, Seoul, Korea, 11(2), 477-486, 2011. https://doi.org/10.5392/JKCA.2011.11.2.477
  4. Dix, A., et al. Human Computer Interaction, 2nd ed. Prentice Hall, 1998.
  5. Hall, T. & Bannon, L. "Designing Ubiquitous Computing to Enhance Children's Interaction in Museums", IDC 2005, USA, 2005.
  6. Kim, H. M., "Study on mobile digital text-book design for the vitalization educational function of museum", Hanyang Univ. Master's Thesis, 2009.
  7. Lehn, D., et al. "Engaging Constable: Revealing Art with New Technology", CHI2007 Proceedings, USA, 2007.
  8. Nielsen, J., Usability Engineering, Academic Press. 1993.
  9. Nielsen, J., How to conduct a heuristic evaluation. Jakob Nielsen's Alertbox, 2005, http://www.useit.com/papers/heuristic/heuristic_evaluation.html (Retrieved Septermber 16, 2011).
  10. Oh, H. Y., "Soft Keyboard Interface Design for Mobile Device", The Korea Contents Association, Seoul, Korea, 7(6), 79-88, 2007. https://doi.org/10.5392/JKCA.2007.7.6.079
  11. Oh, M., "A Study of PDA Phone Interface Design", Ewha Womans Univ. Master Thesis, 2009.
  12. Olson, J. & Moran, T., Mapping the method muddle: Guidance in using methods for user interface design. In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, Morgan- Kaufmann, 269-300, 1996.
  13. Park, M. K., "The Study of the Way for Learning Application using Mobile Devices", Incheon Univ., Incheon, Korea, 2011.
  14. Park, Y. S., et al. "Heuristic Evaluation Items for Investigating Usability of a Mobile Phone UI", Proceeding of 2008 Spring Conference of Ergonomics Society of Korea, Kumi, Korea, 2008.
  15. Patton, M. Q., Qualitative Evaluation and Research Methods, 2nd ed. SAGE Publications, 1990.
  16. Preece, J., et. al. Human Computer Interaction, Addison-Wesley, 1994.
  17. Preece, J., et al. Interaction Design, John Wiley & Sons, 2002.
  18. Preece, J., et al. Interaction Design, John Wiley & Sons, 2007.
  19. Ryu, J. H. & Kim, M. J., Understanding Mobile Human-Computer Interaction, HakJiSa, 2010.
  20. Thom-Santelli J., et al. "Beyond Just the Facts: Transforming the Museum Learning Experience", CHI 2006, Canada, 2006.