Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Usability Evaluation of Graphic User Interfaces for a Military Computer-Based Training System

  • Kim, Sungho (ROK Air Force Academy: Department of Systems Engineering) ;
  • Lee, Soojung (LIG Nex1: ILS R&D Lab) ;
  • Lee, Kiwon (LIG Nex1: ILS R&D Lab) ;
  • Lee, Baekhee (POSTECH: Department of Industrial and Management Engineering) ;
  • Lee, Jihyung (POSTECH: Department of Industrial and Management Engineering) ;
  • Park, Seikwon (ROK Air Force Academy: Department of Systems Engineering) ;
  • You, Heecheon (POSTECH: Department of Industrial and Management Engineering)
  • Received : 2015.05.28
  • Accepted : 2015.09.04
  • Published : 2015.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The present study was to improve the graphic user interface (GUI) of a military computer-based training (CBT) system in terms of usability. Background: Existing studies have focused on usability evaluation of a particular GUI type such as sequence, hierarchy, or context type; however, few research has been conducted which identifies preferred GUI features based on a comparative analysis of different GUI types. Method: A comparative evaluation was conducted by 9 CBT design experts using a 7-point scale (1: very low, 4: neutral, and 7: very high) on hierarchy and context GUI types of a military CBT system in terms of 10 usability criteria. Then, preferred features of the hierarchy and context types being accommodated, a new GUI was developed and validated by 22 CBT users. Results: While the hierarchy type was found preferred by 1.6 times in terms of controllability to the context type, the opposite was found in terms of attractiveness, simplicity, and responsiveness by 0.6, 0.8, and 0.8 times, respectively. The proposed GUI was found superior to the hierarchy and context types in terms of accessibility and informativeness by more than 1.5 times, but inferior to the hierarchy and context type in terms of simplicity by 0.6 and 0.9 times, respectively. Conclusion: The new GUI developed by accommodating the preferred features of the hierarchy and context types improves usability in terms of accessibility and informativeness except simplicity. Application: The comparative analysis of various GUIs can be applied to develop an improved GUI in a systematic manner based on preferred features of the existing GUIs.

Keywords

References

  1. Abran, A., Khelifi, A., Suryn, W. and Seffah, A., Consolidating the ISO usability models, In Proceedings of the 11th International Software Quality Management Conference, 23-25, 2003.
  2. Carvalho, P.V.R., Santos, I.L., Gomes, J.O., Borges, M.R.S. and Guerlain, S., Human factors approach for evaluation and redesign of human-system interfaces of a nuclear power plant simulator, Displays, 29, 273-284, 2008. https://doi.org/10.1016/j.displa.2007.08.010
  3. Ha, C.H. and Kim, H.S., A development of rule-based computer based training system for the NBC, In Proceedings of KIISE conference, 24(2), 313-316, 1997.
  4. Han, S.H., Yang, H.C. and Im, D.G., Designing a human-computer interface for a process control room: A case of a steel manufacturing company, International Journal of Industrial Ergonomics, 37, 383-393, 2007. https://doi.org/10.1016/j.ergon.2006.12.006
  5. Harding, B., Windows & icons & mice, oh my! The changing face of computing, In Proceedings of the 19th Annual Frontiers in Education conference, 337-342, 1989.
  6. ISO, ISO/IEC 9126-1: Software engineering - Product quality - Part 1: Quality model, 2001.
  7. Jang, D.Y. and Byun, S.N., Approach of methodology for an improving displays of computerized procedure system and development of procedure writer's guidelines in the nuclear power plant, In Proceedings of KIIE conference, 11, 765-772, 2004.
  8. Jung, Y.S., A study on the usability evaluation criteria of mobile navigation using AHP approach, Master's thesis, Hansung University, 2013.
  9. Kim, J.H. and Byun, S.N., A study of design improvement on the alarm display for Go-ri 2, In Proceedings of KIIE conference, 10, 288-294, 2009.
  10. Kwahk, J.Y., A methodology for evaluating the usability of audiovisual consumer electronic products, Ph.D. dissertation, Pohang University of Science and Technology, 1999.
  11. Letsu-Dake, E. and Ntuen, C., A case study of experimental evaluation of adaptive interfaces, International Journal of Industrial Ergonomics, 40, 34-40, 2010. https://doi.org/10.1016/j.ergon.2009.10.002
  12. Lim, D.K., Han, S.H., Yang, H.C. and Kim, J.S., Ergonomic screen design of control room in steel manufacturing process, In Proceedings of the 20th ESK conference, 11, 143-146, 2002.
  13. Nielsen, J., Finding usability problems through heuristic evaluation, In Proceedings of the SIGCHI'92 conference, 373-380, 1992.
  14. Nielsen, J., Usability inspection methods, In Proceedings of the ACM CHI'94 conference, 413-414, 1994.
  15. Oh, S.H., A comparison of usability evaluation methods: A case study on a camera application for visually impaired people, Master's thesis, Pohang University of Science and Technology, 2013.
  16. Park, J.H., Han, S.H., Park, J.H., Park, W.G., Kim, H.K. and Hong, S.W., Comparison of usability evaluation methods for mobile application, In Proceedings of the 30th ESK Conference, 5, 154-157, 2012.
  17. Park, S.G., The embodiment of a CBT system for the military training & education: Focus on the development of courseware, Master's thesis, Taegu University, 1997.
  18. Park, W.K., Han, S.H., Kang, S.J., Park, Y.S. and Chun, J.M., A factor combination approach to developing style guides for mobile phone user interface, International Journal of Industrial Ergonomics, 41, 536-545, 2011. https://doi.org/10.1016/j.ergon.2011.04.002
  19. Potelle, H. and Rouet, J., Effects of content representation andreaders' prior knowledge on thecomprehension of hypertext, International Journal of Human-Computer Studies, 58, 327-345, 2003. https://doi.org/10.1016/S1071-5819(03)00016-8
  20. Seffah, A., Donyaee, M., Kline, R.B. and Padda, H.K., Usability measurement and metrics: A consolidated model, Software Quality Journal, 14(2), 159-178, 2006. https://doi.org/10.1007/s11219-006-7600-8