Journal of the Korean Society for Library and Information Science (한국문헌정보학회지)

Korean Society For Library And Information Science (한국문헌정보학회)
권호 표지
DOI QR코드

DOI QR Code

Usability Evaluation Criteria Development and Application for Map-Based Data Visualization

지도 기반 데이터 시각화 플랫폼 사용성 평가 기준 개발 및 적용 연구

  • Received : 2024.04.24
  • Accepted : 2024.05.11
  • Published : 2024.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to develop an evaluation tool for map-based data visualization platforms and to conduct heuristic usability evaluations on existing platforms representing inter-regional information. We compared and analyzed the usability evaluation criteria of map-based platforms from the previous studies along with Nielsen's (1994) 10 usability evaluation principles. We proposed nine evaluation criteria, including (1) visibility, (2) representation of the real world, (3) consistency and standards, (4) user control and friendliness, (5) flexibility, (6) design, (7) compatibility, (8) error prevention and handling, and (9) help provision and documentation. Additionally, to confirm the effectiveness of the proposed criteria, four experts was invited to evaluate five domestic and international map-based data visualization platforms. As a result, the experts were able to rank the usability of the five platforms using the proposed map-based data visualization usability evaluation criteria, which included quantified scores and subjective opinions. The results of this study are expected to serve as foundational material for the future development and evaluation of map-based visualization platforms.

본 연구의 목적은 지도 기반 데이터 시각화 플랫폼에 적합한 평가 도구를 개발하고, 이를 현재 상용되고 있는 지역간 정보를 나타내는 지도 기반 데이터 시각화 플랫폼을 대상으로 휴리스틱 사용성 평가를 수행하는 것이다. 본 연구에서는 Nielsen(1994)의 사용성 평가 10가지 원칙과 함께 지도 기반 플랫폼의 사용성 평가 기준을 다룬 선행연구들의 결과를 비교·분석하여 (1) 가시성, (2) 실세계와의 일치, (3) 일관성 및 표준, (4) 사용자 제어 여부와 친화성, (5) 융통성, (6) 디자인, (7) 호환성, (8) 오류 방지 및 해결, (9) 도움말 제공 및 문서화로 9가지의 평가 항목을 개발하였다. 또한, 개발한 평가 항목의 실효성을 확인하기 위해, 국내외 5개의 지도 기반 데이터 시각화 플랫폼을 대상으로 전문가 4명을 초빙하여 사용성 평가를 진행하였다. 평가 결과, 전문가들은 제안한 지도 기반 데이터 시각화 사용성 평가 기준을 사용하여, 수치화한 점수와 주관적 의견을 포함한 5개 플랫폼의 사용성을 순위화한 평가 결과를 도출할 수 있었다. 본 연구의 결과는 향후 지도 기반 시각화 플랫폼을 개발하고 평가함에 있어서 전반적인 가이드라인의 기초 자료가 될 수 있을 것으로 기대한다.

Keywords

Acknowledgement

이 논문은 2023년 대한민국 교육부와 한국연구재단의 지원을 받아 수행된 연구임(과제번호: NRF-2023S1A5A2A21087977).

References

  1. Byeon, Sangyoung & Kim, Keewhan (2020). Estimating actual population of Sejong city using open data and grid system. Journal of The Korean Data Analysis Society, 22(5), 1793-1807. http://doi.org/10.37727/jkdas.2020.22.5.1793
  2. Cho, Joo-Eun & Lee, Seong-il (2009). Digital divide in e-Government web sites. Information Society & Media, (16), 53-82.
  3. Choi, Jin, Kil, Sun-Young, & Lim, Soon-Bum (2017). Development of web-based interface tool for map data visualization. Journal of Korea Multimedia Society, 20(8), 1216-1223. http://doi.org/10.9717/kmms.2017.20.8.1216
  4. Hwang, Hong Seop & Park, Ji Su (2016). Development and application of the elementary school safety map based on public data. Social Studies Education, 55(4), 115-129.
  5. Kil, Sun-Young, Choi, Jin, & Lim, Soon-Bum (2016). Development of a web application for map visualization using D3.js. Proceedings of Korean Institute of Information Scientists and Engineers, 1941-1943.
  6. Kim, Minjung (2020). A study on the visualization of epidemic data by chronicles. Journal of the Korean Society of Design Culture, 26(3), 19-33. http://doi.org/10.18208/ksdc.2020.26.3.19
  7. Kim, MinJung (2021). A study on geospatial visualization strategies based on infectious disease data: focused on website dashboard UI. Journal of the Korean Society Design Culture, 27(3), 27-38. http://doi.org/10.18208/ksdc.2021.27.3.27
  8. Kim, So-Yeon, An, Se-Yun, & Ju, Hannah (2021). Development of the guidelines for expressing big data Visualization. Journal of the Korea Contents Association, 21(2), 100-112.
  9. Kwak, Ho-wan, Kwahk, Jie-un, Kim, Su-jin, & Lee, Jung-Mo (2000). Usability testing of the domestic web site design: questionnaire and heuristic evaluation. Korean Journal of Cognitive Science, 11(1), 33-45.
  10. Park, Joohwan, Han, Sungho, Park, Jaehyun, Park, Wonkyu, Kim, Hyunkyung, & Hong, Sang-Woo (2012). Comparison of usability evaluation methods for mobile application. Proceedings of Ergonomics Society of Korea, 154-157.
  11. SGISplus. Available: https://sgis.kostat.go.kr/view/administStats/newlyDash
  12. Smart Seoul-map. Available: https://map.seoul.go.kr/smgis2/policyMap
  13. Schwabish, J. A. (2021). Better Data Visualizations: A Guide for Scholars, Researchers, and Wonks. 정순욱 옮김 (2022). 어나더레벨 데이터 시각화: 사회과학 분야의 연구원을 위한 데이터 시각화 안내서. 서울: 에이콘.
  14. Wilke, C. O. (2019). Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures. 권혜정 옮김 (2020). 데이터 시각화 교과서: 데이터 분석의 본질을 살리는 그래프와 차트 제작의 기본 원리와 응용. 의왕: 책만.
  15. Alvaredo, F., Atkinson, A. B., Blanchet, T., Chancel, L., Bauluz, L., Fisher-Post, M., Flores, I., Garbinti, B., Goupille-Lebret, J., & Martinez-Toledano, C. (2020). Distributional National Accounts Guidelines, Methods and Concepts Used In the World Inequality Database. Paris School of Economics. Available: https://hal.science/hal-03307274
  16. Card, S. K., Mackinlay, J., & Shneiderman, B. (1999). Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann.
  17. Carr, D. (1999). Guidelines for Designing Information Visualization Applications. ECUE'99:01/12/1999-03/12/1999.
  18. Chen, C.-h., Hardle, W., Unwin, A., & Friendly, M. (2008). A Brief History of Data Visualization. Handbook of Data Visualization, 15-56.
  19. Chetty, R., Friedman, J. N., Hendren, N., Jones, M. R., & Porter, S. R. (2018). The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility (No. w25147). National Bureau of Economic Research. http://doi.org/ 10.3386/w25147
  20. Hartson, H. R., Andre, T. S., & Williges, R. C. (2001). Criteria for evaluating usability evaluation methods. International Journal of Human-computer Interaction, 13(4), 373-410. https://doi.org/10.1207/S15327590IJHC1304_03
  21. ISO, I. (2018). Ergonomics of Human-System Interaction-Part 11: Usability: Definitions and Concepts (ISO 9241-11: 2018).
  22. Komarkova, J., Visek, O., & Novak, M. (2007). Heuristic evaluation of usability of GeoWeb sites. Web and Wireless Geographical Information Systems: 7th International Symposium, W2GIS 2007, Cardiff, UK.
  23. Kosara, R., Drury, F., Holmquist, L. E., & Laidlaw, D. H. (2008). Visualization criticism. IEEE Computer Graphics and Applications, 28(3), 13-15.
  24. Kuparinen, L. (2016). Validation and extension of the usability heuristics for mobile map applications. In ICC & GIS2016: Proceedings of the 6th International Conference on Cartography & GIS (Vol. 1 and 2). Bulgarian Cartographic Association.
  25. Kuparinen, L., Silvennoinen, J., & Isomaki, H. (2013). Introducing usability heuristics for mobile map applications. In Proceedings of the 26th International Cartographic Conference. Dresden, Germany.
  26. Lewis, J. R. (2021). Measuring user experience with 3, 5, 7, or 11 points: does it matter? Human Factors, 63(6), 999-1011. https://doi.org/10.1177/0018720819881312
  27. Li, Q. & Li, Q. (2020). Overview of data visualization. Embodying Data: Chinese Aesthetics, Interactive Visualization and Gaming Technologies, 17-47. https://doi.org/10.1007/978-981-15-5069-0_2
  28. Marquez, J. O., Meirelles, P., & da Silva, T. S. (2021). Interactive web maps: usability heuristics proposal. Proceedings of the ICA, 4(70), https://doi.org/10.5194/ica-proc-4-70-2021
  29. Moro, E., Calacci, D., Dong, X., & Pentland, A. (2021). Mobility patterns are associated with experienced income segregation in large US cities. Nature Communications, 12(1), 4633. https://doi.org/10.1038/s41467-021-24899-8
  30. Nielsen, J. (1994). Usability Engineering. San Francisco: Morgan Kaufmann.
  31. Shneiderman, B. (2003). The eyes have it: a task by data type taxonomy for information visualizations. The Craft of Information Visualization, 364-371. https://doi.org/10.1016/B978-155860915-0/50046-9
  32. Stock, K. & Guesgen, H. (2016). Geospatial reasoning with open data. Automating Open Source Intelligence, 171-204. https://doi.org/10.1016/B978-0-12-802916-9.00010-5
  33. The Atlas of Inequality. Available: https://inequality.media.mit.edu/
  34. The Opportunity Atlas. Available: https://www.opportunityatlas.org/
  35. Victorelli, E. Z. & Reis, J. C. D. (2020). Human-data Interaction Design Guidelines for Visualization Systems. Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, 1-10. https://doi.org/10.1145/3424953.3426511
  36. Waddell, C., Regan, B., Henry, S. L., Burks, M. R., Thatcher, J., Urban, M. D., & Bohman, P. (2003). Constructing Accessible Web sites. California: Apress Berkeley.
  37. World Inequality Database. Available: https://wid.world/world/