Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Usability Test of Serious Game Robot App for Hospitalized Children

입원 아동 환자를 위한 로봇용 기능성 게임 앱 사용성 평가

  • Received : 2018.11.19
  • Accepted : 2019.02.01
  • Published : 2019.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

This study was conducted to evaluate the usability of serious-game apps for robots that are being developed for hospitals to add familiarity to hospital life for hospitalized patients. We conducted a usability test of 10 experts and 12 elementary school students with inpatient experience. The usability evaluation of the developed apps was based on the professional (MARS) evaluation tool and the user (uMARS) evaluation tool. The results of the usability test of the serious game robot app were $3.67{\pm}0.342$ for professionals and $3.68{\pm}0.592$ for children. The expert group obtained the highest score in the aesthetics category, and the user group obtained the highest score in the functionality category. In the subjective comments, the experts pointed out the game layout and the consistency of the style. According to the children, the methods were easy to learn, and the screen movement was mainly described. Both groups received low ratings in terms of engagement through participation. This study will provide useful reference material when the functional game app is actually installed in the robot and the usability test is conducted again after the results obtained in this study are considered.

본 논문은 입원 아동 환자들에게 병원생활에 익숙함을 더하기 위해 병원을 배경으로 개발한 로봇용 기능성 게임앱의 사용성 평가를 하기 위한 것이다. 전문가 10명과 입원 경험이 있는 초등학생 12명을 대상으로 사용성 평가를 실시하였다. 개발된 앱의 사용성 평가는 전문가용(MARS) 평가도구와 사용자용(uMARS) 평가도구를 사용하였다. 전체적으로 개발된 로봇용 기능성 게임 앱의 사용성 평가 결과는 전문가용은 $3.67{\pm}0.342$점이고 아동용은 $3.68{\pm}0.592$점으로 비슷한 결과를 나타냈다. 전문가 집단으로부터 평가에서는 심미성(aesthetics) 측면에서 가장 높은 점수를 받았고 사용자 집단으로부터 평가에서는 기능성(functionality) 측면에서 가장 높은 점수를 받았다. 주관식 의견에서도 동일하게 전문가의 의견에서는 게임 배치, 스타일의 일관성 등을 지적하였고, 아동의 의견에서는 방법을 익히기 쉬움, 화면 이동 등 위주로 기술하였다. 두 집단에서 모두 참여를 통한 관심 유도(engagement) 측면에서 낮은 평가를 받았다. 본 연구에서 도출된 결과들을 반영하여 향후 입원해 있는 아동을 대상으로 기능성 게임 앱을 개발한 로봇에 실제로 장착하고 사용성 평가를 다시 진행할 때 의미 있는 참고자료가 되기를 기대한다.

Keywords

SHGSCZ_2019_v20n2_228_f0001.png 이미지

Fig. 1. Prototype of “MUN” Robots

SHGSCZ_2019_v20n2_228_f0002.png 이미지

Fig. 2. Screen of Serious Game App for Robots

Table 1. Mean and Standard deviation of each item

SHGSCZ_2019_v20n2_228_t0001.png 이미지

Table 2. Comments from expert and child group

SHGSCZ_2019_v20n2_228_t0002.png 이미지

References

  1. M. G. Kang, H. J. Lee, Y. T. Kim, "The Current Status of the Use of Robots for Children with Disabilities", special education, vol. 12, no.3, pp. 127-152, Oct. 2013. DOI :10.18541/ser.2013.10.12.3.127
  2. G. M. R. Jung, "Current Status and Prospects of the Game Industry", Journal of Game Industry, vol. 1, no. 4, pp. 1-8, 2010.
  3. H. J. Lee, "Change to Useful Game: Trends of Serious Game", Electronics and telecommunications trends, vol. 27, no. 3, pp. 43-50, Jun. 2012. DOI: 10.22648/ETRI.2012.J.270305
  4. S. Dehem, G. Stoquart, T. Lejeune, I. Brouwers, V. Montedoro, M. Edwards, S. Heins, D. Galinski, B. Dehez, "Assessment of upper limb motor impairments in children with cerebral palsy using a rehabilitation robot and serious game exercise", Paper presented at the the 5th IEEE Conference on Serious Games and Applications for Health, 2017.
  5. KISDI STAT Researcher. "2017 KISDI STAT Report", [cited 2017 December 15], Available From: http://m.kisdi.re.kr/mobile/repo/stat_view.m?key1=14242 &selectPage= (accessed Oct. 10, 2018)
  6. H. W. Baek, Y. M. Shin, K. M. Shin, "Emotional and Behavioral Problems Related to Smartphone Overuse in Elementary School Children". J Korean Neuropsychiatr Assoc, vol. 53, no. 5, pp. 320-326, Sep. 2014. DOI: http://dx.doi.org/10.4306/jknpa.2014.53.5.320
  7. LV. Calderita, P. Bustos, C. Suarez-Mejias, B. Ferrer-Gonzalez, A. Bandera, "Rehabilitation for Children while Playing with a Robotic Assistant in a Serious Game". Paper presented at the Neurotechnix. 2013. DOI: 10.5220/0004646700890096
  8. R. Labruyere, C. N. Gerber, K. Birrer-Brutsch, A. Meyer-Heim, H. J. van Hedel, "Requirements for and impact of a serious game for neuro-pediatric robot-assisted gait training", Res Dev Disabil, vol. 34, no. 11, pp. 3906-3915, Nov. 2013. DOI: 10.1016/j.ridd.2013.07.031
  9. J. G. Jo, W. H. Heo, "Usability Evaluation Frameworks of Mobile Apps on SmartPhone", Asia-pacific journal of multimedia services convergent with art, humanities, and sociology, vol. 7, no. 12, pp. 841-848, Dec. 2017. DOI:http://dx.doi.org/10.14257/ajmahs.2017.12.24
  10. J. H. Park, S. H. Han, J. H. Park, W. G. Park, H. G. Kim, & S. W. Hong, "Comparison of Usability Evaluation Methods for Mobile Application", Ergonomics Society of Korea Conference Proceedings, pp.154-157, 2012.
  11. J. C. Bastien, "Usability testing: a review of some methodological and technical aspects of the method", International journal of medical informatics, vol.79, no. 4, pp. e18-e23, 2010. DOI: https://doi.org/10.1016/j.ijmedinf.2008.12.004
  12. W. Hwang, G. Salvendy, "Number of people required for usability evaluation: the $10{\pm}2$ rule", Communications of the ACM, vol. 53, no. 5, pp. 130-133, May 2010. DOI: 10.1145/1735223.1735255
  13. S. R. Stoyanov, L. Hides, D. J. Kavanagh, O. Zelenko, D. Tjondronegoro, M. Mani, "Mobile app rating scale: a new tool for assessing the quality of health mobile apps", JMIR mHealth and uHealth, vol. 3, no. 1, 2015. DOI: 10.2196/mhealth.3422
  14. S. R. Stoyanov, L. Hides, D. J. Kavanagh, H. Wilson, "Development and validation of the user version of the Mobile Application Rating Scale(uMARS)", JMIR mHealth and uHealth, vol. 4, no. 2, pp. e72, Jun. 2016. DOI: 10.2196/mhealth.5849
  15. J. Y. Lee, "Development and evaluation of hyperlipidemia management mobile application based on transtheoretical model", Doctoral thesis. [cited 2017 August], Available From: http://www.riss.kr/link?id=T14619667 (accessed Oct. 10, 2018)
  16. A. J. Byun, "Development and Evaluation of Smartphone App Healthy Kids for Children's Weight Control with Their Parents", Master Thesis, [cited 2018 February], Available From: http://www.riss.kr.libproxy.snu.ac.kr/link?id=T14817668 (accessed Oct. 10, 2018)
  17. J. G. Jo, "Usability Evaluation using Heuristic Evaluation Method in Mobile Apps", Asia-pacific journal of multimedia services convergent with art, humanities, and sociology, vol. 8, no. 6, pp. 919-926, Jun. 2018.
  18. S. Schoeppe, S. Alley, A. L. Rebar, M. Hayman, N. A. Bray, W. V. Lippevelde, J. P. Gnam, P. Bachert, A. Direito, C. Vandelanotte, "Apps to improve diet, physical activity and sedentary behaviour in children and adolescents: a review of quality, features and behaviour change techniques", International Journal of Behavioral Nutrition and Physical Activity, vol. 14, no. 1 pp.83, Jun. 2017. DOI: https://doi.org/10.1186/s12966-017-0538-3