International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

Gesture Control Gaming for Motoric Post-Stroke Rehabilitation

  • Received : 2023.10.05
  • Published : 2023.10.30
Download PDF
⟨ Previous Next ⟩

Abstract

The hospital situation, timing, and patient restrictions have become obstacles to an optimum therapy session. The crowdedness of the hospital might lead to a tight schedule and a shorter period of therapy. This condition might strike a post-stroke patient in a dilemma where they need regular treatment to recover their nervous system. In this work, we propose an in-house and uncomplex serious game system that can be used for physical therapy. The Kinect camera is used to capture the depth image stream of a human skeleton. Afterwards, the user might use their hand gesture to control the game. Voice recognition is deployed to ease them with play. Users must complete the given challenge to obtain a more significant outcome from this therapy system. Subjects will use their upper limb and hands to capture the 3D objects with different speeds and positions. The more substantial challenge, speed, and location will be increased and random. Each delegated entity will raise the scores. Afterwards, the scores will be further evaluated to correlate with therapy progress. Users are delighted with the system and eager to use it as their daily exercise. The experimental studies show a comparison between score and difficulty that represent characteristics of user and game. Users tend to quickly adapt to easy and medium levels, while high level requires better focus and proper synchronization between hand and eye to capture the 3D objects. The statistical analysis with a confidence rate(α:0.05) of the usability test shows that the proposed gaming is accessible, even without specialized training. It is not only for therapy but also for fitness because it can be used for body exercise. The result of the experiment is very satisfying. Most users enjoy and familiarize themselves quickly. The evaluation study demonstrates user satisfaction and perception during testing. Future work of the proposed serious game might involve haptic devices to stimulate their physical sensation.

Keywords

Acknowledgement

This work was supported by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah Saudi Arabia. The authors, therefore, gratefully acknowledge the DSR technical and financial support.

References

  1. R. Baldwin and B. W. d. Mauro, Mitigating the COVID Economic Crisis: Act Fast and Do Whatever It Takes, a VoxEU.org, CEPR Press. 2020.
  2. G. Burdea et al., "Assistive game controller for artificial intelligence-enhanced telerehabilitation post-stroke," Assistive Technology, pp. 1-12, 2019.
  3. T. Richmond et al., "American Telemedicine Association's Principles for Delivering Telerehabilitation Services," (in eng), Int J Telerehabil, vol. 9, no. 2, pp. 63-68, Fall 2017. https://doi.org/10.5195/ijt.2017.6232
  4. S. Massalha, O. Clarkin, R. Thornhill, G. Wells, and B. J. W. Chow, "Decision Support Tools, Systems, and Artificial Intelligence in Cardiac Imaging," Canadian Journal of Cardiology, vol. 34, no. 7, pp. 827-838, 2018/07/01/ 2018. https://doi.org/10.1016/j.cjca.2018.04.032
  5. M. Agostini et al., "Telerehabilitation and recovery of motor function: a systematic review and meta-analysis," (in eng), J Telemed Telecare, vol. 21, no. 4, pp. 202-13, Jun 2015. https://doi.org/10.1177/1357633X15572201
  6. M. Kamkarhaghighi, P. Mirza-Babaei, and K. El-Khatib, "Game-Based Stroke Rehabilitation," in Recent Advances in Technologies for Inclusive Well-Being: From Worn to Off-body Sensing, Virtual Worlds, and Games for Serious Applications, A. L. Brooks, S. Brahnam, B. Kapralos, and L. C. Jain, Eds. Cham: Springer International Publishing, 2017, pp. 147-162.
  7. Y. X. Hung, P. C. Huang, K. T. Chen, and W. C. Chu, "What Do Stroke Patients Look for in Game-Based Rehabilitation: A Survey Study," (in eng), Medicine (Baltimore), vol. 95, no. 11, p. e3032, Mar 2016.
  8. M. C. Beato, E. Morton, C. Iadarola, L. Winterberger, and N. Dawson, "Can the Wii Fit Balance Board be Used as a Fall Risk Assessment Tool among Poststroke Patients?," Journal of Stroke and Cerebrovascular Diseases, vol. 29, no. 2, p. 104500, 2020/02/01/ 2020.
  9. U. Ritterfeld, M. J. Cody, and P. Vorderer, Serious Games: Mechanisms and effects. New York: Routledge. 2009.
  10. B. Ferreira and P. Menezes, "Gamifying Motor Rehabilitation Therapies: Challenges and Opportunities of Immersive Technologies," Information, vol. 11, no. 2, 2020.
  11. B. Ferreira, J. Lourenco, and P. Menezes, "A Serious Game for Post-Stroke Motor Rehabilitation," in 2019 5th Experiment International Conference (exp.at'19), 2019, pp. 383-387.
  12. F. L. F. Eichinger, A. V. Soares, F. Noveletto, Y. Sagawa, P. Bertemes Filho, and S. C. Domenech, "Serious game for rehabilitation of the lower limb of hemiparetics patients after stroke," Annals of Physical and Rehabilitation Medicine, vol. 61, pp. e486-e487, 2018/07/01/ 2018. https://doi.org/10.1016/j.rehab.2018.05.1134
  13. J. Jonsdottir, R. Bertoni, M. Lawo, A. Montesano, T. Bowman, and S. Gabrielli, "Serious games for arm rehabilitation of persons with multiple sclerosis. A randomized controlled pilot study," Multiple Sclerosis and Related Disorders, vol. 19, pp. 25-29, 2018. https://doi.org/10.1016/j.msard.2017.10.010
  14. R. Friedrich, P. Hiesel, S. Peters, D. P. Siewiorek, A. Smailagic, and B. Brugge, "Serious Games for Home-based Stroke Rehabilitation," (in eng), Stud Health Technol Inform, vol. 213, pp. 157-60, 2015.
  15. M. N. A. v. d. Kuil, J. M. A. Visser-Meily, A. W. M. Evers, and I. J. M. v. d. Ham, "A Usability Study of a Serious Game in Cognitive Rehabilitation: A Compensatory Navigation Training in Acquired Brain Injury Patients," (in English), Frontiers in Psychology, Original Research vol. 9, no. 846, 2018-June-05 2018.
  16. N. Barrett, I. Swain, C. Gatzidis, and C. Mecheraoui, "The use and effect of video game design theory in the creation of game-based systems for upper limb stroke rehabilitation," Journal of Rehabilitation and Assistive Technologies Engineering, vol. 3, p. 2055668316643644, 2016/01/01 2016.
  17. K. E. Laver, B. Lange, S. George, J. E. Deutsch, G. Saposnik, and M. Crotty, "Virtual reality for stroke rehabilitation," Cochrane Database of Systematic Reviews, no. 11, 2017.
  18. D. B. Mekbib et al., "Virtual reality therapy for upper limb rehabilitation in patients with stroke: a meta-analysis of randomized clinical trials," Brain Injury, vol. 34, no. 4, pp. 456-465, 2020/03/20 2020. https://doi.org/10.1080/02699052.2020.1725126
  19. L. Sheehy et al., "Home-based virtual reality training after discharge from hospital-based stroke rehabilitation: a parallel randomized feasibility trial," Trials, vol. 20, no. 1, p. 333, 2019/06/07 2019.
  20. P. J. Standen et al., "A low cost virtual reality system for home based rehabilitation of the arm following stroke: a randomised controlled feasibility trial," (in eng), Clin Rehabil, vol. 31, no. 3, pp. 340-350, Mar 2017. https://doi.org/10.1177/0269215516640320
  21. A. H. Basori, "Emotion Walking for Humanoid Avatars Using Brain Signals," International Journal of Advanced Robotic Systems, vol. 10, no. 1, p. 29, 2013/01/01 2013.
  22. A. H. Basori, "End-effector wheeled robotic arm gaming prototype for upper limb coordination control in home-based therapy," Telkomnika, vol. 18, no. 4, pp. 2080-2086, 2020. https://doi.org/10.12928/telkomnika.v18i4.3775
  23. E. Amengual Alcover, A. Jaume-i-Capo, and B. Moya-Alcover, "PROGame: A process framework for serious game development for motor rehabilitation therapy," PLOS ONE, vol. 13, no. 5, p. e0197383, 2018.
  24. J. Jonsdottir et al., "Response to commentary of Shirani and Okuda regarding "Unilateral arm rehabilitation for persons with multiple sclerosis using serious games in a virtual reality approach: Bilateral treatment effect?"," Multiple Sclerosis and Related Disorders, vol. 37, 2020.
  25. C. Chien-Yen et al., "Towards pervasive physical rehabilitation using Microsoft Kinect," in 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, 2012, pp. 159-162.
  26. O. Mubin, F. Alnajjar, N. Jishtu, B. Alsinglawi, and A. Al Mahmud, "Exoskeletons With Virtual Reality, Augmented Reality, and Gamification for Stroke Patients' Rehabilitation: Systematic Review," JMIR Rehabil Assist Technol, vol. 6, no. 2, p. e12010, 2019/9/8 2019.
  27. C. Wang et al., "A feasibility study of non-invasive motor-imagery BCI-based robotic rehabilitation for Stroke patients," in 2009 4th International IEEE/EMBS Conference on Neural Engineering, 2009, pp. 271-274.
  28. [M. Riduwan, A. H. Basori, and F. Mohamed, "Finger-based Gestural Interaction for Exploration of 3D Heart Visualization," Procedia - Social and Behavioral Sciences, vol. 97, pp. 684-690, 2013/11/06/ 2013. https://doi.org/10.1016/j.sbspro.2013.10.288
  29. A. H. Basori and H. M. Aljadali, "Telerobotic 3D Articulated Arm-Assisted Surgery Tools with Augmented Reality for Surgery Training," in TelehealthIntech: Intech, 2018.
  30. M. Maier, B. Rubio Ballester, A. Duff, E. Duarte Oller, and P. F. M. J. Verschure, "Effect of Specific Over Nonspecific VR-Based Rehabilitation on Poststroke Motor Recovery: A Systematic Meta-analysis," Neurorehabilitation and Neural Repair, vol. 33, no. 2, pp. 112-129, 2019/02/01 2019. https://doi.org/10.1177/1545968318820169
  31. R. Karamians, R. Proffitt, D. Kline, and L. V. Gauthier, "Effectiveness of Virtual Reality- and Gaming-Based Interventions for Upper Extremity Rehabilitation Poststroke: A Meta-analysis," Archives of Physical Medicine and Rehabilitation, vol. 101, no. 5, pp. 885-896, 2020/05/01/ 2020. https://doi.org/10.1016/j.apmr.2019.10.195
  32. H. S. Lee, Y. J. Park, and S. W. Park, "The Effects of Virtual Reality Training on Function in Chronic Stroke Patients: A Systematic Review and Meta-Analysis," (in eng), Biomed Res Int, vol. 2019, p. 7595639, 2019.
  33. K. Cho, J. Yu, and J. Jung, "Effects of Virtual Reality-Based Rehabilitation on Upper Extremity Function and Visual Perception in Stroke Patients: a Randomized Control Trial," Journal of Physical Therapy Science, vol. 24, no. 11, pp. 1205-1208, 2012. https://doi.org/10.1589/jpts.24.1205
  34. Y.-B. Oh et al., "Efficacy of Virtual Reality Combined With Real Instrument Training for Patients With Stroke: A Randomized Controlled Trial," Archives of Physical Medicine and Rehabilitation, vol. 100, no. 8, pp. 1400-1408, 2019/08/01/ 2019. https://doi.org/10.1016/j.apmr.2019.03.013