The Journal of Korea Institute of Information, Electronics, and Communication Technology (한국정보전자통신기술학회논문지)

Korea Information Electronic Communication Technology (한국정보전자통신기술학회)
권호 표지
DOI QR코드

DOI QR Code

Virtual Reality Contents for Rehabilitation Training Utilizing Skeletal Data and Foot Pressure Mat

골격 데이터와 발 압력매트를 활용한 재활 훈련용 가상 현실 콘텐츠

  • Jongwook Si (Dept. of Computer.AI Convergence Engineering, Kumoh National Institute of Technology) ;
  • Hyeri Jeong (Dept. of Computer Engineering, Kumoh National Institute of Technology) ;
  • Sangjin Lee (Dept. of Computer Engineering, Kumoh National Institute of Technology) ;
  • Sungyoung Kim (Dept. of Computer Engineering, Kumoh National Institute of Technology)
  • Received : 2024.09.24
  • Accepted : 2024.10.12
  • Published : 2024.10.29
Download PDF
⟨ Previous Next ⟩

Abstract

With the growing interest in rehabilitation therapy and exercise programs, there is an increasing need for smart content that simultaneously addresses both health and engagement. Particularly, exercises performed in a state of physical imbalance carry a high risk of injury, making it essential to detect and integrate balance into the training process. This paper proposes Rehabilitation Training program that combines a pressure platform with virtual reality (VR) technology to address this issue. The program enables users to perform exercises such as squats, stationary walking, and forward-backward walking in a VR environment, utilizing real-time foot pressure data captured through a pressure mat. Additionally, an algorithm based on YOLOv8-pose extracted skeletal coordinates is proposed to assess body balance and automatically count squat repetitions. The experimental results showed an average accuracy of 87.9% for each posture, confirming that users can be provided with a safer, more efficient, and immersive training experience through this approach.

최근 재활 치료와 운동 프로그램에 대한 관심이 증가함에 따라, 건강과 재미를 동시에 충족할 수 있는 스마트콘텐츠 개발의 필요성이 커지고 있다. 특히, 신체 불균형 상태에서의 운동은 부상 위험이 높아, 균형을 감지하고 이를 반영한 훈련이 중요하다. 본 논문에서는 이러한 문제를 해결하기 위해 발 압력매트와 가상 현실(VR) 기술을 결합한 재활 운동 프로그램을 제안한다. 이 프로그램은 VR 환경에서 스쿼트, 제자리 걷기, 앞뒤로 걷기 등의 운동을 수행할 수 있으며, 발 압력매트를 통해 실시간으로 발 압력을 감지하여 활용한다. 또한, YOLOv8-pose 기반으로 추출된 골격 좌표를 활용한 알고리즘을 제안하여 신체 균형을 평가하고, 스쿼트 횟수를 자동으로 계산하는 기능도 포함한다. 실험 결과 각각의 자세에 대하여 평균적으로 87.9%의 정확도를 보였으며, 이를 통해 사용자는 더욱 안전하고 효율적인 맞춤형 훈련 경험과 몰입감 있는 훈련 경험을 제공할 수 있음을 확인하였다.

Keywords

Acknowledgement

Following are results of a study on the "Leaders in INdustry-university Cooperation 3.0" Project, supported by the Mi nistry of Education and National Research Foundation of Korea

References

  1. J. Yang and J. Lee, "Utilization exercise rehabilitation using metaverse (vr.ar.mr.xr)". Korean Journal of Sport Biomechanics, Vol. 31, No. 4, pp. 249-258, 2021.
  2. K. Cho, J. Park, and A. Kang, "Metaverse for Exercise Rehabilitation: Possibilities and Limitations", International Journal of Environmental Research and Public Health, Vol. 20, No. 8, pp. 5483-5494, 2023.
  3. S. Son, J. Si, and S. Kim, "Development of Metaverse Rehabilitation Content for Body Balance and Gait Analysis". Proceedings of KIIT Conference, pp. 414-415, Nov. 2023.
  4. J. Si, H. Son, D. Kim, M. Kim, J. Jeong, G. Kim, Y. Kim, and S. Kim, "Fall Detection using Skeletal Coordinate Vector and LSTM Model", Journal of Korean Institute of Information Technology, Vol. 18, No. 12, pp. 19-29, 2020.
  5. S. Lee and M. Lee, "Real-Time Display Color Temperature Automatic Control Method Based on Stress Parameters to Improve Visual Comfort in VR Environment", Journal of Korea Multimedia Society, Vol. 27, No, 7, pp. 745-757, 2024.
  6. S. Kong, J. Kim, G. Jeong, G. Roh, E. Park, Y. Cho, and J. Kim, "Production of Virtual Electrical Circuit Practice Education Contents based on Mixed Reality using Meta Quest Pro", Journal of the Korea Computer Graphics Society, Vol. 30, No. 3, pp. 61-69, 2024.
  7. J. Kim, E. Bae, J. Lee, S. Ahn, and H. Bae, "New approach to Forest Virtual Reality based rehabilitation platform", Journal of Rehabilitation Welfare Engineering & Assistive Technology, Vol. 18, No. 2, pp. 47-53, 2024.
  8. M. Kang and H. Lee, "Development of Virtual-Reality based Verb Learning Program for Children with Language Disorders", Journal of the Korea Entertainment Industry Association, Vol. 18, No. 2, pp. 103-112, 2024.
  9. C. Yoon, S. Yang, J. Park, J. Si, Y. Jung, and S. Kim, "Metaverse Virtual Interview Platform Leveraging Generative AI and Speech Recognition", The Journal of Korean Institute of Information Technology, Vol. 22, No. 6, pp. 163-173, 2024.
  10. D. Park, J. Yeo, and K. Shin, "Development of an Early Childhood Figure Skating Program by the Motor Developmental Phase", Korean Journal of Convergence Science, Vol. 13, No. 1, pp. 47-62, 2024.
  11. T. Yoon and K. Lee, "Design and implementation of an interactive fitness platform", Journal of Korea Game Society, Vol. 23, No. 5, pp. 111-120, 2023.
  12. Smart Mat for Rehabilitation Exercises, https://doi.org/10.8080/1020220142587
  13. YOLOv8-Pose, https://docs.ultralytics.com/ko/tasks/pose/