International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Lower Limb EMG-Based Virtual Reality Interface for Enhanced VR Interaction

  • Gyounghyun Kim (Department of Smart System, Kwangwoon University) ;
  • Heejun Youn (Department of Plasma Bio Display, Kwangwoon University) ;
  • Seunghyun Lee (Ingenium College Liberal Arts, Kwangwoon University) ;
  • Soonchul Kwon (Graduate School of Smart Convergence, Kwangwoon University)
  • Received : 2024.10.24
  • Accepted : 2024.11.05
  • Published : 2024.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

One of the key elements for maximizing user immersion in virtual reality (VR) is the development of intuitive and sensory interaction methods. While physical devices such as controllers in existing VR equipment are used to control the user's movement intentions, their drawback is that they cannot reflect detailed muscle strength. In this study, we designed a novel interaction method that increases user immersion by reflecting the activity of leg muscles in the VR environment, moving away from the traditional hand-centered control method. In the experiment, surface electromyography (sEMG) was used to measure the muscle activity of the gastrocnemius and tibialis anterior muscles in six participants. Within the VR program, various virtual objects were implemented that responded to the movement and strength of the lower limbs, allowing for a detailed reflection of the user's lower limb movements in the VR environment. The results showed that the interaction method using lower limb muscle activity demonstrated higher user immersion and satisfaction compared to the conventional controller-based method. Additionally, participants reported feeling as if they were using their entire body, greatly enhancing the sense of realism in the VR experience. This study presents a new interaction paradigm utilizing lower limb movements in VR technology and demonstrates its potential for application in various fields such as VR games, rehabilitation training, and sports simulation.

Keywords

Acknowledgement

This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program(IITP-2024-RS-2023-00258639) supervised by the IITP(Institute for Information & Communications Technology Planning & Evaluation).

References

  1. A.M. Al-Ansi, M. Jaboob, A. Garad, and A. Al-Ansi, "Analyzing augmented reality (AR) and virtual reality (VR) recent development in education", Social Sciences & Humanities Open, Vol. 8, No. 1, pp. 100532, 2023.10. DOI: https://doi.org/10.1016/j.ssaho.2023.100532
  2. L.T. De Paolis, C. Gatto, L. Corchia, and V. De Luca, "Usability, user experience and mental workload in a mobile Augmented Reality application for digital storytelling in cultural heritage" Virtual Reality, Vol. 27, No. 2, pp. 1117-1143, 2023. DOI: https://doi.org/10.1007/s10055-022-00712-9
  3. T. Rose, C.S. Nam, and K.B. Chen, "Immersion of virtual reality for rehabilitation-Review" Applied ergonomics, Vol. 69, pp. 153-161, 2018. DOI: https://doi.org/10.1016/j.apergo.2018.01.009
  4. S. Pyo, J. Lee, K. Bae, S. Sim, and J. Kim, "Recent progress in flexible tactile sensors for human-interactive systems: from sensors to advanced applications" Advanced Materials, Vol. 33, No. 47, pp. 2005902, 2021. DOI: https://doi.org/10.1002/adma.202005902
  5. V. Ricotti, B. Kadirvelu, V. Selby, R. Festenstein, E. Mercuri, T. Voit, and A.A. Faisal, "Wearable full-body motion tracking of activities of daily living predicts disease trajectory in Duchenne muscular dystrophy" Nature medicine, Vol. 29, No. 1, pp. 95-103, 2023. DOI: https://doi.org/10.1038/s41591-022-02045-1
  6. A.M. Al-Ansi, M. Jaboob, A. Garad, and A. Al-Ansi, "Analyzing augmented reality (AR) and virtual reality (VR) recent development in education" Social Sciences & Humanities Open, Vol. 8, No. 1, pp. 100532, 2023. DOI: https://doi.org/10.1016/j.ssaho.2023.100532
  7. D. Kutak, P.P. Vazquez, T. Isenberg, M. Krone, M. Baaden, J. Byska, and H. Miao, "State of the art of molecular visualization in immersive virtual environments", Computer Graphics Forum, Vol. 42, No. 6, pp. e14738, September 2023. DOI: https://doi.org/10.1111/cgf.14738
  8. N. Jiang, T. Liu, Z. Cao, J. Cui, Z. Zhang, Y. Chen, and S. Huang, "Full-body articulated human-object interaction", Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9365-9376, 2023. DOI: https://doi.org/10.1109/iccv51070.2023.00859
  9. A. Al-Jumaily and R.A. Olivares, "Electromyogram (EMG) driven system based virtual reality for prosthetic and rehabilitation devices", Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services, pp. 582-586, December 2009. DOI: https://doi.org/10.1145/1806338.1806448
  10. A. Phinyomark, E. Campbell, and E. Scheme, "Surface electromyography (EMG) signal processing, classification, and practical considerations", Biomedical Signal Processing: Advances in Theory, Algorithms and Applications, pp. 3-29, 2020. DOI: https://doi.org/10.1007/978-981-13-9097-5_1
  11. A.F.T. Ibrahim, V.R. Gannapathy, L.W. Chong, and I.S.M. Isa, "Analysis of electromyography (EMG) signal for human arm muscle: A review", Advanced Computer and Communication Engineering Technology: Proceedings of ICOCOE 2015, pp. 567-575, 2016. DOI: https://doi.org/10.1007/978-3-319-24584-3_49
  12. V. Simkovic, V. Zajicek and R. Hajtmanek, "User Tracking in VR Environment", 2019 International Conference on Engineering Technologies and Computer Science (EnT), Moscow, Russia, 2019, pp. 80-84, doi: 10.1109/EnT.2019.00022. DOI: https://doi.org/10.1109/EnT.2019.00022
  13. N. Albers, B. Hizli, B.L. Scheltinga, E. Meijer, and W.P. Brinkman, "Setting physical activity goals with a virtual coach: vicarious experiences, personalization and acceptance", Journal of medical systems, Vol. 47, No. 1, pp. 15, 2023. DOI: https://doi.org/10.1007/s10916-022-01899-9
  14. Farfan, Fernando D., Julio C. Politti, and Carmelo J. Felice. "Evaluation of EMG processing techniques using information theory", Biomedical engineering online 9 (2010): 1-18. DOI: https://doi.org/10.1186/1475-925X-9-72
  15. R. Fu, B. Zhang, H. Liang, S. Wang, Y. Wang, and Z. Li, "Gesture recognition of sEMG signal based on GASF-LDA feature enhancement and adaptive ABC optimized SVM", Biomedical Signal Processing and Control, Vol. 85, pp. 105104, 2023. DOI: https://doi.org/10.1016/j.bspc.2023.105104
  16. Rembold, Christopher M. "Regulation of contraction and relaxation in arterial smooth muscle" Hypertension 20.2 (1992): 129-137.2023 DOI: https://doi.org/10.1161/01.HYP.20.2.129
  17. M. Al-Ayyad, H.A. Owida, R. De Fazio, B. Al-Naami, and P. Visconti, "Electromyography monitoring systems in rehabilitation: A review of clinical applications, wearable devices and signal acquisition methodologies", Electronics, Vol. 12, No. 7, pp. 1520, 2023. DOI: https://doi.org/10.3390/electronics12071520
  18. K. Fukui, N. Maeda, M. Komiya, S. Tsutsumi, K. Harada, S. Kuroda, and Y. Urabe, "Walking Practice Combined with Virtual Reality Contributes to Early Acquisition of Symmetry Prosthetic Walking: An Experimental Study Using Simulated Prosthesis", Symmetry, Vol. 13, No. 12, pp. 2282, December 2021. DOI: https://doi.org/10.3390/sym13122282
  19. G. Lim, H. Youn, H. Kim, H. Jeong, J. Cho, S. Lee, and S. Kwon, "Impact of Mixed Reality-Based Rehabilitation on Muscle Activity in Lower-Limb Amputees: An EMG Analysis", IEEE Access, Vol. 12, pp. 106415-106431, 2024. DOI: https://doi.org/10.1109/ACCESS.2024.3436710
  20. F. Palermo, M. Cognolato, I. Eggel, M. Atzori, and H. Muller, "An augmented reality environment to provide visual feedback to amputees during sEMG Data Acquisitions", Towards Autonomous Robotic Systems: 20th Annual Conference, TAROS 2019, London, UK, July 3-5, 2019, Proceedings, Part II 20, pp. 3-14, July 2019. DOI: https://doi.org/10.1007/978-3-030-25332-5_1
  21. A.O. Andrade, S. Nasuto, P. Kyberd, C.M. Sweeney-Reed, and F.R. Van Kanijn, "EMG signal filtering based on empirical mode decomposition", Biomedical Signal Processing and Control, Vol. 1, No. 1, pp. 44-55, 2006. DOI: https://doi.org/10.1016/j.bspc.2006.03.003
  22. M. Besomi, P.W. Hodges, E.A. Clancy, J. Van Dieen, F. Hug, M. Lowery, and K. Tucker, "Consensus for experimental design in electromyography (CEDE) project: Amplitude normalization matrix", Journal of Electromyography and Kinesiology, Vol. 53, pp. 102438, 2020. DOI: https://doi.org/10.1016/j.jelekin.2020.102438