Multimodal Interface Control Module for Immersive Virtual Education

몰입형 가상교육을 위한 멀티모달 인터페이스 제어모듈

  • 이재협 (한국기술교육대학교 컴퓨터공학부) ;
  • 임성민 (숙명여자대학교 교육학과)
  • Received : 2013.05.28
  • Accepted : 2013.06.20
  • Published : 2013.06.30

Abstract

This paper suggests a multimodal interface control module which allows a student to naturally interact with educational contents in virtual environment. The suggested module recognizes a user's motion when he/she interacts with virtual environment and then conveys the user's motion to the virtual environment via wireless communication. Futhermore, a haptic actuator is incorporated into the proposed module in order to create haptic information. Due to the proposed module, a user can haptically sense the virtual object as if the virtual object is exists in real world.

본 연구에서는 학습자가 가상공간 내에서 교육 컨텐츠를 자연스럽게 조작할 수 있는 멀티모달 인터페이스 제어모듈을 제시한다. 제안하는 모듈은 사용자가 가상공간과 인터랙션을 할 때 사용자의 모션을 인식하고 인식된 정보를 무선통신을 통하여 가상공간으로 전달한다. 제안하는 입력장치는 햅틱 액츄에이터를 탑재하고 있어 교육 컨텐츠와 사용자의 인터랙션에 따른 햅틱 감각을 생성하여 사용자가 교육용 컨텐츠들을 쉽게 조작할 수 있게 해 준다.

Keywords

References

  1. M. Hereld, I. R. Judson and R. L. Stevens, "Introduction to Building Projection-based Tiled Displays," IEEE Visualization 1999, pp.215-224, San Francisco, CA, Oct, 1999
  2. R. Yang, D. Gotz, J. Hensley, H. Towles, and M. Brown, "PixelFlex: A Reconfigurable Multi-Projector Display System," IEEE Visualization 2001, San Diego California, Oct. 2001
  3. Y. Chen, H. Chen, D. Clark, Z. Liu, G. Wallace, and K. Li, "Software Environments for Cluster-based Display Systems," IEEE International Symposium on Cluster Computing and the Grid, pp.202-210, Brisbane, Australia, 2001
  4. M. Hereld, I. R. Judson, and R. L. Stevens, "Introduction to Building Projection-based Tiled Display Systems", IEEE Computer Graphics and Applications, vol 20(4), pp 22-28, 2000.
  5. H. Sugaman, and A. Weisel Eichler, "Use of the Wii Fit system for the treatment of balance problems in the elderly : A feasibility study", Virtual Rehabilitation International Conference, pp.111-116, 2009.
  6. Microsoft, ESPN Winter X Games, Website, http://www.microsoft.com, 2010
  7. Nintendo, WII Remote, Website, http://www.nintendo.com,2006
  8. Sungmin Im, Doyoon Kim, Jaehyub Lee and Sangyoun Kim, "Virtual Reality based Immersive Technology Education System", KIPEE, Feb, pp. 44 - 50, 2009
  9. Jinhwa Cho,, Seongsoo Kim and Yeongtaek Kim,, "Mesh Simplification Considering Volume and Boundary Reservation", IITA-2350-396