Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.04.057

Controlling Position of Virtual Reality Contents with Mouth-Wind and Acceleration Sensor  

Kim, Jong-Hyun (Dept. of Software Application, Kangnam University)
Abstract
In this paper, we propose a new framework to control VR(Virtual reality) contents in real time using user's mouth-wind and acceleration sensor of mobile device. In VR, user interaction technology is important, but various user interface methods is still lacking. Most of the interaction technologies are hand touch screen touch or motion recognition. We propose a new interface technology that can interact with VR contents in real time using user's mouth-wind method with acceleration sensor. The direction of the mouth-wind is determined using the angle and position between the user and the mobile device, and the control position is adjusted using the acceleration sensor of the mobile device. Noise included in the size of the mouth wind is refined using a simple average filter. In order to demonstrate the superiority of the proposed technology, we show the result of interacting with contents in game and simulation in real time by applying control position and mouth-wind external force to the game.
Keywords
VR content controls; User interface; Mouth-wind; Acceleration sensor; Mobile device;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 M. Buckwald. (2014) Leap motion. https://developer.leapmotion.com/documentation/.
2 P. Trotta. (2018) Captoglove. https://www.captoglove.com/downloads/.
3 V. Omni. (2018) Cyberith virtualizer. https://www.cyberith.com/research-development/.
4 Facebook. (2018) Oculus go. https://developer.oculus.com/documentation/.
5 W. Zhao, J. Chai, and Y.-Q. Xu, "Combining markerbased mocap and rgb-d camera for acquiring high-fidelity hand motion data," in Proceedings of the 11th ACM SIGGRAPH/Eurographics conference on Computer Animation, 2012, pp. 33-42..
6 T. Cakmak and H. Hager, "Cyberith virtualizer: a locomotion device for virtual reality," in ACM SIGGRAPH 2014 Emerging Technologies, 2014, p. 6.
7 K. Hinckley, J. Pierce, M. Sinclair, and E. Horvitz, "Sensing techniques for mobile interaction," in Proceedings of the 13th annual ACM symposium on User interface software and technology, 2000, pp. 91-100.
8 I. E. Sutherland, "A head-mounted three dimensional display,"in Proceedings of the December 9-11, 1968, fall joint computer conference, part I, 1968, pp. 757-764.
9 Sangtae Kim, Soobin Lee, and Sungkwan Jung, "Method for recognizing individual users using mobile device and 3d depth camera," Proceedings of Symposium of the Korean Institute of communications and Information Sciences, pp. 489-490, 2015.
10 Jong-Hyun Kim, "Interaction technique in simulations using mouth-wind on mobile devices," Journal of the Korea Computer Graphics Society, vol. 24, no. 4, pp. 21-27, 2018..   DOI
11 T. Labs. (2014) Myo gesture control armband. https://support.getmyo.com/hc/enus/categories/200376235-Developing-With-Myo.
12 C. Schissler, A. Nicholls, and R. Mehra, "Efficient hrtf-based spatial audio for area and volumetric sources," IEEE transactions on visualization and computer graphics, vol. 22, no. 4, pp. 1356-1366, 2016.   DOI
13 H. G. Hoffman, "Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments," in Virtual Reality Annual International Symposium, 1998. Proceedings., IEEE 1998, 1998, pp. 59-63.
14 C. Carvalheiro, R. Nobrega, H. da Silva, and R. Rodrigues, "User redirection and direct haptics in virtual environments," in Proceedings of the 2016 ACM on Multimedia Conference, 2016, pp. 1146-1155.
15 S. Rawat, S. Vats, and P. Kumar, "Evaluating and exploring the myo armband," in System Modeling & Advancement in Research Trends (SMART), International Conference, 2016, pp. 115-120.
16 Chung-Jae Lee, Jong-Hyun Kiml, Jung Lee and Sun-Jeong Kim, "Verification of the usefulness of smartphone for wrist swing motion in vr environments," Journal of Korea Game Society, vol. 17, no. 3, pp. 53-62, 2017.   DOI
17 J. Stam, "Stable fluids," in Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, ser. ACM SIGGRAPH, 1999, pp. 121-128.