Browse > Article
http://dx.doi.org/10.9717/kmms.2012.15.4.425

Interaction Augmented Reality System using a Hand Motion  

Choi, Kwang-Woon (중앙대학교 첨단영상대학원)
Jung, Da-Un (중앙대학교 첨단영상대학원)
Lee, Suk-Han (중앙대학교 첨단영상대학원)
Choi, Jong-Soo (중앙대학교 첨단영상대학원)
Publication Information
Journal of Korea Multimedia Society / v.15, no.4, 2012 , pp. 425-438 More about this Journal
Abstract
In this paper, We propose Augmented Reality (AR) System for the interaction between user's hand motion and virtual object motion based on computer vision. The previous AR system provides inconvenience to user because the users have to control the marker and the sensor like a tracker. We solved the problem through hand motion and provide the convenience to the user. Also the motion of virtual object using a physical phenomenon gives a reality. The proposed system obtains geometrical information by the marker and hand. The system environments like virtual space of moving virtual ball and bricks are made by using the geometrical information and user's hand motion is obtained from the hand's information with extracted feature point through the taping hand. And it registers a virtual plane stably by getting movement of the feature points. The movement of the virtual ball basically is parabolic motion with a parabolic equation. When the collision occurs either the planes or the bricks, we show movement of the virtual ball with ball position and normal vector of plane and the ball position is faulted. So we showed corrected ball position through experiment. and we proved that this system can replaced the marker system to compare to jitter of augmented virtual object and progress speed with it.
Keywords
Augmented reality; Hand motion;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 O. Bergig, N. Hagbi, and J. El-Sana, "In-Place 3D Sketching for Authoring and Augmenting Mechanical Systems," IEEE International Symposium on Mixed and Augmented Reality, pp. 87-94, 2009.
2 Y. Uematsu and H. Saito, "Interactive AR Bowling System by Vision-Based Tracking," Proceedings of the International Conference on Advances in Computer Entertainment Technology, pp. 236-237, 2007.
3 H. Kaufmann and B. Meyer, "Simulating Educational Physical Experiments in Augmented reality," ACM SIGGRAPH ASIA 2008, pp. 1-8, 2008.
4 C. Chae and K. Ko, "Introduction of Physics Simulation in Augmented Reality," International Symposium on Ubiquitous Virtual Reality, pp. 37-40, 2008.
5 C.S. Chua, H. Guan, and Y.K. Ho, "Model- Based 3D Hand Posture Estimation from a Single 2D Image," Image and Vision Computing, Vol.20, No.3, pp. 191-202, 2002.   DOI
6 R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge Univ. Press, London, 2003.
7 이정진, 김종호, 김태영, "증강현실 응용을 위한 손 끝점 추출과 손 동작 인식 기법," 한국멀티미디어학회 논문지, 13권, 2호, pp. 316-323, 2010.   과학기술학회마을
8 R.T. Azuma, "A Survey of Augmented Reality," Presence, Teleoperators and Virtual Environments, Vol.6, No.4, pp. 355-385, 1997.   DOI
9 S. Vogt, A. Khamene, F. Sauer, A. Keil, and H. Niemann, "A High Performance AR System for Medical Applications," ISMAR 2003, pp. 270-271, 2003.
10 C. Bichlmeier, S.M. Heining, M. Feuerstein, and N. Navab, "The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments," IEEE Transactions on Medical Imageing, Vol.28, No.9, pp. 1498-1510, 2009.   DOI
11 D. Wagner and I. Barakonyi, "Augmented Reality Kanji Learning," ISMAR 2003, pp. 335, 2003.
12 T. Miyashita, P. Meier, T. Tachikawa, S. Orlic, T. Eble, V. Scholz, A. Gapel, O. Gerl, S. Arnaudov, and S. Lieberknecht, "An Augmented Reality Museum guide," ISMAR 2008, pp. 103-106, 2008.
13 Z. Szalavari, E. Eckstein, and M. Gervautz, "Collaborative Gaming in Augmented Reality," Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 195-204, 2008.
14 B. Thomas, B. Close, J. Donoghue, J. Squires, P. deBondi , M. Morris, and W. Piekarski, "ARQuake: An Outdoor/Indoor Augmented Reality First Person Application," Proceeedings of the 4th IEEE International Symposium on Wearable Computers, pp. 139-146, 2000.
15 H. Bay, A. Ess, T. Tuytelaars, and L.V. Gool, "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding, Vol 110, No.3, pp. 346-359, 2008.   DOI   ScienceOn
16 T. Ohshima, K. Satoh, H. Yamamoto, and H. Tamura, "AR2Hockey: A Case Study of Collaborative Augmented Reality," Proceedings of the Virtual Reality Annual International Symposium, pp. 268-275, 1998.
17 D.G. Lowe, "Distinve Image Features from Scale-Invarinat Keypoints," International Journal of Computer Vision, Vol.60, No.2, pp. 90-110, 2004.
18 J. Shi and C. Tomasi, "Good Features to Track," IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, 1994.
19 M. Leotta and K. Boyle, "Plausible Physics in Augmented Images," ACM SIGGRAPH 2005, pp. 53, 2005.
20 H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proceedings of the 2nd International Workshop on Augmented Reality, pp. 85-94. 1999.
21 Li. Yingzhu, L.-K. Shark, S.J. Hobbs, and J. Ingham, "Real-Time Immersive Table Tennis Game for Two Players with Motion Tracking," International Conference Information Visualisation, pp. 500-505, 2010.
22 B.H. Thomas and W. Piekarski, "Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment," Virtual Reality: Research, Development, and Applications, Vol.6, No.3, pp. 167-180, 2002.   DOI
23 S.H. Lee and J.S. Choi, "AR Squash Game," ISMAR 2007, pp. 4-8, 2007.
24 M. Imura, T. Amada, Y. Yasumuro, and Y. Manabe, "Synthetic Representation of Virtual Fluid for Mixed Reality," International Conference on Virtual Reality, pp. 135-142, 2006.