Browse > Article
http://dx.doi.org/10.5762/KAIS.2013.14.10.5169

A Framework for 3D Hand Gesture Design and Modeling  

Kwon, Doo-Young (Department of New Media, Korean German Institute of Technology)
Publication Information
Journal of the Korea Academia-Industrial cooperation Society / v.14, no.10, 2013 , pp. 5169-5175 More about this Journal
Abstract
We present a framework for 3D hand gesture design and modeling. We adapted two different pattern matching techniques, Dynamic Time Warping (DTW) and Hidden Markov Models (HMMs), to support the registration and evaluation of 3D hand gestures as well as their recognition. One key ingredient of our framework is a concept for the convenient gesture design and registration using HMMs. DTW is used to recognize hand gestures with a limited training data, and evaluate how the performed gesture is similar to its template gesture. We facilitate the use of visual sensors and body sensors for capturing both locative and inertial gesture information. In our experimental evaluation, we designed 18 example hand gestures and analyzed the performance of recognition methods and gesture features under various conditions. We discuss the variability between users in gesture performance.
Keywords
3D Hand Gesture; Gesture Design; Gesture Evaluation; Gesture Recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 X. Cas, R. Balakrishnan: Visionwand: interaction techniques for large displays using a passive wand tracked in 3d. In Proceedings of UIST '03, pp. 173- 182. 2003. DOI: http://dx.doi.org/10.1145/964696.964716   DOI
2 A. Wilson., S. Shafer.: Xwand: Ui for intelligent spaces. In Proceedings of ACM CHI'03, pp. 545-522. 2003. DOI: http://dx.doi.org/10.1145/642611.642706   DOI
3 J. Rekimoto: Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Proceedings of the ISWC '01, p. 21. 2001. DOI: http://dx.doi.org/10.1109/ISWC.2001.962092   DOI
4 P. Keir, J. Payne, J. Elgoyhen, M. Horner, M. Naef, and P. Anderson. Gesture-recognition with nonreferenced tracking. In Proceedings of the 3D User Interfaces (3DUI'06), 2006. DOI: http://dx.doi.org/10.1109/VR.2006.64   DOI
5 E. Tuulari and A. Ylisaukko-oja. Soapbox: A platform for ubiquitous computing research and applications. In Proceedings of Pervasive '02, pages 125-138, 2002. DOI: http://dx.doi.org/10.1007/3-540-45866-2_11   DOI   ScienceOn
6 K. Tsukada and M. Yasamura. Ubi-finger: Gesture input device for mobile use. In Proceedings of APCHI '02, pages 388-400, 2002.
7 J.K. Perng, B. Fisher, and S. Hollar et al. Acceleration sensing glove. In Proceedings of The Third International Symposium on Wearable Computers, pages 178-179, 1999. DOI: http://dx.doi.org/10.1109/ISWC.1999.806717   DOI
8 Z.Zhang.. Flexible camera calibration by viewing a plane from unknown orientations. In Proceedings of the 7th International Conference on Computer Vision 1999, pages 662-673, 1999 DOI: http://dx.doi.org/10.1109/ICCV.1999.791289   DOI
9 OpenSource Computer Vision Library. Intel Corp. , http://www.intel.com.
10 L. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proceedings of the IEEE, volume 77, pages 257-286, Feburuary 1989. DOI: http://dx.doi.org/10.1109/5.18626   DOI   ScienceOn
11 M. H. Ko, G. West, S. Venkatesh, and M. Kumar. Online context recognition in multisensor systems using dynamic time warping. In Proceedings of ISSNIP '05, 2005.
12 E. Keogh and M. Pazzani. Derivative dynamic time warping. In Proceedings in First SIAM International Conference on Data Mining, 2001. DOI: http://dx.doi.org/10.1109/ISSNIP.2005.1595593
13 S. T., Auxier, J., Ashbrook: The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In Proceedings of ISWC 2000. DOI: http://dx.doi.org/10.1109/ISWC.2000.888469   DOI
14 D. Y. Kwon and M. Gross. Combining body sensors and visual sensors for motion training. In Proceedings of ACM SIGCHI ACE'05, pages 94-101. 2005. DOI: http://dx.doi.org/10.1145/1178477.1178490   DOI