Browse > Article
http://dx.doi.org/10.5909/JBE.2014.19.6.942

RGB Camera-based Real-time 21 DoF Hand Pose Tracking  

Choi, Junyeong (Department of Computer and Software, Hanyang University)
Park, Jong-Il (Department of Computer Science and Engineering, Hanyang University)
Publication Information
Journal of Broadcast Engineering / v.19, no.6, 2014 , pp. 942-956 More about this Journal
Abstract
This paper proposes a real-time hand pose tracking method using a monocular RGB camera. Hand tracking has high ambiguity since a hand has a number of degrees of freedom. Thus, to reduce the ambiguity the proposed method adopts the step-by-step estimation scheme: a palm pose estimation, a finger yaw motion estimation, and a finger pitch motion estimation, which are performed in consecutive order. Assuming a hand to be a plane, the proposed method utilizes a planar hand model, which facilitates a hand model regeneration. The hand model regeneration modifies the hand model to fit a current user's hand, and improves robustness and accuracy of the tracking results. The proposed method can work in real-time and does not require GPU-based processing. Thus, it can be applied to various platforms including mobile devices such as Google Glass. The effectiveness and performance of the proposed method will be verified through various experiments.
Keywords
hand tracking; particle swarm optimization; human computer interaction; computer interface;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. Kim, O. Hilliges, S. Izadi, A. Butler, J. Chen, I. Oikonomidis, and P. Olivier, "Digits: freehand 3D interactions anywhere using a wristworn gloveless sensor," Proc. of the 25th annual ACM Symposium on User Interface Software and Technology, pp. 167-176, 2012.
2 Google Glass, http://www.google.com/glass/.
3 J.-H. Kim, N. D. Thang, and T.-S. Kim, "3-D hand motion tracking and gesture recognition using a data glove," Proc. of IEEE International Symposium on Industrial Electronics, pp. 1013-1018, 2009.
4 R. Y. Wang and J. Popovic, "Real-time hand-tracking with a color glove," ACM Transactions on Graphics, vol. 28, no. 3, 2009.
5 P. Mistry and P. Maes, "SixthSense: a wearable gestural interface," Proc. of ACM SIGGRAPH ASIA 2009 Sketches, 2009.
6 Z. Zhao and A. Elgammal, "Spatiotemporal pyramid representation for recognition of facial expressions and hand gestures," Proc. of 8th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 1-6, 2008.
7 C. Cao, Y. Sun, R. Li,and L. Chen, "Hand posture recognition via joint feature sparse representation," Optical Engineering, vol. 50, no. 12, 127210, 2011.   DOI
8 J. Choi, J. Park, H. Park, and J.-I. Park, "iHand: an interactive bare-hand-based augmented reality interface on commercial mobile phones," Optical Engineering, vol. 52, no. 2, 027206, 2013.   DOI
9 B. Stenger, A. Thayananthan, P. H. S. Torr, and R. Cipolla, "Filtering using a tree-based estimator," Proc. of 9th IEEE International Conference on Computer Vision, vol. 2, pp. 1063-1070, 2003.
10 I. Oikonomidis, N. Kyriazis, and A. A. Argyros, "Efficient model- based 3D tracking of hand articulations using kinect," Proc. of the 22nd British Machine Vision Conference, 2011.
11 K. Li, I.-M. Chen, S. H. Yeo, and C. K. Lim, "Development of finger-motion capturing device based on optical linear encoder," Journal of Rehabilitation Research & Development, vol. 48, no. 1, pp. 69-82, 2011.   DOI   ScienceOn
12 I. Oikonomidis, N. Kyriazis and A.A. Argyros, "Tracking the articulated motion of two strongly interacting hands", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 18-20, 2012.
13 S. Sridhar, A. Oulasvirta, and C. Theobalt, "Interactive markerless articulated hand motion tracking using RGB and depth data," Proc. of IEEE International Conference on Computer Vision, pp. 2456-2463, 2013.
14 C. Xu and L. Cheng, "Efficient hand pose estimation from a single depth image," Proc. of IEEE International Conference on Computer Vision, pp. 3456-3462, 2013.
15 T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, 2002.
16 OpenMP Fortran Application Program Interface, http://www.openmp.org/.
17 M. Clerc and J. Kennedy, "The particle swarm-explosion, stability, and convergence in a multidimensional complex space," IEEE Transactions on Evolutionary Computation, vol. 6, no. 1, pp. 58-73, 2002.   DOI   ScienceOn