Browse > Article

A study on hand gesture recognition using 3D hand feature  

Bae Cheol-Soo (관동대학교)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.10, no.4, 2006 , pp. 674-679 More about this Journal
Abstract
In this paper a gesture recognition system using 3D feature data is described. The system relies on a novel 3D sensor that generates a dense range mage of the scene. The main novelty of the proposed system, with respect to other 3D gesture recognition techniques, is the capability for robust recognition of complex hand postures such as those encountered in sign language alphabets. This is achieved by explicitly employing 3D hand features. Moreover, the proposed approach does not rely on colour information, and guarantees robust segmentation of the hand under various illumination conditions, and content of the scene. Several novel 3D image analysis algorithms are presented covering the complete processing chain: 3D image acquisition, arm segmentation, hand -forearm segmentation, hand pose estimation, 3D feature extraction, and gesture classification. The proposed system is tested in an application scenario involving the recognition of sign-language postures.
Keywords
gesture recognition; 3d depth image; hand segmentation; feature extraction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 N. Jojic, B. Brumitt, B. Meyers, S. Harris, and T. Huang. 'Detection and estimation of pointing gestures in dense disparity maps.', in Proc. Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000
2 D. M. Gavrila, 'The Visual Analysis of Human Movement: A Survey.', CVIU, v.73 no.1, pp.82-98, 1999   DOI   ScienceOn
3 A. Utsumi and J. Ohya. 'Multiple hand gesture tracking using multiple cameras.', in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999
4 R. O. Duda, E. Hart, and D. G. Stock. 'Pattern Classification.', Wiley, 2001
5 V. I. Pavlovic, R. Sharma, T. S. Huang, 'Visual interpretation of hand gestures for human-computer interaction: a review.', IEEE transactions on pattern analysis and machine intelligence, v.19 no.7, pp.677-695,1997   DOI   ScienceOn
6 R. Grzeszcuk, G. Bradski, M. H. Chu, and J. Y. Bouguet. ' Stereo based gesture recognition invariant to 3d pose and lighting.', in Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 1, 2000
7 F. Forster, M. Lang, and B. Radic. 'Real-time 3d and color camera.', in Proc. ICAV3D 2001, Mykonos, Greece, May 2001
8 C. C. Lien, C. L. Huang, 'Model-based articulated hand motion tracking for gesture recognition.', Image and vision computing, v.16 no.2, pp.121-134, 1998   DOI   ScienceOn
9 C. Jennings. 'Robust finger tracking with multiple cameras,', in Proc. Intl. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 1999