Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2009.16B.5.347

Motion Plane Estimation for Real-Time Hand Motion Recognition  

Jeong, Seung-Dae (경북대학교 전자전기컴퓨터학부)
Jang, Kyung-Ho (경북대학교 전자전기컴퓨터학부)
Jung, Soon-Ki (경북대학교 컴퓨터공학과)
Abstract
In this thesis, we develop a vision based hand motion recognition system using a camera with two rotational motors. Existing systems were implemented using a range camera or multiple cameras and have a limited working area. In contrast, we use an uncalibrated camera and get more wide working area by pan-tilt motion. Given an image sequence provided by the pan-tilt camera, color and pattern information are integrated into a tracking system in order to find the 2D position and direction of the hand. With these pose information, we estimate 3D motion plane on which the gesture motion trajectory from approximately forms. The 3D trajectory of the moving finger tip is projected into the motion plane, so that the resolving power of the linear gesture patterns is enhanced. We have tested the proposed approach in terms of the accuracy of trace angle and the dimension of the working volume.
Keywords
Camera; Vision; Tracking; Motion Recognition; Remote Control;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Barry Brumitt and JJ Cadiz, "Let There Be Light: Comparing Interfaces for Homes of the Future," Proceedings of INTERACT'01, pp.375-382, 2001.
2 Kai Nickel, Edgar Seemann and Rainer Stiefelhagen, "3D-Tracking of Head and Hands for Pointing Gesture Recognition in a Human-Robot Interaction Scenario," IEEE International Conference on Automatic Face and Gesture Recognition, pp.565-570, 2004.   DOI
3 Kazuhiko Sumi, Akihiro Sugimoto, Takashi Matsuyama, Masato Toda and Sotaro Tsukizawa, "Active Wearable Vision Sensor: Recognition of Human Activities and Environments," Proceedings of the International Conference on Informatics Research for Development of Knowledge Society Infrastructure, pp.15-22, 2004.   DOI
4 Odest Chadwicke Jenkins, German Gonzalez and Matthew Maverick Loper, "Tracking Human Motion and Actions for Interactive Robots," Proceeding of the ACM/IEEE international conference on Human-robot interaction, pp.365-372, 2007.   DOI
5 Paul P. Maglio, Teenie Matlock, Christopher S. Campbell, Shumin Zhai and Barton A. Smith, "Gaze and Speech in Attentive User Interfaces," Proceedings of the International Conference on Multimodal Interfaces, pp.1-7, 2000.
6 Qiang Zhu, Ching-Tung Wu, Kwang-Ting Cheng and Yi-Leh Wu, "An adaptive skin model and its application to objectionable image filtering," Proceedings of the 12th annual ACM international conference on Multimedia, pp.56-63, 2004.   DOI
7 Qi Jie Zhao, Da Wei Tu, Da Ming Gao and Ren San Wang, "Human-Computer Interaction Models and Their Application in an Eye-Gaze Input System," Proceedings of 2004 International Conference on Machine Learning and Cybernetics, pp.2274-2278, 2004.
8 Jakub Segen and Senthil Kumar, "Gesture VR: vision-based 3D hand interace for spatial interaction," Proceedings of the sixth ACM international conference on Multimedia, pp.455-464, 1998.   DOI
9 Andy Cassidy, Dan Hook and Avinash Baliga, "Hand Tracking using Spatial Gesture Modeling and Visual Feedback for a Virtual DJ System," Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, pp.197-202, 2002.   DOI
10 Yang Liu and Yunde Jia, "A Robust Hand Tracking and Gesture Recognition Method for Wearable Visual Interfaces and Its Applications," Proceedings of the Third International Conference on Image and Graphics, pp.472-475, 2004.   DOI
11 Le Song and Masahiro Takatsuka, "Real-time 3D Finger Pointing for an Augmented Desk," Proceedings of the Sixth Australasian conference on User interface, Vol.40, pp.99-108, 2005.
12 Alvaro Cassinelli, Stephane Perrin and Masatoshi Ishikawa, "Smart Laser-Scanner for 3D Human-Machine Interface," CHI'05 extended abstracts on Human factors in computing systems, pp.1138-1139, 2005.   DOI
13 Andrew Wu, Mubarak Shah and Niels da Vitoria Lobo, "A Virtual 3D Blackboard: 3D Finger Tracking Using a Single Camera," IEEE International Conference on Automatic Face and Gesture Recognition, pp.536-543, 2000.   DOI
14 Douglas Chai and King Ngan, "Face Segmentation Using Skin-Color Map in Videophone Applications," IEEE Transactions on Circuits and Systems for Video Technology, pp.551-564, 1999.   DOI   ScienceOn
15 Xiying Wang, Xiwen Zhang and Guozhong Dai, "Tracking of deformable human hand in real time as continuous input for gesture-based interaction," Proceedings of the 12th ACM International Conference on Intelligent user interfaces, pp.235-242, 2007.   DOI
16 N. Soontranon, Supavadee Aramvith and Thanarat H. Chalidabhongse, "Improved Face and Hand Tracking for Sign Language Recognition," Proceedings of the International Conference on Information Technology: Coding and Computing, Vol.2, pp.141-146, 2005.   DOI
17 Satoshi Yonemoto, Hiroshi Nakano and Rin-ichiro Taniguchi, "Avatar Motion Control by User Body Postures," Proceedings of the eleventh ACM international conference on Multimedia, pp. 347-350, 2003.   DOI