Browse > Article

Efficient Fingertip Tracking and Mouse Pointer Control for Implementation of a Human Mouse  

박지영 (성균관대학교 정보통신학부)
이준호 (성균관대학교 정보통신학부)
Abstract
This paper discusses the design of a working system that visually recognizes hand gestures for the control of a window based user interface. We present a method for tracking the fingertip of the index finger using a single camera. Our method is based on CAMSHIFT algorithm and performs better than the CAMSHIFT algorithm in that it tracks well particular hand poses used in the system in complex backgrounds. We describe how the location of the fingertip is mapped to a location on the monitor, and how it Is both necessary and possible to smooth the path of the fingertip location using a physical model of a mouse pointer. Our method is able to track in real time, yet not absorb a major share of computational resources. The performance of our system shows a great promise that we will be able to use this methodology to control computers in near future.
Keywords
Human Computer Interface (HCI); Human Mouse; Tracking;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. Jennings, 'Robust finger tracking with multiple cameras' International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 152-160, 1999   DOI
2 J. Rehg and T. Kanade, 'Visual Analysis of High DOF Articulated Object with Application to Hand Tracking,' CMU Tech. Report CMU-CS-95-138, Carnegie Mellon University, April, 1993
3 R. Kjeldsen and J. Render, 'Towards the use of Gesture in Traditional User Interfaces,' International Conference on Automatic Face and Gesture Recognition, pp.151-156, 1996   DOI
4 W. T. Freeman, K. Tanaka, J. Ohta and K. Kyuma, 'Computer vision for computer games' Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp. 100-105, 1996
5 B. K. P. Horn, 'Robot vision,' MIT Press, 1986
6 Gary R. Bradski, 'Computer Vision Face Tracking For Use in a Perceptual User Interface,' Intel Technology Journal Q2, 1998
7 R. Kjeldsen, 'Visual Interpretation of Hand Gestures as a Practial Interface Modality' PhD Thesis, Department of Computer Science, Columbia University, October 1996
8 Andrew Wu, Mubarak Shah and N. da Vitoria Lobo, 'A Virtual 3D Blackboard: 3D Finger Tracking using a Single Camera' Proceedings of the Fourth International Conference on Atomatic Face and Gesture Reconition, pp. 536-543, 2000   DOI
9 김유호, 김종선, 박지영, '휴먼 마우스 구현을 위한 효율적인 검지 좌표 검출 및 추적', HCI 학술대회, 한국정보과학회 10권 1호, pp800-805, 2001
10 R. Kjeldsen and J. Kender 'Interaction with On-Screen Objects using Visual Gesture Recognition' IEEE Conference on Computer Vision and Pattern Recognition, pp. 788-793, 1997   DOI
11 Harvey Gould and Jan Tobochnik 'An Introduction to Computer Simulation Methods' Addison Wesley Publishing Company, 1996