Browse > Article

Visual Touchless User Interface for Window Manipulation  

Kim, Jin-Woo (한양대학교 전자컴퓨터통신공학과)
Jung, Kyung-Boo (한양대학교 전자컴퓨터통신공학과)
Jeong, Seung-Do (한양대학교 전기정보통신기술연구소)
Choi, Byung-Uk (한양대학교 컴퓨터공학부)
Publication Information
Journal of KIISE:Software and Applications / v.36, no.6, 2009 , pp. 471-478 More about this Journal
Abstract
Recently, researches for user interface are remarkably processed due to the explosive growth of 3-dimensional contents and applications, and the spread class of computer user. This paper proposes a novel method to manipulate windows efficiently using only the intuitive motion of hand. Previous methods have some drawbacks such as burden of expensive device, high complexity of gesture recognition, assistance of additional information using marker, and so on. To improve the defects, we propose a novel visual touchless interface. First, we detect hand region using hue channel in HSV color space to control window using hand. The distance transform method is applied to detect centroid of hand and curvature of hand contour is used to determine position of fingertips. Finally, by using the hand motion information, we recognize hand gesture as one of predefined seven motions. Recognized hand gesture is to be a command to control window. In the proposed method, user can manipulate windows with sense of depth in the real environment because the method adopts stereo camera. Intuitive manipulation is also available because the proposed method supports visual touch for the virtual object, which user want to manipulate, only using simple motions of hand. Finally, the efficiency of the proposed method is verified via an application based on our proposed interface.
Keywords
User Interface; Visual Touchless; Window Manipulation; Hand Motion;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. Sharma, T. Darrell, M. P. Harper, G. Lazzari, and M. Turk, 'Visual touchpad: a two-handed gestural input device,' Proceedings of the 6th International Conference on Multimodal Interfaces, pp. 13-15, 2004
2 Q. Chen, N.D Georganas, and E.M. Petriu, 'Realtime Vision-based Hand Gesture Recognition Using Haar-like Features,' Instrumentation and Measurement Technology Conference Proceedings, IEEE, pp. 1-6, 2007
3 G. Borgefors, Distance transformations in digital images, Computer Vision, Graphics and Image Processing, Academic Press Professional, Inc, 1986
4 승억, 정종우, 서영완, '테이블탑 기기와 인터랙티브 벽면 디스플레이의 기술 동향과 응용', 정보과학회지, 26권 제3호 통권 제226호, pp. 5-14, 2008   과학기술학회마을
5 T. Lee and T. Hollerer, 'Handy AR : Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking,' 11th IEEE International Symposium on Wearable Computers, pp. 11-13, 2007   DOI
6 R. Almeida and P. Cubaud, 'Supporting 3D Window Manipulation with a Yawing Mouse,' Proceedings of the 4th Nordic conference on Humancomputer, Oslo, Norway, pp. 477-480, 2006   DOI
7 A.A. Argyros and M. I. A. Lourakis, 'Visionbased interpretation of hand gestures for remote control of a computer mouse,' Computer Vision in Human-Computer Interaction, pp. 40-51, 2006
8 F. Dadgostar and A. Sarrafzadeh, 'An adaptivereal- time skin detector based on Hue thresholding: A comparison on two motion tracking methods,' Pattern Recognition Letters, Vol.27, Issue 12, pp. 1342-1352, 2006   DOI   ScienceOn
9 A. Licsara and T. Szirányia, 'User-adaptive hand gesture recognition system with interactive training,' Image and Vision Computing, Vol.23, Issue 12, pp. 1102-1114, 2005   DOI   ScienceOn
10 A.A. Argyros and M. I. A. Lourakis, 'Real-time tracking of multiple skin-colored objects with a possibly moving camera,' European Conference on Computer Vision, Vol.3, pp. 368-379, 2004