Browse > Article
http://dx.doi.org/10.5909/JBE.2014.19.1.83

MPEG-U based Advanced User Interaction Interface System Using Hand Posture Recognition  

Han, Gukhee (Multimedia Engineering, Hanbat National University)
Lee, Injae (Broadcasting & Telecommunications Media Research Department, ETRI)
Choi, Haechul (Multimedia Engineering, Hanbat National University)
Publication Information
Journal of Broadcast Engineering / v.19, no.1, 2014 , pp. 83-95 More about this Journal
Abstract
Hand posture recognition is an important technique to enable a natural and familiar interface in HCI(human computer interaction) field. In this paper, we introduce a hand posture recognition method by using a depth camera. Moreover, the hand posture recognition method is incorporated with MPEG-U based advanced user interaction (AUI) interface system, which can provide a natural interface with a variety of devices. The proposed method initially detects positions and lengths of all fingers opened and then it recognizes hand posture from pose of one or two hands and the number of fingers folded when user takes a gesture representing a pattern of AUI data format specified in the MPEG-U part 2. The AUI interface system represents user's hand posture as compliant MPEG-U schema structure. Experimental results show performance of the hand posture recognition and it is verified that the AUI interface system is compatible with the MPEG-U standard.
Keywords
MPEG-U; Depth camera; Hand and finger recognition; AUI(Advanced User Interaction); User interface;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Information technology - Rich media user interfaces - Part 2: Advanced user interaction (AUI) interfaces. - ISO/IEC 23007, Feb. 2012.
2 G. Han, A. Baek, and H. Choi, "MPEG-U part2 based Advanced User Interaction Interface System," Journal of Korea Contents Association, Vol. 12, No. 12, pp. 54-62, Dec. 2012.
3 Robert Y. Wang and Jovan Popovi, "Real-Time Hand-Tracking with a Color Glove," ACM Transactions on Graphics, Vol. 28, Issue. 3, No. 63, Aug. 2009.
4 R. Lockton and A. Fitzgibbon, "Real-time gesture recognition using deterministic boosting," BMVC, pp. 1-10, Sep. 2002.
5 Anastasios Roussos, Stavros Theodorakis, Vassilis Pitsikalis and Petros Maragos, "Hand tracking and affine shape-appearance handshape sub-units in continuous sign language recognition," ECCV Workshop on Sign, Gesture and Activity, Hersonissos, Crete, Greece, Sep. 2010.
6 Yuh-Rau Wang, Wei-Hung Lin, and Ling Yang, "A novel real time hand detection based on skin-color," Consumer Electronics (ISCE), IEEE 17th International Symposium on, pp. 141-142, Jun. 2013.
7 Xintao Li, Can Tang, Chun Gong, Sheng Cheng and Jianwei Zhang, "Hand Segmentation Based on Skin Tone and Motion Detection with Complex Backgrounds," Chinese Intelligent Automation Conference, Springer Berlin Heidelberg, Vol. 256, pp. 105-111, Jan. 2013.
8 V. Argyros and S. Sclaroff, "Database indexing methods for 3D hand pose estimation," Gesture Workshop, pp. 288-299. Apr. 2003.
9 Candescent NUI Samples & Source code http://candescentnui. codeplex. com/ SourceControl/latest#CCT.NUI.Visual/ClusterLayer. cs.
10 S. Malik, "Real-time hand tracking and finger tracking for interaction," CSC2503F Project Report, Department of Computer Science, University of Toronto, Dec. 2003.
11 C. Davatzikos and J. L. Prince, "Convexity analysis of active contour problems," Image Vision Computing, Vol. 17, pp. 27-36, Jan. 1999.   DOI   ScienceOn
12 I. Oikonomidis, N. Kyriazis and AA. Argyros, "Efficient Model-based 3D Tracking of Hand Articulations using Kinect," BMVC, pp. 101.1-101.11, Sep. 2011.
13 Junyeong Choi, Hanhoon Park and Jong-ll Park, "Hand shape recognition using distance transform and shape decomposition," Image Processing(ICIP), pp. 3605-3608, Sept. 2011.
14 KINECT. http://en.wikipedia.org/wiki/Kinect.
15 Sara Taskinen and David I, "Robust estimation and inference for bivariate line‐fitting in allometry," Biometrical Journal, pp. 652-672, Jun. 2011.
16 Pedro F. Felzenszwalb and Daniel P. Huttenlocher, "Distance Transforms of Sampled Functions," Theory of Computing, Vol. 8, pp. 415-428, Sep. 2012.   DOI