Browse > Article
http://dx.doi.org/10.9717/kmms.2013.16.9.1031

Region-growing based Hand Segmentation Algorithm using Skin Color and Depth Information  

Seo, Jonghoon (연세대학교 컴퓨터과학과)
Chae, Seungho (연세대학교 컴퓨터과학과)
Shim, Jinwook (연세대학교 컴퓨터과학과)
Kim, Hayoung (연세대학교 컴퓨터과학과)
Han, Tack-Don (연세대학교 컴퓨터과학과)
Publication Information
Journal of Korea Multimedia Society / v.16, no.9, 2013 , pp. 1031-1043 More about this Journal
Abstract
Extracting hand region from images is the first part in the process to recognize hand posture and gesture interaction. Therefore, a good segmenting method is important because it determines the overall performance of hand recognition systems. Conventional hand segmentation researches were prone to changing illumination conditions or limited to the ability to detect multiple people. In this paper, we propose a robust technique based on the fusion of skin-color data and depth information for hand segmentation process. The proposed algorithm uses skin-color data to localize accurate seed location for region-growing from a complicated background. Based on the seed location, our algorithm adjusts each detected blob to fill up the hole region. A region-growing algorithm is applied to the adjusted blob boundary at the detected depth image to obtain a robust hand region against illumination effects. Also, the resulting hand region is used to train our skin-model adaptively which further reduces the effects of changing illumination. We conducted experiments to compare our results with conventional techniques which validates the robustness of the proposed algorithm and in addition we show our method works well even in a counter light condition.
Keywords
Hand segmentation; Region-growing; Skin color-depth hybrid;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 L. Dipietro, A.M. Sabatini, and P. Dario, "A Survey of Glove-Based Systems and Their Applications," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, Vol. 38, No. 4, pp. 461- 482, 2008.
2 J. Suarez and R.R. Murphy, "Hand Gesture Recognition with Depth Images: A Review," Proc. the 21st IEEE Int. Symposium on Robot and Human Interactive Communication, pp. 411-417, 2012.
3 D. Michel, I. Oikonomidis, and A. Argyros, "Scale Invariant and Deformation Tolerant Partial Shape Matching," Image and Vision Computing, Vol. 29, No. 7, pp. 459-469, 2011.   DOI   ScienceOn
4 I. Oikonomidis, N. Kyriazis, and A. Argyros, "Tracking the Articulated Motion of Two Strongly Interacting Hands," Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 1862-1869, 2012.
5 김지호, 박양우, 한규필, "기울기와 위치 정보를 이용한 손동작기반 실시간 숫자 인식기 구현," 정보처리학회지, 제2권, 제3호, pp. 199-204, 2013.   과학기술학회마을   DOI   ScienceOn
6 이광용, 황부현, "Airtouch 기술을 활용한 스마트융합 DID 시스템 설계," 한국항행학회논문지, 제17권, 제2호, pp. 240-246, 2013.   과학기술학회마을   DOI   ScienceOn
7 정지성, 김종오, 김도형, 권순옥, 주성연, 오원근, 류관희, "3D 전자교과서를 제어하기 위한 손 제스처 인터페이스," 한국컴퓨터게임학회논문지, 제25권, 제4호, pp. 119-127. 2012.
8 V. Vezhnevets, V. Sazonov, and A. Andreeva, "A Survey on Pixel-based Skin Color Detection Techniques," Proc. Int. Conf. Graphicon, pp. 85-92, 2003.
9 P. Kakumanu, S. Makrogiannis, and N. Bourbakis, "A Survey of Skin-color Modeling and Detection Methods," Pattern Recognition, Vol. 40, No. 3, pp. 1106-1122, 2007.   DOI   ScienceOn
10 박상윤, 이응주, "복잡한 영상에 강인한 손동작인식 방법," 멀티미디어학회논문지, 제13권, 제7 호, pp. 1000-1015, 2010.
11 F. Xu and K. Fujimura, "Human Detection using Depth and Gray Images," Proc. IEEE Int. Conf. on Advanced Video and Signal Based Surveillance, pp. 115-121, 2003.
12 X. Liu and K. Fujimura, "Hand Gesture Recognition using Depth Data," Proc. the 6th IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 529-534, 2004.
13 H. An and D. Kim, Hand Gesture Recognition using 3D Depth Data, Department of Computer Science and Engineering, Pohang University of Science and Technology, Korea, 2009.
14 Z. Ren, J. Yuan, and Z. Zhang, "Robust Hand Gesture Recognition based on Finger-earth Mover's Distance with a Commodity Depth Camera," Proc. the 19th ACM Int. Conf. on Multimedia, pp. 1093-1096, 2011.
15 K. Fujimura and X. Liu, "Sign Recognition using Depth Image Streams," Proc. the 7th Int. Conf. on Automatic Face and Gesture Recognition, pp. 381-386, 2006.
16 X. Chai, Y. Fang, and K. Wang, "Robust Hand Gesture Analysis and Application in Gallery Browsing," Proc. IEEE Int. Conf. on Multimedia and Expo, pp. 938-941, 2009.
17 M. Elmezain, A. Al-Hamadi, and B. Michaelis, "Improving Hand Gesture Recognition using 3D Combined Features," Proc. the 2nd Int. Conf. on Machine Vision, pp. 128-132, 2009.
18 M. Elmezain, A. Al-Hamadi, and B. Michaelis, "Hand Trajectory-based Gesture Spotting and Recognition using HMM," Proc. the 16th IEEE Int. Conf. on Image Processing, pp. 3577-3580, 2009.
19 M. Van den Bergh and L. Van Gool, "Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction," Proc. IEEE Workshop on Applications of Computer Vision, pp. 66-72, 2011.
20 S. Kang, A. Roh, and H. Hong, "Using Depth and Skin Color for Hand Gesture Classification," IEEE Int. Conf. on Consumer Electronics, pp. 155-156, 2011.
21 Q. Zhu, C.T. Wu, K.T. Cheng, and Y.L. Wu, "An Adaptive Skin Model and Its Application to Objectionable Image Filtering," Proc. the 12th ACM Int. Conf. on Multimedia, pp. 56-63, 2013.
22 C.O. Conaire, N.E. O'Connor, and A.F. Smeaton, "Detector Adaptation by Maximising Agreement Between Independent Data Sources," Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1- 6, 2007.
23 K. Kim, T.H. Chalidabhongse, D. Harwood, and L. Davis, "Real-time Foreground-background Segmentation using Codebook Model," Real-Time Imaging, Vol. 11, No. 3, pp. 172- 185, 2005.
24 B.H. Oh, J.H. An, and K.S. Hong, "Mobile User Interface using a Robust Fingertip Detection Algorithm for Complex Lighting and Background Conditions," Int. Proc. of Computer Science and Information Technology, Vol. 27, pp. 143-147, 2012.
25 F. Dadgostar and A. Sarrafzadeh, "An Adaptive Real-time Skin Detector Based on Hue Thresholding: A Comparison on Two Motion Tracking Methods," Pattern Recognition Letters, Vol. 27, No. 12, pp. 1342-1352, 2006.   DOI   ScienceOn