Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Skin Region Detection Using Histogram Approximation Based Mean Shift Algorithm

Mean Shift 알고리즘 기반의 히스토그램 근사화를 이용한 피부 영역 검출

  • Byun, Ki-Won (School of Electronics Eng., Pusan National University) ;
  • Joo, Jae-Heum (School of Multimedia Eng., Pusan Catholic University) ;
  • Nam, Ki-Gon (School of Electronics Eng., Pusan National University)
  • 변기원 (부산대학교 전자전기공학과) ;
  • 주재흠 (부산 가톨릭대학교 멀티미디어 공학과) ;
  • 남기곤 (부산대학교 전자전기공학과)
  • Received : 2010.11.11
  • Accepted : 2011.05.09
  • Published : 2011.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

At existing skin detection methods using skin color information defined based on the prior knowldege, threshold value to be used at the stage of dividing the backround and the skin region was decided on a subjective point of view through experiments. Also, threshold value was selected in a passive manner according to their background and illumination environments in these existing methods. These existing methods displayed a drawback in that their performance was fully influenced by the threshold value estimated through repetitive experiments. To overcome the drawback of existing methods, this paper propose a skin region detection method using a histogram approximation based on the mean shift algorithm. The proposed method is to divide the background region and the skin region by using the mean shift method at the histogram of the skin-map of the input image generated by the comparison of the similarity with the standard skin color at the CbCr color space and actively finding the maximum value converged by brightness level. Since the histogram has a form of discontinuous function accumulated according to the brightness value of the pixel, it gets approximated as a Gaussian Mixture Model (GMM) using the Bezier Curve method. Thus, the proposed method detects the skin region by using the mean shift method and actively finding the maximum value which eventually becomes the dividing point, not by using the manually selected threshold value unlike other existing methods. This method detects the skin region high performance effectively through experiments.

사전에 정의된 피부 색상 정보를 이용한 기존 피부 검출 방법들은 배경과 피부 영역을 분할하는 단계에서 사용되는 임계값을 실험을 통하여 주관적 관점에서 결정하였다. 또한 기존 방법들은 배경 환경과 조명 환경에 따라 각각 다른 임계값을 설정하였다. 이러한 기존 방법들은 반복 실험을 통하여 추정된 임계값에 따라 성능이 좌우되는 단점이 제시되었다. 제시된 기존 방법들의 단점을 극복하기 위하여 본 논문은 mean shift 알고리즘 기반의 히스토그램 근사화를 이용한 피부 영역 검출 방법을 제안한다. 제안하는 방법은 CbCr 컬러공간에서의 표준 피부색상과 유사도를 비교하여 생성된 입력 영상의 피부맵(skin-map)의 히스토그램에서 mean shift 방법을 이용하여 각각 밝기 영역별로 수렴하는 극대점을 능동적으로 찾아서 배경 영역과 피부영역으로 분할한다. 히스토그램은 픽셀의 명도값에 따라 누적되는 불연속 함수의 형태를 가지므로 베이지 곡선(Bezier curve) 기법을 이용하여 연속 가우시안 함수로 근사화된다. 따라서 제안하는 방법은 기존 방법에서처럼 수동적으로 임계값을 설정하는 방법을 사용하지 않고 mean shift 기법을 이용하여 능동적으로 영역 분할점인 극대점을 찾아서 피부 영역을 검출한다. 제안된 방법은 실험을 통하여 강인하고 효율적으로 피부 영역을 검출하였다.

Keywords

References

  1. Z. Jiang, Z. Wu and M. Yao, "Skin Detection on Images with Color Deviation," IEEE Trans Congress on Services Part II. pp. 171-174, 2008.
  2. S. Kherchaoui and A. Houacine, "Face Detection Based on A Model of the Skin Color with Constranins and Template Matching," Int'l Conf. Machine and Web Intell. pp. 469-472, 2010.
  3. L. Zhengming, Z. Tong and Z. Jin, "Skin Detection in Color Images," Int'l Conf. ICCET. pp. 156-159, 2010.
  4. T. Uongqiu, Y. Faling, C. Guohua and J. Shizhong, "Skin Color Detection by Illumination Estimation and Normalization in Shadow Regions," IEEE. Conf. ICIA. pp. 1082-1085, 2010.
  5. D.A. Socolinsky, A. Selinger, and J.D. Neuheisel, "Face Recognition with Visible and Thermal Infrared Imagery," Computer. Vision Image Understanding, vol. 91, nol. 1-2, pp. 72-114, 2003. https://doi.org/10.1016/S1077-3142(03)00075-4
  6. S.G. Kong, J. Heo, B.R. Abidi, J. Paik, and M.A. Abidi, "Recent Advances in Visual and Infrared Face Recognition: A Review," Computer Vision Image Understanding, vol. 97, 2005.
  7. A.S. Nunez and M. J Mendenhall, "Detection of Human Skin in Near Infrared Hyperspectral Imagery," IEEE. Int'l IGARSS. vol. 2, pp. 621-624, 2008.
  8. C. Liensberger, J. Stottinger and M. Kampel, "Color-Based and Context-Aware Skin Detectionfor Online Video Annotation," IEEE. Trans. Intl'l MMSP . pp. 1-6, 2009.
  9. Z. Pan, G. Healey, M. Prasad, and B. Tromberg, "Face Recognition in Hyperspectral Images," IEEE Trans. Pattern Anal. Mach. Intell, vol. 25, no. 12, 2003.
  10. E. Hjelm, and B.K. Low, "Face Detection: A Survey," Computer Vision and Image Understanding, vol. 83, no. 3, pp. 236-274, Sept. 2001. https://doi.org/10.1006/cviu.2001.0921
  11. M. Niazi and S. Jafar, "Hybrid Face Detection with HSV Color method and HAAR Classifier," Int'l Conf. Software Technology and Engineering, pp. 325-329, 2010.
  12. A. Popov and D. Dimitrova, "A New Approach for Finding Face Features in Color Images," IEEE. Int'l. Intelligent Systems, pp. 33-37, 2008.
  13. H. F. Hashem, "Adaptive Technique for Human Face Detection using HSV Color Space and Neural Networks," Radio Science Conf. pp. 1-7, 2009.
  14. W. Xinyu, X, Huosheng, W. Heng and L. Heng,"Robust Real-Time Face Detection with Skin Color Detection and The Modified Census Transform," Int'l Conf. ICIA. pp. 590-595, 2008.
  15. P. Sebastian and V. Vooi, "Tracking using Normalized Cross Correlation and Color Space," Intl'l Conf. Intelligent and Advanced Systems, pp. 770-774, 2007.
  16. R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, "Face Detection in Color Images," IEEE Trans. on PAMI, vol. 24, no. 5, pp.696-706, May 2002. https://doi.org/10.1109/34.1000242
  17. T. Darrell, G. G. Gordon, M. Harville, and J. Woodfill, "Integrated Person Tracking Using Stereo, Color, and Pattern Detection," Proc. IEEE Conf. CVPR, pp. 601-607, 1998.
  18. X. Zhu, J. Yang, and A. Waibel, "Segmenting Hands of Arbitrary Color," in Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 446-453, 2000.
  19. M. H. Yang and N. Ahuja, "Gaussian Mixture Model for Human Skin Color and Its Application in Image and Video Databases," in Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, pp. 458-466, 1999.
  20. D. Saxe and R. Foulds, "Toward Robust Skin Identification in Video Image, " in Porc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 379-384, 1996.
  21. K. Schwerdt and J. L. Crowley, "Robust Face Tracking Using Color," in Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp.90-95, 2000.
  22. M. Soraino, B. Martinkauppi, S. Huovinen, and M. Laaksonen, "Skin Detection in Video under Changing Illumination Conditiions," in Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 839-842, 2000.
  23. A. Pal, "Multicues Face Detection in Complex Background for Frontal Faces," Int'l. Machine Vision and Image Processing Conf. pp. 57-62, 2008.
  24. A. Diplaros, T. Gevers and N. Vlassis, "Skin Detection using The EM Algorithm with Spatial Constraints," IEEE. Int'l. Systems, Man and Cybernetics, vol. 4, pp. 3071-3075, 2004.
  25. Y. Ukil, K. Minsung, T. Kar-Ann and S. Kwanghoon, "An Illumination Invariant Skin-Color Model for Face Detection," IEEE. Int'l Conf. Biometrics: Theory Applications and Systems, pp. 1-6, 2010
  26. D. Hyun-Chul. Y. Ju-Yeon and C. Sung-Il, "Skin Color Detection through Estimation and Conversion of Illuminant Color under Various Illuminations," IEEE. Trans. Consumer Electronics, pp. 1103-1108, 2007.
  27. R. Ding and Y. Zhang, "The Extension of The Dual De Casteljau Algorithm," Int'l Conf. on PDCAT, pp. 688-692, Aug. 2003.