Journal of the Institute of Electronics and Information Engineers (전자공학회논문지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Selective Incremental Learning for Face Tracking Using Staggered Multi-Scale LBP

얼굴 추적에서의 Staggered Multi-Scale LBP를 사용한 선택적인 점진 학습

  • Lee, Yonggeol (Department of Computer Science and Engineering, Dankook University) ;
  • Choi, Sang-Il (Department of Computer Science and Engineering, Dankook University)
  • Received : 2015.02.25
  • Accepted : 2015.04.23
  • Published : 2015.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

The incremental learning method performs well in face face tracking. However, it has a drawback in that it is sensitive to the tracking error in the previous frame due to the environmental changes. In this paper, we propose a selective incremental learning method to track a face more reliably under various conditions. The proposed method is robust to illumination variation by using the LBP(Local Binary Pattern) features for each individual frame. We select patches to be used in incremental learning by using Staggered Multi-Scale LBP, which prevents the propagation of tracking errors occurred in the previous frame. The experimental results show that the proposed method improves the face tracking performance on the videos with environmental changes such as illumination variation.

점진 학습은 비교적 높은 얼굴 추적 성능을 보이지만, 환경적인 변화로 인해 추적에 오차가 발생하면 그 이후의 추적에 오차가 전파되어 추적 성능이 감소한다는 단점이 있다. 본 논문에서는, 다양한 변이 조건에서 강인하게 동작할 수 있는 선택적인 점진 학습 방법을 제안한다. 먼저, 개별 프레임에 대해 LBP(Local Binary Pattern) 특징을 추출하여 사용함으로써 조명 변이에 보다 강인하게 동작 할수 있고, Staggered Multi-Scale LBP를 사용하여 점진 학습에 사용할 패치(patch)를 선택하여 이전 프레임에서의 오차가 전파되는 것을 방지하였다. 실험을 통해, 제안한 방법이 조명 변이와 같은 환경적 변이가 존재하는 비디오 영상에 대해서도 기존의 추적 방법들보다 우수한 얼굴 추적 성능을 보이는 것을 확인할 수 있었다.

Keywords

References

  1. F. Cootes, J. Edwards, and J. Taylor, "Active appearance models." IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 23, no. 6, pp. 681-685, 2001. https://doi.org/10.1109/34.927467
  2. O. Balan and J. Black, "An adaptive appearance model approach for model-based articulated object tracking." IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 1, pp. 758-765, 2006.
  3. A. Ross, et al., "Incremental learning for robust visual tracking." International Journal of Computer Vision, Vol. 77, no. 1-3, pp. 125-141, 2008. https://doi.org/10.1007/s11263-007-0075-7
  4. J. Black and D. Jepson, "Eigentracking: Robust matching and tracking of articulated objects using a view-based representation." International Journal of Computer Vision, Vol. 26, no. 1, pp. 63-84, 1998. https://doi.org/10.1023/A:1007939232436
  5. M. La Cascia, S. Sclaroff, and V. Athitsos, "Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models." IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 22, no. 4, pp. 322-336, 2000. https://doi.org/10.1109/34.845375
  6. Y. Lee and S. Choi, "Face tracking based on incremental learning under illumination variation." 2013 Korea Signal Processing Conference, pp. 53-56, Daejeon, Korea, March 2013.
  7. T. Ojala, M. Pietikainen and D. Harwood, "A comparative study of texture measures with classification based on featured distributions." Pattern Recognition, Vol. 29, no. 1, pp. 51-59, 1996. https://doi.org/10.1016/0031-3203(95)00067-4
  8. D. Kim, M. Sohn and S. Lee, "A Study on Face Recognition Method based on Binary Pattern Image under Varying Lighting Condition", Journal of the Institute of Electronics and Information Engineers, Vol. 49, no. 2, pp. 61-74, 2012.
  9. Y. Cao, et al., "Stagged multi-scale lbp for pedestrian detection." 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 449-452, Florida, USA, September 2012.
  10. A. Levey and M. Lindenbaum, "Sequential Karhunen-Loeve basis extraction and its application to images." IEEE Trans. Image Processing, Vol. 9, no. 8, pp. 1371-1374, 2000. https://doi.org/10.1109/83.855432
  11. B. Froba and A. Ernst, "Face detection with the modified census transform." Proc. Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 91-96, 2004.
  12. G. Cho, et al., "Real-Time Face Recognition System Based on Illumination-insensitive MCT and Frame Consistency.", Journal of the Institute of Electronics and Information Engineers, Vol. 45, no. 3, pp. 123-134, 2008.
  13. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection." IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886-893, San Diego, USA, June 2005.
  14. C. Cortes and V. Vapnik, "Support-vector networks." Machine Learning, Vol. 20, no. 3, pp. 273-297, 1995. https://doi.org/10.1007/BF00994018
  15. National Institute of Standards and Technology, the FERET database. http://www.itl.nist.gov/iad/humanid/feret/
  16. A.M. Martinez and R. Benavente, The AR Face Database. CVC Technical Report #24, June 1998.
  17. T. Sim, S. Baker and M. Bsat, "The CMU pose, illumination, and expression database." IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 25, no. 12, pp. 1615-1618, 2003. https://doi.org/10.1109/TPAMI.2003.1251154
  18. O. Jesorsky, J. Kirchberg and W. Frischholz, "Robust face detection using the hausdorff distance." Audio-and video-based biometric person authentication. Springer, pp. 90-95, 2001.
  19. C. H. Kim, et al., "A new biased discriminant analysis using composite vectors for eye detection." IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, Vol. 42, no. 4, pp. 1095-1106, 2012. https://doi.org/10.1109/TSMCB.2012.2186798
  20. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features." Proc. of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1-511 , 2001.
  21. S. H. Park, D. Cho and K. R. Park, "A Study on Eye Detection by Using Adaboost for Iris Recognition in Mobile Environments.", Journal of the Institute of Electronics and Information Engineers, Vol. 45, no. 4, pp. 1-11, 2008.