KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Robustness of Face Recognition to Variations of Illumination on Mobile Devices Based on SVM

  • Nam, Gi-Pyo (Division of Electronics and Electrical Engineering, Dongguk University, Biometrics Engineering Research Center (BERC)) ;
  • Kang, Byung-Jun (ETRI) ;
  • Park, Kang-Ryoung (Division of Electronics and Electrical Engineering, Dongguk University, Biometrics Engineering Research Center (BERC))
  • Published : 2010.02.27
Download PDF
⟨ Previous Next ⟩

Abstract

With the increasing popularity of mobile devices, it has become necessary to protect private information and content in these devices. Face recognition has been favored over conventional passwords or security keys, because it can be easily implemented using a built-in camera, while providing user convenience. However, because mobile devices can be used both indoors and outdoors, there can be many illumination changes, which can reduce the accuracy of face recognition. Therefore, we propose a new face recognition method on a mobile device robust to illumination variations. This research makes the following four original contributions. First, we compared the performance of face recognition with illumination variations on mobile devices for several illumination normalization procedures suitable for mobile devices with low processing power. These include the Retinex filter, histogram equalization and histogram stretching. Second, we compared the performance for global and local methods of face recognition such as PCA (Principal Component Analysis), LNMF (Local Non-negative Matrix Factorization) and LBP (Local Binary Pattern) using an integer-based kernel suitable for mobile devices having low processing power. Third, the characteristics of each method according to the illumination va iations are analyzed. Fourth, we use two matching scores for several methods of illumination normalization, Retinex and histogram stretching, which show the best and $2^{nd}$ best performances, respectively. These are used as the inputs of an SVM (Support Vector Machine) classifier, which can increase the accuracy of face recognition. Experimental results with two databases (data collected by a mobile device and the AR database) showed that the accuracy of face recognition achieved by the proposed method was superior to that of other methods.

Keywords

References

  1. Q. Tao, R. N. J. Veldhuis, "Biometric Authentication for a Mobile Personal Device," in Proc. of International Conference on Mobile and Ubiquitous Systems, pp. 1-3, 2006.
  2. A. Hadid, J. Y. Heikkila, O. Silven, M. Pietikainen, "Face and Eye Detection for Person Authentication in Mobile Phones," in Proc. of International Conference on Distributed Smart Cameras, pp. 101-108, 2007.
  3. J. Czyz, S. Bengio, C. Marce, L. Vandendorpe, "Scalability Analysis of Audio-visual Person Authentication," in Proc. of International Conference on Audio and Video Based Biometric Person Identification, pp. 752-760, 2003.
  4. D. J. Lee, K. C. Kwak, J. O. Min, M. G. Chun, "Multi-modal Biometrics System Using Face and Signature," LNCS, vol. 3043, pp. 635-644, 2004.
  5. T. J. Smith, "LA County Sheriff's Department (LASD) Mobile ID Project : From Pilot to Countrywide roll-out," Biometrics 2008, 2008.
  6. X. Xie, K. M. Lam, "An Efficient Illumination Normalization Method for Face Recognition," Pattern Recognition Letters, vol. 27, pp. 609-617, 2006. https://doi.org/10.1016/j.patrec.2005.09.026
  7. L. Qing, S. Shan, X. Chen, W. Gao, "Face Recognition under Varying Lighting Based on the Probabilistic Model of Gabor Phase," in Proc. of 18th Int'l Conf. Pattern Recognition, ICPR 2006, vol. 3, pp. 1139-1142, 2006.
  8. S. Shan, W. Gao, B. Cao, D. Zhao, "Illumination Normalization for Robust Face Recognition Against Varying Lighting Conditions," in Proc. of IEEE Int'l Workshop on Analysis and Modeling of Faces and Gestures, 2003.
  9. M. Y. Nam, P. K. Rhee, "An Efficient Face Recognition for Variant Illumination Condition," ISPACS2005, vol. 1, pp. 111-115, 2004.
  10. H. Wang, S. Z. Li, Y. Wang, "Face Recognition under Varying Lighting Conditions Using Self Quotient Image," in Proc. of IEEE Int'l Conf. on Automatic Face and Gesture Recognition, 2004.
  11. P. Viola, M. Jones, "Robust Real-time Face Detection," International Journal of Computer Vision, vol. 57, no. 2, pp.137-154, 2004.
  12. OpenCV, Available on: http://opencvlibrary.sourceforge.net/ (accessed on January 2, 2010).
  13. G. D. Hines, Z. Rahman, D. J. Jobson, G. A. Woodell, "Single-scale Retinex Using Digital Signal Processors," in Proc. of Global Signal Processing Conference, Sep. 2004.
  14. R. C. Gonzalez, R. E. Woods, "Digital image processing," Addison-Wesley, MA, 1992.
  15. L. I. Smith, "A Tutorial on Principal Components Analysis", 2002.
  16. M. Turk, A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991. https://doi.org/10.1162/jocn.1991.3.1.71
  17. S. Han, H. A. Park, D. H. Cho, K. R. Park, S. Y. Lee, "Face Recognition Based on Near-Infrared Light Using Mobile Phone," in Proc. of 8th ICANNGA 2007, Lecture Notes in Computer Science , vol. 4432, pp. 440-448, 2007.
  18. S. Z. Li, X. W. Hou, H. J. Zhang, Q. S. Cheng, "Learning Spatially Localized, Parts-based Representation," in Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition, Hawaii, Dec. 11-13, 2001.
  19. D. D. Lee, H. S. Seung, "Learning the Parts of Objects by Non-negative Matrix Factorization," Nature, vol. 401, pp. 788-791, 1999. https://doi.org/10.1038/44565
  20. Y. Rodriguez, S. Marcel, "Face Authentication Using Adapted Local Binary Pattern Histograms," LNCS, vol. 3954, pp. 321-332, 2006.
  21. H. A. Park and K. R. Park, "Iris Recognition based on Score Level Fusion by using SVM," Pattern Recognition Letters, vol. 28, no. 1, pp. 94-104, 2007.
  22. N. A. Macmillan, C. D. Creelman, "Detection Theory: A User's Guide," Cambridge University Press, NY, 1991.
  23. A. M. Martinez, R. Benavente, The AR face database, CVC Tech, Report #24, 1998.
  24. E. H. Land, J. J. McCann, "Lightness and Retinex Theory," J. Opt. Soc. Am., vol. 61, pp 1-11, 1971. https://doi.org/10.1364/JOSA.61.000001
  25. A. Moore, J. Allman, R. M. Goodman, "A Real-time Neural System for Color Constancy," IEEE Trans. Neural Networks, vol. 2, pp. 237-247, Mar. 1991. https://doi.org/10.1109/72.80334
  26. B. D. Thompson, Z. Rahman, S. K. Park, "Retinex Preprocessing for Improved Multi-spectral Image Classification," Visual Information Processing VIII, Proc. SPIE 3716, 1999.
  27. Sony UMPC, Available on: http://b2b.sony.com (accessed on January 2, 2010).
  28. R. P. Wildes, "Iris Recognition: An Emerging Biometric Technology," Proc. IEEE, vol. 85, no. 9, pp. 1348-1363, 1997. https://doi.org/10.1109/5.628669
  29. E. Land, "An Alternative Technique for the Computation of the Designator in the Retinex Theory of Color Vision," in Proc. Nat. Acad, Sci., vol.83, pp. 3078-3080, 1986. https://doi.org/10.1073/pnas.83.10.3078
  30. D. J. Jobson, Z. Rahman, and G. A. Woodell, "Retinex Processing for Automatic Image Enhancement," Human Vision and Electronic Imaging VII, SPIE Symposium on Electronic Imaging, vol. 4662, 2002.
  31. http://www.soe.ucsc.edu/classes/ee264/Winter02/yan.ppt (accessed on 2010.02.08).
  32. R. O. Duda, and P. E. Hart, "Pattern Classification and Scene Analysis," Wiley-Interscience, USA.
  33. http://www.cs.ucl.ac.uk/staff/M.Sewell/winsvm/ (accessed on 2010.02.08)
  34. V. Vapnik, "Statistical Learning Theory," John Wiley & Sons, NY, USA, 1998.
  35. http://www-ai.cs.uni-dortmund.de/SOFTWARE/MYSVM/index.html (accessed on 2010.02.08).

Cited by

  1. Blink detection robust to various facial poses vol.193, pp.2, 2010, https://doi.org/10.1016/j.jneumeth.2010.08.034
  2. 장파장 근적외선 조명 및 밴드 패스 필터 기반 이동형 홍채 인식 시스템 및 성능 평가 vol.14, pp.9, 2011, https://doi.org/10.9717/kmms.2011.14.9.1125
  3. Multimodal Biometric System Based on the Recognition of Face and Both Irises vol.9, pp.3, 2010, https://doi.org/10.5772/50869
  4. Face Recognition Algorithm for Photographs and Viewed Sketch Matching Using Score-Level Fusion vol.9, pp.3, 2010, https://doi.org/10.5772/51470
  5. New Fuzzy-Based Retinex Method for the Illumination Normalization of Face Recognition vol.9, pp.4, 2010, https://doi.org/10.5772/51664
  6. Tracking and Face Recognition of Multiple People Based on GMM, LKT and PCA vol.15, pp.4, 2010, https://doi.org/10.9717/kmms.2012.15.4.449
  7. Brainwave-based Mood Classification Using Regularized Common Spatial Pattern Filter vol.10, pp.2, 2010, https://doi.org/10.3837/tiis.2016.02.020
  8. Gender Recognition from Human-Body Images Using Visible-Light and Thermal Camera Videos Based on a Convolutional Neural Network for Image Feature Extraction vol.17, pp.3, 2010, https://doi.org/10.3390/s17030637
  9. Visible-Light Camera Sensor-Based Presentation Attack Detection for Face Recognition by Combining Spatial and Temporal Information vol.19, pp.2, 2010, https://doi.org/10.3390/s19020410