Journal of Electrical Engineering and Technology

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

A Novel Face Recognition Algorithm based on the Deep Convolution Neural Network and Key Points Detection Jointed Local Binary Pattern Methodology

  • Received : 2015.10.10
  • Accepted : 2016.05.16
  • Published : 2017.01.02
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a novel face recognition algorithm based on the deep convolution neural network and key point detection jointed local binary pattern methodology to enhance the accuracy of face recognition. We firstly propose the modified face key feature point location detection method to enhance the traditional localization algorithm to better pre-process the original face images. We put forward the grey information and the color information with combination of a composite model of local information. Then, we optimize the multi-layer network structure deep learning algorithm using the Fisher criterion as reference to adjust the network structure more accurately. Furthermore, we modify the local binary pattern texture description operator and combine it with the neural network to overcome drawbacks that deep neural network could not learn to face image and the local characteristics. Simulation results demonstrate that the proposed algorithm obtains stronger robustness and feasibility compared with the other state-of-the-art algorithms. The proposed algorithm also provides the novel paradigm for the application of deep learning in the field of face recognition which sets the milestone for further research.

Keywords

References

  1. Sumathi, S., and R. Malini. "Face recognition system to enhance E Health." E-Health Networking, Digital Ecosystems and Technologies (EDT), 2010 International Conference on. Vol. 1. IEEE, 2010.
  2. Jalal, A., and S. Kim. "Global security using human face understanding under vision ubiquitous architecture system." World Acad. Sci. Eng. Technol 13 (2006): 7-11.
  3. Jalal, Ahmad, Shaharyar Kamal, and Daijin Kim. "A depth video sensor-based life-logging human activity recognition system for elderly care in smart indoor environments." Sensors 14.7 (2014): 11735-11759. https://doi.org/10.3390/s140711735
  4. Jalal, Ahmad, and Yasir Ali Rasheed. "Collaboration achievement along with performance maintenance in video streaming." Proceedings of the IEEE Conference on Interactive Computer Aided Learning, Villach, Austria. Vol. 2628. 2007.
  5. Jalal, A. "Security architecture for third generation (3G) using GMHS cellular network." Emerging Technologies, 2007. ICET 2007. International Conference on. IEEE, 2007.
  6. Wang, Su-Jing, Hui-Ling Chen, Wen-Jing Yan, Yu- Hsin Chen, and Xiaolan Fu. "Face recognition and micro expression recognition based on discriminant tensor subspace analysis plus extreme learning machine." Neural processing letters 39, no. 1 (2014):25-43. https://doi.org/10.1007/s11063-013-9288-7
  7. Lu, Jiwen, Yap-Peng Tan, and Gang Wang. "Discriminative multimanifold analysis for face recognition from a single training sample per person." Pattern Analysis and Machine Intelligence, IEEE Transactions on 35, no. 1 (2013): 39-51. https://doi.org/10.1109/TPAMI.2012.70
  8. Ballihi, Lahoucine, Boulbaba Ben Amor, Mohamed Daoudi, Anuj Srivastava, and Driss Aboutajdine. "Boosting 3-D-geometric features for efficient face recognition and gender classification." Information Forensics and Security, IEEE Transactions on 7, no. 6 (2012): 1766-1779. https://doi.org/10.1109/TIFS.2012.2209876
  9. Wang, Haoxiang, Ferdinand Shkjezi, and Ela Hoxha. "Distance metric learning for multi-camera people matching." In Advanced Computational Intelligence(ICACI), 2013 Sixth International Conference on, pp. 140-143. IEEE, 2013.
  10. Ying, Yiming, and Peng Li. "Distance metric learning with eigenvalue optimization." The Journal of Machine Learning Research 13, no. 1 (2012): 1-26.
  11. Ma, Lianyang, Xiaokang Yang and Dacheng Tao. "Person re-identification over camera networks using multi-task distance metric learning." Image Processing, IEEE Transactions on 23, no. 8 (2014): 3656-3670. https://doi.org/10.1109/TIP.2014.2331755
  12. Le, Quoc V. "Building high-level features using large scale unsupervised learning." In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pp. 8595-8598. IEEE, 2013.
  13. Weinland, Daniel, Remi Ronfard, and Edmond Boyer. "A survey of vision-based methods for action representation, segmentation and recognition." Computer Vision and Image Understanding 115, no. 2 (2011):224-241. https://doi.org/10.1016/j.cviu.2010.10.002
  14. Kim, Joongrock, et al. "3D Multi-Spectrum Sensor System with Face Recognition." Sensors 13.10 (2013): 12804-12829. https://doi.org/10.3390/s131012804
  15. Jalal, Ahmad, Jeong Tai Kim, and Tae-Seong Kim. "Development of a life logging system via depth imaging-based human activity recognition for smart homes." Proceedings of the International Symposium on Sustainable Healthy Buildings, Seoul, Korea. 2012.
  16. Jalal, Ahmad, Jeong Tai Kim, and Tae-Seong Kim. "Development of a life logging system via depth imaging-based human activity recognition for smart homes." Proceedings of the International Symposium on Sustainable Healthy Buildings, Seoul, Korea. 2012.
  17. Jalal, A. S., and Shaharyar Kamal. "Real-time life logging via a depth silhouette-based human activity recognition system for smart home services." Advanced Video and Signal Based Surveillance (AVSS), 2014 11th IEEE International Conference on. IEEE, 2014.
  18. Jalal, Ahmad, Shaharyar Kamal, and Daijin Kim. "Shape and motion features approach for activity tracking and recognition from kinect video camera." Advanced Information Networking and Applications Workshops (WAINA), 2015 IEEE 29th International Conference on. IEEE, 2015.
  19. Huang, Gary B., Honglak Lee, and Erik Learned-Miller. "Learning hierarchical representations for face verification with convolutional deep belief networks." In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2518-2525. IEEE, 2012.
  20. He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Spatial pyramid pooling in deep convolutional networks for visual recognition." In Computer Vision-ECCV 2014, pp. 346-361. Springer International Publishing, 2014.
  21. Abdel-Hamid, Ossama, Abdel-rahman Mohamed, Hui Jiang, and Gerald Penn. "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition." In Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, pp. 4277-4280. IEEE, 2012.
  22. Morwal, Sudha, Nusrat Jahan, and Deepti Chopra. "Named entity recognition using hidden Markov model (HMM)." International Journal on Natural Language Computing (IJNLC) 1, no. 4 (2012).
  23. Min, Rui, et al. "Real-time 3D face identification from a depth camera." Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 2012.
  24. Jalal, Ahmad, Jeong Tai Kim, and Tae-Seong Kim. "Human activity recognition using the labeled depth body parts information of depth silhouettes." Proceedings of the 6th International Symposium on Sustainable Healthy Buildings, Seoul, Korea. 2012.
  25. Jalal, Ahmad, Md Zia Uddin, and T-S. Kim. "Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home." Consumer Electronics, IEEE Transactions on 58.3 (2012): 863-871. https://doi.org/10.1109/TCE.2012.6311329
  26. Cai, Qin, et al. "3d deformable face tracking with a commodity depth camera." Computer Vision-ECCV 2010. Springer Berlin Heidelberg, 2010. 229-242.
  27. Jalal, A. S., Yeonho Kim, and Daijin Kim. "Ridge body parts features for human pose estimation and recognition from RGB-D video data." Computing, Communication and Networking Technologies (ICCCNT), 2014 International Conference on. IEEE, 2014.
  28. Jun, Bongjin, Inho Choi, and Daijin Kim. "Local transform features and hybridization for accurate face and human detection." Pattern Analysis and Machine Intelligence, IEEE Transactions on 35.6 (2013):1423-1436. https://doi.org/10.1109/TPAMI.2012.219
  29. Jalal, Ahmad, and Amir Shahzad. "Multiple facial feature detection using vertex-modeling structure." Proceedings of the IEEE Conference on Interactive Computer Aided Learning, Villach, Austria. Vol. 2628. 2007.
  30. Erdogmus, Nesli, and Sebastien Marcel. "Spoofing in 2D face recognition with 3D masks and anti-spoofing with kinect." Biometrics: Theory, Applications and Systems (BTAS), 2013 IEEE Sixth International Conference on. IEEE, 2013.
  31. Li, Kehuang, Zhen Huang, You-Chi Cheng, and Chin-Hui Lee. "A maximal figure-of-merit learning approach to maximizing mean average precision with deep neural network based classifiers." In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, pp. 4503-4507. IEEE.
  32. Huang, Jui-Ting, Jinyu Li, Dong Yu, Li Deng, and Yifan Gong. "Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers." In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pp. 7304-7308. IEEE, 2013.
  33. Sainath, Tara N., Brian Kingsbury, Abdel-rahman Mohamed, and Bhuvana Ramabhadran. "Learning filter banks within a deep neural network framework." In Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on, pp. 297-302. IEEE.
  34. Saon, George, Hagen Soltau, David Nahamoo, and Michael Picheny. "Speaker adaptation of neural network acoustic models using i-vectors." In Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on, pp. 55-59. IEEE.
  35. Ray, Jessica, Brian Thompson, and Wade Shen. "Comparing a high and low-level deep neural network implementation for automatic speech recognition." High Performance Technical Computing in Dynamic Languages (HPTCDL), 2014 First Workshop for. IEEE, 2014.
  36. Gerstenberger, M. C., A. Christophersen, R. Buxton, and A. Nicol. "Bi-directional risk assessment in carbon capture and storage with Bayesian Networks." International Journal of Greenhouse Gas Control 35(2015): 150-159. https://doi.org/10.1016/j.ijggc.2015.01.010
  37. Llorente, Roberto, Maria Morant, Eloy Pellicer, Milan Herman, Zsolt Nagy, Javier Herrera, Jose Correcher et al. "Radio-over-fiber quintuple-play service provision for deep fiber-to-the-home passive networks." In Communications Workshops (ICC), 2013 IEEE International Conference on, pp. 868-872. IEEE, 2013.
  38. Sivaram, Garimella SVS, and Hynek Hermansky. "Sparse multilayer perceptron for phoneme recognition." Audio, Speech, and Language Processing, IEEE Transactions on 20, no. 1 (2012): 23-29. https://doi.org/10.1109/TASL.2011.2129510
  39. Panchal, Gaurang, Amit Ganatra, Y. P. Kosta, and Devyani Panchal. "Behaviour analysis of multilayer perceptrons with multiple hidden neurons and hidden layers." International Journal of Computer Theory and Engineering 3, no. 2 (2011): 332-337.
  40. Oh, Sung-Kwun, Sung-Hoon Yoo, and Witold Pedrycz. "Design of face recognition algorithm using PCALDA combined for hybrid data pre-processing and polynomial-based RBF neural networks: Design and its application." Expert Systems with Applications 40.5 (2013): 1451-1466. https://doi.org/10.1016/j.eswa.2012.08.046
  41. Wang, Su-Jing, Jian Yang, Ming-Fang Sun, Xu-Jun Peng, Ming-Ming Sun, and Chun-Guang Zhou. "Sparse tensor discriminant color space for face verification." Neural Networks and Learning Systems, IEEE Transactions on 23, no. 6 (2012): 876-888. https://doi.org/10.1109/TNNLS.2012.2191620
  42. Hu, Yiqun, Ajmal S. Mian, and Robyn Owens. "Face recognition using sparse approximated nearest points between image sets." Pattern Analysis and Machine Intelligence, IEEE Transactions on 34, no. 10 (2012): 1992-2004. https://doi.org/10.1109/TPAMI.2011.283
  43. Lu, Jiwen, Gang Wang, and Philippe Moulin. "Image set classification using holistic multiple order statistics features and localized multi-kernel metric learning." In Computer Vision (ICCV), 2013 IEEE International Conference on, pp. 329-336. IEEE, 2013.
  44. Cao, Zhimin, et al. "Face recognition with learningbased descriptor." Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2010.

Cited by

  1. An Approach for HVCB Mechanical Fault Diagnosis Based on a Deep Belief Network and a Transfer Learning Strategy vol.14, pp.1, 2019, https://doi.org/10.1007/s42835-018-00048-y