Browse > Article
http://dx.doi.org/10.22937/IJCSNS.2021.21.8.38

FRS-OCC: Face Recognition System for Surveillance Based on Occlusion Invariant Technique  

Abbas, Qaisar (College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU))
Publication Information
International Journal of Computer Science & Network Security / v.21, no.8, 2021 , pp. 288-296 More about this Journal
Abstract
Automated face recognition in a runtime environment is gaining more and more important in the fields of surveillance and urban security. This is a difficult task keeping in mind the constantly volatile image landscape with varying features and attributes. For a system to be beneficial in industrial settings, it is pertinent that its efficiency isn't compromised when running on roads, intersections, and busy streets. However, recognition in such uncontrolled circumstances is a major problem in real-life applications. In this paper, the main problem of face recognition in which full face is not visible (Occlusion). This is a common occurrence as any person can change his features by wearing a scarf, sunglass or by merely growing a mustache or beard. Such types of discrepancies in facial appearance are frequently stumbled upon in an uncontrolled circumstance and possibly will be a reason to the security systems which are based upon face recognition. These types of variations are very common in a real-life environment. It has been analyzed that it has been studied less in literature but now researchers have a major focus on this type of variation. Existing state-of-the-art techniques suffer from several limitations. Most significant amongst them are low level of usability and poor response time in case of any calamity. In this paper, an improved face recognition system is developed to solve the problem of occlusion known as FRS-OCC. To build the FRS-OCC system, the color and texture features are used and then an incremental learning algorithm (Learn++) to select more informative features. Afterward, the trained stack-based autoencoder (SAE) deep learning algorithm is used to recognize a human face. Overall, the FRS-OCC system is used to introduce such algorithms which enhance the response time to guarantee a benchmark quality of service in any situation. To test and evaluate the performance of the proposed FRS-OCC system, the AR face dataset is utilized. On average, the FRS-OCC system is outperformed and achieved SE of 98.82%, SP of 98.49%, AC of 98.76% and AUC of 0.9995 compared to other state-of-the-art methods. The obtained results indicate that the FRS-OCC system can be used in any surveillance application.
Keywords
Computer vision; Face Recognition; Local binary pattern; partial occlusion; Color space; Feature Extraction; Stack-based autoencoders;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Wu, C. Y., & Ding, J. J. (2018). Occluded face recognition using low-rank regression with generalized gradient direction. Pattern Recognition, 80, 256-268.   DOI
2 Li, X. X., Dai, D. Q., Zhang, X. F., & Ren, C. X. (2013). Structured sparse error coding for face recognition with occlusion. IEEE transactions on image processing, 22(5), 1889-1900.   DOI
3 Abate A., Nappi M., Riccio D., and Tucci M., "Occluded Face Recognition by Means of the IFS," in Proceedings of the 2nd International Conference Image Analysis and Recognition, Berlin, pp. 1073-1080, 2005.
4 Kumar, S., & Singh, S. K. (2020). Occluded Thermal Face Recognition Using Bag of CNN ($ Bo $ CNN). IEEE Signal Processing Letters, 27, 975-979.   DOI
5 Qiu, H., Gong, D., Li, Z., Liu, W., & Tao, D. (2021). End2End Occluded Face Recognition by Masking Corrupted Features. IEEE Transactions on Pattern Analysis and Machine Intelligence.
6 Bommidi, K., & Sundaramurthy, S. (2021). A compressed string matching algorithm for face recognition with partial occlusion. Multimedia Systems, 27(2), 191-203.   DOI
7 Koc, M. (2021). A novel partition selection method for modular face recognition approaches on occlusion problem. Machine Vision and Applications, 32(1), 1-11.   DOI
8 M. A. Turk, A. P. Pentland, "Face recognition using eigenfaces", Proceedings of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 586-591, Hawaii 1991.
9 M. Martinez, "Recognizing Imprecisely Localized, Partially Occluded and Expression Variant Faces from a Single Sample per Class", in IEEE Trans. on PAMI, V.24, p748-763, 2002   DOI
10 P. Quintiliano, A. N. Santa-Rosa, R. Guadagnin "Face recognition based on eigenfeatures", Proc. SPIE Vol. 4550, p. 140-145, Image Extraction, Segmentation, and Recognition, 2001
11 Yu, Y. F., Dai, D. Q., Ren, C. X., & Huang, K. K. (2017). Discriminative multi-scale sparse coding for single-sample face recognition with occlusion. Pattern Recognition, 66, 302-312.   DOI
12 T. Kurita, M. Pic and T. Takahashi, "Recognition and Detection of Occluded Faces by a Neural Network Classifier with Recursive Data Reconstruction", Proc. of the IEEE Conf. on Advanced Video and Signal Based Surveillance (AVSS'03), pp. 53-58, 2003.
13 Aleix M., "Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample Per Class," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 748-763, 2002.   DOI
14 Amirhosein N., Esam A., and Majid A., "Illumination Invariant Feature Extraction and Mutual-Information-Based Local Matching for Face Recognition under Illumination Variation and Occlusion," Pattern Recognition, vol. 44, no. 10-11, pp. 2576-2587, 2011.   DOI
15 Baudat G. and Anouar F., "Generalized Discriminant Analysis using a Kernel Approach," Neural Computation, vol. 12, no. 10, pp. 2385-2404, 2000.   DOI
16 Sharma, M., Prakash, S., & Gupta, P. (2013). An efficient partial occluded face recognition system. Neurocomputing, 116, 231-241.   DOI
17 Ou, W., You, X., Tao, D., Zhang, P., Tang, Y., & Zhu, Z. (2014). Robust face recognition via occlusion dictionary learning. Pattern Recognition, 47(4), 1559-1572.   DOI
18 Chen W., Yuen P., Huang J., and Dai D., "Kernel Machine-Based One-Parameter Regularized Fisher Discriminant Method for Face Recognition," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 35, no. 4, pp. 659-669, 2005.   DOI
19 Long, Y., Zhu, F., Shao, L., & Han, J. (2018). Face recognition with a small occluded training set using spatial and statistical pooling. Information Sciences, 430, 634-644.   DOI
20 Zheng, W., Gou, C., & Wang, F. Y. (2020). A novel approach inspired by optic nerve characteristics for few-shot occluded face recognition. Neurocomputing, 376, 25-41.   DOI
21 M. A. Mottaleb and A. Elgammal. Face Detection in complex environments from color images. IEEE ICIP: 622-626, 1999.
22 J. Kim, Y. Sung, S.M. Yoon and B.G. Park, "A New Video Surveillance System Employing Occluded Face Detection", Proc. of the 18th int. conf. on Innovations in Applied Artificial Intelligence, Italy, pp. 65-68, 2005.
23 S. M. Yoon and S. C. Kee, "Detection of Partially Occluded Face using Support Vector Machines", IAPR Workshop on Machine Vision Applications, Japan, pp. 546-549, 2002.
24 K. Hotta, "A Robust Face Detector Under Partial Occlusion", Int. Conf. on Image Processing, 2004 (ICIP '04), pp. 597-600, 2004.
25 A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, "From few to many: Illumination cone models for recognition under variable lighting and pose", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no.6, pp. 643-660, 2001   DOI
26 J. Ross and Beveridge et. al. A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: 535 - 542, 2001.
27 A.M. Martinez and R. Benavente, "The AR Face Database", CVC Technical Report 24, 1998.
28 A.M. Martinez, "Recognition of Partially Occluded and/or Imprecisely Localized Faces using a Probabilistic Approach", CVPR, Vol. 1, pp. 712-717, 2000. MIT face database, ftp://whitechapel.media.mit.edu/pub/images/