Browse > Article
http://dx.doi.org/10.22937/IJCSNS.2022.22.6.41

Masked Face Recognition via a Combined SIFT and DLBP Features Trained in CNN Model  

Aljarallah, Nahla Fahad (Department of of information and computer science, College of Computer Science and Engineering, University of Hai'l)
Uliyan, Diaa Mohammed (Department of of information and computer science, College of Computer Science and Engineering, University of Hai'l)
Publication Information
International Journal of Computer Science & Network Security / v.22, no.6, 2022 , pp. 319-331 More about this Journal
Abstract
The latest global COVID-19 pandemic has made the use of facial masks an important aspect of our lives. People are advised to cover their faces in public spaces to discourage illness from spreading. Using these face masks posed a significant concern about the exactness of the face identification method used to search and unlock telephones at the school/office. Many companies have already built the requisite data in-house to incorporate such a scheme, using face recognition as an authentication. Unfortunately, veiled faces hinder the detection and acknowledgment of these facial identity schemes and seek to invalidate the internal data collection. Biometric systems that use the face as authentication cause problems with detection or recognition (face or persons). In this research, a novel model has been developed to detect and recognize faces and persons for authentication using scale invariant features (SIFT) for the whole segmented face with an efficient local binary texture features (DLBP) in region of eyes in the masked face. The Fuzzy C means is utilized to segment the image. These mixed features are trained significantly in a convolution neural network (CNN) model. The main advantage of this model is that can detect and recognizing faces by assigning weights to the selected features aimed to grant or provoke permissions with high accuracy.
Keywords
Face recognition; masked face; scale invariant features; image segmentation; local binary pattern; CNN model;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Kolar, Z., Chen, H., & Luo, X. (2018). Transfer learning and deep convolutional neural networks for safety guardrail detection in 2D images. Automation in Construction, 89, 58-70.   DOI
2 Kumar, D., Garain, J., Kisku, D. R., Sing, J. K., & Gupta, P. (2020). Unconstrained and constrained face recognition using dense local descriptor with ensemble framework. Neurocomputing, 408, 273-284.   DOI
3 Lin, K., Zhao, H., Lv, J., Li, C., Liu, X., Chen, R., & Zhao, R. (2020). Face detection and segmentation based on improved mask R-CNN. Discrete Dynamics in Nature and Society, 2020.
4 Loey, M., Manogaran, G., Taha, M. H. N., & Khalifa, N. E. M. (2021b). A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic. Measurement, 167, 108288.   DOI
5 Banerjee, I., Ling, Y., Chen, M. C., Hasan, S. A., Langlotz, C. P., Moradzadeh, N., Chapman, B., Amrhein, T., Mong, D., Rubin, D. L., & others. (2019). Comparative effectiveness of convolutional neural network (CNN) and recurrent neural network (RNN) architectures for radiology text report classification. Artificial Intelligence in Medicine, 97, 79-88.   DOI
6 Chen, J., Hachem, E., & Viquerat, J. (2021). Graph neural networks for laminar flow prediction around random two-dimensional shapes. Physics of Fluids, 33(12), 123607.   DOI
7 Cheng, S., Tzimiropoulos, G., Shen, J., & Pantic, M. (2020). Faster, better and more detailed: 3d face reconstruction with graph convolutional networks. Proceedings of the Asian Conference on Computer Vision.
8 Lee, G.-H., & Lee, S.-W. (2020). Uncertainty-aware mesh decoder for high fidelity 3d face reconstruction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 6100-6109.
9 Lin, J., Yuan, Y., Shao, T., & Zhou, K. (2020). Towards high-fidelity 3D face reconstruction from in-the-wild images using graph convolutional networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 5891-5900.
10 Mohamed, S. S., Mohamed, W. A., Khalil, A. T., & Mohra, A. S. (2020). Deep learning face detection and recognition. International Journal of Advanced Science and Technology, 29(2), 1-6.
11 Liu, K., Kang, G., Zhang, N., & Hou, B. (2018). Breast cancer classification based on fully-connected layer first convolutional neural networks. IEEE Access, 6, 23722-23732.   DOI
12 Chavda, J. Dsouza, S. Badgujar and A. Damani, "Multi-Stage CNN Architecture for Face Mask Detection," 2021 6th International Conference for Convergence in Technology (I2CT), 2021, pp. 1-8, doi: 10.1109/I2CT51068.2021.9418207.   DOI
13 Bianchi, F. M., Grattarola, D., Livi, L., & Alippi, C. (2021). Graph neural networks with convolutional arma filters. IEEE Transactions on Pattern Analysis and Machine Intelligence.
14 Mukherjee, S., Boral, S., Siddiqi, H., Mishra, A., & Meikap, B. C. (2021). Present cum future of SARS-CoV-2 virus and its associated control of virus-laden air pollutants leading to potential environmental threat-a global review. Journal of Environmental Chemical Engineering, 9(2), 104973.   DOI
15 Pan, Y., & Zhang, L. (2021). Dual attention deep learning network for automatic steel surface defect segmentation. Computer-Aided Civil and Infrastructure Engineering.
16 Qi, C., Zhang, J., Jia, H., Mao, Q., Wang, L., & Song, H. (2021). Deep face clustering using residual graph convolutional network. Knowledge-Based Systems, 211, 106561.   DOI
17 Ren, Y., Huang, J., Hong, Z., Lu, W., Yin, J., Zou, L., & Shen, X. (2020). Image-based concrete crack detection in tunnels using deep fully convolutional networks. Construction and Building Materials, 234, 117367.   DOI
18 Ryumina, E., Ryumin, D., Ivanko, D., & Karpov, A. (2021). A NOVEL METHOD FOR PROTECTIVE FACE MASK DETECTION USING CONVOLUTIONAL NEURAL NETWORKS AND IMAGE HISTOGRAMS. International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences.
19 Saadat, S., Rawtani, D., & Hussain, C. M. (2020). Environmental perspective of COVID-19. Science of the Total Environment, 728, 138870.   DOI
20 Mundial, I. Q., Hassan, M. S. U., Tiwana, M. I., Qureshi, W. S., & Alanazi, E. (2020). Towards facial recognition problem in COVID-19 pandemic. 2020 4rd International Conference on Electrical, Telecommunication and Computer Engineering (ELTICOM), 210-214.
21 Sanz, H., Valim, C., Vegas, E., Oller, J. M., & Reverter, F. (2018). SVM-RFE: selection and visualization of the most relevant features through non-linear kernels. BMC Bioinformatics, 19(1), 1-18   DOI
22 Cabani, A., Hammoudi, K., Benhabiles, H., & Melkemi, M. (2021). MaskedFace-Net-A dataset of correctly/incorrectly masked face images in the context of COVID-19. Smart Health, 19, 100144.   DOI
23 Al_azrak, F. M., Elsharkawy, Z. F., Elkorany, A. S., el Banby, G. M., Dessowky, M. I., El-Samie, A., & Fathi, E. (2020). Copy-move forgery detection based on discrete and SURF transforms. Wireless Personal Communications, 110(1), 503-530.   DOI
24 Arefi, M. F., & Poursadeqiyan, M. (2020). A review of studies on the COVID-19 epidemic crisis disease with a preventive approach. Work, 66(4), 717-729.   DOI
25 Aswal, V., Tupe, O., Shaikh, S., & Charniya, N. N. (2020). Single Camera Masked Face Identification. 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), 57-60.
26 Cho, S. W., Baek, N. R., Kim, M. C., Koo, J. H., Kim, J. H., & Park, K. R. (2018). Face detection in nighttime images using visible-light camera sensors with two-step faster region-based convolutional neural network. Sensors, 18(9), 2995.   DOI
27 Wu, W., Yin, Y., Wang, X., & Xu, D. (2018). Face detection with different scales based on faster R-CNN. IEEE Transactions on Cybernetics, 49(11), 4017-4028.   DOI
28 Lee, S. H. (2020). Deep learning based face mask recognition for access control. Journal of the Korea Academia-Industrial Cooperation Society, 21(8), 395-400.   DOI
29 Hung, B. T. (2021). Face recognition using hybrid HOG-CNN approach. In Research in Intelligent and Computing in Engineering (pp. 715-723). Springer, Singapore.
30 Militante, S. v, & Dionisio, N. v. (2020). Real-time facemask recognition with alarm system using deep learning. 2020 11th IEEE Control and System Graduate Research Colloquium (ICSGRC), 106-110.
31 Din, N. U., Javed, K., Bae, S., & Yi, J. (2020). A novel GAN-based network for unmasking of masked face. IEEE Access, 8, 44276-44287.   DOI
32 Christlein, V., Spranger, L., Seuret, M., Nicolaou, A., Kral, P., & Maier, A. (2019). Deep generalized max pooling. 2019 International Conference on Document Analysis and Recognition (ICDAR), 1090-1096.
33 Geng, L., Zhang, S., Tong, J., & Xiao, Z. (2019). Lung segmentation method with dilated convolution based on VGG-16 network. Computer Assisted Surgery, 24(sup2), 27-33.   DOI
34 Loey, M., Manogaran, G., Taha, M. H. N., & Khalifa, N. E. M. (2021a). A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic. Measurement, 167, 108288.   DOI
35 Hansen, M. F., Smith, M. L., Smith, L. N., Salter, M. G., Baxter, E. M., Farish, M., & Grieve, B. (2018). Towards on-farm pig face recognition using convolutional neural networks. Computers in Industry, 98, 145-152.   DOI
36 Nagrath, P., Jain, R., Madan, A., Arora, R., Kataria, P., & Hemanth, J. (2021). SSDMNV2: A real time DNN-based face mask detection system using single shot multibox detector and MobileNetV2. Sustainable Cities and Society, 66, 102692.   DOI
37 Mata, B. U., & others. (2021). Face Mask Detection Using Convolutional Neural Network. Journal of Natural Remedies, 21(12(1)), 14-19.
38 Sandesara, A. G., Joshi, D. D., & Joshi, S. D. (2020). Facial Mask Detection Using Stacked CNN Model. Int. J. Sci. Res. Comput. Sci. Eng. Inform. Technol.
39 Hariri, W. (2021). Efficient masked face recognition method during the covid-19 pandemic. ArXiv Preprint ArXiv:2105.03026.