Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

The improved facial expression recognition algorithm for detecting abnormal symptoms in infants and young children

영유아 이상징후 감지를 위한 표정 인식 알고리즘 개선

  • Kim, Yun-Su (Dept. of Information and Communication Engineering, Changwon National University) ;
  • Lee, Su-In (Dept. of Information and Communication Engineering, Changwon National University) ;
  • Seok, Jong-Won (Dept. of Information and Communication Engineering, Changwon National University)
  • Received : 2021.08.22
  • Accepted : 2021.09.17
  • Published : 2021.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The non-contact body temperature measurement system is one of the key factors, which is manage febrile diseases in mass facilities using optical and thermal imaging cameras. Conventional systems can only be used for simple body temperature measurement in the face area, because it is used only a deep learning-based face detection algorithm. So, there is a limit to detecting abnormal symptoms of the infants and young children, who have difficulty expressing their opinions. This paper proposes an improved facial expression recognition algorithm for detecting abnormal symptoms in infants and young children. The proposed method uses an object detection model to detect infants and young children in an image, then It acquires the coordinates of the eyes, nose, and mouth, which are key elements of facial expression recognition. Finally, facial expression recognition is performed by applying a selective sharpening filter based on the obtained coordinates. According to the experimental results, the proposed algorithm improved by 2.52%, 1.12%, and 2.29%, respectively, for the three expressions of neutral, happy, and sad in the UTK dataset.

비접촉형 체온 측정 시스템은 광학 및 열화상 카메라를 활용하여 집단시설의 발열성 질병을 관리하는 핵심 요소 중 하나이다. 기존 체온 측정 시스템은 딥러닝 기반 얼굴검출 알고리즘이 사용되어 얼굴영역의 단순 체온 측정에는 활용할 수 있지만, 의사표현이 어려운 영유아의 이상 징후를 인지하는데 한계가 있다. 본 논문에서는 기존의 체온 측정 시스템에서 영유아의 이상징후 감지를 위해 표정인식 알고리즘을 개선한다. 제안된 방법은 객체탐지 모델을 사용하여 영상에서 영유아를 검출한 후 얼굴영역을 추출하고 표정인식의 핵심 요소인 눈, 코, 입의 좌표를 획득한다. 이후 획득된 좌표를 기반으로 선택적 샤프닝 필터를 적용하여 표정인식을 진행한다. 실험결과에 따르면 제안된 알고리즘은 UTK 데이터셋에서 무표정, 웃음, 슬픔 3가지 표정에 대해 각각 2.52%, 1.12%, 2.29%가 향상되었다.

Keywords

Acknowledgement

This work was supported by the Technology development Program(S3017456) funded by the Ministry of SMEs and Startups(MSS, Korea)

References

  1. H Yang, XA Wang, "Cascade classifier for face detection," Journal of Algorithms & Computational Technology, Vol.10, No.3, pp.187-197, 2016. DOI: 10.1177/17483018166 49073
  2. YUSTIAWATI, Ratna, et al. "Analyzing of Different Features Using Haar Cascade Classifier." 2018 International Conference on Electrical Engineering and Computer Science (ICECOS), pp.129-134, 2018. DOI: 10.1109/ICECOS.2018.8605266
  3. I. Masi, Y. Wu, T. Hassner and P. Natarajan, "Deep Face Recognition: A Survey," 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp.471-478, 2018. DOI: 10.1109/SIBGRAPI.2018.00067.
  4. R. Girshick, J. Donahue, T. Darrell, and J. Malik. "Rich feature hierarchies for accurate object detection and semantic segmentation," In CVPR(IEEE Conference on Computer Vision and Pattern Recognition), 2014. DOI: 10.1109/CVPR.2014.81
  5. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi. "You only look once: Unified, real-time object detection" arXiv preprint arXiv:1506.02640, 2015.
  6. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. "SSD: Single shot multibox detector," In Eur. Conf. Comp. Vis. (ECCV), pp.21-37, 2016. DOI: 10.1007/978-3-319-46448-0_2
  7. FARFADE, Sachin Sudhakar; SABERIAN, Mohammad J.; LI, Li-Jia. "Multi-view face detection using deep convolutional neural networks." In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval. pp.643-650, 2015. DOI: 10.1145/2671188.2749408
  8. ZHANG, Kaipeng, et al. "Joint face detection and alignment using multitask cascaded convolutional networks." IEEE Signal Processing Letters, Vol.23, No.10, pp.1499-1503, 2016. DOI: 10.1109/LSP.2016.2603342
  9. A. Mollahosseini, D. Chan, and M. H. Mahoor, "Going deeper in facial expression recognition using deep neural networks," in WACV, 2016. DOI: 10.1109/WACV.2016.7477450
  10. C. Ilke, S. Eren, A. Emre, "MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images," Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp.1-6, 2019. DOI: 10.1109/IPTA.2019.8936114.