Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

Development of an intelligent camera for multiple body temperature detection

다중 체온 감지용 지능형 카메라 개발

  • Lee, Su-In (Dept. of Information and Communication Engineering, Changwon National University) ;
  • Kim, Yun-Su (Dept. of Information and Communication Engineering, Changwon National University) ;
  • Seok, Jong-Won (Dept. of Information and Communication Engineering, Changwon National University)
  • Received : 2022.09.07
  • Accepted : 2022.09.25
  • Published : 2022.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an intelligent camera for multiple body temperature detection. The proposed camera is composed of optical(4056*3040) and thermal(640*480), which detects abnormal symptoms by analyzing a person's facial expression and body temperature from the acquired image. The optical and thermal imaging cameras are operated simultaneously and detect an object in the optical image, in which the facial region and expression analysis are calculated from the object. Additionally, the calculated coordinate values from the optical image facial region are applied to the thermal image, also the maximum temperature is measured from the region and displayed on the screen. Abnormal symptom detection is determined by using the analyzed three facial expressions(neutral, happy, sadness) and body temperature values. In order to evaluate the performance of the proposed camera, the optical image processing part is tested on Caltech, WIDER FACE, and CK+ datasets for three algorithms(object detection, facial region detection, and expression analysis). Experimental results have shown 91%, 91%, and 84% accuracy scores each.

본 논문에서는 다중 체온 감지용 지능형 카메라를 제안한다. 제안하는 카메라는 광학(4056*3040) 및 열화상(640*480) 2종의 카메라로 구성되고 획득된 영상으로부터 사람의 표정 및 체온을 분석하여 이상 증상을 감지한다. 광학 및 열화상카메라는 동시에 운영되며 광학 영상에서 객체를 검출한 후 얼굴영역을 도출하여 표정분석을 수행한다. 열화상카메라는 광학카메라에서 얼굴영역으로 판단한 좌표 값을 적용하고 해당영역의 최고 온도를 측정하여 화면에 표출한다. 이상 징후 감지는 분석된 표정 3가지(무표정, 웃음, 슬픔)와 체온 값을 활용하여 판단하며 제안된 장비의 성능을 평가하기 위해 광학영상 처리부는 Caltech, WIDER FACE, CK+ 데이터셋을 3종의 영상처리 알고리즘(객체검출, 얼굴영역 검출, 표정분석)에 적용하였다. 실험결과로 객체검출률, 얼굴영역 검출률, 표정분석률 각각 91%, 91%, 84%을 도출하였다.

Keywords

Acknowledgement

This work was supported by the Technology development Program(S3017456) funded by the Ministry of SMEs and Startups(MSS, Korea)

References

  1. R. Girshick, J. Donahue, T. Darrell, and J. Malik. "Rich feature hierarchies for accurate object detection and semantic segmentation," In CVPR (IEEE Conference on Computer Vision and Pattern Recognition), 2014. DOI: 10.48550/arXiv.1311.2524
  2. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.779-788, 2015. DOI: 10.48550/arXiv.1506.02640
  3. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. "SSD: Single shot multibox detector," In Eur. Conf. Comp. Vis. (ECCV). pp. 21-37, 2016. DOI: 10.1007/978-3-319-46448-0_2
  4. Kim, Yun-Su, Su-In Lee, and Jong-Won Seok. "The improved facial expression recognition algorithm for detecting abnormal symptoms in infants and young children," Journal of IKEEE, Vol.25, No.3, pp.430-436, 2021. DOI: 10.7471/ikeee.2021.25.3.430
  5. ZHANG, Kaipeng, et al. "Joint face detection and alignment using multitask cascaded convolutional networks," IEEE Signal Processing Letters, Vol.23, No.10, pp.1499-1503, 2016. DOI: 10.1109/LSP.2016.2603342
  6. C. Ilke, S. Eren, A. Emre, "MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images," Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp.1-6, 2019. DOI: 10.1109/IPTA.2019.8936114.
  7. P. Dollar, C. Wojek, B. Schiele and P. Perona, "Pedestrian detection: A benchmark," 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp.304-311, 2009. DOI: 10.1109/CVPR.2009.5206631.
  8. Yang, Shuo and Luo, Ping and Loy, Chen Change and Tang, Xiaoou, "WIDER FACE: A Face Detection Benchmark," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  9. P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar and I. Matthews, "The Extended CohnKanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression," 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, pp. 94-101, 2010. DOI: 10.1109/CVPRW.2010.5543262.