Browse > Article
http://dx.doi.org/10.9717/kmms.2022.25.1.010

Design and Implementation of Entry-level COVID-19 Digital Signage Player supporting Fever Detection, Face Mask Wearing Detection and KI-pass QR Code Checking  

Huy-Tran, Quoc Bao (Dept. of Intelligent Systems, Graduate School, Soongsil University)
Park, SangGun (CublickDigital, Inc.)
Chung, SunTae (Dept. of AI Convergence, Soongsil University)
Publication Information
Journal of Korea Multimedia Society / v.25, no.1, 2022 , pp. 10-28 More about this Journal
Abstract
In this paper, we present an entry-level COVID-19 stand-alone digitial signage player (CoSiP) which performs not only conventional digital signage functionalities but also fever detection, face mask wearing detection, and KI-pass QR code checking. The overall design of CoSiP is proposed, and implementation of a temperature checking algorithm using a low cost thermal sensor is elaborately presented. Through experiments over datasets and against a developed CoSiP device, it is shown that the fever detection, face mask wearing detection, KI-pass QR code checking as well as signage functionalities of the proposed CoSiP work properly and reliably.
Keywords
Fever detection; Face mask detection; KI-pass QR code checking; Digital signage;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proceeding 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1. pp. 1-8, 2001.
2 A Guide to KI-PASS, Korea Disease Control and Prevention Agency, 2021.
3 Digital signage, https://en.wikipedia.org/wiki/Digital_signage (accessed December 13, 2021).
4 Human body temperature, http://www.khna.or.kr/homecare_new/01_first/adult01.php (accessed December 13, 2021).
5 Thermography, https://en.wikipedia.org/wiki/Thermography (accessed December 13, 2021).
6 H.Y. Kim, "Technology Trend of MEMS Infrared Sensor," Electrical & Electronic Materials, Vol. 24, Issue 1, pp. 23-33, 2011.
7 J. Hee, H. S. Cho, S. H. Park, and J. H. Lee, "A Study on Skin Temperature Distribution of the Human Body as Fundamental Data for Developing Heat Energy Harvesting Clothing," Journal of Korea Sciety for Emotion and Sensibility, Vol. 14, Issue 3], pp. 435-444, 2011.
8 D.D. Pascoe and G. Fisher, "Comparison of Measuring Sites for the Assessment of Body Temperature," Thermology International, Vol. 19, Issue 1, pp. 35-42, 2009.
9 N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1. pp. 886-893, 2005.
10 A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks," Advances in Neural Information Processing Systems, Vol. 25, pp. 1097-1105, 2012.
11 S. Minaee, P. Luo, Z. Lin, and K. Bowyer, "Going Deeper Into Face Detection: A Survey," arXiv P reprint, arXiv:2103.14983, 2021.
12 Google MLKit, https://developers.google.com/ml-kit (accessed December 13, 2021).
13 S. Teboulbi, S. Messaoud, M.A. Hajjaji, and A. Mtibaa, "Real-Time Implementation of AI-Based Face Mask Detection and Social Distancing Measuring System for COVID-19 Prevention," Scientific Programming, Vol. 2021, pp. 1-21, 2021.
14 M. F. Azwan, Mushahar, and N. Zaini, "Human Body Temperature Detection based on Thermal Imaging and Screening using YOLO Person Detection," IEEE International Conference on Control System, Computing and Engineering, pp. 27-28, 2021.
15 Bar Code Scanning, https://developers.google.com/ml-kit/vision/barcode-scanning (accessed December 13, 2021).
16 Google ML Kit Face Detection API, https://developers.google.com/ml-kit/vision/facedetection (accessed December 13, 2021).
17 K.R. Singh, S.D. Kamble, S. M. Kalbande, and P. Fulzele, "A Review on COVID-19 Face Mask Detection Using CNN," Journal of Pharmaceutical Research International, Vol. 33 (35B), pp 39-45, 2021.
18 S. Sethi, M. Kathuria, and T. Kaushik, "Face Mask Detection Using Deep Learning: An Approach to Reduce Risk of Coronavirus Spread," Journal of Biomedical Informatics, Vol. 120, pp. 1-12, 2021.
19 K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," arXiv P reprint, arXiv:1512.03385v1, 2015.
20 V. Bazarevsky, Y. Kartynnik, A. Vakunov, K. Raveendran, and M. Grundmann, "BlazeFace: Sub-Millisecond Neural Face Detection on Mobile GPUs," arXiv P reprint, arXiv:1907. 05047, 2019.
21 M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4510-4520, 2018.
22 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv P reprint, arXiv: 1409.1556v6, 2014.
23 H. Lim, S. Ryoo, and H. Jung, "Face-Mask Detection with Micro processor," Journal of Korea Institute of Information and Communication Engineering, Vol. 25, No. 3, pp. 490-493, 2021.   DOI
24 Liming Hu, Facemaskdetector, https://github.com/liminghu/facemaskdetector (accessed December 13, 2021).
25 A. Somboonkaew, et al., "Mobile-Platform for Automatic Fever Screening System Based on Infrared Forehead Temperature," Opto-Electronics and Communications Conference, 2017.
26 IEC 80601-2-59:2017/DAMD 1 Medical Electrical Equipment -Part 2-59: Particular Requirements for the Basic Safety and Essential Performance of Screening Thermo- graphs for Human Febrile Temperature Screening-Amendment 1, https://www.iso.org/standard/83469.html (accessed December 13, 2021).
27 J. Ahlberg, N. Markus, and A. Berg, "Multi-Person Fever Screening Using a Thermal And A Visual Camera," Svenska Sallskapet for Automatiserad Bildanalys, 2015.
28 Rockchip RK3399 Datasheet, https://www.rockchip.fr/RK3399%20datasheet%20V1.8.pdf (accessed December 13, 2021).
29 D. Perpetuini, C. Filippini, D. Cardone, and A. Merla, "An Overview of Thermal Infrared Imaging-Based Screenings during Pandemic Emergencies," International Journal of Environmental Research and Public Health, Vol. 18, Issue 6, 3286, 2021   DOI
30 J. Foster, A. B. Lloyd, and G. Havenith, "NonContact Infrared Assessment of Human Body Temperature," The Journal Temperature Toolbox, Temperature, Vol. 18, Issue 4, pp. 306-319, 2021.
31 Do I need a Blackbody for Skin Temperature Screening?, https://www.flir.com/discover/public-safety/do-i-need-a-blackbody-forskin-temperature-screening/ (accessed December 13, 2021).
32 W. Liu, et al., "SSD: Single Shot MultiBox Detector," European Conference on computer vision, pp 21-37, 2016.
33 G. Jocher, YOLOv5, https://github.com/ultralytics/yolov5 (accessed December 13, 2021).
34 A. Howard, et al., "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," arXiv Preprint, arXiv: 1704.04861, 2017.
35 W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, and A.C. Berg, "Ann-Arbor-SSD: Single Shot MultiBox Detector," arXiv Preprint, arXiv:1512.02325, 2018.
36 T. Ruffin, J. Steele, Y. Acquaah, N. Sharma, E. Sarku, R. Tesiero and B. Gokaraju, "Noninvasive Low Cost Fever Detection Systems," SoutheastCon, 2021.
37 OpenCV, https://opencv.org/ (accessed December 13, 2021).
38 M.J. Lee, Y.M. Kim, and Y.M. Lim. "Masked Face Temperature Measurement System Using Deep Learning," Journal of Korea Multimedia Society, Vol. 24, No. 2, pp. 208-214, 2021.   DOI
39 TeraRanger Evo Thermal 33, https://www.terabee.com/shop/thermal-cameras/teraranger-evo-thermal-33/ (accessed December 13, 2021).
40 Application Note on Fever Detection with Evo Thermal 33, https://terabee.b-cdn.net/wpcontent/uploads/2020/11/Application-noteon-fever-detection-with-Evo-Thermal-33.pdf (accessed December 13, 2021).
41 Z. Wang, et al., "Masked Face Recognition Dataset and Application," arXiv Preprint, arXiv:2003.09093v2, 2020.
42 Real-World-Masked-Face-Dataset, https://gi thub.com/X-zhangyang/Real-WorldMasked-Face-Dataset (accessed December 13, 2021).