Browse > Article
http://dx.doi.org/10.33851/JMIS.2021.8.1.1

Non-Contact Heart Rate Monitoring from Face Video Utilizing Color Intensity  

Sahin, Sarker Md (Information Convergence Engineering, Pusan National University)
Deng, Qikang (Information Convergence Engineering, Pusan National University)
Castelo, Jose (Information Convergence Engineering, Pusan National University)
Lee, DoHoon (Information Convergence Engineering, Pusan National University)
Publication Information
Journal of Multimedia Information System / v.8, no.1, 2021 , pp. 1-10 More about this Journal
Abstract
Heart Rate is a crucial physiological parameter that provides basic information about the state of the human body in the cardiovascular system, as well as in medical diagnostics and fitness assessments. At present day, it has been demonstrated that facial video-based photoplethysmographic signal captured using a low-cost RGB camera is possible to retrieve remote heart rate. Traditional heart rate measurement is mostly obtained by direct contact with the human body, therefore, it can result inconvenient for long-term measurement due to the discomfort that it causes to the subject. In this paper, we propose a non-contact-based remote heart rate measuring approach of the subject which depends on the color intensity variation of the subject's facial skin. The proposed method is applied in two regions of the subject's face, forehead and cheeks. For this, three different algorithms are used to measure the heart rate. i.e., Fast Fourier Transform (FFT), Independent Component Analysis (ICA) and Principal Component Analysis (PCA). The average accuracy for the three algorithms utilizing the proposed method was 89.25% in both regions. It is also noteworthy that the FastICA algorithm showed a higher average accuracy of more than 92% in both regions. The proposed method obtained 1.94% higher average accuracy than the traditional method based on average color value.
Keywords
Computer vison; Face video; Heart rate monitoring; Remote photoplethysmography;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Davis et al., "Continuous non-contact vital sign monitoring in neonatal intensive care unit," Healthc. Technol. Lett., vol. 1, no. 3, pp. 87-91, 2014, doi: 10.1049/htl.2014.0077.   DOI
2 X. Chen, J. Cheng, R. Song, Y. Liu, R. Ward, and Z. J. Wang, "Video-Based Heart Rate Measurement: Recent Advances and Future Prospects," IEEE Trans. Instrum. Meas., vol. 68, no. 10, pp. 3600-3615, 2019, doi: 10.1109/TIM.2018.2879706.   DOI
3 P. K. Jain and A. K. Tiwari, "Heart monitoring systems-A review," Comput. Biol. Med., vol. 54, no. 2014, pp. 1-13, 2014, doi: 10.1016/j.compbiomed.2014.08.014.   DOI
4 German Da Costa, "Optical remote sensing of heartbeats," Opt. Commun., vol. 117, no. 5-6, pp. 395-398, 1995, doi: https://doi.org/10.1016/0030-4018(95)00181-7.   DOI
5 E. F. Greneker, "Radar sensing of heartbeat and respiration at a distance with applications of the technology," Radar 97 (Conf. Publ. No. 449), pp. 150-154, 1997, doi: 10.1049/cp:19971650.   DOI
6 W. Verkruysse, L. O. Svaasand, and J. S. Nelson, "Remote plethysmographic imaging using ambient light," Opt. Express, vol. 16, no. 26, p. 21434, 2008, doi: 10.1364/oe.16.021434.   DOI
7 M. Elgendi, "On the Analysis of Photoplethysmogram Signal," Curr. Cardiol. Rev., vol. 8, no. c, pp. 14-25, 2012.   DOI
8 N. Saquib, M. T. I. Papon, I. Ahmad, and A. Rahman, "Measurement of heart rate using photoplethysmography," in Proceeding of 2015 Int. Conf. Netw. Syst. Secur. NSysS 2015, 2015, doi: 10.1109/NSysS.2015.7043525.   DOI
9 M. A. Hassan, A. S. Malik, D. Fofi, N. Saad, B. Karasfi, Y. S. Ali, and F. Meriaudeau, "Heart rate estimation using facial video: A review," Biomed. Signal Process. Control, vol. 38, pp. 346-360, 2017, doi: 10.1016/j.bspc.2017.07.004.   DOI
10 D. S. Short, "The syndrome of alternating bradycardia and tachycardia," British Heart Journal, vol. 16, no. 2 p. 208, 1954.   DOI
11 S. Hu, J. Zheng, V. Chouliaras, and R. Summers, "Feasibility of imaging photoplethysmography," in Proceeding of the 1st Int. Conf. Biomed. Eng. Informatics, BMEI 2008, vol. 2, pp. 72-75, 2008, doi: 10.1109/BMEI.2008.365.   DOI
12 A. Reisner, P. A. Shaltis, D. McCombie, and H. H. Asada, "Utility of the photoplethysmogram in circulatory monitoring," Anesthesiology, vol. 108, no. 5, pp. 950-958, 2008, doi: 10.1097/ALN.0b013e31816c89e1.   DOI
13 J. Zheng and S. Hu, "The preliminary investigation of imaging photoplethysmographic system," J. Phys. Conf. Ser., vol. 85, no. 1, 2007, doi: 10.1088/1742-6596/85/1/012031.   DOI
14 P. Y. Chiang et al., "Machine learning classification for assessing the degree of stenosis and blood flow volume at arteriovenous fistulas of hemodialysis patients using a new photoplethysmography sensor device," Sensors (Switzerland), vol. 19, no. 15, pp. 1-16, 2019, doi: 10.3390/s19153422.   DOI
15 Boubenna, Hadjer, and Dohoon Lee, "Feature selection for facial emotion recognition based on genetic algorithm," in Proceeding of the 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), pp. 511-517, Changsha, China, 2016.
16 W. Wang, A. C. Den Brinker, S. Stuijk, and G. De Haan, "Algorithmic Principles of Remote PPG," IEEE Trans. Biomed. Eng., vol. 64, no. 7, pp. 1479-1491, 2017, doi: 10.1109/TBME.2016.2609282.   DOI
17 H. Demirezen and C. E. Erdem, "An overview of non-contact photoplethysmography," pp. 1-4, 2017, doi: 10.1109/siu.2017.7960176.   DOI
18 H. Abdi and L. J. Williams, "Principal component analysis," Wiley Interdiscip. Rev. Comput. Stat., vol. 2, no. 4, pp. 433-459, 2010, doi: 10.1002/wics.101.   DOI
19 H. Boubenna and D. Lee, "Image-based emotion recognition using evolutionary algorithms," Biologically Inspired Cognitive Architectures, vol. 24, pp. 70-76, 2018.   DOI
20 Ji-Hae Kim, Byung-Gyu Kim, Partha Pratim Roy, and Dami Jeong, "Efficient facial expression recognition algorithm based on hierarchical deep neural network structure," IEEE Access, vol. 7, pp. 41273-41285, 2019.   DOI
21 Dami Jeong, Byung-Gyu Kim, and Suh-Yeon Dong, "Deep joint spatiotemporal network (DJSTN) for efficient facial expression recognition," Sensors, vol. 20, no. 7, p. 1936, 2020, doi: 10.3390/s20071936.   DOI
22 P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proceeding of IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1, 2001, doi: 10.1109/cvpr.2001.990517.   DOI
23 C. Massaroni, E. Schena, S. Silvestri, and S. Maji, "Comparison of two methods for estimating respiratory waveforms from videos without contact," Med. Meas. Appl. MeMeA 2019 - Symp. Proc., 2019, doi: 10.1109/MeMeA.2019.8802167.   DOI
24 G. Akti and D. Goularas, "Frequency component extraction from color images for specific sound transformation and analysis," in Proceeding of the 3rd Int. Conf. Image Process. Theory, Tools Appl. IPTA 2012, pp. 253-258, 2012, doi: 10.1109/IPTA.2012.6469573   DOI