Browse > Article
http://dx.doi.org/10.9717/kmms.2020.23.11.1388

Heart Rate Measurement Combining Motion and Color Information  

Lomaliza, Jean-Pierre (Dept. of Electronic Engineering, Pukyong National University)
Park, Hanhoon (Dept. of Electronic Engineering, Pukyong National University)
Moon, Kwang-Seok (Dept. of Electronic Engineering, Pukyong National University)
Publication Information
Abstract
Daily monitoring of the heart rate can facilitate detection of heart-related diseases in their early stages. Therefore, providing an easy-to-use and noninvasive heart rate monitoring system has been a very popular research topic in the field of healthcare. One of good candidate methods is to use commonly available cameras and extract information that can help to estimate heart rate from a human face. Generally, such information can be retrieved using two different approaches: photoplethysmography (PPG) and ballistocardiography (BCG). PPG exploits slight color changes caused by blood volume variations during heartbeats; thus, it tends to be vulnerable to unstable lighting conditions. BCG exploits subtle head motions caused by pumped blood travelling through the carotid artery during heartbeats; thus, it is vulnerable to the voluntary head movements that are not related to heartbeats. Nevertheless, most related works use either to estimate the heart rate. In this paper, we propose to combine two approaches to be robust to challenging conditions. Specifically, we explore possible ways to combine raw signals obtained from two approaches and verify that the proposed combination shows better accuracies under challenging conditions, such as voluntary head movements and ambient lighting changes.
Keywords
Heart Rate Measurement; Photoplethysmography; Ballistocardiography; Hybrid Approach; Face Video;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 W. Verkruysse, L.O. Svaasand, and J.S. Nelson, "Remote Plethysmographic Imaging Using Ambient Light," Optics Express, Vol. 16, No. 26, 21434-21445, 2008.   DOI
2 H.E. Tasli, A. Gudi, and M. den Uyl, "Remote PPG Based Vital Sign Measurement Using Adaptive Facial Regions," Proceeding of IEEE International Conference on Image Processing, 2014.
3 M.P. Tarvainen, P.O. Ranta-aho, and P.A. Karjalainen, "An Advanced Detrending Me-thod with Application to HRV Analysis," IEEE Transactions on Biomedical Engineering, Vol. 49, No. 2, pp. 172-175, 2002.   DOI
4 M. Jain, S. Deb, and A.V. Subramanyam, "Face Video Based Touchless Blood Pressure and Heart Rate Estimation," Proceeding of IEEE International Workshop on Multimedia Signal Processing, pp. 1-5, 2016.
5 P. Viola and M.J. Jones, "Robust Real-time Face Detection," International Journal of Computer Vision, Vol. 57, pp. 137-154, 2004.   DOI
6 G. Bradski and A. Kaehler, Learning OpenCV: Computer Vision with the OpenCV Library, O'Reilly Media, Sebastopol, California, 2008.
7 X. Xiong and F. De la Torre, "Supervised Descent Method and Its Applications to Face Alignment," Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 532-539, 2013.
8 N.V. Hoan, J.H. Park, S.H. Lee, and K.R. Kwon, "Real-time Heart Rate Measurement Based on Photoplethysmography Using Android Smartphone Camera," Journal of Korea Multimedia Society, Vol. 20, No. 2, pp. 234-243, 2017.   DOI
9 J.P. Lomaliza and H. Park, "Improved Peak Detection Technique for Robust PPG-based Heartrate Monitoring System on Smartphones," Multimedia Tools and Applications, Vol. 77, No. 13, pp. 17131-17155, 2018.   DOI
10 E.J. Benjamin, P. Muntner, A. Alonso, M.S. Bittencourt, C.W. Callaway, A.P. Carson et al., "Heart Disease and Stroke Statistics-2019 Update: A Report from the American Heart Association," Circulation, Vol. 139, No. 10, pp. e56-e528, 2019.
11 A.B. Hertzman and J.B. Dillon, "Applications of Photoelectric Plethysmography in Peripheral Vascular Disease," American Heart Journal, Vol. 20, No. 6, pp. 750-761, 1940.   DOI
12 X. Li, J. Chen, G. Zhao, and M. Pietikainen, "Remote Heart Rate Measurement from Face Videos under Realistic Situations," Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4264-4271, 2014.
13 S. Tulyakov, X. Alameda-Pineda, E. Ricci, L. Yin, J.F. Cohn, and N. Sebe, "Self-adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions," Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2396-2404, 2016.
14 A. Lam and Y. Kuno, "Robust Heart Rate Measurement from Video Using Select Random Patches," Proceeding of the IEEE International Conference on Computer Vision, pp. 3640-3648, 2015.
15 G. Balakrishnan, F. Durand, and J. Guttag, "Detecting Pulse from Head Motions in Video," Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3430-3437, 2013.
16 L. Shan and M. Yu, "Video-based Heart Rate Measurement Using Head Motion Tracking and ICA," Proceeding of International Congress on Image and Signal Processing, Vol. 1, pp. 160-164, 2013.
17 M.A. Haque, R. Irani, K. Nasrollahi, and T.B. Moeslund, "Heartbeat Rate Measurement from Facial Video," IEEE Intelligent Systems, Vol. 31, No. 3, pp. 40-48, 2016.   DOI