Browse > Article

Robust Extraction of Heartbeat Signals from Mobile Facial Videos  

Lomaliza, Jean-Pierre (Department of Electronic Engineering, Pukyong National University)
Park, Hanhoon (Department of Electronic Engineering, Pukyong National University)
Publication Information
Journal of the Institute of Convergence Signal Processing / v.20, no.1, 2019 , pp. 51-56 More about this Journal
Abstract
This paper proposes an improved heartbeat signal extraction method for ballistocardiography(BCG)-based heart-rate measurement on mobile environment. First, from a mobile facial video, a handshake-free head motion signal is extracted by tracking facial features and background features at the same time. Then, a novel signal periodicity computation method is proposed to accurately separate out the heartbeat signal from the head motion signal. The proposed method could robustly extract heartbeat signals from mobile facial videos, and enabled more accurate heart rate measurement (measurement errors were reduced by 3-4 bpm) compared to the existing method.
Keywords
Heart rate measurement; facial video; head motion analysis; handshake handling; periodic signal extraction; smartphone camera;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 A. Arcelus, M. Sardar, and A. Mihailidis, "Design of a capacitive ECG sensor for unobtrusive heart rate measurements," in IEEE Int. Instrumentation and Measurement Technology Conf., Minneapolis, MN, USA, May 2013.
2 P. Leonard, N. Grubb, P. Addison, D. Clifton, and J. Watson, "An algorithm for the detection of individual breaths from the pulse oximeter waveform," J. Clin. Monit. Comput., vol. 18, pp. 309-312, 2004.   DOI
3 D. W. Holdsworth, "Characterization of blood-flow waveforms in normal human subjects," Physiol. Meas., vol. 20, no. 3, pp. 219-240, 1999.   DOI
4 M. Garbey, N. Sun, A. Merla, and I. Pavlidis, "Contact-free measurement of cardiac pulse based on the analysis of thermal imagery," IEEE Trans. Biomed. Eng., vol. 54, no. 8, pp. 1418-1426, 2007.   DOI
5 M.-Z. Poh, D. J. McDuff, and R. W. Picard, "Non-contact, automated cardiac pulse measurements using video imaging and blind source separation," Optics Express, vol. 18, no. 10, pp. 10762-10774, 2010.   DOI
6 Y.-C. Lin, N.-K. Chou, G.-Y. Lin, M.-H. Li, and Y.-H. Lin, "A real-time contactless pulse rate and motion status monitoring system based on complexion tracking," Sensors, vol. 17, no. 7, pp. 1490, 2017.   DOI
7 J.-P. Lomaliza and H. Park, "A highly efficient and reliable heart rate monitoring system using smartphone cameras," Multimed. Tools Appl., vol. 76, no. 20, pp. 21051-21071, 2017.   DOI
8 D. Grimaldi, Y. Kurylyak, F. Lamonaca, and A. Nastro, "Photo-plethysmography detection by smart-phone's video camera," in IEEE Int. Conf. on Intell. Data Acqu. Adv. Compu. Syst., Prague, Czech Republic, 2011, pp. 488-491.
9 M. A. Hassan, A. S. Malik, D. Fofi, N. Saad, B. Karasfi, Y. S. Ali, and F. Meriaudeau, "Heart rate estimation using facial video: A review," Biomedical Signal Processing and Control, vol. 38, pp. 346-360, 2017.   DOI
10 G. Balakrishnan, F. Durand, and J. Guttag, "Detecting pulse from head motions in video," in CVPR, Portland, OR, USA, June 2013.
11 J.-P. Lomaliza and H. Park, "Detecting pulse from head motions using smartphone camera," LNEE, vol. 415, pp. 243-251, 2016.
12 Y.-G. Lim, "Development of chair backrest for non-intrusive simultaneous measurement of ECG and BCG," Journal of the Institute of Convergence Signal Processing, vol. 19, no. 3, pp. 104-109, 2018.
13 J. Shi and C. Tomasi, "Good features to track," in IEEE Conference on Computer Vision and Pattern Recognition, 1994, pp. 593-600.
14 B.D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Imaging Understanding Workshop, 1981, pp. 121-130.