DOI QR코드

DOI QR Code

Comparison of rPPG-based Oxygen Saturation Measurement Performance by Face Area with Simple Signal Processing

신호 처리를 통한 비접촉 광용적맥파 기반 얼굴 영역별 산소포화도 추정 성능 비교

  • Hyojin Jo (Yeungnam University) ;
  • Nam Kyu Kwon (Yeungnam University)
  • 조효진 ;
  • 권남규
  • Received : 2024.06.28
  • Accepted : 2024.08.12
  • Published : 2024.08.31

Abstract

This study evaluates the performance of remote photoplethysmography (rPPG)-based oxygen saturation (SpO2) estimation across different face areas. The information in the red and green channels is extracted through spatial averaging on the detected area, followed by detrending, min-max normalization, and low-pass filtering are performed. Finally, SpO2 is estimated using the Ratio of Ratios method based on Beer-Lambert law. Using the PURE dataset, SpO2 estimation accuracy was evaluated with mean absolute error (MAE). Experimental results showed the entire face provided the highest accuracy, followed by the forehead, left cheek, right cheek, and lips.

Keywords

Acknowledgement

본 논문은 2023년도 정부 (과학기술정보통신부)의 재원으로 한국연구재단의 지원을 받아 수행된 연구임 (NO.RS-2023-00219725).

References

  1. A. d. F. G. Rosa, R. C. Betini, "Noncontact SpO 2 Measurement Using Eulerian Video Magnification," IEEE Transactions on Instrumentation and Measurement, Vol. 69, No. 5, pp. 2120-2130, 2019.
  2. H. Xiao, T. Liu, Y. Sun, Y. Li, S. Zhao, A. Avolio, "Remote Photoplethysmography for Heart Rate Measurement: A Review," Biomedical Signal Processing and Control, Vol. 88, pp. 105608, 2024.
  3. B. Huang, S. Hu, Z. Liu, C. L. Lin, J. Su, C. Zhao, L. Wang, W. Wang, "Challenges and Prospects of Visual Contactless Physiological Monitoring in Clinical Study," NPJ Digital Medicine, Vol. 6, No. 1, pp. 231, 2023.
  4. L. Niu, J. Speth, N. Vance, B. Sporrer, A. Czajka, P. Flynn, "Full-body Cardiovascular Sensing with Remote Photoplethysmography," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5994-6004, 2023.
  5. S. Kwon, J. Kim, D. Lee, K. Park, "ROI Analysis for Remote Photoplethysmography on Facial Video," in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2015: IEEE, pp. 4938-4941.
  6. A. Gupta, A. G. Ravelo-Garcia, F. M. Dias, "Availability and Performance of Face Based Non-contact Methods for Heart Rate and Oxygen Saturation Estimations: A Systematic Review," Computer Methods and Programs in Biomedicine, Vol. 219, pp. 106771, 2022.
  7. Q. Fan, K. Li, "Noncontact Imaging Plethysmography for Accurate Estimation of Physiological Parameters," Journal of Medical and Biological Engineering, Vol. 37, pp. 675-685, 2017.
  8. X. Sun, T. Wen, W. Chen, B. Huang, "CCSpO 2 Net: Camera-Based Contactless Oxygen Saturation Measurement Foundation Model in Clinical Settings," IEEE Transactions on Instrumentation and Measurement, 2024.
  9. https://omlc.org/spectra/hemoglobin/
  10. L. Kong, Y. Zhao, L. Dong, Y. Jian, X. Jin, B. Li, Y. Feng, M. Liu, X. Liu, H. Wu, "Non-contact Detection of Oxygen Saturation Based on Visible Light Imaging Device Using Ambient Light," Optics Express, Vol. 21, No. 15, pp. 17464-17471, 2013.
  11. L. Tarassenko, M. Villarroel, A. Guazzi, J. Jorge, D. Clifton, C. Pugh, "Non-contact Video-based Vital Sign Monitoring Using Ambient Light and Auto-regressive Models," Physiological Measurement, Vol. 35, No. 5, pp. 807, 2014.
  12. A. Al-Naji, G. A. Khalid, J. F. Mahdi, J. Chahl, "Non-contact SpO2 Prediction System Based on a Digital Camera," Applied Sciences, Vol. 11, No. 9, pp. 4255, 2021.
  13. B. Wei, X. Wu, C. Zhang, Z. Lv, "Analysis and Improvement of Non-contact SpO2 Extraction Using an RGB Webcam," Biomedical Optics Express, Vol. 12, No. 8, pp. 5227-5245, 2021.
  14. S. Bobbia, R. Macwan, Y. Benezeth, A. Mansouri, J. Dubois, "Unsupervised Skin Tissue Segmentation for Remote Photoplethysmography," Pattern Recognition Letters, Vol. 124, pp. 82-90, 2019.
  15. A. Lam, Y. Kuno, "Robust Heart Rate Measurement from Video Using Select Random Patches," in Proceedings of the IEEE International Conference on Computer Vision, pp. 3640-3648, 2015.
  16. X. Ding, D. Nassehi, E. C. Larson, "Measuring Oxygen Saturation with Smartphone Cameras Using Convolutional Neural Networks," IEEE Journal of Biomedical and Health Informatics, Vol. 23, No. 6, pp. 2603-2610, 2018.
  17. A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W. Y. Lo, P. Dollar, R. Girshick, "Segment Anything," in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4015-4026, 2023.
  18. R. Stricker, S. Muller, H. M. Gross, "Non-contact Video-based Pulse Rate Measurement on a Mobile Service Robot," in The 23rd IEEE International Symposium on Robot and Human Interactive Communication, 2014: IEEE, pp. 1056-1062.
  19. http://www.tu-ilmenau.de/neurob/data-sets/pulse
  20. S. R. Lee, S. E. Lee, S. H. Jo, S. H. Kim, "Region-of-Interest Extraction Optimization for Improving the Accuracy of Non-contact Heart Rate Measurement by Using Two-dimensional Face Images," Journal of Institute of Control, Robotics and Systems, Vol. 29, No. 3, pp. 272-278, 2023, doi: 10.5302/J.ICROS.2023.22.0167
  21. B. Amos, B. Ludwiczuk, M. Satyanarayanan, "Openface: A General-purpose Face Recognition Library with Mobile Applications," CMU School of Computer Science, Vol. 6, No. 2, pp. 20, 2016.
  22. M. P. Tarvainen, P. O. Ranta-Aho, P. A. Karjalainen, "An Advanced Detrending Method with Application to HRV Analysis," IEEE Transactions on Biomedical Engineering, Vol. 49, No. 2, pp. 172-175, 2002.
  23. J. S. Hoffman, V. K. Viswanath, C. Tian, X. Ding, M. J. Thompson, E. C. Larson, S. N. Patel, E. J. Wang, "Smartphone Camera Oximetry in an Induced Hypoxemia Study," NPJ Digital Medicine, Vol. 5, No. 1, pp. 146, 2022.