Turn off MathJax
Article Contents
JI Xiao-qiang, LIU Zhen-yao, LI Bing-lin, RAO Zhi, LI Gui-wen, SU Li-wei. Non-contact perception of physiological parameters from face video[J]. Chinese Optics. doi: 10.37188/CO.2021-0157
Citation: JI Xiao-qiang, LIU Zhen-yao, LI Bing-lin, RAO Zhi, LI Gui-wen, SU Li-wei. Non-contact perception of physiological parameters from face video[J]. Chinese Optics. doi: 10.37188/CO.2021-0157

Non-contact perception of physiological parameters from face video

doi: 10.37188/CO.2021-0157
Funds:  Supported by Department of Science and Technology of Natural Science Foundation of Jilin Province under grant number (No. 20210204131YY)
  • Available Online: 2021-10-19
  •   Objetive   In order to allow subjects to detect various physiological parameters under non-contactconditions in daily life.  Method  A method based on imaging photoplethysmography has been proposed to estimate physiological parameters from face videos recorded by mobile phone in this paper. First, the "wavelet transform-principal component analysis-blind source separation" algorithm is proposed to extract the RGB three-channel pulse wave signal with high signal-to-noise ratio. Then, the green channel signal is processed separately in the frequency domain and the time domain to estimate the heart rate and respiration rate;the pulse wave signals of the red and blue channels are processed, and then combined with the oxygen saturation detected by the oximeter to perform data fitting, and the best linear equation for estimating the oxygen saturation value from the facial video is found. Finally, the error of the estimation results of various physiological parameters under natural light is compared, and the estimation results of each parameter under three lighting environments are analyzed.  Result  The results show that under the three lighting environments, the average error of heart rate is 0.5512 bpm, the average error of respiration rate is −0.6321 brpm, and the average error of oxygen saturation is −0.2743%.   Conclusion  In summary, the non-contact physiological parameter estimation method proposed in this paper has high accuracy, universality and stability, and the estimation result is highly consistent with the measurement result of the standard instrument, which can meet the needs of daily physiological parameter measurement.
  • loading
  • [1]
    TULPPO M P, KIVINIEMI A M, JUNTTILA M J, et al. Home monitoring of heart rate as a predictor of imminent cardiovascular events[J]. Frontiers in Physiology, 2019, 10: 341. doi: 10.3389/fphys.2019.00341
    KAUSER M A, SAFIUDDIN M. Heart rate-an emerging cardiovascular risk factor[J]. University Heart Journal, 2012, 8(1): 30-35. doi: 10.3329/uhj.v8i1.11665
    MATHER M, THAYER J F. How heart rate variability affects emotion regulation brain networks[J]. Current Opinion in Behavioral Sciences, 2018, 19: 98-104. doi: 10.1016/j.cobeha.2017.12.017
    TARASSENKO L, VILLARROEL M, GUAZZI A, et al. Non-contact video-based vital sign monitoring using ambient light and auto-regressive models[J]. Physiological Measurement, 2014, 35(5): 807-831. doi: 10.1088/0967-3334/35/5/807
    BAL U. Non-contact estimation of heart rate and oxygen saturation using ambient light[J]. Biomedical Optics Express, 2015, 6(1): 86-97. doi: 10.1364/BOE.6.000086
    CASALINO G, CASTELLANO G, PASQUADIBISCEGLIE V, et al. Contact-Less real-time monitoring of cardiovascular risk using video imaging and fuzzy inference rules[J]. Information, 2019, 10(1): 9.
    荣猛, 范强, 李凯扬. 基于IPPG非接触式生理参数测量算法的研究[J]. 生物医学工程研究,2018,37(1):27-31,35.

    RONG M, FAN Q, LI K Y. Study on the measurement algorithm of contactless physiological parameter based on imaging photoplenthysmography[J]. Journal of Biomedical Engineering Research, 2018, 37(1): 27-31,35. (in Chinese)
    李晓媛, 武鹏, 刘允, 等. 基于人脸视频的心率参数提取[J]. 光学 精密工程,2020,28(3):548-557. doi: 10.3788/OPE.20202803.0548

    LI X Y, WU P, LIU Y, et al. Extraction of heart rate parameters from video of human face[J]. Optics and Precision Engineering, 2020, 28(3): 548-557. (in Chinese) doi: 10.3788/OPE.20202803.0548
    LUGUERN D, MACWAN R, BENEZETH Y, et al. Wavelet Variance Maximization: a contactless respiration rate estimation method based on remote photoplethysmography[J]. Biomedical Signal Processing and Control, 2021, 63: 102263. doi: 10.1016/j.bspc.2020.102263
    RAHMAN H, AHMED M U, BEGUM S. Non-contact physiological parameters extraction using facial video considering illumination, motion, movement and vibration[J]. IEEE Transactions on Biomedical Engineering, 2020, 67(1): 88-98. doi: 10.1109/TBME.2019.2908349
    戴阳, 郑婷婷, 杨雪. 基于视频放大与盲源分离的非接触式心率检测[J]. 计算机系统应用,2021,30(1):228-234.

    DAI Y, ZHENG T T, YANG X. Non-contact heart rate detection based on video amplification and blind source separation[J]. Computer Systems &Applications, 2021, 30(1): 228-234. (in Chinese)
    CHEN Q, JIANG X Y, LIU X Y, et al. . Non-contact heart rate monitoring in neonatal intensive care unit using RGB camera[C]. Proceedings of the 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, IEEE, 2020: 5822-5825.
    WU H Y, RUBINSTEIN M, SHIH E, et al. Eulerian video magnification for revealing subtle changes in the world[J]. ACM Transactions on Graphics, 2012, 31(4): 65.
    LIU J G, LUO H, ZHENG P P. et al. Transdermal optical imaging revealed different spatiotemporal patterns of facial cardiovascular activities[J]. Scientific Reports, 2018, 8(1): 10588. doi: 10.1038/s41598-018-28804-0
    彭仁杰, 姚云霞. 小波分解和重构的光学可变图像融合研究[J]. 激光杂志,2021,42(3):145-148.

    PENG R J, YAO Y X. Research on optical variable image fusion based on wavelet decomposition and reconstruction[J]. Laser Journal, 2021, 42(3): 145-148. (in Chinese)
    YING L, ZHANG F B, ZHANG Y L, et al. Identifying distributed dynamic loading in one spatial dimension based on combing wavelet decomposition and Kalman filter with unknown input[J]. Journal of Aerospace Engineering, 2021, 34(4): 04021025. doi: 10.1061/(ASCE)AS.1943-5525.0001265
    SONG K, ZHANG B Y, LI W, et al. Research on parallel principal component analysis based on ternary optical computer[J]. Optik, 2021, 241: 167176. doi: 10.1016/j.ijleo.2021.167176
    张申华, 杨延西, 秦峤孟. 针对光栅图像的快速盲去噪方法[J]. 中国光学,2021,14(3):596-604. doi: 10.37188/CO.2020-0166

    ZAHNG SH H, YANG Y X, QIN Q M. A fast blind denoising method for grating image[J]. Chinese Optics, 2021, 14(3): 596-604. (in Chinese) doi: 10.37188/CO.2020-0166
    邱晓华, 李敏, 邓光芒, 等. 多层卷积特征融合的双波段决策级船舶识别[J]. 光学 精密工程,2021,29(1):183-190. doi: 10.37188/OPE.20212901.0183

    QIU X H, LI M, DENG G M, et al. Multi-layer convolutional features fusion for dual-band decision-level ship recognition[J]. Optics and Precision Engineering, 2021, 29(1): 183-190. (in Chinese) doi: 10.37188/OPE.20212901.0183
    VERKRUYSSE W, SVAASAND L O, NELSON J S. Remote plethysmographic imaging using ambient light[J]. Optics Express, 2008, 16(26): 21434-21445. doi: 10.1364/OE.16.021434
    乔闹生, 孙萍. CCD非线性效应对双频光栅三维面形测量的影响[J]. 中国光学,2021,14(3):661-669. doi: 10.37188/CO.2020-0143

    QIAO N SH, SUN P. Influence of CCD nonlinearity effect on the three-dimensional shape measurement of dual frequency grating[J]. Chinese Optics, 2021, 14(3): 661-669. (in Chinese) doi: 10.37188/CO.2020-0143
    赵云, 吕金光, 秦余欣, 等. 微型傅立叶变换光谱仪的优化设计与实验研究[J]. 中国光学,2020,13(2):411-425. doi: 10.3788/co.20201302.0411

    ZHAO Y, LV J G, QIN Y X, et al. Optimization design and experimental study of micro-Fourier transform spectrometer[J]. Chinese Optics, 2020, 13(2): 411-425. (in Chinese) doi: 10.3788/co.20201302.0411
    刘今越, 刘浩, 贾晓辉, 等. 基于视觉的非接触呼吸频率自动检测方法[J]. 仪器仪表学报,2019,40(2):51-58.

    LIU J Y, LIU H, JIA X H, et al. Vision-based automatic detection method for non-contact respiratory rate[J]. Chinese Journal of Scientific Instrument, 2019, 40(2): 51-58. (in Chinese)
  • 加载中


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(15)  / Tables(3)

    Article views (63) PDF downloads(6) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint