The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Remote Heart Rate Measurement From Highly Compressed Facial Videos: An End-to-End Deep Learning Solution With Video Enhancement
Open accessAbstract
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing rPPG approaches rely on analyzing very fine details of facial videos, which are prone to be affected by video compression. Here we propose a two-stage, end-to-end method using hidden rPPG information enhancement and attention networks, which is the first attempt to counter video compression loss and recover rPPG signals from highly compressed videos. The method includes two parts: 1) a Spatio-Temporal Video Enhancement Network (STVEN) for video enhancement, and 2) an rPPG network (rPPGNet) for rPPG signal recovery. The rPPGNet can work on its own for robust rPPG measurement, and the STVEN network can be added and jointly trained to further boost the performance especially on highly compressed videos. Comprehensive experiments are performed on two benchmark datasets to show that, 1) the proposed method not only achieves superior performance on compressed videos with high-quality videos pair, 2) it also generalizes well on novel data with only compressed videos available, which implies the promising potential for real-world applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
Overview of the H.264/AVC video coding standard
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815165 · Cited by 8,184
A Closer Look at Spatiotemporal Convolutions for Action Recognition
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., & Paluri, M. (2017) · arXiv · doi:10.48550/arxiv.1711.11248 · Cited by 3,664 · cited 1×
“”ST Block” represents spatio-temporal block [30], which is constructed by two sets of cascaded 3D convolution filters with kernel size of 1×3×3 and 3×1×1, respectively.”
BackgroundA Closer Look at Spatiotemporal Convolutions for Action Recognition
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., & Paluri, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00675 · Cited by 3,516
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100 · cited 1×
“, chrominancebased rPPG (CHROM) [4], projection plane orthogonal to the skin tone (POS) [35], and spatial subspace rotation [36, 34, 13].”
BackgroundRemote plethysmographic imaging using ambient light
Verkruysse, W., Svaasand, L. O., & Nelson, J. S. (2008) · Optics Express · doi:10.1364/oe.16.021434 · Cited by 1,719
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Non-contact, automated cardiac pulse measurements using video imaging and blind source separation
Poh, M.-Z., McDuff, D. J., & Picard, R. W. (2010) · Optics Express · doi:10.1364/oe.18.010762 · Cited by 1,643
Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam
Poh, M.-Z., McDuff, D. J., & Picard, R. W. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2086456 · Cited by 1,486
Robust pulse rate from chrominance-based rPPG
de Haan, G., & Jeanne, V. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2266196 · Cited by 1,378 · cited 5×
“, chrominancebased rPPG (CHROM) [4], projection plane orthogonal to the skin tone (POS) [35], and spatial subspace rotation [36, 34, 13].”
BackgroundMethodInfluentialAlgorithmic principles of remote PPG
Wang, W., den Brinker, A. C., Stuijk, S., & de Haan, G. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2609282 · Cited by 1,234
Compression Artifacts Reduction by a Deep Convolutional Network
Dong, C., Deng, Y., Loy, C. C., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.73 · Cited by 883
DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
Chen, W., & McDuff, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_22 · Cited by 716
Remote Heart Rate Measurement from Face Videos under Realistic Situations
Li, X., Chen, J., Zhao, G., & Pietikainen, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.543 · Cited by 550
Self-citationA Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation
Wang, W., Stuijk, S., & de Haan, G. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2508602 · Cited by 370
ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS
Ponomarenko, N. N., Silvestri, F., Egiazarian, K., Carli, M., Astola, J. T., & Лукин, В. В. (2007) · Cited by 364
Tulyakov, S., Alameda-Pineda, X., Ricci, E., Yin, L., Cohn, J. F., & Sebe, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.263 · Cited by 340
When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach
Liu, D., Wen, B., Liu, X., Wang, Z., & Huang, T. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/117 · Cited by 231
Multi-frame Quality Enhancement for Compressed Video
Yang, R., Xu, M., Wang, Z., & Li, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00697 · Cited by 220
Deep Generative Adversarial Compression Artifact Removal
Galteri, L., Seidenari, L., Bertini, M., & Bimbo, A. D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.517 · Cited by 212
Robust Heart Rate Measurement from Video Using Select Random Patches
Lam, A., & Kuno, Y. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.415 · Cited by 176
SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific
Niu, X., Han, H., Shan, S., & Chen, X. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546321 · Cited by 174
Li, X., Alikhani, I., Shi, J., Seppänen, T., Junttila, J. M., Majamaa‐Voltti, K., Tulppo, M. P., & Zhao, G. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00043 · Cited by 125
Self-citationMcDuff, D., Blackford, E. B., & Estepp, J. R. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.17 · Cited by 108
Chaichulee, S., Villarroel, M., Jorge, J., Arteta, C., Green, G., McCormick, K. P., Zisserman, A., & Tarassenko, L. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.41 · Cited by 78
A Novel Framework for Remote Photoplethysmography Pulse Extraction on Compressed Videos
Zhao, C., Lin, C., Chen, W., & Li, Z. G. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00177 · Cited by 62
Atrial Fibrillation Detection From Face Videos by Fusing Subtle Variations
Shi, J., Alikhani, I., Li, X., Yu, Z., Seppänen, T., & Zhao, G. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2926632 · Cited by 62
Self-citationDeep Super Resolution for Recovering Physiological Information from Videos
McDuff, D. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00185 · Cited by 48
Tang, C., Lu, J., & Liu, J. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00178 · Cited by 45
Adaptive skin segmentation via feature-based face detection
Taylor, M. J., & Morris, T. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2052003 · Cited by 24
Non-Contact Reflectance Photoplethysmography: Progress, Limitations, and Myths
Špetlík, R., Čech, J., & Matas, J. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00111 · Cited by 21
Cited by
PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer
Yu, Z., Shen, Y., Shi, J., Zhao, H., Torr, P., & Zhao, G. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00415 · Cited by 300
Self-citationDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.07634 · Cited by 280
Deep learning for face anti-spoofing: A survey
Yu, Z., Qin, Y., Li, X., Zhao, C., Lei, Z., & Zhao, G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3215850 · Cited by 227
Self-citationNowara, E. M., McDuff, D., & Veeraraghavan, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00150 · Cited by 66
PhysFlow: Skin tone transfer for remote heart rate estimation through conditional normalizing flows
Comas, J., Alomar, A., Ruiz, A., & Sukno, F. (2024) · arXiv · doi:10.48550/arxiv.2407.21519 · Cited by 4
“Deep learning-based methods [24, 31, 39, 42, 48, 63] have surpassed conventional techniques, achieving state-of-the-art performance in estimating vital signs from facial videos.”
Metadata
- Authors
- Yu, Z., Peng, W., Li, X., Hong, X., & Zhao, G.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 151-160
- OpenAlex
- W2986906199
- Cited by
- 340
- References
- 36
- FWCI
- 70.25
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.