Algorithmic principles of remote PPG
Open accessAbstract
This paper introduces a mathematical model that incorporates the pertinent optical and physiological properties of skin reflections with the objective to increase our understanding of the algorithmic principles behind remote photoplethysmography (rPPG). The model is used to explain the different choices that were made in existing rPPG methods for pulse extraction. The understanding that comes from the model can be used to design robust or application-specific rPPG solutions. We illustrate this by designing an alternative rPPG method, where a projection plane orthogonal to the skin tone is used for pulse extraction. A large benchmark on the various discussed rPPG methods shows that their relative merits can indeed be understood from the proposed model.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Numerous other studies that stratify results against Fitzpatrick classification identify the same trend: errors in determining heart rate from wearable PPG devices that use primarily green light are increased in individuals with dark skin tones due to high absorption caused by increased amounts of epidermal melanin.
“In addition to these examples, numerous other studies that stratify results against Fitzpatrick classification identify the same trend; errors in determining heartrate from wearable PPG devices that use primarily green light as their source is increased in individuals with dark skin tones due to the high absorption caused by increased amounts of epidermal melanin [42,43,44,45].”
From Sources of inaccuracy in photoplethysmography for continuous cardiovascular monitoring (2021) · cites this paper as [42]
Cites
Remote plethysmographic imaging using ambient light
Verkruysse, W., Svaasand, L. O., & Nelson, J. S. (2008) · Optics Express · doi:10.1364/oe.16.021434 · Cited by 1,728 · see citing works
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664 · see citing works
Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam
Poh, M., McDuff, D., & Picard, R. W. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2086456 · Cited by 1,488 · see citing works
Robust pulse rate from chrominance-based rPPG
de Haan, G., & Jeanne, V. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2266196 · Cited by 1,378 · see citing works
Self-citationRemote Heart Rate Measurement from Face Videos under Realistic Situations
Li, X.-B., Chen, J., Zhao, G.-Y., & Pietikainen, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.543 · Cited by 547 · see citing works
Improved motion robustness of remote-PPG by using the blood volume pulse signature
de Haan, G., & van Leest, A. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/9/1913 · Cited by 491 · see citing works
Self-citationNon-contact video-based vital sign monitoring using ambient light and auto-regressive models
Tarassenko, L., Villarroel, M., Guazzi, A., Jorge, J., Clifton, D. A., & Pugh, C. W. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/5/807 · Cited by 421 · see citing works
Measuring pulse rate with a webcam — A non-contact method for evaluating cardiac activity
Lewandowska, M., Rumiński, J., Kocejko, T., & Nowak, J. (2011) · Cited by 420 · see citing works
DistancePPG: Robust non-contact vital signs monitoring using a camera
Kumar, M., Veeraraghavan, A., & Sabharwal, A. (2015) · Biomedical Optics Express · doi:10.1364/boe.6.001565 · Cited by 417 · cited 1× · see citing works
“For a thorough evaluation, we benchmark it with seven commonly used or state-of-the-art rPPG methods: 1) G (2007) [1], the single wavelength method that is still popular as evidenced by recent researches [7], [10].”
MethodA Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation
Wang, W., Stuijk, S., & de Haan, G. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2508602 · Cited by 369 · see citing works
Self-citationTulyakov, S., Alameda-Pineda, X., Ricci, E., Yin, L., Cohn, J. F., & Sebe, N. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.263 · Cited by 351 · see citing works
Remote measurement of cognitive stress via heart rate variability
McDuff, D., Gontarek, S., & Picard, R. W. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944243 · Cited by 315 · see citing works
Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG
Wang, W., Stuijk, S., & de Haan, G. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2356291 · Cited by 282 · see citing works
Self-citationIntroducing Contactless Blood Pressure Assessment Using a High Speed Video Camera
Jeong, I. C., & Finkelstein, J. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0439-z · Cited by 161 · see citing works
Non-contact measurement of oxygen saturation with an RGB camera
Guazzi, A., Villarroel, M., Jorge, J., Daly, J., Frise, M. C., Robbins, P. A., & Tarassenko, L. (2015) · Biomedical Optics Express · doi:10.1364/boe.6.003320 · Cited by 151 · see citing works
Detection of atrial fibrillation using contactless facial video monitoring
Couderc, J., Kyal, S., Mestha, L. K., Xu, B., Peterson, D. R., Xia, X., & HALL, B. W. (2014) · Heart Rhythm · doi:10.1016/j.hrthm.2014.08.035 · Cited by 92 · see citing works
Tsouri, G. R., & Zheng, L. (2015) · Journal of Biomedical Optics · doi:10.1117/1.jbo.20.4.048002 · Cited by 72 · see citing works
Towards continuous monitoring of pulse rate in neonatal intensive care unit with a webcam
Mestha, L. K., Kyal, S., Xu, B., Lewis, L., & Kumar, V. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944455 · Cited by 66 · see citing works
Constrained independent component analysis approach to nonobtrusive pulse rate measurements
Tsouri, G. R., Kyal, S., Dianat, S. A., & Mestha, L. K. (2012) · Journal of Biomedical Optics · doi:10.1117/1.jbo.17.7.077011 · Cited by 62 · see citing works
Quality metric for camera-based pulse rate monitoring in fitness exercise
Wang, W., Balmaekers, B., & de Haan, G. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532795 · Cited by 27 · see citing works
Self-citationFeasibility of Contactless Pulse Rate Monitoring of Neonates using Google Glass
Fernando, S., Wang, W., Kirenko, I. O., et al. (2015) · doi:10.4108/eai.14-10-2015.2261589 · Cited by 24 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
Chen, W., & McDuff, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_22 · Cited by 716 · see citing works
Sources of inaccuracy in photoplethysmography for continuous cardiovascular monitoring
Fine, J., Branan, K. L., Rodriguez, A. J., Boonya-ananta, T., Ajmal, Ramella-Roman, J. C., McShane, M. J., & Coté, G. L. (2021) · Biosensors · doi:10.3390/bios11040126 · Cited by 348 · see citing works
Cuffless Blood Pressure Measurement
Mukkamala, R., Stergiou, G. S., & Avolio, A. P. (2022) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-110220-014644 · Cited by 180 · see citing works
Nowara, E. M., McDuff, D., & Veeraraghavan, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00150 · Cited by 66 · see citing works
Addison, P. S., Jacquel, D., Foo, D. M. H., & Borg, U. R. (2018) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-017-0076-1 · Cited by 24 · see citing works
The Effect of Optical Crosstalk on Accuracy of Reflectance-Type Pulse Oximeter for Mobile Healthcare
Baek, H. J., Shin, J., & Cho, J. (2018) · Journal of Healthcare Engineering · doi:10.1155/2018/3521738 · Cited by 22 · see citing works
PhysFlow: Skin tone transfer for remote heart rate estimation through conditional normalizing flows
Comas, J., Alomar, A., Ruiz, A., & Sukno, F. (2024) · arXiv · doi:10.48550/arxiv.2407.21519 · Cited by 4 · see citing works
“Also, we include some traditional methods such as POS [60] and CHROM [12] as baseline results.”
Method
- Authors
- Wang, W., den Brinker, A. C., Stuijk, S., & de Haan, G.
- Affiliations
- Eindhoven University of Technology (NL)
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2017-07
- Volume
- 64
- Issue
- 7
- Pages
- 1479-1491
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2520509592
- Cited by
- 1,234
- References
- 21
- Citations by year
- 2026: 141 · 2025: 220 · 2024: 203 · 2023: 187 · 2022: 150 · 2021: 128 · 2020: 76 · 2019: 66 · 2018: 43 · 2017: 20
- FWCI
- 20.73
- Type
- journal article
- Language
- en
- Open access
- green
- research.tue.nl
- Locations
- IEEE Transactions on Biomedical Engineering (publishedVersion)
- PubMed (publishedVersion)
- TU/e Research Portal (submittedVersion)
- TU/e Research Portal (submittedVersion, other-oa)
- Funders
- Technische Universiteit Eindhoven
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Keywords
- remote photoplethysmography, pulse extraction, projection plane, skin tone
- MeSH terms
- Algorithms, Blood Flow Velocity, Blood Volume, Blood Volume Determination, Colorimetry, Computer Simulation, Humans, Image Interpretation, Computer-Assisted, Light, Models, Biological, Photography, Scattering, Radiation, Sensitivity and Specificity, Skin Physiological Phenomena, Reproducibility of Results, Photoplethysmography, Monitoring, Ambulatory, Remote Sensing Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review