Camera Measurement of Physiological Vital Signs
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
The need for remote tools for healthcare monitoring has never been more apparent. Camera measurement of vital signs leverages imaging devices to compute physiological changes by analyzing images of the human body. Building on advances in optics, machine learning, computer vision, and medicine, these techniques have progressed significantly since the invention of digital cameras. This article presents a comprehensive survey of camera measurement of physiological vital signs, describing the vital signs that can be measured and the computational techniques for doing so. I cover both clinical and non-clinical applications and the challenges that need to be overcome for these applications to advance from proofs of concept. Finally, I describe the current resources (datasets and code) available to the research community and provide a comprehensive webpage (https://cameravitals.github.io/) with links to these resource and a categorized list of all papers referenced in this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 2×
“They leveraged Model Agnostic Meta-Learning (MAML) [43] and tested both unsupervised and supervised model adaptation.”
MethodPicard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Akselrod, S., Gordon, D., Ubel, F. A., Shannon, D. C., Berger, A. C., & Cohen, R. J. (1981) · Science · doi:10.1126/science.6166045 · Cited by 5,079 · cited 1×
“The HRV low frequency (LF) component is modulated by baroreflex activity and contains both sympathetic and parasympathetic activity [4].”
BackgroundA Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Robust pulse rate from chrominance-based rPPG
de Haan, G., & Jeanne, V. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2266196 · Cited by 1,378 · cited 1×
“Chromiance-based methods [38, 39] are such an example, these are designed with the aim of eliminating specular relections by using speciically tuned color diferences.”
MethodAlgorithmic principles of remote PPG
Wang, W., den Brinker, A. C., Stuijk, S., & de Haan, G. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2609282 · Cited by 1,234 · cited 3×
“Wang et al. [158] proposed another physically-grounded demixing approach based on defining a plane orthogonal to the color space of the skin (POS) which one of the most robust signal processing methods for PPG recovery.”
MethodInfluentialOn the Analysis of Fingertip Photoplethysmogram Signals
Elgendi, M. (2012) · Current Cardiology Reviews · doi:10.2174/157340312801215782 · Cited by 1,206 · cited 1×
“these features for downstream assessments [39].”
BERNTSON, G. G., CACIOPPO, J. T., & QUIGLEY, K. S. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb01731.x · Cited by 998 · cited 1×
“arrhythmia (RSA) is one example of this; RSA describes the rhythmical fluctuations in heart periods at the breathing frequency [13].”
BackgroundDeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
Chen, W., & McDuff, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_22 · Cited by 716
Self-citationTakazawa, K., Tanaka, N., Fujita, M., Matsuoka, O., Saiki, T., Aikawa, M., Tamura, S., & Ibukiyama, C. (1998) · Hypertension · doi:10.1161/01.hyp.32.2.365 · Cited by 589
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499
Improved motion robustness of remote-PPG by using the blood volume pulse signature
de Haan, G., & van Leest, A. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/9/1913 · Cited by 491
Effects of skin pigmentation on pulse oximeter accuracy at low saturation
Bickler, P. E., Feiner, J. R., & Severinghaus, J. W. (2005) · Anesthesiology · doi:10.1097/00000542-200504000-00004 · Cited by 427
Heart rate measurement based on a time-lapse image.
Takano, C., & Ohta, Y. (2007) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2006.09.006 · Cited by 345 · cited 3×
“Understandably, much of the early work on focused on rigid, stationary subjects [61, 146, 154, 167].”
BackgroundMethodPhotoplethysmography based atrial fibrillation detection: a review
Pereira, T., Tran, N., Gadhoumi, K., Pelter, M. M., Do, D. H., Lee, R. J., Colorado, R., Meisel, K., & Hu, X. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0207-9 · Cited by 300 · cited 1×
“There are clinical applications for PPG measurement as the signal contains information about the health state and risk of cardiovascular diseases [40, 114, 125].”
BackgroundDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.07634 · Cited by 280
Rapid implementation of a COVID-19 remote patient monitoring program
Annis, T., Pleasants, S., Hultman, G., Lindemann, E., Thompson, J. A., Billecke, S., Badlani, S., & Melton, G. B. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa097 · Cited by 252 · cited 1×
“With large numbers of telehealth visits being conducted over video conferencing platforms [9] there is still no scalable substitute for the measurements that would have traditionally recorded at a doctor’s office.”
BackgroundDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413707 · Cited by 220 · cited 1×
“Researchers have leveraged this to detect deep fake videos [35, 123] and propose anti-spoofing systems [73, 77].”
BackgroundRacial discrepancy in pulse oximeter accuracy in preterm infants
Vesoulis, Z., Tims, A., Lodhi, H., Lalos, N., & Whitehead, H. (2022) · Journal of Perinatology · doi:10.1038/s41372-021-01230-3 · Cited by 120 · cited 1×
“Evidence of biases in SpO2 measurement with skin type is prevalent, with three monitors tested overestimating oxygen saturation in darker skin types in adults [16] and infants [155].”
BackgroundCOGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera
McDuff, D. J., Hernandez, J., Gontarek, S., & Picard, R. W. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858247 · Cited by 113 · cited 2×
“From cardiac signals heart rate variability or pulse rate variability has been used as a measure to quantify changes in cognitive load or stress [24, 87].”
MethodSelf-citationGawałko, M., Duncker, D., Manninger, M., van der Velden, R. M. J., Hermans, A. N. L., Verhaert, D. V. M., Pison, L., Pisters, R., Hemels, M., Sultan, A., et al. (2021) · EP Europace · doi:10.1093/europace/euab050 · Cited by 106
Remote PPG based vital sign measurement using adaptive facial regions
Tasli, H. E., Gudi, A., & den Uyl, M. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025282 · Cited by 99 · cited 2×
“[149]22 VicarPPG includes twenty recordings of 10 subjects (ages 20-35).”
BackgroundPerinasal Imaging of Physiological Stress and Its Affective Potential
Shastri, D., Papadakis, M., Tsiamyrtzis, P., Bass, B., & Pavlidis, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.13 · Cited by 89 · cited 2×
“Using this technique research has revealed how to measure changes in the diameter of the gland in the perinasal region, which can be used to measure transient perspiration [133].”
BackgroundMethodSimultaneous monitoring of ballistocardiogram and photoplethysmogram using a camera
Shao, D., Tsow, F., Liu, C., Yang, Y., & Tao, N. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2585109 · Cited by 69
Nowara, E. M., McDuff, D., & Veeraraghavan, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00150 · Cited by 66 · cited 1×
“Some initial work has begun to characterize diferences in performance of algorithms (both supervised and unsupervised) by diferent demographic and environmental parameters [3, 107].”
BackgroundSelf-citationAddison, P. S., Jacquel, D., Foo, D. M. H., & Borg, U. R. (2018) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-017-0076-1 · Cited by 24
Cited by
EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Cardiac Measurement
Liu, X., Hill, B., Jiang, Z., Patel, S., & McDuff, D. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00498 · Cited by 193
“Camera-based physiological measurement is a noncontact approach for capturing cardiac signals via light reflected from the body [20].”
BackgroundSelf-citation
Metadata
- Authors
- McDuff, D.
- Venue
- ACM Computing Surveys
- Published
- 2023-01-16
- Volume
- 55
- Issue
- 9
- Pages
- 1-40
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3217591046
- Cited by
- 159
- References
- 26
- FWCI
- 9.18
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.