CoChat

DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks

Open access
Chen, Weixuan, McDuff, Daniel · 2018 · Lecture Notes in Computer Science

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.

Abstract

Non-contact video-based physiological measurement has many applications in health care and human-computer interaction. Practical applications require measurements to be accurate even in the presence of large head rotations. We propose the first end-to-end system for video-based measurement of heart and breathing rate using a deep convolutional network. The system features a new motion representation based on a skin reflection model and a new attention mechanism using appearance information to guide motion estimation, both of which enable robust measurement under heterogeneous lighting and major motions. Our approach significantly outperforms all current state-of-the-art methods on both RGB and infrared video datasets. Furthermore, it allows spatial-temporal distributions of physiological signals to be visualized via the attention mechanism.

Overview

Integrity signals

Registry

Crossref · 10.1007/978-3-030-01216-8_22

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 50 references

Research works printed but not linked: 2

  1. Chen, W., Hernandez, J., Picard, R.W.: Non-contact physiological measurements from near-infrared video of the neck. arXiv preprint arXiv:1805.09511 (2017) · arXiv
  2. Sharma, S., Kiros, R., Salakhutdinov, R.: Action recognition using visual attention. arXiv preprint arXiv:1511.04119 (2015) · arXiv

Cited by

See all 838

Metadata

Authors
Chen, W., & McDuff, D.
Affiliations
  • MIT Media Lab (US)
  • Microsoft (United States) (US)
Corresponding author
Chen, Weixuan
Venue
Lecture Notes in Computer Science
Published
2018
Pages
356-373
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W2963433879
Cited by
716
References
49
Citations by year
2026: 75 · 2025: 163 · 2024: 132 · 2023: 109 · 2022: 93 · 2021: 75 · 2020: 43 · 2019: 25 · 2018: 1
FWCI
78.94
Type
conference paper
Language
en
Open access
Licence
Locations
  • Lecture notes in computer science (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
Keywords
heart rate estimation, respiratory rate estimation, non-contact monitoring, convolutional attention network, motion estimation, infrared video

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks. https://app.cochat.ai/papers/10.1007/978-3-030-01216-8_22
The paper
Chen, W., & McDuff, D. (2018). DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-030-01216-8_22

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.