Detecting sleep using heart rate and motion data from multisensor consumer-grade wearables, relative to wrist actigraphy and polysomnography
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Study Objectives: Multisensor wearable consumer devices allowing the collection of multiple data sources, such as heart rate and motion, for the evaluation of sleep in the home environment, are increasingly ubiquitous. However, the validity of such devices for sleep assessment has not been directly compared to alternatives such as wrist actigraphy or polysomnography (PSG). Methods: Eight participants each completed four nights in a sleep laboratory, equipped with PSG and several wearable devices. Registered polysomnographic technologist-scored PSG served as ground truth for sleep–wake state. Wearable devices providing sleep–wake classification data were compared to PSG at both an epoch-by-epoch and night level. Data from multisensor wearables (Apple Watch and Oura Ring) were compared to data available from electrocardiography and a triaxial wrist actigraph to evaluate the quality and utility of heart rate and motion data. Machine learning methods were used to train and test sleep–wake classifiers, using data from consumer wearables. The quality of classifications derived from devices was compared. Results: For epoch-by-epoch sleep–wake performance, research devices ranged in d′ between 1.771 and 1.874, with sensitivity between 0.912 and 0.982, and specificity between 0.366 and 0.647. Data from multisensor wearables were strongly correlated at an epoch-by-epoch level with reference data sources. Classifiers developed from the multisensor wearable data ranged in d′ between 1.827 and 2.347, with sensitivity between 0.883 and 0.977, and specificity between 0.407 and 0.821. Conclusions: Data from multisensor consumer wearables are strongly correlated with reference devices at the epoch level and can be used to develop epoch-by-epoch models of sleep–wake rivaling existing research devices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
The Role of Actigraphy in the Study of Sleep and Circadian Rhythms
Ancoli-Israel, S., Cole, R., Alessi, C., Chambers, M., Moorcroft, W., & Pollak, C. P. (2003) · Sleep · doi:10.1093/sleep/26.3.342 · Cited by 2,751 · cited 1×
“Wrist actigraphy has since emerged as a popular alternative to PSG because of the low obtrusiveness, more manageable cost, and adequate accuracy for monitoring sleep–wake states determined by PSG, the gold standard for monitoring sleep [2].”
BackgroundBias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 1×
“Iterating through model parameters to minimize the test set error generates a biased estimate of model performance, as test set performance is no longer outside of the training procedure [45, 46].”
BackgroundOdor cues during slow-wave sleep prompt declarative memory consolidation
Rasch, B., Büchel, C., Gais, S., & Born, J. (2007) · Science · doi:10.1126/science.1138581 · Cited by 1,181
Marino, M., Li, Y., Rueschman, M. N., Winkelman, J. W., Ellenbogen, J. M., Solet, J. M., Dulin, H., Berkman, L. F., & Buxton, O. M. (2013) · Sleep · doi:10.5665/sleep.3142 · Cited by 1,056
Self-citationA unifying view on dataset shift in classification
Moreno-Torres, J. G., Raeder, T., Alaiz-Rodríguez, R., Chawla, N. V., & Herrera, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.019 · Cited by 1,029
Auditory closed-loop stimulation of the sleep slow oscillation enhances memory
Ngo, H.-V. V., Martinetz, T., Born, J., & Mölle, M. (2013) · Neuron · doi:10.1016/j.neuron.2013.03.006 · Cited by 885
Auditory Processing across the Sleep-Wake Cycle
Portas, C. M., Krakow, K., Allen, P., Josephs, O., Armony, J. L., & Frith, C. D. (2000) · Neuron · doi:10.1016/s0896-6273(00)00169-0 · Cited by 392
The Cost of Poor Sleep: Workplace Productivity Loss and Associated Costs
Rosekind, M. R., Gregory, K. B., Mallis, M. M., Brandt, S. L., Seal, B., & Lerner, D. (2010) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0b013e3181c78c30 · Cited by 385
Upgrading the sleeping brain with targeted memory reactivation
Oudiette, D., & Paller, K. A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.01.006 · Cited by 350
Real-time sleep apnea detection by classifier combination
Xie, B., & Minn, H. (2012) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2012.2188299 · Cited by 294
The Sleep of the Ring: Comparison of the ŌURA Sleep Tracker Against Polysomnography
de Zambotti, M., Rosas, L., Colrain, I. M., & Baker, F. C. (2019) · Behavioral Sleep Medicine · doi:10.1080/15402002.2017.1300587 · Cited by 287 · cited 1×
“For example, the Oura Ring has been reported to have a sensitivity to detect sleep of 96% and a specificity to detect wake of 48% [33], whereas the Fitbit Charge 2 has been reported to have a sensitivity to detect sleep of 96% and a specificity to detect wake of 61% [34].”
BackgroundThe economic cost of inadequate sleep
Hillman, D., Mitchell, S., Streatfeild, J., Burns, C., Bruck, D., & Pezzullo, L. (2018) · Sleep · doi:10.1093/sleep/zsy083 · Cited by 278
Walch, O., Huang, Y., Forger, D., & Goldstein, C. (2019) · Sleep · doi:10.1093/sleep/zsz180 · Cited by 240
Stenholm, S., Head, J., Kivimäki, M., Magnusson Hanson, L. L., Pentti, J., Rod, N. H., Clark, A. J., Oksanen, T., Westerlund, H., & Vahtera, J. (2019) · The Journals of Gerontology: Series A · doi:10.1093/gerona/gly016 · Cited by 55
Cited by
Papini, G. B., Fonseca, P., van Gilst, M. M., Bergmans, J. W. M., Vullings, R., & Overeem, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-69935-7 · Cited by 90
Ghorbani, S., Golkashani, H. A., Chee, N. I., Teo, T. B., Dicom, A. R., Yilmaz, G., Leong, R. L., Ong, J. L., & Chee, M. W. (2022) · Nature and Science of Sleep · doi:10.2147/nss.s359789 · Cited by 36
Clinical utility of smartphone applications for sleep physicians
Hathorn, T., Byun, Y. J., Rosen, R., & Sharma, A. (2023) · Sleep and Breathing · doi:10.1007/s11325-023-02851-y · Cited by 8
“SleepSpace–Tracker and Coach, which utilizes the data input of popular wearable devices, cited validation data for these products [22].”
BackgroundZhu, Y., Stephenson, C., Moghimi, E., Jagayat, J., Nikjoo, N., Kumar, A., Shirazi, A., Patel, C., Omrani, M., & Alavi, N. (2023) · PLOS ONE · doi:10.1371/journal.pone.0285757 · Cited by 7
“Fitbit contains heart rate sensors and motion detectors which facilitate sleep monitoring [49].”
A 2022 Survey of Commercially Available Smartphone Apps for Sleep
Doty, T. J., Stekl, E. K., Bohn, M., Klosterman, G., Simonelli, G., & Collen, J. (2023) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2023.05.008 · Cited by 4
Metadata
- Authors
- Roberts, D. M., Schade, M. M., Mathew, G. M., Gartenberg, D., & Buxton, O. M.
- Venue
- Sleep
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-03-26
- Volume
- 43
- Issue
- 7
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- OpenAlex
- W3013552016
- Cited by
- 152
- References
- 16
- FWCI
- 21.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.