Performance of seven consumer sleep-tracking devices compared with polysomnography
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Study Objectives: Consumer sleep-tracking devices are widely used and becoming more technologically advanced, creating strong interest from researchers and clinicians for their possible use as alternatives to standard actigraphy. We, therefore, tested the performance of many of the latest consumer sleep-tracking devices, alongside actigraphy, versus the gold-standard sleep assessment technique, polysomnography (PSG). Methods: In total, 34 healthy young adults (22 women; 28.1 ± 3.9 years, mean ± SD) were tested on three consecutive nights (including a disrupted sleep condition) in a sleep laboratory with PSG, along with actigraphy (Philips Respironics Actiwatch 2) and a subset of consumer sleep-tracking devices. Altogether, four wearable (Fatigue Science Readiband, Fitbit Alta HR, Garmin Fenix 5S, Garmin Vivosmart 3) and three nonwearable (EarlySense Live, ResMed S+, SleepScore Max) devices were tested. Sleep/wake summary and epoch-by-epoch agreement measures were compared with PSG. Results: Most devices (Fatigue Science Readiband, Fitbit Alta HR, EarlySense Live, ResMed S+, SleepScore Max) performed as well as or better than actigraphy on sleep/wake performance measures, while the Garmin devices performed worse. Overall, epoch-by-epoch sensitivity was high (all ≥0.93), specificity was low-to-medium (0.18–0.54), sleep stage comparisons were mixed, and devices tended to perform worse on nights with poorer/disrupted sleep. Conclusions: Consumer sleep-tracking devices exhibited high performance in detecting sleep, and most performed equivalent to (or better than) actigraphy in detecting wake. Device sleep stage assessments were inconsistent. Findings indicate that many newer sleep-tracking devices demonstrate promising performance for tracking sleep and wake. Devices should be tested in different populations and settings to further examine their wider validity and utility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,856
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619 · cited 1×
“Proportional bias was calculated using linear regression methods for Bland–Altman plots [39] (and has been used previously for device performance testing [29]), which indicates the reliability of the bias versus PSG ( y -axis value) and whether it changes in proportion to the mean of the device and…”
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
(2007) · Cited by 6,530
Van Dongen, H. P. A., Maislin, G., Mullington, J. M., & Dinges, D. F. (2003) · Sleep · doi:10.1093/sleep/26.2.117 · Cited by 3,173
The Role of Actigraphy in the Study of Sleep and Circadian Rhythms
Ancoli-Israel, S., Cole, R., Alessi, C., Chambers, M., Moorcroft, W., & Pollak, C. P. (2003) · Sleep · doi:10.1093/sleep/26.3.342 · Cited by 2,751 · cited 6×
“However, there are many limitations of actigraphy compared with PSG [11–17].”
InfluentialNeurocognitive consequences of sleep deprivation
Goel, N., Rao, H., Durmer, J., & Dinges, D. (2009) · Seminars in Neurology · doi:10.1055/s-0029-1237117 · Cited by 2,154 · cited 1×
“Sleep plays an integral role in our physical and mental health [1–4] and for achieving high levels of alertness and performance [5–7], thereby impacting everyday functioning.”
Automatic Sleep/Wake Identification From Wrist Activity
Cole, R. J., Kripke, D. F., Gruen, W., Mullaney, D. J., & Gillin, J. C. (1992) · Sleep · doi:10.1093/sleep/15.5.461 · Cited by 1,941
Sleep disturbance and psychiatric disorders: A longitudinal epidemiological study of young Adults
Breslau, N., Roth, T., Rosenthal, L., & Andreski, P. (1996) · Biological Psychiatry · doi:10.1016/0006-3223(95)00188-3 · Cited by 1,831 · cited 1×
“Sleep plays an integral role in our physical and mental health [1–4] and for achieving high levels of alertness and performance [5–7], thereby impacting everyday functioning.”
Cited by
Perlis, M. L., Posner, D., Riemann, D., Bastien, C. H., Teel, J., & Thase, M. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00879-0 · Cited by 395
Waking Up to the Importance of Sleep in Type 2 Diabetes Management: A Narrative Review.
Henson, J., Covenant, A., Hall, A. P., Herring, L., Rowlands, A. V., Yates, T., & Davies, M. J. (2024) · Diabetes Care · doi:10.2337/dci23-0037 · Cited by 69
Ghorbani, S., Golkashani, H. A., Chee, N. I., Teo, T. B., Dicom, A. R., Yilmaz, G., Leong, R. L., Ong, J. L., & Chee, M. W. (2022) · Nature and Science of Sleep · doi:10.2147/nss.s359789 · Cited by 36
“Earlier consumer wearables had relatively poor and variable performance, but newer devices have shown greater accuracy and consistency of sleep assessment which continue to improve.(2,5,26,27) To guide their own usage of collected data, most users, clinicians, and researchers, are interested in improvements of two maj…”
BackgroundDevine, J. K., Chinoy, E. D., Markwald, R. R., Schwartz, L. P., & Hursh, S. R. (2020) · Sensors · doi:10.3390/s21010076 · Cited by 32
“for additional study participant screening details [18].”
Self-citationClinical utility of smartphone applications for sleep physicians
Hathorn, T., Byun, Y. J., Rosen, R., & Sharma, A. (2023) · Sleep and Breathing · doi:10.1007/s11325-023-02851-y · Cited by 8
A 2022 Survey of Commercially Available Smartphone Apps for Sleep
Doty, T. J., Stekl, E. K., Bohn, M., Klosterman, G., Simonelli, G., & Collen, J. (2023) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2023.05.008 · Cited by 4
Metadata
- Authors
- Chinoy, E. D., Cuellar, J. A., Huwa, K. E., Jameson, J. T., Watson, C. H., Bessman, S. C., Hirsch, D. A., Cooper, A. D., Drummond, S. P. A., & Markwald, R. R.
- Venue
- Sleep
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-12-30
- Volume
- 44
- Issue
- 5
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- OpenAlex
- W3117339351
- Cited by
- 433
- References
- 46
- FWCI
- 41.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.