The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Performance of seven consumer sleep-tracking devices compared with polysomnography
Open accessAbstract
Study Objectives: Consumer sleep-tracking devices are widely used and becoming more technologically advanced, creating strong interest from researchers and clinicians for their possible use as alternatives to standard actigraphy. We, therefore, tested the performance of many of the latest consumer sleep-tracking devices, alongside actigraphy, versus the gold-standard sleep assessment technique, polysomnography (PSG). Methods: In total, 34 healthy young adults (22 women; 28.1 ± 3.9 years, mean ± SD) were tested on three consecutive nights (including a disrupted sleep condition) in a sleep laboratory with PSG, along with actigraphy (Philips Respironics Actiwatch 2) and a subset of consumer sleep-tracking devices. Altogether, four wearable (Fatigue Science Readiband, Fitbit Alta HR, Garmin Fenix 5S, Garmin Vivosmart 3) and three nonwearable (EarlySense Live, ResMed S+, SleepScore Max) devices were tested. Sleep/wake summary and epoch-by-epoch agreement measures were compared with PSG. Results: Most devices (Fatigue Science Readiband, Fitbit Alta HR, EarlySense Live, ResMed S+, SleepScore Max) performed as well as or better than actigraphy on sleep/wake performance measures, while the Garmin devices performed worse. Overall, epoch-by-epoch sensitivity was high (all ≥0.93), specificity was low-to-medium (0.18–0.54), sleep stage comparisons were mixed, and devices tended to perform worse on nights with poorer/disrupted sleep. Conclusions: Consumer sleep-tracking devices exhibited high performance in detecting sleep, and most performed equivalent to (or better than) actigraphy in detecting wake. Device sleep stage assessments were inconsistent. Findings indicate that many newer sleep-tracking devices demonstrate promising performance for tracking sleep and wake. Devices should be tested in different populations and settings to further examine their wider validity and utility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,856
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
(2007) · Cited by 6,530
Van Dongen, H. P. A., Maislin, G., Mullington, J. M., & Dinges, D. F. (2003) · Sleep · doi:10.1093/sleep/26.2.117 · Cited by 3,173
The Role of Actigraphy in the Study of Sleep and Circadian Rhythms
Ancoli-Israel, S., Cole, R., Alessi, C., Chambers, M., Moorcroft, W., & Pollak, C. P. (2003) · Sleep · doi:10.1093/sleep/26.3.342 · Cited by 2,751 · cited 6×
“However, there are many limitations of actigraphy compared with PSG [11–17].”
InfluentialNeurocognitive consequences of sleep deprivation
Goel, N., Rao, H., Durmer, J., & Dinges, D. (2009) · Seminars in Neurology · doi:10.1055/s-0029-1237117 · Cited by 2,154
Automatic Sleep/Wake Identification From Wrist Activity
Cole, R. J., Kripke, D. F., Gruen, W., Mullaney, D. J., & Gillin, J. C. (1992) · Sleep · doi:10.1093/sleep/15.5.461 · Cited by 1,941
Sleep disturbance and psychiatric disorders: A longitudinal epidemiological study of young Adults
Breslau, N., Roth, T., Rosenthal, L., & Andreski, P. (1996) · Biological Psychiatry · doi:10.1016/0006-3223(95)00188-3 · Cited by 1,831 · cited 1×
“Sleep plays an integral role in our physical and mental health [1–4] and for achieving high levels of alertness and performance [5–7], thereby impacting everyday functioning.”
Belenky, G., Wesensten, N. J., Thorne, D. R., Thomas, M. L., Sing, H. C., Redmond, D. P., Russo, M. B., & Balkin, T. J. (2003) · Journal of Sleep Research · doi:10.1046/j.1365-2869.2003.00337.x · Cited by 1,436 · cited 1×
“Sleep plays an integral role in our physical and mental health [1–4] and for achieving high levels of alertness and performance [5–7], thereby impacting everyday functioning.”
The role and validity of actigraphy in sleep medicine: an update
Sadeh, A. (2011) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2010.10.001 · Cited by 1,415
The metabolic consequences of sleep deprivation
Knutson, K. L., Spiegel, K., Penev, P., & Van Cauter, E. (2007) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2007.01.002 · Cited by 1,365 · cited 2×
“The disrupted sleep protocol was randomized and counterbalanced between Lab Visits 2 and 3, and during the other visit, the participants were not disrupted by external stimuli during the sleep episode (see Supplemental Materials for additional details on the experimental sleep disruption protocol…”
Morgenthaler, T., Alessi, C., Friedman, L., Owens, J., Kapur, V., Boehlecke, B., Brown, T., Chesson, A., Coleman, J., Lee-Chiong, T., et al. (2007) · Sleep · doi:10.1093/sleep/30.4.519 · Cited by 1,142 · cited 2×
“Actigraphy utilizes a research-grade wrist-worn device to collect physical activity data that are later processed with algorithms to estimate sleep and wake [9–12].”
Sleep and mental disorders: a meta-analysis of polysomnographic research
Baglioni, C., Nanovska, S., Regen, W., Spiegelhalder, K., Feige, B., Nissen, C., Reynolds, C. F., & Riemann, D. (2016) · Psychological Bulletin · doi:10.1037/bul0000053 · Cited by 1,074
Marino, M., Li, Y., Rueschman, M. N., Winkelman, J. W., Ellenbogen, J. M., Solet, J. M., Dulin, H., Berkman, L. F., & Buxton, O. M. (2013) · Sleep · doi:10.5665/sleep.3142 · Cited by 1,056
The Role of Actigraphy in the Evaluation of Sleep Disorders
Sadeh, A., Hauri, P. J., Kripke, D. F., & Lavie, P. (1995) · Sleep · doi:10.1093/sleep/18.4.288 · Cited by 909
Luyster, F. S., Strollo, P. J., Zee, P. C., & Walsh, J. K. (2012) · Sleep · doi:10.5665/sleep.1846 · Cited by 853
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564
VAN DE WATER, A. T. M., HOLMES, A., & HURLEY, D. A. (2011) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00814.x · Cited by 447
Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis
Haghayegh, S., Khoshnevis, S., Smolensky, M. H., Diller, K. R., & Castriotta, R. J. (2019) · Journal of Medical Internet Research · doi:10.2196/16273 · Cited by 446
A validation study of Fitbit Charge 2™ compared with polysomnography in adults
de Zambotti, M., Goldstone, A., Claudatos, S., Colrain, I. M., & Baker, F. C. (2018) · Chronobiology International · doi:10.1080/07420528.2017.1413578 · Cited by 413
Wake Detection Capacity of Actigraphy During Sleep
Paquet, J., Kawinska, A., & Carrier, J. (2007) · Sleep · doi:10.1093/sleep/30.10.1362 · Cited by 352
Mantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314
Movement toward a novel activity monitoring device
Montgomery-Downs, H. E., Insana, S. P., & Bond, J. A. (2012) · Sleep and Breathing · doi:10.1007/s11325-011-0585-y · Cited by 301
The Sleep of the Ring: Comparison of the ŌURA Sleep Tracker Against Polysomnography
de Zambotti, M., Rosas, L., Colrain, I. M., & Baker, F. C. (2019) · Behavioral Sleep Medicine · doi:10.1080/15402002.2017.1300587 · Cited by 287
Depner, C. M., Cheng, P. C., Devine, J. K., Khosla, S., de Zambotti, M., Robillard, R., Vakulin, A., & Drummond, S. P. A. (2020) · Sleep · doi:10.1093/sleep/zsz254 · Cited by 245
Self-citationConsumer Sleep Technology: An American Academy of Sleep Medicine Position Statement
Khosla, S., Deak, M. C., Gault, D., Goldstein, C. A., Hwang, D., Kwon, Y., O'Hearn, D., Schutte-Rodin, S., Yurcheshen, M., Rosen, I. M., et al. (2018) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7128 · Cited by 242
Meltzer, L. J., Hiruma, L. S., Avis, K., Montgomery-Downs, H., & Valentin, J. (2015) · Sleep · doi:10.5665/sleep.4918 · Cited by 228
Baron, K. G., Duffecy, J., Berendsen, M. A., Cheung Mason, I., Lattie, E. G., & Manalo, N. C. (2018) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2017.12.002 · Cited by 186
Validation of Sleep-Tracking Technology Compared with Polysomnography in Adolescents
de Zambotti, M., Baker, F. C., & Colrain, I. M. (2015) · Sleep · doi:10.5665/sleep.4990 · Cited by 160
Lee, X. K., Chee, N. I. Y. N., Ong, J. L., Teo, T. B., van Rijn, E., Lo, J. C.-Y., & Chee, M. W. L. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7932 · Cited by 158
A systematic review of the accuracy of sleep wearable devices for estimating sleep onset
Scott, H., Lack, L. C., & Lovato, N. (2019) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2019.101227 · Cited by 158
Menghini, L., Cellini, N., Goldstone, A., Baker, F. C., & de Zambotti, M. (2020) · SLEEP · doi:10.1093/sleep/zsaa170 · Cited by 154
Consumer sleep tracking devices: a review of mechanisms, validity and utility
Kolla, B. P., Mansukhani, S., & Mansukhani, M. P. (2016) · Expert Review of Medical Devices · doi:10.1586/17434440.2016.1171708 · Cited by 144
Sleep devices: wearables and nearables, informational and interventional, consumer and clinical
Bianchi, M. T. (2017) · Metabolism · doi:10.1016/j.metabol.2017.10.008 · Cited by 140
Validation of Contact-Free Sleep Monitoring Device with Comparison to Polysomnography
Tal, A., Shinar, Z., Shaki, D., Codish, S., & Goldbart, A. D. (2017) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.6514 · Cited by 139
Limiting racial disparities and bias for wearable devices in health science research
Colvonen, P. J., DeYoung, P. N., Bosompra, N.-O. A., & Owens, R. L. (2020) · Sleep · doi:10.1093/sleep/zsaa159 · Cited by 137
Evaluation of a consumer fitness-tracking device to assess sleep in adults
de Zambotti, M., Claudatos, S., Inkelis, S., Colrain, I. M., & Baker, F. C. (2015) · Chronobiology International · doi:10.3109/07420528.2015.1054395 · Cited by 127
Moreno-Pino, F., Porras-Segovia, A., López-Esteban, P., Artés, A., & Baca-García, E. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.8032 · Cited by 112
Kahawage, P., Jumabhoy, R., Hamill, K., de Zambotti, M., & Drummond, S. P. A. (2019) · Journal of Sleep Research · doi:10.1111/jsr.12931 · Cited by 91
Self-citationCook, J. D., Eftekari, S. C., Dallmann, E., Sippy, M., & Plante, D. T. (2018) · Journal of Sleep Research · doi:10.1111/jsr.12789 · Cited by 59
Sleep Validity of a Non-Contact Bedside Movement and Respiration-Sensing Device
Schade, M. M., Bauer, C. E., Murray, B. R., Gahan, L., Doheny, E. P., Kilroy, H., Zaffaroni, A., & Montgomery‐Downs, H. E. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7892 · Cited by 52
Grandner, M. A., & Rosenberger, M. E. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-815373-4.00012-5 · Cited by 50
Hamill, K., Jumabhoy, R., Kahawage, P., de Zambotti, M., Walters, E. M., & Drummond, S. P. A. (2019) · Journal of Sleep Research · doi:10.1111/jsr.12944 · Cited by 44
Self-citationJumabhoy, R., Dao, P., Maskevich, S., Stout, J. C., & Drummond, S. (2017) · SLEEP · doi:10.1093/sleepj/zsx050.778 · Cited by 3
Self-citation
Cited by
Perlis, M. L., Posner, D., Riemann, D., Bastien, C. H., Teel, J., & Thase, M. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00879-0 · Cited by 395
Waking Up to the Importance of Sleep in Type 2 Diabetes Management: A Narrative Review.
Henson, J., Covenant, A., Hall, A. P., Herring, L., Rowlands, A. V., Yates, T., & Davies, M. J. (2024) · Diabetes Care · doi:10.2337/dci23-0037 · Cited by 69
Ghorbani, S., Golkashani, H. A., Chee, N. I., Teo, T. B., Dicom, A. R., Yilmaz, G., Leong, R. L., Ong, J. L., & Chee, M. W. (2022) · Nature and Science of Sleep · doi:10.2147/nss.s359789 · Cited by 36
Devine, J. K., Chinoy, E. D., Markwald, R. R., Schwartz, L. P., & Hursh, S. R. (2020) · Sensors · doi:10.3390/s21010076 · Cited by 32
Self-citationClinical utility of smartphone applications for sleep physicians
Hathorn, T., Byun, Y. J., Rosen, R., & Sharma, A. (2023) · Sleep and Breathing · doi:10.1007/s11325-023-02851-y · Cited by 8
Metadata
- Authors
- Chinoy, E. D., Cuellar, J. A., Huwa, K. E., Jameson, J. T., Watson, C. H., Bessman, S. C., Hirsch, D. A., Cooper, A. D., Drummond, S. P. A., & Markwald, R. R.
- Venue
- Sleep
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-12-30
- Volume
- 44
- Issue
- 5
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- OpenAlex
- W3117339351
- Cited by
- 433
- References
- 46
- FWCI
- 41.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.