The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
State of the science and recommendations for using wearable technology in sleep and circadian research
Open accessAbstract
Wearable sleep-tracking technology is of growing use in the sleep and circadian fields, including for applications across other disciplines, inclusive of a variety of disease states. Patients increasingly present sleep data derived from their wearable devices to their providers and the ever-increasing availability of commercial devices and new-generation research/clinical tools has led to the wide adoption of wearables in research, which has become even more relevant given the discontinuation of the Philips Respironics Actiwatch. Standards for evaluating the performance of wearable sleep-tracking devices have been introduced and the available evidence suggests that consumer-grade devices exceed the performance of traditional actigraphy in assessing sleep as defined by polysomnogram. However, clear limitations exist, for example, the misclassification of wakefulness during the sleep period, problems with sleep tracking outside of the main sleep bout or nighttime period, artifacts, and unclear translation of performance to individuals with certain characteristics or comorbidities. This is of particular relevance when person-specific factors (like skin color or obesity) negatively impact sensor performance with the potential downstream impact of augmenting already existing healthcare disparities. However, wearable sleep-tracking technology holds great promise for our field, given features distinct from traditional actigraphy such as measurement of autonomic parameters, estimation of circadian features, and the potential to integrate other self-reported, objective, and passively recorded health indicators. Scientists face numerous decision points and barriers when incorporating traditional actigraphy, consumer-grade multi-sensor devices, or contemporary research/clinical-grade sleep trackers into their research. Considerations include wearable device capabilities and performance, target population and goals of the study, wearable device outputs and availability of raw and aggregate data, and data extraction, processing, and analysis. Given the difficulties in the implementation and utilization of wearable sleep-tracking technology in real-world research and clinical settings, the following State of the Science review requested by the Sleep Research Society aims to address the following questions. What data can wearable sleep-tracking devices provide? How accurate are these data? What should be taken into account when incorporating wearable sleep-tracking devices into research? These outstanding questions and surrounding considerations motivated this work, outlining practical recommendations for using wearable technology in sleep and circadian research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
National Sleep Foundation's sleep time duration recommendations: methodology and results summary.
Hirshkowitz, M., Whiton, K., Albert, S. M., Alessi, C., Bruni, O., DonCarlos, L., Hazen, N., Herman, J., Katz, E. S., Kheirandish-Gozal, L., et al. (2015) · Sleep Health · doi:10.1016/j.sleh.2014.12.010 · Cited by 4,404 · cited 1×
“Based on biological changes, the recommended sleep durations for age groups are as follows: 10–13 h for ages 3–5 years, 9–11 h for ages 6–13 years, 8–10 h for ages 14–17 years, 7–9 h for ages 18–64 years, and 7–8 h for > 65 years [123].”
Ohayon, M. M., Carskadon, M. A., Guilleminault, C., & Vitiello, M. V. (2004) · Sleep · doi:10.1093/sleep/27.7.1255 · Cited by 3,349
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
The Role of Actigraphy in the Study of Sleep and Circadian Rhythms
Ancoli-Israel, S., Cole, R., Alessi, C., Chambers, M., Moorcroft, W., & Pollak, C. P. (2003) · Sleep · doi:10.1093/sleep/26.3.342 · Cited by 2,751 · cited 5×
“However, because circadian rhythms are sometimes non-sinusoidal, alternatives such as transformation of the cosine curve or other nonparametric methods often result in a better fit to activity data [37, 38].”
InfluentialNahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · cited 1×
“Further building on ESM, wearable devices are a powerful input to just-in-time-adapitve interventions [144], personalized interventions delivered in real-time in response to changes in an individual’s internal and contextual state.”
Diagnosis and Management of Obstructive Sleep Apnea: A Review
Gottlieb, D. J., & Punjabi, N. M. (2020) · JAMA · doi:10.1001/jama.2020.3514 · Cited by 1,482 · cited 1×
“Given the relevance of OSA for daytime function, management of certain chronic conditions, and risk of incident disease (particularly cardiovascular) [91], the lack of high-quality evidence regarding the ability of consumer-grade wearables to detect OSA prevents their use as a diagnostic tool.”
The role and validity of actigraphy in sleep medicine: an update
Sadeh, A. (2011) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2010.10.001 · Cited by 1,415 · cited 2×
“For both children and adults, proportional biases have been reported across indices of both sleep duration and disturbances, generally pointing toward a greater inaccuracy of the devices on nights with more disturbed sleep, a well-known recognized limitation in the actigraphy literature [57].”
A novel, open access method to assess sleep duration using a wrist-worn accelerometer
van Hees, V. T., Sabia, S., Anderson, K. N., Denton, S. J., Oliver, J., Catt, M., Abell, J. G., Kivimäki, M., Trenell, M. I., & Singh-Manoux, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142533 · Cited by 744 · cited 1×
“Machine learning analysis of data acquired with contemporary research/clinical-grade devices provides a novel methodology that may be superior to original algorithms to quantify sleep from raw acceleration data [73] and may even identify off-wrist time [74].”
How accurate is pulse rate variability as an estimate of heart rate variability?
Schäfer, A., & Vagedes, J. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2012.03.119 · Cited by 661
Phillips, A. J. K., Clerx, W. M., O’Brien, C. S., Sano, A., Barger, L. K., Picard, R. W., Lockley, S. W., Klerman, E. B., & Czeisler, C. A. (2017) · Scientific Reports · doi:10.1038/s41598-017-03171-4 · Cited by 647 · cited 1×
“In studies with healthy adults, the mean absolute error (the difference between the measured value and the “true” value) has typically fallen within 2 h [77, 78].”
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564
Brage, S., Brage, N., Franks, P. W., Ekelund, U., Wong, M.-Y., Andersen, L. B., Froberg, K., & Wareham, N. J. (2004) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00703.2003 · Cited by 473 · cited 1×
“Additionally, the relationship between oxygen uptake and HR is highly individual and would require individual calibration for optimal accuracy [51, 52].”
Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis
Haghayegh, S., Khoshnevis, S., Smolensky, M. H., Diller, K. R., & Castriotta, R. J. (2019) · Journal of Medical Internet Research · doi:10.2196/16273 · Cited by 446
Sources of inaccuracy in photoplethysmography for continuous cardiovascular monitoring
Fine, J., Branan, K. L., Rodriguez, A. J., Boonya-ananta, T., Ajmal, Ramella-Roman, J. C., McShane, M. J., & Coté, G. L. (2021) · Biosensors · doi:10.3390/bios11040126 · Cited by 348 · cited 3×
“Additionally, increasing skin thickness, which is directly correlated with body mass index (BMI), also dampens PPG signal [96].”
Miller, D. J., Sargent, C., & Roach, G. D. (2022) · Sensors · doi:10.3390/s22166317 · Cited by 328 · cited 2×
“In an interesting recent work from Miller et al. [93], the authors evaluated sleep HR and HRV measures from different wearable devices and compared them to gold-standard ECG.”
InfluentialKantermann, T., Sung, H., & Burgess, H. J. (2015) · Journal of Biological Rhythms · doi:10.1177/0748730415597520 · Cited by 323
Movement toward a novel activity monitoring device
Montgomery-Downs, H. E., Insana, S. P., & Bond, J. A. (2012) · Sleep and Breathing · doi:10.1007/s11325-011-0585-y · Cited by 301
Wearable Photoplethysmography for Cardiovascular Monitoring
Charlton, P. H., Kyriacou, P. A., Mant, J., Marozas, V., Chowienczyk, P., & Alastruey, J. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3149785 · Cited by 250 · cited 1×
“Venous fluctuations during respiration result in low-frequency alternating current oscillations superimposed on the direct current baseline signal of PPG, allowing for quantification of RR [80, 81].”
Walch, O., Huang, Y., Forger, D., & Goldstein, C. (2019) · Sleep · doi:10.1093/sleep/zsz180 · Cited by 240 · cited 3×
“Scientific teams have developed algorithms (typically utilizing machine learning) that can categorize sleep from signals derived from the Fitbit [101], Apple Watch [13, 102–104], Oura ring [102, 105], Amazfit [106], and the Microsoft Band [107].”
Self-citationde Zambotti, M., Baker, F. C., Willoughby, A. R., Godino, J. G., Wing, D., Patrick, K., & Colrain, I. M. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.03.006 · Cited by 222 · cited 2×
“These findings are distinct from those in the pediatric and adolescent population, where PSG TST may be underestimated and WASO overestimated by consumer-grade device output [61–63], though this was not always the case [69].”
Recent advances in wearable sensors and portable electronics for sleep monitoring
Kwon, S., Kim, H., & Yeo, W.-H. (2021) · iScience · doi:10.1016/j.isci.2021.102461 · Cited by 209
Allen, J., & Murray, A. (2003) · Physiological Measurement · doi:10.1088/0967-3334/24/2/306 · Cited by 202
Beattie, Z., Oyang, Y., Statan, A., Ghoreyshi, A., Pantelopoulos, A., Russell, A., & Heneghan, C. (2017) · Physiological Measurement · doi:10.1088/1361-6579/aa9047 · Cited by 198 · cited 1×
“Scientific teams have developed algorithms (typically utilizing machine learning) that can categorize sleep from signals derived from the Fitbit [101], Apple Watch [13, 102–104], Oura ring [102, 105], Amazfit [106], and the Microsoft Band [107].”
Orthosomnia: are some patients taking the quantified self too far?
Baron, K. G., Abbott, S., Jao, N., Manalo, N., & Mullen, R. (2017) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.6472 · Cited by 188 · cited 1×
“This aligns with increasing concerns about orthosomnia, where wearable users become overly perfectionistic and preoccupied with improving their sleep [155].”
Figueiro, M., Hamner, R., Bierman, A., & Rea, M. (2013) · Lighting Research & Technology · doi:10.1177/1477153512450453 · Cited by 179 · cited 1×
“…the use of these approaches with wearable devices may rely on activity as the only available input into these light-based models, though evidence across multiple populations has supported the robustness of this method [45, 46], perhaps due to the limitations of measuring light on the wrist [47].”
Cao, R., Azimi, I., Sarhaddi, F., Niela-Vilen, H., Axelin, A., Liljeberg, P., & Rahmani, A. M. (2022) · Journal of Medical Internet Research · doi:10.2196/27487 · Cited by 159 · cited 1×
“These outcomes are not too dissimilar from those provided by others and by earlier studies evaluating previous-generation wearable devices [62, 69, 94, 95].”
Fonseca, P., Weysen, T., Goelema, M. S., Møst, E. I. S., Radha, M., Lunsingh Scheurleer, C., van den Heuvel, L., & Aarts, R. M. (2017) · SLEEP · doi:10.1093/sleep/zsx097 · Cited by 148 · cited 1×
“…training and testing with the rationale that together, actigraphy and PSG sleep measurement modalities derive similar parameters (activity counts and PPG pulse/PRV from the pulse oxi-meter) that are recorded in a single consumer-grade device along-side an annotated gold-standard [13, 109, 110].”
Accuracy of commercially available heart rate monitors in athletes: a prospective study
Pasadyn, S. R., Soudan, M., Gillinov, M., Houghtaling, P., Phelan, D., Gillinov, N., Bittel, B., & Desai, M. Y. (2019) · Cardiovascular Diagnosis and Therapy · doi:10.21037/cdt.2019.06.05 · Cited by 135
Evaluation of a consumer fitness-tracking device to assess sleep in adults
de Zambotti, M., Claudatos, S., Inkelis, S., Colrain, I. M., & Baker, F. C. (2015) · Chronobiology International · doi:10.3109/07420528.2015.1054395 · Cited by 127
Moreno-Pino, F., Porras-Segovia, A., López-Esteban, P., Artés, A., & Baca-García, E. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.8032 · Cited by 112
St. Hilaire, M. A., Klerman, E. B., Khalsa, S. B. S., Wright, K. P., Czeisler, C. A., & Kronauer, R. E. (2007) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2007.04.001 · Cited by 109
Godino, J. G., Wing, D., de Zambotti, M., Baker, F. C., Bagot, K., Inkelis, S., Pautz, C., Higgins, M., Nichols, J., Brumback, T., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237719 · Cited by 107 · cited 3×
“…to the device may result in sensor positioning disparate from that observed when an adult uses the device; however, as an example, the Fitbit Charge HR is designed to fit wrists that are 5.4 to 8.7 inches in diameter (inclusive of the average wrist size of children as young as 3 years of age) [62].”
Influential40 years of actigraphy in sleep medicine and current state of the art algorithms
Patterson, M. R., Nunes, A. A. S., Gerstel, D., Pilkar, R., Guthrie, T., Neishabouri, A., & Guo, C. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00802-1 · Cited by 91
Papini, G. B., Fonseca, P., van Gilst, M. M., Bergmans, J. W. M., Vullings, R., & Overeem, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-69935-7 · Cited by 90
Pipek, L. Z., Nascimento, R. F. V., Acencio, M. M. P., & Teixeira, L. R. (2021) · Scientific Reports · doi:10.1038/s41598-021-98453-3 · Cited by 87
Baker, F. C., Willoughby, A. R., Massimiliano, D. Z., Franzen, P. L., Prouty, D., Javitz, H., Hasler, B., Clark, D. B., & Colrain, I. M. (2016) · SLEEP · doi:10.5665/sleep.5978 · Cited by 61
Ghorbani, S., Golkashani, H. A., Chee, N. I., Teo, T. B., Dicom, A. R., Yilmaz, G., Leong, R. L., Ong, J. L., & Chee, M. W. (2022) · Nature and Science of Sleep · doi:10.2147/nss.s359789 · Cited by 36
Cited by
One-year actigraphy study of sleep and rest-activity rhythms as markers of relapse in depression
Tonon, A. C., Nexha, A., Cunningham, J. E. A., d’Eon, J., Chakrabarty, T., Farzan, F., Foster, J. A., Harkness, K. L., Hassel, S., Ho, K., et al. (2026) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2025.4453 · Cited by 9
Bulman, A., McKune, A., Georgousopoulou, E., Sergi, D., & Naumovski, N. (2026) · Contemporary Clinical Trials · doi:10.1016/j.cct.2026.108306 · Cited by 1
Metadata
- Authors
- de Zambotti, M., Goldstein, C., Cook, J., Menghini, L., Altini, M., Cheng, P., & Robillard, R.
- Venue
- SLEEP
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-12-27
- Volume
- 47
- Issue
- 4
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- OpenAlex
- W4390258985
- Cited by
- 250
- References
- 38
- FWCI
- 58.05
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.