The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Self-supervised learning of accelerometer data provides new insights for sleep and its association with mortality
Open accessPreprint — published as 10.1038/s41746-024-01065-0 · Paper page
Abstract
Summary: Background: Sleep is essential to life. Accurate measurement and classification of sleep/wake and sleep stages is important in clinical studies for sleep disorder diagnoses and in the interpretation of data from consumer devices for monitoring physical and mental well-being. Existing non-polysomnography sleep classification techniques mainly rely on heuristic methods developed in relatively small cohorts. Thus, we aimed to establish the accuracy of wrist-worn accelerometers for sleep stage classification and subsequently describe the association between sleep duration and efficiency (proportion of total time asleep when in bed) with mortality outcomes. Methods: We developed and validated a self-supervised deep neural network for sleep stage classification using concurrent laboratory-based polysomnography and accelerometry data from three countries (Australia, the UK, and the USA). The model was validated within-cohort using subject-wise five-fold cross-validation for sleep-wake classification and in a three-class setting for sleep stage classification wake, rapid-eye-movement sleep (REM), non-rapid-eye-movement sleep (NREM) and by external validation. We assessed the face validity of our model for population inference by applying the model to the UK Biobank with 100,000 participants, each of whom wore a wristband for up to seven days. The derived sleep parameters were used in a Cox regression model to study the association of sleep duration and sleep efficiency with all-cause mortality. Findings: After exclusion, 1,448 participant nights of data were used to train the sleep classifier. The difference between polysomnography and the model classifications on the external validation was 34.7 minutes (95% limits of agreement (LoA): −37.8 to 107.2 minutes) for total sleep duration, 2.6 minutes for REM duration (95% LoA: −68.4 to 73.4 minutes) and 32.1 minutes (95% LoA: −54.4 to 118.5 minutes) for NREM duration. The derived sleep architecture estimate in the UK Biobank sample showed good face validity. Among 66,214 UK Biobank participants, 1,642 mortality events were observed. Short sleepers (<6 hours) had a higher risk of mortality compared to participants with normal sleep duration (6 to 7.9 hours), regardless of whether they had low sleep efficiency (Hazard ratios (HRs): 1.69; 95% confidence intervals (CIs): 1.28 to 2.24) or high sleep efficiency (HRs: 1.42; 95% CIs: 1.14 to 1.77). Interpretation: Deep-learning-based sleep classification using accelerometers has a fair to moderate agreement with polysomnography. Our findings suggest that having short overnight sleep confers mortality risk irrespective of sleep continuity. Funding: This research has been conducted using the UK Biobank Resource under Application Number 59070. The UK Biobank received ethical approval from the National Health Service National Research Service (Ref 21/NW/0157). We would like to acknowledge the Raine Study participants and their families for their ongoing participation in the study and the Raine Study team for study coordination and data collection. We also thank the NHMRC for their long-term contribution to funding the study over the last 30 years. The core management of the Raine Study is funded by The University of Western Australia, Curtin University, Telethon Kids Institute, Women and Infants Research Foundation, Edith Cowan University, Murdoch University, The University of Notre Dame Australia and the Raine Medical Research Foundation. The 22-year Gen2 Raine Study follow-up was funded by NHMRC project grants 1027449 & 1044840. The data collection for the Pennsylvania dataset is funded, in part, by US National Institute of Health (NIMH) grant R21 MH103963 (MB). HY, DB, and AD are supported by Novo Nordisk. RW and AD are supported by Health Data Research UK, an initiative funded by UK Research and Innovation, Department of Health and Social Care (England) and the devolved administrations, and leading medical research charities. AD is additionally supported by Swiss Re, Wellcome Trust [223100/Z/21/Z], and the British Heart Foundation Centre of Research Excellence (grant number RE/18/3/34214). DWR is supported by MRC programme grant MR/P023576/1; Wellcome Trust (107849/Z/15/Z). TP and AR are supported by the National Institute for Health Research (NIHR) Leicester Biomedical Research Centre and NIHR Applied Research Collaboration East Midlands (ARC EM). SDK is supported by the NIHR Oxford Health Biomedical Research Centre, Health Technology Assessment Programme, Efficacy and Mechanisms Evaluation Programme, Programme Grants for Applied Research, and the Wellcome Trust. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. Computational aspects of this research were funded from the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) with additional support from Health Data Research (HDR) UK and the Wellcome Trust Core Award [grant number 203141/Z/16/Z]. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. For the purpose of open access, the author has applied a CC-BY public copyright licence to any author accepted manuscript version arising from this submission. Research in context: Evidence before this study: Sleep plays a crucial role in our mental and physical health. Nonetheless, much of our understanding of sleep relies on self-report sleep questionnaires, which are subject to recall bias. We searched on Web of Science, Medline, and Google Scholar from the database inception to June 23, 2023, using terms that included “wearable”, “actigraphy” or “accelerometer” in combination with “sleep stage” or “sleep classification”, and “polysomnography”. Existing studies have attempted to use machine learning to predict both sleep and sleep stages using accelerometry. However, prior methods were validated in populations of small sample sizes (n<100), making the prediction validity unclear. To date, no study has examined variations of accelerometer-derived sleep stage estimates in large population datasets with longitudinal disease outcomes. Added value of this study: We showed that our deep-learning-based method improves sleep staging for wrist-worn accelerometers against the current state-of-the-art. We quantified the model uncertainty in a large multicentre dataset with 1,448 nights of concurrent raw accelerometry and polysomnography recordings. We further demonstrated that our sleep staging method could capture population differences concerning age, season, and other sociodemographic characteristics using a large health database. Shorter overnight sleep duration was associated with an increased risk of all-cause mortality after seven years of follow-up in groups with both low and high sleep efficiencies. Implications of all the available evidence: This study helps clinicians to interpret sleep measurements from wearable sensors in routine care. Researchers can use derived sleep parameters in large-scale accelerometer datasets to advance our understanding of the association between sleep and population subgroups with different clinical characteristics. Our findings further suggest that having a short overnight sleep is a risky behaviour regardless of the sleep quality, which requires immediate public attention to fight the social stigma that having a short sleep is acceptable as long as one sleeps well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Short sleep duration and health outcomes: a systematic review, meta-analysis, and meta-regression
Itani, O., Jike, M., Watanabe, N., & Kaneita, Y. (2017) · Sleep Medicine · doi:10.1016/j.sleep.2016.08.006 · Cited by 1,252
Doherty, A., Jackson, D., Hammerla, N., Plötz, T., Olivier, P., Granat, M. H., White, T., van Hees, V. T., Trenell, M. I., Owen, C. G., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169649 · Cited by 1,250
Self-citationGWAS identifies 14 loci for device-measured physical activity and sleep duration
Doherty, A., Smith-Byrne, K., Ferreira, T., Holmes, M. V., Holmes, C., Pulit, S. L., & Lindgren, C. M. (2018) · Nature Communications · doi:10.1038/s41467-018-07743-4 · Cited by 408
Self-citationWang, C., Bangdiwala, S. I., Rangarajan, S., Lear, S. A., AlHabib, K. F., Mohan, V., Teo, K., Poirier, P., TSE, L. A., Liu, Z., et al. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehy695 · Cited by 385
Circadian rhythms and disorders of the timing of sleep
Meyer, N., Harvey, A. G., Lockley, S. W., & Dijk, D.-J. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00877-7 · Cited by 346
Mantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314
Genetic studies of accelerometer-based sleep measures yield new insights into human sleep behaviour
Jones, S. E., van Hees, V. T., Mazzotti, D. R., Marques-Vidal, P., Sabia, S., van der Spek, A., Dashti, H. S., Engmann, J., Kocevska, D., Tyrrell, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-09576-1 · Cited by 300
Self-citationWilletts, M., Hollowell, S., Aslett, L., Holmes, C., & Doherty, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-26174-1 · Cited by 250
Self-citationWalmsley, R., Chan, S., Smith-Byrne, K., Ramakrishnan, R., Woodward, M., Rahimi, K., Dwyer, T., Bennett, D., & Doherty, A. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-104050 · Cited by 238
Self-citationSelf-supervised learning for human activity recognition using 700,000 person-days of wearable data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01062-3 · Cited by 166 · cited 3×
“Even for sleep/wake classification, SleepNet achieved compa337 rable results to a systematic evaluation of eight state-of-the-art sleep algorithms [8] 338 in the Newcastle dataset.”
BackgroundMethodSelf-citationAutomating sleep stage classification using wireless, wearable sensors
Boe, A. J., McGee Koch, L. L., O’Brien, M. K., Shawen, N., Rogers, J. A., Lieber, R. L., Reid, K. J., Zee, P. C., & Jayaraman, A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0210-1 · Cited by 98
40 years of actigraphy in sleep medicine and current state of the art algorithms
Patterson, M. R., Nunes, A. A. S., Gerstel, D., Pilkar, R., Guthrie, T., Neishabouri, A., & Guo, C. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00802-1 · Cited by 91
Katori, M., Shi, S., Ode, K. L., Tomita, Y., & Ueda, H. R. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2116729119 · Cited by 75
Wainberg, M., Jones, S. E., Beaupre, L. M., Hill, S. L., Felsky, D., Rivas, M. A., Lim, A. S. P., Ollila, H. M., & Tripathy, S. J. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003782 · Cited by 64
Golbus, J. R., Pescatore, N. A., Nallamothu, B. K., Shah, N., & Kheterpal, S. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00138-2 · Cited by 57
Liang, Y. Y., Ai, S., Xue, H., Chen, Y., Zhou, J., Shu, X., Weng, F., Zhou, M., Ma, H., Zhang, J., et al. (2023) · The Journals of Gerontology: Series A · doi:10.1093/gerona/glad108 · Cited by 33
Devine, J. K., Chinoy, E. D., Markwald, R. R., Schwartz, L. P., & Hursh, S. R. (2020) · Sensors · doi:10.3390/s21010076 · Cited by 32
Migueles, J. H., Molina-Garcia, P., Torres-Lopez, L. V., Cadenas-Sanchez, C., Rowlands, A. V., Ebner-Priemer, U. W., Koch, E. D., Reif, A., & Ortega, F. B. (2022) · Scientific Reports · doi:10.1038/s41598-022-09469-2 · Cited by 22
Self-citation
Flagged first, then by citations
Research works printed but not linked: 29
- 10.1093/ije/dyr203 · DOI
- 10.1016/j.sleep.2011.11.005 · DOI · Paper page
- 2017, Cohort profile: the Western Australian pregnancy cohort (Raine) study–Generation 2, In: International Journal of Epidemiology, 46, 1384
- 10.1136/bmjopen-2018-026276 · DOI
- Tatiana Plekhanova et al. “Validation of an automated sleep detection algorithm using data from multiple accelerometer brands”. In: Journal of Sleep Research (2022). · DOI
- 2016, Genetic correlation analysis suggests association between increased self-reported sleep duration in adults and schizophrenia and type 2 diabetes, Sleep, 39, 1853, 10.5665/sleep.6168 · DOI
- 10.1038/s41598-018-31628-7 · DOI
- 2022, Reallocation of time between device-measured movement behaviours and risk of incident cardiovascular disease, In: British Journal of Sports Medicine, 56, 1008
- 2012, Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events: deliberations of the sleep apnea definitions task force of the American Academy of Sleep Medicine, In: Journal of Clinical Sleep Medicine, 8, 597
- Kaiming He , et al. “Identity mappings in deep residual networks”. In: European Conference on Computer Vision. Springer. 2016, pp. 630–645. · DOI · Paper page
- Andrew P Creagh , et al. “Digital health technologies and machine learning augment patient reported outcomes to remotely characterise rheumatoid arthritis”. In: medRxiv (2022). · DOI · Paper page
- 2021, Sleep classification from wrist-worn accelerometer data using random forests, Scientific Reports, 11, 1
- 2018, Estimating sleep parameters using an accelerometer without sleep diary, Scientific reports, 8, 12975, 10.1038/s41598-018-31266-z · DOI
- 2012, Interrater reliability: the kappa statistic, Biochemia medica, 22, 276
- 2019, Using hidden Markov models with raw, triaxial wrist accelerometry data to determine sleep stages, In: Australian & New Zealand Journal of Statistics, 61, 273
- 2017, Relationship of sleep duration with all-cause mortality and cardiovascular events: a systematic review and dose-response meta-analysis of prospective cohort studies, In: Journal of the American Heart Association, 6, e005947
- Shahrad Taheri . “Sleep and cardiometabolic health—not so strange bedfellows”. In: The Lancet Diabetes & Endocrinology (2023). · DOI · Paper page
- 2017, Cohort profile: the Western Australian pregnancy cohort (Raine) study–Generation 2, In: International Journal of Epidemiology, 46, 1384
- Tatiana Plekhanova et al. “Validation of an automated sleep detection algorithm using data from multiple accelerometer brands”. In: Journal of Sleep Research (2022). · DOI
- 2016, Genetic correlation analysis suggests association between increased self-reported sleep duration in adults and schizophrenia and type 2 diabetes, Sleep, 39, 1853, 10.5665/sleep.6168 · DOI
- 10.1136/bmjopen-2018-026276 · DOI
- 2015, UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age, PLoS Medicine, 12, e1001779, 10.1371/journal.pmed.1001779 · DOI · Paper page
- Kaiming He , et al. “Identity mappings in deep residual networks”. In: European Conference on Computer Vision. Springer. 2016, pp. 630–645. · DOI · Paper page
- 2021, Sleep classification from wrist-worn accelerometer data using random forests, Scientific Reports, 11, 1
- 2015, National Sleep Foundation’s updated sleep duration recommendations, Sleep health, 1, 233, 10.1016/j.sleh.2015.10.004 · DOI · Paper page
- 2021, Objective sleep efficiency predicts cardiovascular disease in a community population: the sleep heart health study, In: Journal of the American Heart Association, 10, e016201
- 10.1002/sim.4780100703 · DOI
- 2011, Lexis: An R Class for Epidemiological Studies with Long-Term Follow-Up, In: Journal of Statistical Software, 38, 1
- 10.1002/sim.1485 · DOI
Metadata
- Authors
- Yuan, H., Plekhanova, T., Walmsley, R., Reynolds, A. C., Maddison, K. J., Bucan, M., Gehrman, P., Rowlands, A., Ray, D. W., Bennett, D., McVeigh, J., Straker, L., Eastwood, P., Kyle, S. D., & Doherty, A.
- Affiliations
- University of Oxford (GB)
- University of Leicester (GB)
- Flinders University (AU)
- The University of Western Australia (AU)
- University of Pennsylvania (US)
- John Radcliffe Hospital (GB)
- Curtin University (AU)
- Murdoch University (AU)
- Corresponding author
- Doherty, Aiden
- ORCID
- Venue
- medRxiv
- Publisher
- openRxiv
- Published
- 2023-07-08
- PMC
- PMC10350137
- OpenAlex
- W4383618267
- Cited by
- 3
- References
- 20
- Citations by year
- 2025: 1 · 2024: 2
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by
- Locations
- medRxiv (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Funders
- University of Notre Dame
- Wellcome Trust (223100/Z/21/Z, 223100, 107849, /Z/15/Z)
- UK Research and Innovation
- National Institute for Health and Care Research
- British Heart Foundation (RE/18/3/34214)
- Department of Health and Social Care
- Raine Medical Research Foundation (1027449)
- Women and Infants Research Foundation (1044840, 1027449)
- Curtin University of Technology
- Edith Cowan University (1044840, 1027449)
- Murdoch University (1027449, 1044840)
- University of Notre Dame Australia (1027449, 1044840)
- Novo Nordisk
- Swiss Re
- Medical Research Council (MR/P023576/1)
- Health Technology Assessment Programme
- National Health and Medical Research Council (1027449, 1044840)
- Programme Grants for Applied Research
- NIHR Leicester Biomedical Research Centre
- National Institute of Mental Health (MH103963, R21MH103963)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Life Sciences › Neuroscience › Endocrine and Autonomic Systems › Circadian rhythm and melatonin
- Keywords
- sleep stage classification, wrist-worn accelerometers, sleep-wake classification, REM sleep, NREM sleep, sleep duration, sleep efficiency, all-cause mortality, short sleepers, sleep architecture, UK Biobank, external validation, polysomnography, wearable devices, sleep monitoring, consumer health devices, sleep disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review