PreprintCited by 3Sleep and related disordersContext-Aware Activity Recognition SystemsCircadian rhythm and melatonin

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Self-supervised learning of accelerometer data provides new insights for sleep and its association with mortality

Open access

Preprint — published as 10.1038/s41746-024-01065-0 · Paper page

Abstract

Summary: Background: Sleep is essential to life. Accurate measurement and classification of sleep/wake and sleep stages is important in clinical studies for sleep disorder diagnoses and in the interpretation of data from consumer devices for monitoring physical and mental well-being. Existing non-polysomnography sleep classification techniques mainly rely on heuristic methods developed in relatively small cohorts. Thus, we aimed to establish the accuracy of wrist-worn accelerometers for sleep stage classification and subsequently describe the association between sleep duration and efficiency (proportion of total time asleep when in bed) with mortality outcomes. Methods: We developed and validated a self-supervised deep neural network for sleep stage classification using concurrent laboratory-based polysomnography and accelerometry data from three countries (Australia, the UK, and the USA). The model was validated within-cohort using subject-wise five-fold cross-validation for sleep-wake classification and in a three-class setting for sleep stage classification wake, rapid-eye-movement sleep (REM), non-rapid-eye-movement sleep (NREM) and by external validation. We assessed the face validity of our model for population inference by applying the model to the UK Biobank with 100,000 participants, each of whom wore a wristband for up to seven days. The derived sleep parameters were used in a Cox regression model to study the association of sleep duration and sleep efficiency with all-cause mortality. Findings: After exclusion, 1,448 participant nights of data were used to train the sleep classifier. The difference between polysomnography and the model classifications on the external validation was 34.7 minutes (95% limits of agreement (LoA): −37.8 to 107.2 minutes) for total sleep duration, 2.6 minutes for REM duration (95% LoA: −68.4 to 73.4 minutes) and 32.1 minutes (95% LoA: −54.4 to 118.5 minutes) for NREM duration. The derived sleep architecture estimate in the UK Biobank sample showed good face validity. Among 66,214 UK Biobank participants, 1,642 mortality events were observed. Short sleepers (<6 hours) had a higher risk of mortality compared to participants with normal sleep duration (6 to 7.9 hours), regardless of whether they had low sleep efficiency (Hazard ratios (HRs): 1.69; 95% confidence intervals (CIs): 1.28 to 2.24) or high sleep efficiency (HRs: 1.42; 95% CIs: 1.14 to 1.77). Interpretation: Deep-learning-based sleep classification using accelerometers has a fair to moderate agreement with polysomnography. Our findings suggest that having short overnight sleep confers mortality risk irrespective of sleep continuity. Funding: This research has been conducted using the UK Biobank Resource under Application Number 59070. The UK Biobank received ethical approval from the National Health Service National Research Service (Ref 21/NW/0157). We would like to acknowledge the Raine Study participants and their families for their ongoing participation in the study and the Raine Study team for study coordination and data collection. We also thank the NHMRC for their long-term contribution to funding the study over the last 30 years. The core management of the Raine Study is funded by The University of Western Australia, Curtin University, Telethon Kids Institute, Women and Infants Research Foundation, Edith Cowan University, Murdoch University, The University of Notre Dame Australia and the Raine Medical Research Foundation. The 22-year Gen2 Raine Study follow-up was funded by NHMRC project grants 1027449 & 1044840. The data collection for the Pennsylvania dataset is funded, in part, by US National Institute of Health (NIMH) grant R21 MH103963 (MB). HY, DB, and AD are supported by Novo Nordisk. RW and AD are supported by Health Data Research UK, an initiative funded by UK Research and Innovation, Department of Health and Social Care (England) and the devolved administrations, and leading medical research charities. AD is additionally supported by Swiss Re, Wellcome Trust [223100/Z/21/Z], and the British Heart Foundation Centre of Research Excellence (grant number RE/18/3/34214). DWR is supported by MRC programme grant MR/P023576/1; Wellcome Trust (107849/Z/15/Z). TP and AR are supported by the National Institute for Health Research (NIHR) Leicester Biomedical Research Centre and NIHR Applied Research Collaboration East Midlands (ARC EM). SDK is supported by the NIHR Oxford Health Biomedical Research Centre, Health Technology Assessment Programme, Efficacy and Mechanisms Evaluation Programme, Programme Grants for Applied Research, and the Wellcome Trust. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. Computational aspects of this research were funded from the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) with additional support from Health Data Research (HDR) UK and the Wellcome Trust Core Award [grant number 203141/Z/16/Z]. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. For the purpose of open access, the author has applied a CC-BY public copyright licence to any author accepted manuscript version arising from this submission. Research in context: Evidence before this study: Sleep plays a crucial role in our mental and physical health. Nonetheless, much of our understanding of sleep relies on self-report sleep questionnaires, which are subject to recall bias. We searched on Web of Science, Medline, and Google Scholar from the database inception to June 23, 2023, using terms that included “wearable”, “actigraphy” or “accelerometer” in combination with “sleep stage” or “sleep classification”, and “polysomnography”. Existing studies have attempted to use machine learning to predict both sleep and sleep stages using accelerometry. However, prior methods were validated in populations of small sample sizes (n<100), making the prediction validity unclear. To date, no study has examined variations of accelerometer-derived sleep stage estimates in large population datasets with longitudinal disease outcomes. Added value of this study: We showed that our deep-learning-based method improves sleep staging for wrist-worn accelerometers against the current state-of-the-art. We quantified the model uncertainty in a large multicentre dataset with 1,448 nights of concurrent raw accelerometry and polysomnography recordings. We further demonstrated that our sleep staging method could capture population differences concerning age, season, and other sociodemographic characteristics using a large health database. Shorter overnight sleep duration was associated with an increased risk of all-cause mortality after seven years of follow-up in groups with both low and high sleep efficiencies. Implications of all the available evidence: This study helps clinicians to interpret sleep measurements from wearable sensors in routine care. Researchers can use derived sleep parameters in large-scale accelerometer datasets to advance our understanding of the association between sleep and population subgroups with different clinical characteristics. Our findings further suggest that having a short overnight sleep is a risky behaviour regardless of the sleep quality, which requires immediate public attention to fight the social stigma that having a short sleep is acceptable as long as one sleeps well.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.07.07.23292251

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 29

  1. 10.1093/ije/dyr203 · DOI
  2. 10.1016/j.sleep.2011.11.005 · DOI · Paper page
  3. 2017, Cohort profile: the Western Australian pregnancy cohort (Raine) study–Generation 2, In: International Journal of Epidemiology, 46, 1384
  4. 10.1136/bmjopen-2018-026276 · DOI
  5. Tatiana Plekhanova et al. “Validation of an automated sleep detection algorithm using data from multiple accelerometer brands”. In: Journal of Sleep Research (2022). · DOI
  6. 2016, Genetic correlation analysis suggests association between increased self-reported sleep duration in adults and schizophrenia and type 2 diabetes, Sleep, 39, 1853, 10.5665/sleep.6168 · DOI
  7. 10.1038/s41598-018-31628-7 · DOI
  8. 2022, Reallocation of time between device-measured movement behaviours and risk of incident cardiovascular disease, In: British Journal of Sports Medicine, 56, 1008
  9. 2012, Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events: deliberations of the sleep apnea definitions task force of the American Academy of Sleep Medicine, In: Journal of Clinical Sleep Medicine, 8, 597
  10. Kaiming He , et al. “Identity mappings in deep residual networks”. In: European Conference on Computer Vision. Springer. 2016, pp. 630–645. · DOI · Paper page
  11. Andrew P Creagh , et al. “Digital health technologies and machine learning augment patient reported outcomes to remotely characterise rheumatoid arthritis”. In: medRxiv (2022). · DOI · Paper page
  12. 2021, Sleep classification from wrist-worn accelerometer data using random forests, Scientific Reports, 11, 1
  13. 2018, Estimating sleep parameters using an accelerometer without sleep diary, Scientific reports, 8, 12975, 10.1038/s41598-018-31266-z · DOI
  14. 2012, Interrater reliability: the kappa statistic, Biochemia medica, 22, 276
  15. 2019, Using hidden Markov models with raw, triaxial wrist accelerometry data to determine sleep stages, In: Australian & New Zealand Journal of Statistics, 61, 273
  16. 2017, Relationship of sleep duration with all-cause mortality and cardiovascular events: a systematic review and dose-response meta-analysis of prospective cohort studies, In: Journal of the American Heart Association, 6, e005947
  17. Shahrad Taheri . “Sleep and cardiometabolic health—not so strange bedfellows”. In: The Lancet Diabetes & Endocrinology (2023). · DOI · Paper page
  18. 2017, Cohort profile: the Western Australian pregnancy cohort (Raine) study–Generation 2, In: International Journal of Epidemiology, 46, 1384
  19. Tatiana Plekhanova et al. “Validation of an automated sleep detection algorithm using data from multiple accelerometer brands”. In: Journal of Sleep Research (2022). · DOI
  20. 2016, Genetic correlation analysis suggests association between increased self-reported sleep duration in adults and schizophrenia and type 2 diabetes, Sleep, 39, 1853, 10.5665/sleep.6168 · DOI
  21. 10.1136/bmjopen-2018-026276 · DOI
  22. 2015, UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age, PLoS Medicine, 12, e1001779, 10.1371/journal.pmed.1001779 · DOI · Paper page
  23. Kaiming He , et al. “Identity mappings in deep residual networks”. In: European Conference on Computer Vision. Springer. 2016, pp. 630–645. · DOI · Paper page
  24. 2021, Sleep classification from wrist-worn accelerometer data using random forests, Scientific Reports, 11, 1
  25. 2015, National Sleep Foundation’s updated sleep duration recommendations, Sleep health, 1, 233, 10.1016/j.sleh.2015.10.004 · DOI · Paper page
  26. 2021, Objective sleep efficiency predicts cardiovascular disease in a community population: the sleep heart health study, In: Journal of the American Heart Association, 10, e016201
  27. 10.1002/sim.4780100703 · DOI
  28. 2011, Lexis: An R Class for Epidemiological Studies with Long-Term Follow-Up, In: Journal of Statistical Software, 38, 1
  29. 10.1002/sim.1485 · DOI

Metadata

Authors
Yuan, H., Plekhanova, T., Walmsley, R., Reynolds, A. C., Maddison, K. J., Bucan, M., Gehrman, P., Rowlands, A., Ray, D. W., Bennett, D., McVeigh, J., Straker, L., Eastwood, P., Kyle, S. D., & Doherty, A.
Affiliations
  • University of Oxford (GB)
  • University of Leicester (GB)
  • Flinders University (AU)
  • The University of Western Australia (AU)
  • University of Pennsylvania (US)
  • John Radcliffe Hospital (GB)
  • Curtin University (AU)
  • Murdoch University (AU)
Corresponding author
Doherty, Aiden
Venue
medRxiv
Publisher
openRxiv
Published
2023-07-08
OpenAlex
W4383618267
Cited by
3
References
20
Citations by year
2025: 1 · 2024: 2
Type
posted content
Language
en
Open access
Licence
cc-by
Locations
  • medRxiv (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (submittedVersion, cc-by)
  • Figshare (submittedVersion, cc-by)
Funders
  • University of Notre Dame
  • Wellcome Trust (223100/Z/21/Z, 223100, 107849, /Z/15/Z)
  • UK Research and Innovation
  • National Institute for Health and Care Research
  • British Heart Foundation (RE/18/3/34214)
  • Department of Health and Social Care
  • Raine Medical Research Foundation (1027449)
  • Women and Infants Research Foundation (1044840, 1027449)
  • Curtin University of Technology
  • Edith Cowan University (1044840, 1027449)
  • Murdoch University (1027449, 1044840)
  • University of Notre Dame Australia (1027449, 1044840)
  • Novo Nordisk
  • Swiss Re
  • Medical Research Council (MR/P023576/1)
  • Health Technology Assessment Programme
  • National Health and Medical Research Council (1027449, 1044840)
  • Programme Grants for Applied Research
  • NIHR Leicester Biomedical Research Centre
  • National Institute of Mental Health (MH103963, R21MH103963)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Life Sciences › Neuroscience › Endocrine and Autonomic Systems › Circadian rhythm and melatonin
Keywords
sleep stage classification, wrist-worn accelerometers, sleep-wake classification, REM sleep, NREM sleep, sleep duration, sleep efficiency, all-cause mortality, short sleepers, sleep architecture, UK Biobank, external validation, polysomnography, wearable devices, sleep monitoring, consumer health devices, sleep disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review