A Novel, Open Access Method to Assess Sleep Duration Using a Wrist-Worn Accelerometer
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Wrist-worn accelerometers are increasingly being used for the assessment of physical activity in population studies, but little is known about their value for sleep assessment. We developed a novel method of assessing sleep duration using data from 4,094 Whitehall II Study (United Kingdom, 2012-2013) participants aged 60-83 who wore the accelerometer for 9 consecutive days, filled in a sleep log and reported sleep duration via questionnaire. Our sleep detection algorithm defined (nocturnal) sleep as a period of sustained inactivity, itself detected as the absence of change in arm angle greater than 5 degrees for 5 minutes or more, during a period recorded as sleep by the participant in their sleep log. The resulting estimate of sleep duration had a moderate (but similar to previous findings) agreement with questionnaire based measures for time in bed, defined as the difference between sleep onset and waking time (kappa = 0.32, 95%CI:0.29,0.34) and total sleep duration (kappa = 0.39, 0.36,0.42). This estimate was lower for time in bed for women, depressed participants, those reporting more insomnia symptoms, and on weekend days. No such group differences were found for total sleep duration. Our algorithm was validated against data from a polysomnography study on 28 persons which found a longer time window and lower angle threshold to have better sensitivity to wakefulness, while the reverse was true for sensitivity to sleep. The novelty of our method is the use of a generic algorithm that will allow comparison between studies rather than a "count" based, device specific method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Physical activity and sleep were objectively measured over 7 days by use of wristworn triaxial accelerometers; data were assessed with validated calibration and analysis algorithms.13,14”
From Primary care-led weight management for remission of type 2 diabetes (DiRECT): an open-label, cluster-randomised trial (2018) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · cited 1×
“The agreement between weekly average accelerometer assessed sleep duration (time in bed, and total sleep duration − rounded to the nearest integer) and self-reported sleep duration from the health survey questionnaire was assessed using a confusion matrix and a weighted Cohen’s Kappa coefficient [27].”
MethodPhysical Activity in the United States Measured by Accelerometer
TROIANO, R. P., BERRIGAN, D., DODD, K. W., MÂSSE, L. C., TILERT, T., & MCDOWELL, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31815a51b3 · Cited by 7,638 · cited 1×
“Studies of physical activity use a hip- or waist-mounted accelerometer that are not suitable for sleep assessment as they are removed prior to bedtime [1].”
Background(2007) · Cited by 6,530
Health inequalities among British civil servants: the Whitehall II study
Marmot, M. G., Stansfeld, S., Patel, C., North, F., Head, J., White, I., Brunner, E., Feeney, A., Marmot, M. G., & Smith, G. D. (1991) · The Lancet · doi:10.1016/0140-6736(91)93068-k · Cited by 3,608
Automatic Sleep/Wake Identification From Wrist Activity
Cole, R. J., Kripke, D. F., Gruen, W., Mullaney, D. J., & Gillin, J. C. (1992) · Sleep · doi:10.1093/sleep/15.5.461 · Cited by 1,941 · cited 2×
“Previously published methods for sleep detection using accelerometers optimized their parameters to best fit with polysomnography-derived periods of sleep [14,18].”
MethodActivity-Based Sleep-Wake Identification: An Empirical Test of Methodological Issues
Sadeh, A., Sharkey, M., & Carskadon, M. A. (1994) · Sleep · doi:10.1093/sleep/17.3.201 · Cited by 1,487 · cited 1×
“Previous work on sleep detection from accelerometer data relied on algorithms that use magnitude of acceleration as their input [13,18,19].”
MethodA scale for the estimation of sleep problems in clinical research
Jenkins, C. D., Stanton, B.-A., Niemcryk, S. J., & Rose, R. M. (1988) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(88)90138-2 · Cited by 1,203 · cited 1×
“• Insomnia symptoms derived from the Jenkins Sleep Problem Scale [24].”
MethodAge Group Comparability of Raw Accelerometer Output from Wrist- and Hip-Worn Monitors
HILDEBRAND, M., VAN HEES, V. T., HANSEN, B. H., & EKELUND, U. (2014) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000289 · Cited by 1,043
van Hees, V. T., Gorzelniak, L., Dean León, E. C., Eder, M., Pias, M., Taherian, S., Ekelund, U., Renström, F., Franks, P. W., Horsch, A., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061691 · Cited by 926
The Role of Actigraphy in the Evaluation of Sleep Disorders
Sadeh, A., Hauri, P. J., Kripke, D. F., & Lavie, P. (1995) · Sleep · doi:10.1093/sleep/18.4.288 · Cited by 909
Littner, M., Kushida, C. A., Anderson, W. M., Bailey, D., Berry, R. B., Davila, D. G., Hirshkowitz, M., Kapen, S., Kramer, M., Loube, D., et al. (2003) · Sleep · doi:10.1093/sleep/26.3.337 · Cited by 691
van Hees, V. T., Fang, Z., Langford, J., Assah, F., Mohammad, A., da Silva, I. C. M., Trenell, M. I., White, T., Wareham, N. J., & Brage, S. (2014) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00421.2014 · Cited by 676
Self-citationComparison between subjective and actigraphic measurement of sleep and sleep rhythms
Lockley, S. W., Skene, D. J., & Arendt, J. (1999) · Journal of Sleep Research · doi:10.1046/j.1365-2869.1999.00155.x · Cited by 622 · cited 4×
“All respiratory events and sleep stages were scored according to standard criteria so that EEG determined total sleep time could be measured [15].”
BackgroundMethodResultInfluentialMartin, J. L., & Hakim, A. D. (2011) · Chest · doi:10.1378/chest.10-1872 · Cited by 603
The case for open computer programs
Ince, D. C., Hatton, L., & Graham-Cumming, J. (2012) · Nature · doi:10.1038/nature10836 · Cited by 535 · cited 2×
“The (visual) screening of accelerometer (actigraphy) data and sleep log data can be cumbersome in large datasets and it complicates replication [22].”
BackgroundMethodVAN DEN BERG, J. F., VAN ROOIJ, F. J. A., VOS, H., TULEN, J. H. M., HOFMAN, A., MIEDEMA, H. M. E., NEVEN, A. K., & TIEMEIER, H. (2008) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2008.00638.x · Cited by 413 · cited 1×
“Previous findings from the comparison between accelerometer estimates of sleep and a concurrently applied sleep log [15,29,30] should be interpreted with caution because data from the log was used to time nocturnal sleep initiation and waking time, boosting the agreement between the two methods.”
ResultValidation of Self-Reported Sleep Against Actigraphy
Girschik, J., Fritschi, L., Heyworth, J., & Waters, F. (2012) · Journal of Epidemiology · doi:10.2188/jea.je20120012 · Cited by 348 · cited 1×
“Only a few studies have compared accelerometer derived estimates of sleep with independently collected self-reported sleep duration [31,32].”
BackgroundSabia, S., van Hees, V. T., Shipley, M. J., Trenell, M. I., Hagger-Johnson, G., Elbaz, A., Kivimaki, M., & Singh-Manoux, A. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt330 · Cited by 304 · cited 3×
“A more elaborate description of the accelerometer protocol can be found in a recent publication [6].”
BackgroundMethodSelf-citationvan Hees, V. T., Renström, F., Wright, A., Gradmark, A., Catt, M., Chen, K. Y., Löf, M., Bluck, L., Pomeroy, J., Wareham, N. J., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022922 · Cited by 289
Self-citationSleep detection with an accelerometer actigraph: comparisons with polysomnography
Jean-Louis, G., Kripke, D. F., Cole, R. J., Assmus, J. D., & Langer, R. D. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(00)00355-3 · Cited by 267 · cited 1×
“7h)[33–36].”
da Silva, I. C., van Hees, V. T., Ramires, V. V., Knuth, A. G., Bielemann, R. M., Ekelund, U., Brage, S., & Hallal, P. C. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu203 · Cited by 243 · cited 1×
“The wrist-worn version of such accelerometers has become popular, especially in large population studies [4–7], as compliance is equal or better than waist-worn devices [8–10] and it allows assessment of both physical activity and sleep.”
BackgroundArora, T., Broglia, E., Pushpakumar, D., Lodhi, T., & Taheri, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072406 · Cited by 160 · cited 2×
“Only a few studies have compared accelerometer derived estimates of sleep with independently collected self-reported sleep duration [31,32].”
BackgroundMaglione, J. E., Ancoli‐Israel, S., Peters, K. W., Paudel, M. L., Yaffe, K. S., Ensrud, K. E., & Stone, K. L. (2014) · SLEEP · doi:10.5665/sleep.3834 · Cited by 148 · cited 1×
“The lower agreement for time in bed seen in women, depressed participants, those reporting more insomnia symptoms, and on weekend days may be explained by a lower validity of selfreported sleep in these groups or on these days of the week, a lower validity of the accelerometer method, or a combination of the two [38].”
BackgroundSleep Estimates Using Microelectromechanical Systems (MEMS)
Lindert, B. H. W. T., & Someren, E. J. W. V. (2013) · SLEEP · doi:10.5665/sleep.2648 · Cited by 145 · cited 2×
“Previously published methods for sleep detection using accelerometers optimized their parameters to best fit with polysomnography-derived periods of sleep [14,18].”
BackgroundMethodBlackwell, T., Ancoli‐Israel, S., Redline, S. S., Stone, K. L., & for the Osteoporotic Fractures in Men (MrOS) Study Group (2011) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.1190 · Cited by 112
Head, J. A., Stansfeld, S. A., Ebmeier, K. P., Geddes, J. R., Allan, C. L., Lewis, G., & Mika Kivimaki, B. (2013) · Psychological Medicine · doi:10.1017/s0033291713000342 · Cited by 93
Comment on “Estimating Activity and Sedentary Behavior from an Accelerometer on the Hip and Wrist”
Freedson, P. S., & John, D. (2013) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31827f024d · Cited by 93 · cited 1×
“The wrist-worn version of such accelerometers has become popular, especially in large population studies [4–7], as compliance is equal or better than waist-worn devices [8–10] and it allows assessment of both physical activity and sleep.”
BackgroundMitterling, T., Högl, B., Schönwald, S. V., Hackner, H., Gabelia, D., Hammerl, M., & Frauscher, B. (2015) · SLEEP · doi:10.5665/sleep.4730 · Cited by 92
A comparison of actigraphy scoring rules used in pediatric research
Meltzer, L. J., & Westin, A. M. L. (2011) · Sleep Medicine · doi:10.1016/j.sleep.2011.03.011 · Cited by 65
Towards Benchmarked Sleep Detection with Wrist-Worn Sensing Units
Borazio, M., Berlin, E., Kücükyildiz, N., Scholl, P., & Laerhoven, K. V. (2014) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2014.24 · Cited by 56
Haba‐Rubio, J., Marques-Vidal, P. M., Andries, D., Tobback, N., Preisig, M., Vollenweider, P., Waeber, G., Luca, G., Tafti, M., & Heinzer, R. C. (2015) · SLEEP · doi:10.5665/sleep.4496 · Cited by 55
Actigraphic Assessment of Sleep Disturbances following Traumatic Brain Injury
Sinclair, K. L., Ponsford, J. L., & Rajaratnam, S. M. W. (2012) · Behavioral Sleep Medicine · doi:10.1080/15402002.2012.726203 · Cited by 53 · cited 1×
“Previous findings from the comparison between accelerometer estimates of sleep and a concurrently applied sleep log [15,29,30] should be interpreted with caution because data from the log was used to time nocturnal sleep initiation and waking time, boosting the agreement between the two methods.”
ResultImpact of study design on development and evaluation of an activity-type classifier
van Hees, V. T., Golubić, R., Ekelund, U., & Brage, S. (2013) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00984.2012 · Cited by 49
Assessment of sleep and circadian rhythm disorders in the very old: the Newcastle 85+ Cohort Study
Anderson, K. N., Catt, M., Collerton, J. C., Davies, K., von Zglinicki, T., Kirkwood, T. B. L., & Jagger, C. (2013) · Age and Ageing · doi:10.1093/ageing/aft153 · Cited by 47 · cited 1×
“The wrist-worn version of such accelerometers has become popular, especially in large population studies [4–7], as compliance is equal or better than waist-worn devices [8–10] and it allows assessment of both physical activity and sleep.”
BackgroundSelf-citationA method to compare new and traditional accelerometry data in physical activity monitoring
van Hees, V. T., Pias, M. R., Taherian, S., Ekelund, U., & Brage, S. (2010) · IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) · doi:10.1109/wowmom.2010.5534986 · Cited by 43
Ornat, L., Martínez-Dearth, R., Chedraui, P. A., & Pérez-López, F. R. (2014) · Maturitas · doi:10.1016/j.maturitas.2014.01.005 · Cited by 42 · cited 1×
“The sum of individual scores was then categorised as follows: 0, 1–11, 12–20 [25].”
BackgroundHassani, M., Mika Kivimaki, B., Elbaz, A., Shipley, M. J., Singh‐Manoux, A., & Sabia, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110816 · Cited by 28 · cited 1×
“The wrist-worn version of such accelerometers has become popular, especially in large population studies [4–7], as compliance is equal or better than waist-worn devices [8–10] and it allows assessment of both physical activity and sleep.”
BackgroundSelf-citationCategory 2 enhanced phenotyping at baseline assessment visit in last 100-150,000 participants
Sk, C. (2009) · Cited by 13
Towards Benchmarked Sleep Detection with Inertial Wrist-worn Sensing Units
Borazio, M., Berlin, E., Scholl, P., & Laerhoven, K. V. (2014) · Cited by 10
Cited by
Lean, M. E., Leslie, W. S., Barnes, A. C., Brosnahan, N., Thom, G., McCombie, L., Peters, C., Zhyzhneuskaya, S., Al-Mrabeh, A., Hollingsworth, K. G., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)33102-1 · Cited by 2,095
Self-citationMigueles, J. H., Rowlands, A. V., Huber, F., Sabia, S., & van Hees, V. T. (2019) · Journal for the Measurement of Physical Behaviour · doi:10.1123/jmpb.2018-0063 · Cited by 955
“…mistakes in sleep diary data g.part4 provides the option to visualize the differences between accelerometer-based estimates and sleep diary; this was for example used in van Hees et al. (van Hees et al., 2015) to identify a dozen of problematic nights out of 27000 nights (Figure 2, panel a).”
MethodSelf-citationJones, S. E., Lane, J. M., Wood, A. R., van Hees, V. T., Tyrrell, J., Beaumont, R. N., Jeffries, A. R., Dashti, H. S., Hillsdon, M., Ruth, K. S., et al. (2019) · Nature Communications · doi:10.1038/s41467-018-08259-7 · Cited by 691
Association of sleep duration in middle and old age with incidence of dementia
Sabia, S., Fayosse, A., Dumurgier, J., van Hees, V. T., Paquet, C., Sommerlad, A., Kivimäki, M., Dugravot, A., & Singh-Manoux, A. (2021) · Nature Communications · doi:10.1038/s41467-021-22354-2 · Cited by 628
Self-citationDashti, H. S., Jones, S. E., Wood, A. R., Lane, J. M., van Hees, V. T., Wang, H., Rhodes, J. A., Song, Y., Patel, K., Anderson, S. G., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08917-4 · Cited by 609
Metadata
- Authors
- van Hees, V. T., Sabia, S., Anderson, K. N., Denton, S. J., Oliver, J., Catt, M., Abell, J. G., Kivimäki, M., Trenell, M. I., & Singh-Manoux, A.
- Affiliations
- Freeman Hospital (GB)
- Newcastle University (GB)
- University College London (GB)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-11-16
- Volume
- 10
- Issue
- 11
- Pages
- e0142533
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4646630
- OpenAlex
- W2180429985
- Cited by
- 744
- References
- 39
- Citations by year
- 2026: 86 · 2025: 102 · 2024: 101 · 2023: 85 · 2022: 97 · 2021: 68 · 2020: 105 · 2019: 45 · 2018: 31 · 2017: 17 · 2016: 6
- FWCI
- 27.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- National Institute for Health and Care Research (R01AG034454, SRF-2011-04-017)
- British Heart Foundation (R01 AG013196, R01AG034454, K013351, PG/29605)
- National Institutes of Health (R01AG013196; R01AG034454; R01HL036310)
- Medical Research Council (MR/K013351/1, K013351, MR/K006312/1, R01AG034454)
- Economic and Social Research Council (R01AG034454, ES/J023299/1, ES/ J023299, R01HL036310, J023299)
- National Institute on Aging (R01AG034454, R01AG013196)
- National Heart, Lung, and Blood Institute (R01HL036310)
- National Institute of Environmental Health Sciences (ES/J023299)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Physical Activity and Health
- Keywords
- sleep duration, wrist-worn accelerometers, physical activity monitoring, time in bed, total sleep duration, sleep diary, polysomnography validation, older adults, insomnia, depression, weekend effect, Whitehall II study
- MeSH terms
- Acceleration, Aged, Aged, 80 and over, Algorithms, Depression, Equipment Design, Female, United Kingdom, Humans, Sleep Initiation and Maintenance Disorders, Male, Middle Aged, Monitoring, Physiologic, Motor Activity, Surveys and Questionnaires, Sex Factors, Sleep, Sleep Wake Disorders, Time Factors, Wrist, Polysomnography, Actigraphy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
