Validation of an automated wireless system to monitor sleep in healthy adults
Open accessAbstract
The availability of a reliable system to record sleep stage measures easily and automatically in ambulatory settings could be of utility for research and clinical work. The aim of this study was to evaluate a novel wireless system (WS) that does not require skilled preparation for the automatic collection and scoring of human sleep. Twenty-nine healthy adults underwent concurrent sleep measurement via the WS, polysomnography (PSG) and an actigraph (ACT) in a sleep laboratory for one assessment night preceded by an acclimation night. The PSG recordings were scored by two experienced trained technicians from separate laboratories. Each recording was scored by both technicians to Rechtschaffen and Kales (R&K) criteria. The WS and ACT were compared with each of the PSG scores and a consensus PSG score, and the PSG scores were compared with each other. Inter-rater agreement was assessed for each pair over all pooled epochs by percentage agreement, Cohen's kappa and intraclass correlation coefficient. The WS agreement with each of the two PSG scores for sleep stages was 75.8 and 74.7%, respectively. WS agreement with each of the two PSG scores for sleep/wakefulness was 92.6 and 91.1%, ACT agreement with PSG was 86.3 and 85.7%. The PSG scorers' agreement with each other for sleep stages was 83.2%, and for sleep/wakefulness was 95.8%. The findings from the current study indicate that the WS may provide an easy to use and accurate complement to other established technologies for measuring sleep in healthy adults.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Zeo Sleep Manager has been validated as an accurate device for measuring sleep patterns in adults when compared against polysomnography and actigraphy.
“The Zeo Sleep Manager has been validated as an accurate device for measuring sleep patterns in adults when compared against polysomnography and actigraphy [60, 61].”
From A structural equation model of the relationship between insomnia, negative affect, and paranoid thinking (2017) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 11,772 · see citing works
Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883 · see citing works
(2007) · Cited by 6,530 · see citing works
Hobson, J. A. (1969) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(69)90021-2 · Cited by 5,215 · see citing works
The Role of Actigraphy in the Study of Sleep and Circadian Rhythms
Ancoli-Israel, S., Cole, R., Alessi, C., Chambers, M., Moorcroft, W., & Pollak, C. P. (2003) · Sleep · doi:10.1093/sleep/26.3.342 · Cited by 2,751 · cited 4× · see citing works
“Lower sleep quality may also have contributed to instances of lower performance of ACT, as it has been reported that concordance of ACT with PSG is lower in nights with lower SE (Ancoli-Israel et al., 2003; Kushida et al., 2001; Lichstein et al., 2006).”
BackgroundResultInfluentialKushida, C. A., Chang, A., Patil, C. G., Guilleminault, C., Carrillo, O., & Dement, W. C. (2001) · Sleep Medicine · doi:10.1016/s1389-9457(00)00098-8 · Cited by 997 · see citing works
Statistical Methods for Research Workers.
Anscombe, F. J., & Fisher, R. A. (1955) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2342720 · Cited by 840 · see citing works
A manual of Standardized Terminology
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 632 · see citing works
Actigraphy Validation with Insomnia
Lichstein, K. L., Stone, K. C., James Donaldson, R., Nau, S. D., Soeffing, J. P., Murray, D. M., Lester, K. W., & Aguillard, R. N. (2006) · SLEEP · doi:10.1093/sleep/29.2.232 · Cited by 502 · see citing works
DANKER‐HOPFE, H., ANDERER, P., ZEITLHOFER, J., BOECK, M., DORN, H., GRUBER, G., HELLER, E., LORETZ, E., MOSER, D., PARAPATICS, S., et al. (2009) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2008.00700.x · Cited by 417 · see citing works
Wake Detection Capacity of Actigraphy During Sleep
Paquet, J., Kawinska, A., & Carrier, J. (2007) · SLEEP · doi:10.1093/sleep/30.10.1362 · Cited by 345 · see citing works
Issues of Validity in Actigraphic Sleep Assessment
Tryon, W. W. (2004) · SLEEP · doi:10.1093/sleep/27.1.158 · Cited by 308 · see citing works
Automatic Analysis of Single-Channel Sleep EEG: Validation in Healthy Individuals
Berthomier, C., Drouot, X., Stoica, M., Berthomier, P., Prado, J., Bokar-Thire, D., Benoit, O., Mattout, J., & d’Ortho, M. (2007) · SLEEP · doi:10.1093/sleep/30.11.1587 · Cited by 287 · see citing works
Anderer, P., Gruber, G., Parapatics, S., Woertz, M., Miazhynskaia, T., Klösch, G., Saletu, B., Zeitlhofer, J., Barbanoj, M. J., Danker‐Hopfe, H., et al. (2005) · Neuropsychobiology · doi:10.1159/000085205 · Cited by 285 · see citing works
Interobserver Agreement Among Sleep Scorers From Different Centers in a Large Dataset
Norman, R. G., Pal, I., Stewart, C., et al. (2000) · SLEEP · doi:10.1093/sleep/23.7.1e · Cited by 246 · see citing works
How Accurately Does Wrist Actigraphy Identify the States of Sleep and Wakefulness?
Pollak, C. P., Tryon, W. W., Nagaraja, H. N., & Dzwonczyk, R. R. (2001) · SLEEP · doi:10.1093/sleep/24.8.957 · Cited by 223 · see citing works
Accuracy of sleep perceptions among insomnia sufferers and normal sleepers
Means, M. (2003) · Sleep Medicine · doi:10.1016/s1389-9457(03)00057-1 · Cited by 217 · see citing works
FEIGE, B., AL‐SHAJLAWI, A., NISSEN, C., VODERHOLZER, U., HORNYAK, M., SPIEGELHALDER, K., KLOEPFER, C., PERLIS, M., & RIEMANN, D. (2008) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2008.00651.x · Cited by 211 · see citing works
Limitations of Rechtschaffen and Kales
Himanen, S., & Hasan, J. (2000) · Sleep Medicine Reviews · doi:10.1053/smrv.1999.0086 · Cited by 173 · see citing works
Schaltenbrand, N., Lengelle, R., Toussaint, M., Luthringer, R., Carelli, G., Jacqmin, A., Lainey, E., Muzet, A. G., & Macher, J. P. (1996) · SLEEP · doi:10.1093/sleep/19.1.26 · Cited by 157 · see citing works
Automatic sleep stage classification using two-channel electro-oculography
Virkkala, J., Hasan, J., Värri, A. O., Himanen, S., & Müller, K. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.06.016 · Cited by 130 · see citing works
Pittman, S. D., MacDonald, M., Fogel, R., Malhotra, A., Todros, K., Levy, B., Geva, A. B., & White, D. P. (2004) · SLEEP · doi:10.1093/sleep/27.7.1394 · Cited by 89 · see citing works
Automated Sleep Stage Scoring Using Hybrid Rule- and Case-Based Reasoning
Park, H., Oh, J. S., Jeong, D., et al. (2000) · Computers and Biomedical Research · doi:10.1006/cbmr.2000.1549 · Cited by 88 · see citing works
The AASM scoring manual: a critical appraisal
Grigg-Damberger, M. M. (2009) · Current Opinion in Pulmonary Medicine · doi:10.1097/mcp.0b013e328331a2bf · Cited by 53 · see citing works
Comparison of manual sleep staging with automated neural network-based analysis in clinical practice
Caffarel, J., Gibson, G. J., Harrison, J. P., et al. (2006) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-005-0002-4 · Cited by 41 · see citing works
Prinz, P. N., Larsen, L. H., Moe, K. E., et al. (1994) · SLEEP · doi:10.1093/sleep/17.8.711 · Cited by 24 · see citing works
Validation of automated sleep analysis in normal children
Villa, M., Piro, S., Dotta, A., et al. (1998) · European Respiratory Journal · doi:10.1183/09031936.98.11020458 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564 · see citing works
Arnal, P. J., Thorey, V., Debellemaniere, E., Ballard, M. E., Bou Hernandez, A., Guillot, A., Jourde, H., Harris, M., Guillard, M., Van Beers, P., et al. (2020) · SLEEP · doi:10.1093/sleep/zsaa097 · Cited by 394 · see citing works
Caffeine Effects on Sleep Taken 0, 3, or 6 Hours before Going to Bed
Drake, C., Roehrs, T., Shambroom, J., & Roth, T. (2013) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.3170 · Cited by 366 · see citing works
Self-citationMantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314 · see citing works
Beattie, Z., Oyang, Y., Statan, A., Ghoreyshi, A., Pantelopoulos, A., Russell, A., & Heneghan, C. (2017) · Physiological Measurement · doi:10.1088/1361-6579/aa9047 · Cited by 198 · see citing works
Scullin, M. K. (2013) · Psychology and Aging · doi:10.1037/a0028830 · Cited by 181 · see citing works
Alternatives to polysomnography (PSG): a validation of wrist actigraphy and a partial-PSG system
Kosmadopoulos, A., Sargent, C., Darwent, D., Zhou, X., & Roach, G. D. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0438-7 · Cited by 160 · see citing works
Targeted memory reactivation during sleep improves next-day problem solving
Sanders, K. E. G., Osburn, S., Paller, K. A., & Beeman, M. (2019) · Psychological Science · doi:10.1177/0956797619873344 · Cited by 41 · see citing works
Scott, A. J., Rowse, G., & Webb, T. L. (2017) · PLOS ONE · doi:10.1371/journal.pone.0186233 · Cited by 30 · see citing works
Tonetti, L., Fábregas, S. E., Fabbri, M., Occhionero, M., Erbacci, A., Martoni, M., & Natale, V. (2013) · Biological Rhythm Research · doi:10.1080/09291016.2012.692252 · Cited by 7 · see citing works
- Authors
- SHAMBROOM, J. R., FÁBREGAS, S. E., & JOHNSTONE, J.
- Corresponding author
- SHAMBROOM, JOHN R.
- Venue
- Journal of Sleep Research
- Publisher
- Wiley
- Published
- 2011-08-22
- Volume
- 21
- Issue
- 2
- Pages
- 221-230
- ISSN
- 0962-1105 (ISSN-L)
- 1365-2869
- OpenAlex
- W2158289843
- Cited by
- 216
- References
- 29
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 9 · 2023: 9 · 2022: 8 · 2021: 17 · 2020: 18 · 2019: 16 · 2018: 14 · 2017: 16 · 2016: 21 · 2015: 21 · 2014: 28 · 2013: 13 · 2012: 15
- FWCI
- 23.89
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Sleep Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Keywords
- automated sleep scoring, sleep stage classification, polysomnography, actigraphy, interobserver agreement, healthy adults
- MeSH terms
- Adolescent, Adult, Aged, Female, Humans, Male, Middle Aged, Sleep, Sleep Stages, Wakefulness, Reproducibility of Results, Polysomnography, Young Adult, Actigraphy, Wireless Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
