Promises and Challenges in the Use of Consumer-Grade Devices for Sleep Monitoring
The DOI matches its Crossref record; 174 of the 174 references it cites were found in a registry or an index.
Abstract
The market for smartphones, smartwatches, and wearable devices is booming. In recent years, individuals and researchers have used these devices as additional tools to monitor and track sleep, physical activity, and behavior. Their use in sleep research and clinical applications could address the difficulties in scaling up studies that rely on polysomnography, the gold-standard. However, the use of commercial devices for large-scale sleep studies is not without challenges. With this in mind, this paper presents an extensive review of sleep monitoring systems and the techniques used in their development. We also discuss their performance in terms of reliability and validity, and consider the needs and expectations of users, whether they are experts, patients, or the general public. Through this review, we highlight a number of challenges with current studies: a lack of standard evaluation methods for consumer-grade devices (e.g., reliability and validity assessment); limitations in the populations studied; consumer expectations of monitoring devices; constraints on the resources of consumer-grade devices (e.g., power consumption).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Importantly, only a few commercial devices (i.e., Dreem2TM) used EEG to measure staging as is standard with PSG [36].”
From Clinician-Focused Overview and Developments in Polysomnography (2020) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · cited 1×
“Reliability is the degree to which an assessment experiment, test, or procedure produces the same outcomes every time in a given context [163].”
BackgroundStatistical methods for assessing agreement between two methods of clinical measurement
Bland, J. M., & Altman, D. G. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.10.001 · Cited by 5,220
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Understanding bland altman analysis
Giavarina, D. (2015) · Biochemia Medica · doi:10.11613/bm.2015.015 · Cited by 4,706
A survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
Ohayon, M. M., Carskadon, M. A., Guilleminault, C., & Vitiello, M. V. (2004) · Sleep · doi:10.1093/sleep/27.7.1255 · Cited by 3,349
Kushida, C. A., Littner, M. R., Morgenthaler, T., Alessi, C. A., Bailey, D., Coleman, J., Friedman, L., Hirshkowitz, M., Kapen, S., Kramer, M., et al. (2005) · Sleep · doi:10.1093/sleep/28.4.499 · Cited by 2,054
Research works printed but not linked: 16
- rechtschaffen, 1968, A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects, Public Health Service U S Government Printing Office
- liu, 0, In bed with technology: Challenges and opportunities for sleep tracking, Proc Annu Meet Aust Comput -Human Interaction Conf, 142
- krogh, 1998, An Introduction to Hidden Markov Models for Biological Sequences, 32, 45
- drongelen, 2006, Signal Processing for Neuroscientists An Introduction to the Analysis of Physiological Signals
- russo, 2015, Consumer sleep monitors: Is there a baby in the bathwater, Nature and Science of Sleep, 7, 147
- carós, 0, Very low complexity algorithm for ambulatory activity classification, Proc 3rd Eur Med Biol Eng Conf, 16
- 2006, Sleep Disorders and Sleep Deprivation An Unmet Public Health Problem
- klein, 0, Sleep stages classification using vital signals recordings, Proc Workshop Intell Solutions in Embedded Syst, 47
- yoon, 0, Estimation of sleep posture using a patch-type accelerometer based device, Proc Annu Int Conf IEEE Eng Med Biol Soc, 4942
- mattice, 2012, Fundamentals of Sleep Technology
- fraiwan, 2009, Automatic sleep stage scoring with wavelet packets based on single EEG recording, World Acad Sci Eng Technol, 54, 485
- stephansen, 2017, The use of neural networks in the analysis of sleep stages and the diagnosis of narcolepsy, arXiv 1710 02094
- dement, 2000, History of sleep physiology and medicine, The Principles and Practice of Sleep Medicine, 4, 1
- phan, 0, Metric learning for automatic sleep stage classification, Proc Annu Int Conf Eng Med Biol Soc, 5025
- iber, 2007, The AASM Manual for the scoring of sleep and associated events Rules terminology and technical specifications, 1
- iber, 2007, The AASM Manual for the scoring of sleep and associated events Rules terminology and technical specifications
Cited by
Sleep and the athlete: narrative review and 2021 expert consensus recommendations
Walsh, N. P., Halson, S. L., Sargent, C., Roach, G. D., Nédélec, M., Gupta, L., Leeder, J., Fullagar, H. H., Coutts, A. J., Edwards, B. J., et al. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102025 · Cited by 571
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564
Clinician-Focused Overview and Developments in Polysomnography
Markun, L. C., & Sampat, A. (2020) · Current Sleep Medicine Reports · doi:10.1007/s40675-020-00197-5 · Cited by 136
Mahloko, L., & Adebesin, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-45002-1_9 · Cited by 23
Five million nights: temporal dynamics in human sleep phenotypes
Viswanath, V. K., Hartogenesis, W., Dilchert, S., Pandya, L., Hecht, F. M., Mason, A. E., Wang, E. J., & Smarr, B. L. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01125-5 · Cited by 20
Metadata
- Authors
- Roomkham, S., Lovell, D., Cheung, J., & Perrin, D.
- Venue
- IEEE Reviews in Biomedical Engineering
- Published
- 2018
- Volume
- 11
- Pages
- 53-67
- ISSN
- 1937-3333
- 1941-1189
- Cited by
- 79
- References
- 174
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.