The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Promises and Challenges in the Use of Consumer-Grade Devices for Sleep Monitoring
Abstract
The market for smartphones, smartwatches, and wearable devices is booming. In recent years, individuals and researchers have used these devices as additional tools to monitor and track sleep, physical activity, and behavior. Their use in sleep research and clinical applications could address the difficulties in scaling up studies that rely on polysomnography, the gold-standard. However, the use of commercial devices for large-scale sleep studies is not without challenges. With this in mind, this paper presents an extensive review of sleep monitoring systems and the techniques used in their development. We also discuss their performance in terms of reliability and validity, and consider the needs and expectations of users, whether they are experts, patients, or the general public. Through this review, we highlight a number of challenges with current studies: a lack of standard evaluation methods for consumer-grade devices (e.g., reliability and validity assessment); limitations in the populations studied; consumer expectations of monitoring devices; constraints on the resources of consumer-grade devices (e.g., power consumption).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Importantly, only a few commercial devices (i.e., Dreem2TM) used EEG to measure staging as is standard with PSG [36].”
From Clinician-Focused Overview and Developments in Polysomnography (2020) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · cited 1×
“Reliability is the degree to which an assessment experiment, test, or procedure produces the same outcomes every time in a given context [163].”
BackgroundStatistical methods for assessing agreement between two methods of clinical measurement
Bland, J. M., & Altman, D. G. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.10.001 · Cited by 5,220
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Understanding bland altman analysis
Giavarina, D. (2015) · Biochemia Medica · doi:10.11613/bm.2015.015 · Cited by 4,706
Ohayon, M. M., Carskadon, M. A., Guilleminault, C., & Vitiello, M. V. (2004) · Sleep · doi:10.1093/sleep/27.7.1255 · Cited by 3,349
Kushida, C. A., Littner, M. R., Morgenthaler, T., Alessi, C. A., Bailey, D., Coleman, J., Friedman, L., Hirshkowitz, M., Kapen, S., Kramer, M., et al. (2005) · Sleep · doi:10.1093/sleep/28.4.499 · Cited by 2,054
Self-Reported and Measured Sleep Duration: How Similar Are They?
Lauderdale, D. S., Knutson, K. L., Yan, L. L., Liu, K., & Rathouz, P. J. (2008) · Epidemiology · doi:10.1097/ede.0b013e318187a7b0 · Cited by 1,565
Gangwisch, J. E., Heymsfield, S. B., Boden-Albala, B., Buijs, R. M., Kreier, F., Pickering, T. G., Rundle, A. G., Zammit, G. K., & Malaspina, D. (2006) · Hypertension · doi:10.1161/01.hyp.0000217362.34748.e0 · Cited by 1,284
Sleep loss: a novel risk factor for insulin resistance and type 2 diabetes
Spiegel, K., Knutson, K., Leproult, R., Tasali, E., & Cauter, E. V. (2005) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00660.2005 · Cited by 1,175
Research works printed but not linked: 150
- bhat, 2014, Is there a clinical role for smartphone sleep apps? Comparison of sleep cycle detection by a smartphone application to polysomnography., J Clin Sleep Med, 11, 709, 10.5664/jcsm.4840 · DOI
- 10.1089/acm.2014.0327 · DOI
- 10.1007/s11325-015-1271-2 · DOI
- 10.1016/j.physbeh.2014.04.052 · DOI
- 10.1586/17434440.2016.1171708 · DOI · Paper page
- 10.1109/ISBB.2015.7344944 · DOI
- 10.1088/0967-3334/31/12/005 · DOI
- 10.5665/sleep.4990 · DOI · Paper page
- 10.5664/jcsm.5580 · DOI
- 10.1080/09291016.2016.1191689 · DOI
- areàn, 2016, Mobile technology for mental health assessment, Dialogues Clin Neurosci, 18, 163, 10.31887/DCNS.2016.18.2/parean · DOI
- 10.5665/sleep.6108 · DOI
- 10.1093/aje/kwv251 · DOI · Paper page
- 10.1111/j.1365-2869.2008.00638.x · DOI · Paper page
- 10.1136/bmj.313.7048.41 · DOI · Paper page
- 10.1145/2984511.2984534 · DOI
- dix, 2009, Human-computer interaction, Encyclopedia of Database Systems, 1327, 10.1007/978-0-387-39940-9_192 · DOI · Paper page
- 10.1145/1978942.1979395 · DOI
- 10.1249/MSS.0000000000000778 · DOI · Paper page
- 10.1145/2556288.2557039 · DOI · Paper page
- 10.1145/2030112.2030166 · DOI · Paper page
- 10.1177/1367549415584857 · DOI · Paper page
- rechtschaffen, 1968, A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects, Public Health Service U S Government Printing Office
- 10.1093/sleep/31.2.283 · DOI · Paper page
- liu, 0, In bed with technology: Challenges and opportunities for sleep tracking, Proc Annu Meet Aust Comput -Human Interaction Conf, 142
- 10.1016/B978-1-4377-0326-9.00013-0 · DOI
- hori, 2001, Proposed supplements and amendments to ‘A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects,’ the Rechtschaffen & Kales (1968) Standard, Psychiatry and Clinical Neurosciences, 55, 305, 10.1046/j.1440-1819.2001.00810.x · DOI · Paper page
- 10.1093/sleep/32.2.139 · DOI · Paper page
- 10.1109/TASC.2014.2352391 · doi:10.1109/tasc.2014.2352391
- 10.1109/72.788646 · DOI · Paper page
- krogh, 1998, An Introduction to Hidden Markov Models for Biological Sequences, 32, 45
- 10.1109/EMBC.2014.6943976 · DOI
- 10.1007/978-1-4757-3264-1 · DOI · Paper page
- šušmáková, 2008, Discrimination ability of individual measures used in sleep stages classification, Artif Intell Med, 44, 261, 10.1016/j.artmed.2008.07.005 · DOI
- drongelen, 2006, Signal Processing for Neuroscientists An Introduction to the Analysis of Physiological Signals
- 10.1109/ICCCN.2009.5235366 · DOI
- 10.1093/sleep/17.4.378 · DOI · Paper page
- 10.1016/j.jsmc.2016.07.002 · DOI · Paper page
- 10.1186/1475-925X-9-39 · DOI
- 10.1016/B978-1-4557-7051-9.00009-7 · DOI
- 10.1016/j.sleep.2013.12.022 · DOI
- 10.1016/j.bspc.2015.09.002 · DOI · Paper page
- 10.1053/smrv.1999.0086 · DOI · Paper page
- 10.5665/sleep.4918 · DOI · Paper page
- 10.3109/07420528.2013.782312 · DOI · Paper page
- 10.1177/0145721707308172 · DOI
- 10.1016/j.outlook.2004.12.004 · DOI
- russo, 2015, Consumer sleep monitors: Is there a baby in the bathwater, Nature and Science of Sleep, 7, 147
- 10.1007/BF02347551 · DOI · Paper page
- carós, 0, Very low complexity algorithm for ambulatory activity classification, Proc 3rd Eur Med Biol Eng Conf, 16
- 2006, Sleep Disorders and Sleep Deprivation An Unmet Public Health Problem
- 10.1109/21.97458 · DOI · Paper page
- 10.1016/B978-1-4377-0326-9.00006-3 · DOI
- 10.1109/5.18626 · DOI · Paper page
- 10.1001/archinte.166.16.1701 · DOI · Paper page
- 10.1109/JCN.2011.6157411 · DOI · Paper page
- 10.1016/B978-1-4377-0326-9.00003-8 · DOI
- 10.1016/B978-0-323-24288-2.00002-7 · DOI · Paper page
- 10.1016/B0-72-160797-7/50009-4 · DOI · Paper page
- 10.1007/978-3-319-12817-7_5 · DOI
- 10.1109/TSMCA.2012.2192264 · doi:10.1109/tsmca.2012.2192264
- 10.1007/978-3-642-29734-2_35 · DOI · Paper page
- 10.1097/00004691-199607000-00004 · DOI
- piñero, 2004, Sleep stage classification using fuzzy sets and machine learning techniques, Neurocomputing, 58, 1137, 10.1016/j.neucom.2004.01.178 · doi:10.1016/j.neucom.2004.01.178
- 10.1109/TIM.2012.2187242 · DOI · Paper page
- 10.1007/978-3-540-92841-6_104 · DOI
- 10.1109/IEMBS.2008.4649365 · DOI · Paper page
- 10.1109/CIMCA.2005.1631496 · doi:10.1109/cimca.2005.1631496
- 10.1109/IEEEGCC.2013.6705790 · DOI
- 10.1093/sleep/20.6.423 · DOI · Paper page
- klein, 0, Sleep stages classification using vital signals recordings, Proc Workshop Intell Solutions in Embedded Syst, 47
- 10.1007/978-3-319-12817-7_6 · DOI
- 10.1016/S1389-9457(01)00115-0 · DOI · Paper page
- 10.1164/ajrccm.158.2.9705035 · DOI
- 10.5664/jcsm.2352 · DOI
- 10.1007/s11325-014-0990-0 · DOI
- 10.1016/0013-4694(71)90092-7 · DOI
- 10.1093/sleep/15.5.461 · DOI · Paper page
- 10.1109/ICDM.2010.60 · DOI
- 10.1161/HYPERTENSIONAHA.107.095471 · DOI · Paper page
- 10.1001/archinte.164.4.406 · DOI · Paper page
- 10.1007/BF00203237 · DOI
- 10.1016/j.jneumeth.2007.06.016 · DOI
- 10.1016/j.ijhcs.2016.05.006 · DOI · Paper page
- 10.1145/2639108.2642898 · DOI
- 10.1145/2750858.2807554 · DOI · Paper page
- 10.3390/s110606037 · DOI
- 10.1016/j.smrv.2013.02.001 · DOI
- yoon, 0, Estimation of sleep posture using a patch-type accelerometer based device, Proc Annu Int Conf IEEE Eng Med Biol Soc, 4942
- 10.1109/COMSNETS.2015.7098705 · DOI
- 10.1109/IEMBS.2011.6091903 · DOI
- 10.1016/0013-4694(93)90048-Z · DOI
- 10.1016/j.eswa.2012.09.022 · DOI
- 10.1111/jsr.12105 · DOI
- mattice, 2012, Fundamentals of Sleep Technology
- 10.1109/MPUL.2014.2339291 · doi:10.1109/mpul.2014.2339291
- 10.1109/EMBC.2012.6346412 · DOI
- 10.1109/IEMBS.2000.897979 · doi:10.1109/iembs.2000.897979
- 10.1155/2016/2041467 · DOI
- 10.1007/s11517-005-0002-4 · DOI
- 10.1016/j.jneumeth.2011.12.022 · DOI
- 10.1109/IEMBS.2008.4650401 · DOI
- 10.1016/j.neucom.2012.11.003 · DOI · Paper page
- 10.1109/IEMBS.2004.1403189 · doi:10.1109/iembs.2004.1403189
- 10.1109/TBCAS.2008.2008817 · DOI · Paper page
- 10.1016/0013-4694(96)95636-9 · DOI · Paper page
- 10.1093/sleep/26.7.902 · DOI · Paper page
- 10.1177/009127009703700125 · DOI
- 10.1007/11011620_8 · DOI
- 10.1145/2632048.2632100 · DOI
- 10.1016/S1350-4533(02)00030-9 · DOI · Paper page
- fraiwan, 2009, Automatic sleep stage scoring with wavelet packets based on single EEG recording, World Acad Sci Eng Technol, 54, 485
- 10.3414/ME09-02-0052 · DOI
- stephansen, 2017, The use of neural networks in the analysis of sleep stages and the diagnosis of narcolepsy, arXiv 1710 02094
- 10.1007/s11325-016-1425-x · DOI
- 10.1145/2370216.2370253 · DOI · Paper page
- 10.4108/icst.bodynets.2012.250091 · DOI
- 10.1145/2470654.2481345 · DOI
- krishnan, 2009, Recognition of hand movements using wearable accelerometers, J Ambient Intell Smart Environ, 1, 143, 10.3233/AIS-2009-0019 · DOI
- 10.1016/j.jsmc.2009.04.001 · DOI
- 10.1109/ICASSP.1983.1172250 · DOI · Paper page
- dement, 2000, History of sleep physiology and medicine, The Principles and Practice of Sleep Medicine, 4, 1
- karrenberg, 2013, Signals Processes and Systems An Interactive Multimedia Introduction to Signal Processing (3), 10.1007/978-3-642-38053-2 · doi:10.1007/978-3-642-38053-2
- phan, 0, Metric learning for automatic sleep stage classification, Proc Annu Int Conf Eng Med Biol Soc, 5025
- 10.1016/j.eswa.2010.04.043 · DOI · Paper page
- 10.1109/IEMBS.2001.1020608 · doi:10.1109/iembs.2001.1020608
- 10.1109/IEMBS.2006.259546 · DOI
- 10.1109/10.966600 · DOI · Paper page
- 10.1109/TMC.2015.2462812 · DOI
- 10.1109/MDM.2015.42 · DOI
- 10.1145/2556288.2557220 · DOI · Paper page
- 10.1002/scj.10248 · doi:10.1002/scj.10248
- 10.1080/088395102753559271 · DOI
- schlüter, 2012, An approach for automatic sleep stage scoring and apnea-hypopnea detection, Frontiers Comput Sci, 6, 230, 10.1007/s11704-012-2872-6 · DOI
- 10.1001/archinte.165.8.863 · DOI · Paper page
- 10.1097/01.smj.0000197705.99639.50 · DOI
- 10.1097/NRL.0b013e3181f097cb · DOI
- 10.1093/sleep/32.4.491 · DOI · Paper page
- 10.1109/BIBE.2009.68 · DOI
- 10.1109/ACSSC.1991.186558 · doi:10.1109/acssc.1991.186558
- iber, 2007, The AASM Manual for the scoring of sleep and associated events Rules terminology and technical specifications, 1
- iber, 2007, The AASM Manual for the scoring of sleep and associated events Rules terminology and technical specifications
- 10.1109/EMBC.2013.6610864 · DOI
- 10.1007/s10916-009-9286-5 · DOI
- 10.1016/j.artmed.2004.04.004 · DOI
- 10.1016/S0933-3657(01)00098-7 · doi:10.1016/s0933-3657(01)00098-7
- 10.1016/j.medengphy.2013.07.011 · DOI · Paper page
- 10.1016/j.neuroimage.2012.06.036 · DOI
- 10.1159/000085205 · DOI · Paper page
- 10.1371/journal.pone.0169901 · DOI
Cited by
Sleep and the athlete: narrative review and 2021 expert consensus recommendations
Walsh, N. P., Halson, S. L., Sargent, C., Roach, G. D., Nédélec, M., Gupta, L., Leeder, J., Fullagar, H. H., Coutts, A. J., Edwards, B. J., et al. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102025 · Cited by 571
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564
Clinician-Focused Overview and Developments in Polysomnography
Markun, L. C., & Sampat, A. (2020) · Current Sleep Medicine Reports · doi:10.1007/s40675-020-00197-5 · Cited by 136
Mahloko, L., & Adebesin, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-45002-1_9 · Cited by 23
Five million nights: temporal dynamics in human sleep phenotypes
Viswanath, V. K., Hartogenesis, W., Dilchert, S., Pandya, L., Hecht, F. M., Mason, A. E., Wang, E. J., & Smarr, B. L. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01125-5 · Cited by 20
Metadata
- Authors
- Roomkham, S., Lovell, D., Cheung, J., & Perrin, D.
- Venue
- IEEE Reviews in Biomedical Engineering
- Published
- 2018
- Volume
- 11
- Pages
- 53-67
- ISSN
- 1937-3333
- 1941-1189
- Cited by
- 79
- References
- 40
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Promises and Challenges in the Use of Consumer-Grade Devices for Sleep Monitoring. https://app.cochat.ai/papers/10.1109/rbme.2018.2811735
- The paper
- Roomkham, S., Lovell, D., Cheung, J., & Perrin, D. (2018). Promises and Challenges in the Use of Consumer-Grade Devices for Sleep Monitoring. IEEE Reviews in Biomedical Engineering. https://doi.org/10.1109/rbme.2018.2811735
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.