The DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Clinical utility of the Epworth sleepiness scale
Abstract
Purpose The Epworth sleepiness scale (ESS) is a widely used tool which has been validated as a measure of sleepiness. However, the scores within individual patients referred for clinical sleep services vary considerably which may limit the clinical use of the ESS. We sought to determine the test-retest reliability of the ESS if scores were classified as either normal or sleepy.Methods We measured the ESS in patients presenting to our sleep center at a clinical visit and again when a sleep study was done. Demographic and clinical information was extracted from the electronic medical record.Results Average ESS scores were similar on 2 administrations, mean (SD) of 9.8 (5.4) and 10.2 (6.2). Bland-Altman analysis showed upper and lower limits of agreement of 7.5 and - 6.7, respectively. No demographic or clinical variables were identified which contributed to the intra-individual variability. Of the patients who presented with an initial ESS < 11, 80% had a second ESS < 11. Of the patients who presented with an initial ESS ≥ 11, 89% had a second ESS ≥ 11. Cohen's kappa for the two administrations of the ESS was 0.67 (95% CI of 0.51-0.83). Using previously published reports, we calculated Cohen's kappa for polysomnographic determination of the apnea-hypopnea index (AHI) with values ranging from 0.26 to 0.69.Conclusions Individual ESS scores varied considerably within individual patients, but with classification into either normal or sleepy, the test-retest reliability was substantial and in line with other clinical measures including polysomnographic determination of the AHI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When compared to other clinical measures of sleep quality, it was found valid and reliable [41].”
From The Cyclical Battle of Insomnia and Mental Health Impairment in Firefighters: A Narrative Review (2024) · cites this paper as [41]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
A New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale
Johns, M. W. (1991) · Sleep · doi:10.1093/sleep/14.6.540 · Cited by 17,364
Prospective Study of the Association between Sleep-Disordered Breathing and Hypertension
Peppard, P. E., Young, T., Palta, M., & Skatrud, J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200005113421901 · Cited by 4,973
Marin, J. M., Carrizo, S. J., Vicente, E., & Agusti, A. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71141-7 · Cited by 4,678
Reliability and factor analysis of the Epworth Sleepiness Scale.
Johns, M. (1992) · Sleep · doi:10.1093/sleep/15.4.376 · Cited by 2,193
Sleep Disordered Breathing and Mortality: Eighteen-Year Follow-up of the Wisconsin Sleep Cohort
(2008) · Sleep · doi:10.5665/sleep/31.8.1071 · Cited by 1,853
The Structured Clinical Interview for DSM-III-R (SCID)
Williams, J. B. W. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080038006 · Cited by 1,641
Obstructive Sleep Apnea–Hypopnea and Incident Stroke: The Sleep Heart Health Study
Redline, S., Yenokyan, G., Gottlieb, D. J., Shahar, E., O'Connor, G. T., Resnick, H. E., Diener-West, M., Sanders, M. H., Wolf, P. A., Geraghty, E. M., et al. (2010) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200911-1746oc · Cited by 1,269
Wittchen, H.-U., Lachner, G., Wunderlich, U., & Pfister, H. (1998) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050095 · Cited by 668
Daytime Sleepiness and Sleep Habits of Australian Workers
Johns, M. W., & Hocking, B. (1997) · SLEEP · doi:10.1093/sleep/20.10.844 · Cited by 516
Daytime Sleepiness Predicts Mortality and Cardiovascular Disease in Older Adults
Newman, A. B., Spiekerman, C. F., Enright, P., Lefkowitz, D. S., Manolio, T. A., Reynolds, C. F., & Robbins, J. (2000) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2000.tb03901.x · Cited by 460
The diagnostic interview for personality disorders: Interrater and test-retest reliability
Zanarini, M. C., Frankenburg, F. R., Chauncey, D. L., & Gunderson, J. G. (1987) · Comprehensive Psychiatry · doi:10.1016/0010-440x(87)90012-5 · Cited by 296
Newell, J., Mairesse, O., Verbanck, P., & Neu, D. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.07.045 · Cited by 235
Gooneratne, N. S., Richards, K. C., Joffe, M., Lam, R. W., Pack, F. M., Staley, B. A., Dinges, D. F., & Pack, A. I. (2011) · SLEEP · doi:10.1093/sleep/34.4.435 · Cited by 179
Selin, K. H. (2003) · Alcoholism Clinical and Experimental Research · doi:10.1097/01.alc.0000085633.23230.4a · Cited by 178
The variability of the apnoea–hypopnoea index
Bittencourt, L., Suchecki, D., Tufik, S. B., Peres, C., Togeiro, S. M., Bagnato, M. D. C., & Nery, L. E. (2001) · Journal of Sleep Research · doi:10.1046/j.1365-2869.2001.00255.x · Cited by 161
Chediak, A. D., Acevedo-Crespo, J. C., Seiden, D., Kim, H. H., & Kiel, M. H. (1996) · SLEEP · doi:10.1093/sleep/19.7.589 · Cited by 140
Assessment of the test–retest reliability of laboratory polysomnography
Levendowski, D. J., Zack, N., Rao, S. S., WONG, K. K. H., Gendreau, M., Kranzler, J., Zavora, T., & Westbrook, P. R. (2008) · Sleep And Breathing · doi:10.1007/s11325-008-0214-6 · Cited by 136
Validation of a Self-Applied Unattended Monitor for Sleep Disordered Breathing
Ayappa, I., Norman, R. G., Seelall, V., & Rapoport, D. M. (2008) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.27075 · Cited by 125
Clinical Reproducibility of the Epworth Sleepiness Scale
Nguyen, A. T. D., Baltzan, M., Small, D., Wolkove, N., Guillon, S., & Palayew, M. (2006) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.26512 · Cited by 114
Factors Associated with Nightly Variability in Sleep-disordered Breathing in the Elderly
Bliwise, D. L., Benkert, R. E., & Ingham, R. H. (1991) · CHEST Journal · doi:10.1378/chest.100.4.973 · Cited by 103
Obstructive sleep apnoea is associated with diabetes in sleepy subjects
Ronksley, P. E., Hemmelgarn, B. R., Heitman, S. J., Hanly, P. J., Faris, P., Quan, H., & Tsai, W. H. (2009) · Thorax · doi:10.1136/thx.2009.115105 · Cited by 99
White, L. H., Lyons, O. D., Yadollahi, A., Ryan, C. M., & Bradley, T. D. (2015) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.4462 · Cited by 83
Consistency of Respiratory Measurements from Night to Night during the Sleep of Elderly Men
Aber, W. R., Block, A. J., Hellard, D. W., & Webb, W. B. (1989) · CHEST Journal · doi:10.1378/chest.96.4.747 · Cited by 80
Clinical Reproducibility of the Epworth Sleepiness Scale for Patients With Suspected Sleep Apnea
Campbell, A. J., Neill, A. M., & Scott, D. A. R. (2018) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7108 · Cited by 61
Sleep staging and respiratory events in refractory epilepsy patients: Is there a first night effect?
Selwa, L. M., Marzec, M. L., Chervin, R. D., Weatherwax, K. J., Vaughn, B. V., Foldvary‐Schaefer, N., Wang, L., Song, Y., & Malow, B. A. (2008) · Epilepsia · doi:10.1111/j.1528-1167.2008.01681.x · Cited by 35
The reliability of the Epworth Sleepiness Score in a sleep clinic population
Taylor, E., Zeng, I. S. L., & O'Dochartaigh, C. (2018) · Journal of Sleep Research · doi:10.1111/jsr.12687 · Cited by 26
Reliability of the Wisconsin Sleep Questionnaire: A French contribution to international validation
Teculescu, D., Guillemin, F., Virion, J., Aubry, C., Hannhart, B., Michaely, J.-P., & Gueguen, R. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00029-5 · Cited by 22
Reliability of a Sleep Quality Questionnaire for Use in Epidemiologic Studies
Girschik, J., Heyworth, J. S., & Fritschi, L. (2012) · Journal of Epidemiology · doi:10.2188/jea.je20110107 · Cited by 22
Ma, J., Zhang, C., Zhang, J., Hu, J., Fang, J., Zhang, J., Jia, P., & Wang, G.-F. (2011) · PubMed · Cited by 19
The Validity and Reliability of a Screening Questionnaire for Parkinson's Disease in a Community
Kim, J., Cheong, H., Lee, C. S., Yi, S. E., & Park, K. W. (2010) · Journal of Preventive Medicine and Public Health · doi:10.3961/jpmph.2010.43.1.9 · Cited by 11
Herzog, M., Bedorf, A., Rohrmeier, C., Kühnel, T., Herzog, B., Bremert, T., Plontke, S., & Plößl, S. (2016) · HNO · doi:10.1007/s00106-016-0270-3 · Cited by 1
Cited by
Sorted by citations
Wang, L., Zhang, J., Guo, C., He, J., Zhang, S., Wang, Y., Zhao, Y.-N., Li, L., Wang, J., Hou, L., et al. (2022) · Brain stimulation · doi:10.1016/j.brs.2022.09.003 · Cited by 161
Reliability and Efficacy of the Epworth Sleepiness Scale: Is There Still a Place for It?
Scharf, M. T. (2022) · Nature and Science of Sleep · doi:10.2147/nss.s340950 · Cited by 104
Self-citationMa, H., Yan, J., Sun, W., Jiang, M., & Zhang, Y. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.784314 · Cited by 62
Association of lifestyle with sleep health in general population in China: a cross-sectional study
Zheng, Y., Huang, Y., Gong, Y.-M., Li, M., Zeng, N., Wu, S., Zhang, Z.-B., Tian, S.-S., Yuan, K., Liu, X.-X., et al. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-03002-x · Cited by 48
Microstructural brain abnormalities, fatigue, and cognitive dysfunction after mild COVID-19
Silva, L. S., da Costa, B. A., Aventurato, Í. K., João, R. B., de Campos, B. M., de Brito, M. R., Bechelli, J. F., Silva, L. C. S., dos Santos, A. F., Alvim, M. K. M., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-52005-7 · Cited by 41
Metadata
- Authors
- Walker, N. A., Sunderram, J., Zhang, P., Lu, S.-E., & Scharf, M. T.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Corresponding author
- Scharf, Matthew T
- Venue
- Sleep and Breathing
- Published
- 2020-01-14
- Volume
- 24
- Issue
- 4
- Pages
- 1759-1765
- ISSN
- 1520-9512 (ISSN-L)
- 1522-1709
- OpenAlex
- W2999829930
- Cited by
- 102
- References
- 34
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 28 · 2023: 21 · 2022: 19 · 2021: 6 · 2020: 2
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Sleep And Breathing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Health Sciences › Medicine › Physiology (medical) › Obstructive Sleep Apnea Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Keywords
- Epworth Sleepiness Scale, daytime sleepiness, test-retest reliability, sleep apnea, apnea-hypopnea index, polysomnography, kappa statistic, Bland-Altman analysis
- MeSH terms
- Sleepiness, Female, Humans, Male, Middle Aged, Surveys and Questionnaires, Retrospective Studies, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review