Validation of the Sleep-EVAL System Against Clinical Assessments of Sleep Disorders and Polysomnographic Data
Open accessThe DOI matches its Crossref record.
Abstract
OBJECTIVES: To validate the Sleep-EVAL expert system, a computerized tool designed for the assessment of sleep disorders, against polysomnographic data and clinical assessments by sleep specialists. DESIGN: Patients were interviewed twice, once by a physician using Sleep-EVAL and again by a sleep specialist. Polysomnographic data were also recorded to ascertain diagnoses. Agreement between diagnoses generated by Sleep-EVAL and those formulated by sleep specialists was determined via the kappa statistic. SETTINGS: Sleep disorder centers at Stanford University (USA) and Regensburg University (Germany). PATIENTS: 105 patients aged 18 years or over. INTERVENTIONS: NA. RESULTS: Sleep-EVAL made an average of 1.32 diagnoses per patient, compared with 0.93 for the sleep specialists. Overall agreement on any sleep-breathing disorder was 96.9% (Kappa .94). More than half of the patients were diagnosed with obstructive sleep apnea syndrome (OSAS); the agreement rate for this specific diagnosis was 96.7% (Kappa .93). CONCLUSIONS: The findings indicate that the Sleep-EVAL system is a valid instrument for the recognition of major sleep disorders, particularly insomnia and OSAS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Recommendations for a standard research assessment of insomnia
Buysse, D. J., Ancoli-Israel, S., Edinger, J. D., Lichstein, K. L., & Morin, C. M. (2006) · Sleep · doi:10.1093/sleep/29.9.1155 · Cited by 1,206
Edinger, J. D., Bonnet, M. H., Bootzin, R. R., Doghramji, K., Dorsey, C. M., Espie, C. A., Jamieson, A. O., McCall, W. V., Morin, C. M., & Stepanski, E. J. (2004) · Sleep · doi:10.1093/sleep/27.8.1567 · Cited by 1,039
Place of chronic insomnia in the course of depressive and anxiety disorders
Ohayon, M. M., & Roth, T. (2003) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(02)00052-3 · Cited by 873
Self-citationPrevalence of restless legs syndrome and periodic limb movement disorder in the general population
Ohayon, M. M., & Roth, T. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00443-9 · Cited by 720
Self-citationUsing Chronic Pain to Predict Depressive Morbidity in the General Population
Ohayon, M. M., & Schatzberg, A. F. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.1.39 · Cited by 617
Self-citationRisk Factors for Sleep Bruxism in the General Population
Ohayon, M. M., Li, K. K., & Guilleminault, C. (2001) · Chest · doi:10.1378/chest.119.1.53 · Cited by 570
Self-citationInsomnia and the Performance of US Workers: Results from the America Insomnia Survey
Kessler, R. C., Berglund, P. A., Coulouvrat, C., Hajak, G., Roth, T., Shahly, V., Shillington, A. C., Stephenson, J. J., & Walsh, J. K. (2011) · Sleep · doi:10.5665/sleep.1230 · Cited by 527
Roth, T., Coulouvrat, C., Hajak, G., Lakoma, M. D., Sampson, N. A., Shahly, V., Shillington, A. C., Stephenson, J. J., Walsh, J. K., & Kessler, R. C. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.10.023 · Cited by 478
Ohayon, M. M., & Reynolds, C. F. (2009) · Sleep Medicine · doi:10.1016/j.sleep.2009.07.008 · Cited by 432
Self-citationPrevalence of narcolepsy symptomatology and diagnosis in the European general population
Ohayon, M. M., Priest, R. G., Zulley, J., Smirne, S., & Paiva, T. (2002) · Neurology · doi:10.1212/wnl.58.12.1826 · Cited by 400
Self-citationPrevalence of hallucinations and their pathological associations in the general population
Ohayon, M. M. (2000) · Psychiatry Research · doi:10.1016/s0165-1781(00)00227-4 · Cited by 372
Self-citationPrevalence and Patterns of Problematic Sleep Among Older Adolescents
OHAYON, M. M., ROBERTS, R. E., ZULLEY, J., SMIRNE, S., & PRIEST, R. G. (2000) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200012000-00019 · Cited by 326
Self-citationSevere Hot Flashes Are Associated With Chronic Insomnia
Ohayon, M. M. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.12.1262 · Cited by 318
Self-citationRelationship between chronic painful physical condition and insomnia
Ohayon, M. M. (2005) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.07.001 · Cited by 310
Self-citationDaytime Sleepiness and Cognitive Impairment in the Elderly Population
Ohayon, M. M., & Vecchierini, M.-F. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.2.201 · Cited by 296
Self-citationPrevalence of Depressive Episodes With Psychotic Features in the General Population
Ohayon, M. M., & Schatzberg, A. F. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.11.1855 · Cited by 290
Self-citationBoeve, B. F., Molano, J. R., Ferman, T. J., Smith, G. E., Lin, S.-C., Bieniek, K., Haidar, W., Tippmann-Peikert, M., Knopman, D. S., Graff-Radford, N. R., et al. (2011) · Sleep Medicine · doi:10.1016/j.sleep.2010.12.009 · Cited by 283
What are the contributing factors for insomnia in the general population?
Ohayon, M. M., & Roth, T. (2001) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(01)00285-9 · Cited by 280
Self-citationPrevalence and Correlates of Nonrestorative Sleep Complaints
Ohayon, M. M. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.1.35 · Cited by 276
Self-citationPrevalence and consequences of sleep disorders in a shift worker population
Ohayon, M. M., Lemoine, P., Arnaud-Briant, V., & Dreyfus, M. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00438-5 · Cited by 274
Self-citationOhayon, M. M. (2013) · Sleep Medicine · doi:10.1016/j.sleep.2013.03.002 · Cited by 258
Self-citationPrevalence and Polysomnographic Correlates of Insomnia Comorbid with Medical Disorders
Budhiraja, R., Roth, T., Hudgel, D. W., Budhiraja, P., & Drake, C. L. (2011) · Sleep · doi:10.5665/sleep.1114 · Cited by 255
Ohayon, M. M., Zulley, J., Guilleminault, C., Smirne, S., & Priest, R. G. (2001) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2001.49077.x · Cited by 253
Self-citationPrevalence and consequences of insomnia disorders in the general population of Italy
Ohayon, M. M., & Smirne, S. (2002) · Sleep Medicine · doi:10.1016/s1389-9457(01)00158-7 · Cited by 246
Self-citationChung, K.-F., Yeung, W.-F., Ho, F. Y.-Y., Yung, K.-P., Yu, Y.-M., & Kwok, C.-W. (2015) · Sleep Medicine · doi:10.1016/j.sleep.2014.10.018 · Cited by 226
Prevalence of major depressive disorder in the general population of South Korea
Ohayon, M. M., & Hong, S.-C. (2006) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2005.02.003 · Cited by 135
Self-citationFulda, S., Hornyak, M., Müller, K., Cerny, L., Beitinger, P. A., & Wetter, T. C. (2008) · Somnologie - Schlafforschung und Schlafmedizin · doi:10.1007/s11818-008-0336-x · Cited by 95
Reliability and Validity of the Brief Insomnia Questionnaire in the America Insomnia Survey
Kessler, R. C., Coulouvrat, C., Hajak, G., Lakoma, M. D., Roth, T., Sampson, N., Shahly, V., Shillington, A., Stephenson, J. J., Walsh, J. K., et al. (2010) · Sleep · doi:10.1093/sleep/33.5.1539 · Cited by 71
Polysomnographic pattern recognition for automated classification of sleep-waking states in infants
Estévez, P. A., Held, C. M., Holzmann, C. A., Perez, C. A., Pérez, J. P., Heiss, J., Garrido, M., & Peirano, P. (2002) · Medical & Biological Engineering & Computing · doi:10.1007/bf02347703 · Cited by 69
“The kappa statistic is frequently used to measure inter-rater agreement between human experts and also between automated medical systems and human experts (MARTIN-BARANERA et al., 2000; OHAYON et al., 1999).”
MethodHierarchy of insomnia criteria based on daytime consequences
Ohayon, M. M., Riemann, D., Morin, C., & Reynolds, C. F. (2012) · Sleep Medicine · doi:10.1016/j.sleep.2011.06.010 · Cited by 49
“The system has been tested in various contexts, in clinical psychiatry and sleep disorders clinics [19].”
BackgroundSelf-citationValidity and reliability of the Brief Insomnia Questionnaire in the general population in Hong Kong
Chung, K.-F., Yeung, W.-F., Ho, F. Y.-Y., Ho, L.-M., Yung, K.-P., Yu, Y.-M., & Kwok, C.-W. (2014) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2014.03.002 · Cited by 24
Evaluation of the Insomnia Patient
Arnedt, J. T., Conroy, D. A., Posner, D. A., & Aloia, M. S. (2006) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2006.06.002 · Cited by 16
Komada, Y., Breugelmans, R., Fulda, S., Nakano, S., Watanabe, A., Noda, C., Nishida, S., & Inoue, Y. (2015) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s95681 · Cited by 6
Metadata
- Authors
- Ohayon, M. M., Guilleminault, C., Zulley, J., Palombini, L., & Raab, H.
- Venue
- Sleep
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-10
- Volume
- 22
- Issue
- 7
- Pages
- 925-930
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- OpenAlex
- W2397686603
- Cited by
- 113
- References
- 0
- FWCI
- 10.59
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.