Measurement error in visually scored electrophysiological data: respiration during sleep
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Electrophysiological sleep studies employ the simultaneous recording of multiple physiological parameters. These data are often scored and analyzed visually, i.e. by trained human scorers. In this study, we investigated the measurement error inherent in visual evaluation of respiratory disturbances during human sleep. Three trained scorers independently evaluated twenty-eight all-night sleep recordings. Results indicated that the scorers achieved high agreement on only selected variables. Scorers' experience did not affect the reliability and independent judgements of recording quality did not account for the discrepancies. These findings, although most relevant for the specific parameters studied here, as well as for these scoring criteria, subjects, and techniques, document the unreliability of certain visually scored sleep data. The present paradigm may be useful in evaluating other types of measurement error.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, distinguishing event subtypes (obstructive, central, and mixed) is much more difficult, resulting in worse scorer reliability.22”
From International Consensus Statement on Obstructive Sleep Apnea (2023) · cites this paper as [22]
Citations
Cites
ON THE METHODS AND THEORY OF RELIABILITY
BARTKO, J. J., & CARPENTER, W. T. (1976) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-197611000-00003 · Cited by 1,310
Measurement of the separate volume changes of rib cage and abdomen during breathing
Konno, K., & Mead, J. (1967) · Journal of Applied Physiology · doi:10.1152/jappl.1967.22.3.407 · Cited by 1,027
Statistics: A Biomedical Introduction
Krótki, K. J., Brown, B. W., Hollander, M., & Krotki, K. J. (1980) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402416 · Cited by 445
Statistics: A Biomedical Introduction.
Marriott, F. H. C., Brown, B. W., & Hollander, M. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344819 · Cited by 222
Respiration During Sleep in the Aged Human
Carskadon, M. A., & Dement, W. C. (1981) · Journal of Gerontology · doi:10.1093/geronj/36.4.420 · Cited by 186
Self-citationA new method for evaluating antiarrhythmic drug efficacy.
Sami, M., KRAEMER, H. C., Harrison, D. C., et al. (1980) · Circulation · doi:10.1161/01.cir.62.6.1172 · Cited by 142
Self-citationBreathing Abnormalities During Sleep
Tobin, M. J., Cohn, M. A., & Sackner, M. A. (1983) · Archives of Internal Medicine · doi:10.1001/archinte.1983.00350060149023 · Cited by 50
Sleep related breathing disorders in older men: A search for underlying mechanisms
McGinty, D., Littner, M. R., Beahm, E. K., Ruiz-Primo, E., Young, E., & Sowers, J. R. (1982) · Neurobiology of Aging · doi:10.1016/0197-4580(82)90022-7 · Cited by 50
KRAEMER, H. C., & Korner, A. F. (1976) · Psychological Bulletin · doi:10.1037/0033-2909.83.5.914 · Cited by 35
Self-citationKRAEMER, H. C., & Korner, A. F. (1976) · Psychological Bulletin · doi:10.1037//0033-2909.83.5.914 · Cited by 34
Self-citation
Research works printed but not linked: 3
- Metropolotican Life Insurance Company, 1959, Statistical Bulletin, 40, 1
- Milledge, 1977, Inductive plethysmography: a new respiratory transducer, J. Physiol. (Lond.), 267, 48
- Miles, L.E., Rule, R.B., Benson, K. and Dement, W.C. (in press) Measurement of airflow and tidal volume using the vitalog home monitor, Ann. Biomed. Eng.
Cited by
Snoring and sleep apnea. A population study in Australian men.
Bearpark, H., Elliott, L., Grunstein, R., Cullen, S., Schneider, H., Althaus, W., & Sullivan, C. (1995) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.151.5.7735600 · Cited by 490
International Consensus Statement on Obstructive Sleep Apnea
Chang, J. L., Goldberg, A. N., Alt, J. A., Mohammed, A., Ashbrook, L., Auckley, D., Ayappa, I., Bakhtiar, H., Barrera, J. E., Bartley, B. L., et al. (2023) · International Forum of Allergy & Rhinology · doi:10.1002/alr.23079 · Cited by 350
Reliability of Scoring Respiratory Disturbance Indices and Sleep Staging
Whitney, C. W., Gottlieb, D. J., Redline, S., Norman, R. G., Dodge, R. R., Shahar, E., Surovec, S., & Nieto, F. J. (1998) · Sleep · doi:10.1093/sleep/21.7.749 · Cited by 327
The Scoring of Respiratory Events in Sleep: Reliability and Validity
Redline, S., Budhiraja, R., Kapur, V., Marcus, C. L., Mateika, J. H., Mehra, R., Parthasarthy, S., Somers, V. K., Strohl, K. P., Gozal, D., et al. (2007) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.26818 · Cited by 305
Indications and Standards for Cardiopulmonary Sleep Studies
(1989) · American Review of Respiratory Disease · doi:10.1164/ajrccm/139.2.559 · Cited by 303
Metadata
- Authors
- Bliwise, D., Bliwise, N. G., Kraemer, H. C., & Dement, W.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Bliwise, Donald
- Venue
- Journal of Neuroscience Methods
- Publisher
- Elsevier BV
- Published
- 1984-11
- Volume
- 12
- Issue
- 1
- Pages
- 49-56
- ISSN
- 0165-0270 (ISSN-L)
- OpenAlex
- W2033855064
- Cited by
- 52
- References
- 11
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 2 · 2021: 5 · 2020: 1 · 2019: 1 · 2018: 2 · 2017: 1 · 2015: 2 · 2013: 3
- FWCI
- 3.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Locations
- Journal of Neuroscience Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Aging
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Health Sciences › Medicine › Physiology (medical) › Obstructive Sleep Apnea Research
- Keywords
- measurement error, visual grading, sleep stage classification, respiratory disturbances, sleep apnea, inter-rater reliability, recording quality
- MeSH terms
- Aged, Electrophysiology, Female, Humans, Male, Middle Aged, Neurophysiology, Respiration, Sleep
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measurement error in visually scored electrophysiological data: respiration during sleep. https://app.cochat.ai/papers/10.1016/0165-0270(84)90047-5
- The paper
- Bliwise, D., Bliwise, N. G., Kraemer, H. C., & Dement, W. (1984). Measurement error in visually scored electrophysiological data: respiration during sleep. Journal of Neuroscience Methods. https://doi.org/10.1016/0165-0270(84)90047-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.