The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Spectrum Bias or Spectrum Effect? Subgroup Variation in Diagnostic Test Evaluation
Abstract
Diagnostic tests must be evaluated in a clinically relevant population. However, test performance often varies across population subgroups. Spectrum bias, a term commonly used to describe this heterogeneity, is typically thought to occur when diagnostic test performance varies across patient subgroups and a study of that test's performance does not adequately represent all subgroups. Yet subgroup variation is not a bias if appropriate analyses are conducted. Failure to recognize and address heterogeneity will lead to estimates of test performance that are not generalizable to the relevant clinical populations. Heterogeneity can be addressed with relatively simple stratification procedures, limited primarily by the sample size and the precision of the estimates. This paper proposes the use of the term spectrum effect, rather than spectrum bias, and outlines strategies for using stratified sensitivity and specificity estimates, likelihood ratios, and receiver-operating characteristic curves. Investigators of diagnostic tests should consider the potential for spectrum effect seriously and should address heterogeneity in their analyses. Furthermore, clinicians should consider study samples carefully to determine whether results are generalizable to their specific patient population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,734
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510290071040 · Cited by 1,049
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932 · cited 1×
“Because the algebraic construction of likelihood ratios is analogous to risk ratios (21), the spectrum effect can be evaluated in likelihood ratios by using a test of homogeneity, available in many software programs.”
MethodA consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914
Guidelines for Meta-analyses Evaluating Diagnostic Tests
Irwig, L., Tosteson, A. N. A., Gatsonis, C., Lau, J., Colditz, G., Chalmers, T. C., & Mosteller, F. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-8-199404150-00008 · Cited by 753
Use of methodological standards in diagnostic test research. Getting better but still not good
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 712
Statistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves
McNeil, B. J., & Hanley, J. A. (1984) · Medical Decision Making · doi:10.1177/0272989x8400400203 · Cited by 556
Biases in the assessment of diagnostic tests
Begg, C. B. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060402 · Cited by 496
Cited by
Crosby, D., Bhatia, S., Brindle, K. M., Coussens, L. M., Dive, C., Emberton, M., Esener, S., Fitzgerald, R. C., Gambhir, S. S., Kuhn, P., et al. (2022) · Science · doi:10.1126/science.aay9040 · Cited by 1,379
Riley, R. D., Ensor, J., Snell, K. I. E., Debray, T. P. A., Altman, D. G., Moons, K. G. M., & Collins, G. S. (2016) · BMJ · doi:10.1136/bmj.i3140 · Cited by 585
Kim, H., Hong, H., & Yoon, S. H. (2020) · Radiology · doi:10.1148/radiol.2020201343 · Cited by 539
Variation of a test’s sensitivity and specificity with disease prevalence
Leeflang, M. M. G., Rutjes, A. W. S., Reitsma, J. B., Hooft, L., & Bossuyt, P. M. M. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.121286 · Cited by 530
Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis
Leeflang, M. M. G., Bossuyt, P. M. M., & Irwig, L. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.04.007 · Cited by 482
Metadata
- Authors
- Mulherin, S. A., & Miller, W. C.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2002-10-01
- Volume
- 137
- Issue
- 7
- Pages
- 598-602
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W1970149092
- Cited by
- 327
- References
- 25
- FWCI
- 17.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Spectrum Bias or Spectrum Effect? Subgroup Variation in Diagnostic Test Evaluation. https://app.cochat.ai/papers/10.7326/0003-4819-137-7-200210010-00011
- The paper
- Mulherin, S. A., & Miller, W. C. (2002). Spectrum Bias or Spectrum Effect? Subgroup Variation in Diagnostic Test Evaluation. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-137-7-200210010-00011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.