The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
The interpretation of diagnostic tests
Abstract
Laboratory diagnostic tests are central in the practice of modern medicine. Common uses include screening a specific population for evidence of disease and confirming or ruling out a tentative diagnosis in an individual patient. The interpretation of a diagnostic test result depends on both the ability of the test to distinguish diseased from nondiseased subjects and the particular characteristics of the patient and setting in which the test is being used. This article reviews statistical methodology for assessing laboratory diagnostic test accuracy and interpreting individual test results, with an emphasis on diagnostic tests that yield a continuous measurement. The article begins with a summary of basic concepts and terminology, then briefly discusses study design and reviews methods for assessing the accuracy of a single diagnostic test, comparing the accuracy of two or more diagnostic tests and interpreting individual test results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
Signal detection theory and ROC analysis
Egan, J. P. (1975) · Academic Press eBooks · Cited by 1,659
Bamber, D. (1975) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(75)90001-2 · Cited by 1,439
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510290071040 · Cited by 1,049
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932
Receiver operating characteristic (ROC) methodology: the state of the art.
Hanley, J. A. (1989) · PubMed · Cited by 807
Metz, C. E., Herman, B. A., & Shen, J.-H. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980515)17:9<1033::aid-sim784>3.0.co;2-z · Cited by 793
Use of methodological standards in diagnostic test research. Getting better but still not good
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 712
Analyzing a Portion of the ROC Curve
McClish, D. K. (1989) · Medical Decision Making · doi:10.1177/0272989x8900900307 · Cited by 707
Indices of discrimination or diagnostic accuracy: Their ROCs and implied models.
Swets, J. A. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.1.100 · Cited by 582
Statistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves
McNeil, B. J., & Hanley, J. A. (1984) · Medical Decision Making · doi:10.1177/0272989x8400400203 · Cited by 556
Biases in the assessment of diagnostic tests
Begg, C. B. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060402 · Cited by 496
A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
WIEAND, S., GAIL, M. H., JAMES, B. R., & JAMES, K. L. (1989) · Biometrika · doi:10.1093/biomet/76.3.585 · Cited by 355
Statistical Comparison of Two ROC-curve Estimates Obtained from Partially-paired Datasets
Metz, C. E., Herman, B. A., & Roe, C. A. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800118 · Cited by 338
Nonparametric and semiparametric estimation of the receiver operating characteristic curve
Hsieh, F., & Turnbull, B. W. (1996) · The Annals of Statistics · doi:10.1214/aos/1033066197 · Cited by 335
A receiver operating characteristic partial area index for highly sensitive diagnostic tests.
Jiang, Y., Metz, C. E., & Nishikawa, R. M. (1996) · Radiology · doi:10.1148/radiology.201.3.8939225 · Cited by 275
Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests
Zou, K. H., Hall, W. J., & Shapiro, D. E. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971015)16:19<2143::aid-sim655>3.0.co;2-3 · Cited by 274
Self-citationA General Regression Methodology for ROC Curve Estimation
Tosteson, A. N. A., & Begg, C. B. (1988) · Medical Decision Making · doi:10.1177/0272989x8800800309 · Cited by 272
Evaluation of diagnostic tests without gold standards
Hui, S. L., & Zhou, X. H. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700404 · Cited by 252
On the statistical analysis of ROC curves
Thompson, M. L., & Zucchini, W. (1989) · Statistics in Medicine · doi:10.1002/sim.4780081011 · Cited by 225
Sample size calculations in studies of test accuracy
Obuchowski, N. A. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700405 · Cited by 221
Venkatraman, E. (1996) · Biometrika · doi:10.1093/biomet/83.4.835 · Cited by 219
Advances in statistical methodology for the evaluation of diagnostic and laboratory tests
Campbell, G. (1994) · Statistics in Medicine · doi:10.1002/sim.4780130513 · Cited by 215
Assessment of radiologic tests: control of bias and other design considerations.
Begg, C. B., & McNeil, B. J. (1988) · Radiology · doi:10.1148/radiology.167.2.3357976 · Cited by 213
The Area under the ROC Curve and Its Competitors
Hilden, J. (1991) · Medical Decision Making · doi:10.1177/0272989x9101100204 · Cited by 185
Hanley, J. A., & Hajian-Tilaki, K. O. (1997) · Academic Radiology · doi:10.1016/s1076-6332(97)80161-4 · Cited by 180
Maximum Likelihood Estimation of Parameters of Signal Detection Theory–A Direct Solution
Dorfman, D. D., & Alf, E. (1968) · Psychometrika · doi:10.1007/bf02289677 · Cited by 177
Statistical significance tests for binormal ROC curves
Metz, C. E., & Kronman, H. B. (1980) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(80)90020-6 · Cited by 175
Using Smoothed Receiver Operating Characteristic Curves to Summarize and Compare Diagnostic Systems
Lloyd, C. J. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473797 · Cited by 170
The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test
Coughlin, S. S., Trock, B., Criqui, M. H., Pickle, L. W., Browner, D., & Tefft, M. C. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90180-u · Cited by 167
Effects of dependent errors in the assessment of diagnostic test performance
Torrance-Rynard, V. L., & Walter, S. D. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971015)16:19<2157::aid-sim653>3.0.co;2-x · Cited by 159
On the use and computation of likelihood ratios in clinical chemistry.
Albert, A. (1982) · Clinical Chemistry · doi:10.1093/clinchem/28.5.1113 · Cited by 148
Hajian‐Tilaki, K., Hanley, J. A., Joseph, L., & Collet, J. (1997) · Medical Decision Making · doi:10.1177/0272989x9701700111 · Cited by 144
Multivariate Interpretation of Clinical Laboratory Data.
Sampson, A. R., Albert, A., & Harris, E. K. (1988) · Journal of the American Statistical Association · doi:10.2307/2288902 · Cited by 136
Correcting for verification bias in studies of a diagnostic test's accuracy
Zhou, X. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700403 · Cited by 134
Reid, M. C., Lane, D. A., & Feinstein, A. R. (1998) · The American Journal of Medicine · doi:10.1016/s0002-9343(98)00054-0 · Cited by 131
Receiver operator characteristic (ROC) curves and non‐normal data: An empirical study
Goddard, M., & Hinberg, I. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090315 · Cited by 121
Advances in statistical methodology for diagnostic medecine ni the 1980's
Begg, C. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101205 · Cited by 119
Receiver Operating Characteristic Studies and Measurement Errors
Coffin, M., & Sukhatme, S. (1997) · Biometrics · doi:10.2307/2533545 · Cited by 113
Assessing screening tests: extensions of McNemar’s test
Lachenbruch, P. A., & Lynch, C. J. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19981015)17:19<2207::aid-sim920>3.0.co;2-y · Cited by 110
Comparison of quantitative diagnostic tests: Type I error, power, and sample size
Línnet, K. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060207 · Cited by 97
TESTING FOR TREATMENT DIFFERENCES WITH DROPOUTS PRESENT IN CLINICAL TRIALS - A COMPOSITE APPROACH
Shih, W. J., & Quan, H. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970615)16:11<1263::aid-sim550>3.0.co;2-m · Cited by 93
The Evaluation of Diagnostic Tests
Greenhouse, S. W., & Mantel, N. (1950) · Biometrics · doi:10.2307/3001784 · Cited by 91
Mathematical tools for demonstrating the clinical usefulness of biochemical markers
Boyd, J. C. (1997) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365519709168308 · Cited by 86
Confidence Bands for Receiver Operating Characteristic Curves
Ma, G., & Hall, W. J. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300304 · Cited by 83
Distribution-Free Confidence Bounds for ROC Curves
Hilgers, R. (1991) · Methods of Information in Medicine · doi:10.1055/s-0038-1634822 · Cited by 82
A review on the methodology for assessing diagnostic tests.
Línnet, K. (1988) · Clinical Chemistry · doi:10.1093/clinchem/34.7.1379 · Cited by 78
Constructing a cut‐off point for a quantitative diagnostic test
Schäfer, H. (1989) · Statistics in Medicine · doi:10.1002/sim.4780081110 · Cited by 78
Estimating Diagnostic Test Accuracy Using a "Fuzzy Gold Standard"
Phelps, C. E., & Hutson, A. D. (1995) · Medical Decision Making · doi:10.1177/0272989x9501500108 · Cited by 73
Application of Treatment Thresholds to Diagnostic-test Evaluation
Moons, K. G. M., Stijnen, T., Michel, B. C., Buller, H. R., van Es, G., Grobbee, D. E., & Habbema, J. D. F. (1997) · Medical Decision Making · doi:10.1177/0272989x9701700410 · Cited by 66
Comparing and Optimizing Diagnostic Tests
Somoza, E. C., & Mossman, D. (1992) · Medical Decision Making · doi:10.1177/0272989x9201200303 · Cited by 64
Alternative Summary Indices for the Receiver Operating Characteristic Curve
Lee, W., & Hsiao, C. K. (1996) · Epidemiology · doi:10.1097/00001648-199611000-00007 · Cited by 62
An Exponential Model Used for optimal Threshold selection on ROC Curues
England, W. L. (1988) · Medical Decision Making · doi:10.1177/0272989x8800800208 · Cited by 62
Resampling Techniques in the Analysis of Non-binormal ROC Data
Mossman, D. (1995) · Medical Decision Making · doi:10.1177/0272989x9501500406 · Cited by 60
Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test.
De, S. (1995) · PubMed · Cited by 45
Comparing Two Diagnostic Tests against the Same "Gold Standard" in the Same Sample
Bloch, D. A. (1997) · Biometrics · doi:10.2307/2533098 · Cited by 41
Efficient confidence bounds for ROC curves
Schäfer, H. J. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131506 · Cited by 37
Analysis of clustered data in receiver operating characteristic studies
Beam, C. A. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700402 · Cited by 35
Beam, C. A., & Wieand, H. S. (1991) · Biometrics · doi:10.2307/2532648 · Cited by 26
A test for crossing receiver operating characteristic (roc) curves
Moise, A., Clement, B., & Raissis, M. (1988) · Communication in Statistics- Theory and Methods · doi:10.1080/03610928808829727 · Cited by 23
Assessing diagnostic tests by a strictly proper scoring rule
Línnet, K. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080510 · Cited by 16
Cited by
Estimation of the Youden Index and its Associated Cutoff Point
Fluss, R., Faraggi, D., & Reiser, B. (2005) · Biometrical Journal · doi:10.1002/bimj.200410135 · Cited by 2,608
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
The use of receiver operating characteristic curves in biomedical informatics
Lasko, T. A., Bhagwat, J. G., Zou, K. H., & Ohno-Machado, L. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.008 · Cited by 823
Jiménez‐Valverde, A. (2012) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2011.00683.x · Cited by 803
Bliese, P. D., Wright, K. M., Adler, A. B., Cabrera, O., Castro, C. A., & Hoge, C. W. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.272 · Cited by 733
Metadata
- Authors
- Shapiro, D. E.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 1999-04
- Volume
- 8
- Issue
- 2
- Pages
- 113-134
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2066772169
- Cited by
- 383
- References
- 67
- FWCI
- 8.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.