Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 239

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

The partial area under the summary ROC curve

Walter, S. D. · 2005 · Statistics in Medicine

Abstract

The area under the curve (AUC) is commonly used as a summary measure of the receiver operating characteristic (ROC) curve. It indicates the overall performance of a diagnostic test in terms of its accuracy at various diagnostic thresholds used to discriminate cases and non-cases of disease. The AUC measure is also used in meta-analyses, where each component study provides an estimate of the test sensitivity and specificity. These estimates are then combined to calculate a summary ROC (SROC) curve which describes the relationship between-test sensitivity and specificity across studies. The partial AUC has been proposed as an alternative measure to the full AUC. When using the partial AUC, one considers only those regions of the ROC space where data have been observed, or which correspond to clinically relevant values of test sensitivity or specificity. In this paper, we extend the idea of using the partial AUC to SROC curves in meta-analysis. Theoretical and numerical results describe the variation in the partial AUC and its standard error as a function of the degree of inter-study heterogeneity and of the extent of truncation applied to the ROC space. A scaled partial area measure is also proposed to restore the property that the summary measure should range from 0 to 1. The results suggest several disadvantages of the partial AUC measures. In contrast to earlier findings with the full AUC, the partial AUC is rather sensitive to heterogeneity. Comparisons between tests are more difficult, especially if an empirical truncation process is used. Finally, the partial area lacks a useful symmetry property enjoyed by the full AUC. Although the partial AUC may sometimes have clinical appeal, on balance the use of the full AUC is preferred.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/sim.2103

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 23

  1. Hanley, 1998, Encyclopedia of Biostatistics, 3738
  2. Irwig, 1993, Journal of Clinical Epidemiology, 48, 119, 10.1016/0895-4356(94)00099-C · DOI · Paper page
  3. Irwig, 1994, Annals of Internal Medicine, 120, 667, 10.7326/0003-4819-120-8-199404150-00008 · DOI · Paper page
  4. Reid, 1995, Journal of American Medical Association, 274, 645, 10.1001/jama.1995.03530080061042 · doi:10.1001/jama.1995.03530080061042 · Paper page
  5. Walter, 1999, Statistics in Medicine, 18, 3409, 10.1002/(SICI)1097-0258(19991230)18:24<3409::AID-SIM377>3.0.CO;2-8 · DOI
  6. Hanley, 1982, Radiology, 143, 29, 10.1148/radiology.143.1.7063747 · DOI · Paper page
  7. Hilden, 1991, Medical Decision Making, 11, 95, 10.1177/0272989X9101100204 · DOI · Paper page
  8. Walter, 2002, Statistics in Medicine, 21, 1237, 10.1002/sim.1099 · DOI · Paper page
  9. Dodd, 2003, Biometrics, 59, 614, 10.1111/1541-0420.00071 · DOI · Paper page
  10. Dodd, 2003, Journal of American Medical Association, 98, 409, 10.1198/016214503000198 · DOI
  11. Baker, 2001, Journal of American Medical Association, 96, 421, 10.1198/016214501753168136 · DOI
  12. Moses, 1993, Statistics in Medicine, 12, 1293, 10.1002/sim.4780121403 · DOI · Paper page
  13. Bamber, 1975, Journal of Mathematical Psychology, 12, 387, 10.1016/0022-2496(75)90001-2 · DOI · Paper page
  14. Scheidler, 1997, Journal of American Medical Association, 278, 1096, 10.1001/jama.1997.03550130070040 · DOI · Paper page
  15. Fahey, 1995, American Journal of Epidemiology, 141, 680, 10.1093/oxfordjournals.aje.a117485 · DOI · Paper page
  16. McClish, 1989, Medical Decision Making, 9, 190, 10.1177/0272989X8900900307 · DOI · Paper page
  17. Thompson, 1989, Statistics in Medicine, 8, 1277, 10.1002/sim.4780081011 · DOI · Paper page
  18. Statistical Evaluation of Medical Tests for Classification and Prediction. Oxford University Press: Oxford, 2003. · DOI · Paper page
  19. Statistical Methods in Diagnostic Medicine. Wiley: New York, 2002. · DOI · Paper page
  20. Bucher, 1997, Journal of Clinical Epidemiology, 50, 683, 10.1016/S0895-4356(97)00049-8 · DOI · Paper page
  21. Psaty, 2003, Journal of American Medical Association, 289, 2534, 10.1001/jama.289.19.2534 · DOI · Paper page
  22. Jiang, 1996, Radiology, 201, 745, 10.1148/radiology.201.3.8939225 · DOI · Paper page
  23. Rutter, 1995, Academic Radiology, 2, s48

Cited by

See all 239

Metadata

Authors
Walter, S. D.
Venue
Statistics in Medicine
Publisher
Wiley
Published
2005
Volume
24
Issue
13
Pages
2025-2040
ISSN
  • 0277-6715 (ISSN-L)
  • 1097-0258
OpenAlex
W2130728435
Cited by
239
References
3
FWCI
7.00
Type
journal article
Language
en
Open access
closed
Licence
doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 3895 d)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.