The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Three-way ROCs
Abstract
Receiver operating characteristic (ROC) analysis traditionally has dealt with dichoto mous diagnostic tasks (e.g., determining whether a disorder is present or absent). Often, however, medical problems involve distinguishing among more than two diag nostic alternatives. This article extends ROC concepts to diagnostic enterprises with three possible outcomes. For a trichotomous decision task, one can plot a ROC surface on three-dimensional coordinates; the volume under the ROC surface (VUS) equals the probability that test values will allow a decision maker to correctly sort a trio of items containing a randomly-selected member from each of three populations. Thus, the VUS summarizes global diagnostic accuracy for trichotomous tests, just as the area under a ROC curve does for a two-alternative diagnostic task. Information gain at points on the surface can be calculated just as is done for two-dimensional ROC curves, and investigators can thus compare three-way ROCs by comparing maximum information gain on each ROC surface. Key words: receiver operating characteristic, ROC, three-way ROC, three-alternative decision task, resampling, bootstrap, infor mation. (Med Decis Making 1999;19:78-89)
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
The Structured Clinical Interview for DSM-III-R (SCID): I: History, Rationale, and Description
Spitzer, R. L. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080032005 · Cited by 4,336
Regier, D. A. (1990) · JAMA · doi:10.1001/jama.1990.03450190043026 · Cited by 3,962
Dorfman, D. D., & Alf, E. (1969) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(69)90019-4 · Cited by 874
Nonparametric Analysis of Clustered ROC Curve Data
Obuchowski, N. A. (1997) · Biometrics · doi:10.2307/2533958 · Cited by 429
The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves
Hanley, J. A. (1988) · Medical Decision Making · doi:10.1177/0272989x8800800308 · Cited by 309
Metz, C. E., Goodenough, D. J., & Rossmann, K. (1973) · Radiology · doi:10.1148/109.2.297 · Cited by 218
Cited by
A Survey of Predictive Modeling on Imbalanced Domains
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · ACM Computing Surveys · doi:10.1145/2907070 · Cited by 1,129
Statnikov, A., Aliferis, C. F., Tsamardinos, I., Hardin, D., & Levy, S. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti033 · Cited by 839
The use of receiver operating characteristic curves in biomedical informatics
Lasko, T. A., Bhagwat, J. G., Zou, K. H., & Ohno-Machado, L. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.008 · Cited by 823
Sun, X., & Xu, W. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2337313 · Cited by 630
Obuchowski, N. A., & Bullen, J. A. (2018) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aab4b1 · Cited by 542
Metadata
- Authors
- Mossman, D.
- Venue
- Medical Decision Making
- Publisher
- SAGE Publications
- Published
- 1999-01
- Volume
- 19
- Issue
- 1
- Pages
- 78-89
- ISSN
- 0272-989X (ISSN-L)
- 1552-681X
- OpenAlex
- W2048537487
- Cited by
- 302
- References
- 20
- FWCI
- 3.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Three-way ROCs. https://app.cochat.ai/papers/10.1177/0272989x9901900110
- The paper
- Mossman, D. (1999). Three-way ROCs. Medical Decision Making. https://doi.org/10.1177/0272989x9901900110
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.