The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Receiver operating characteristic curve: overview and practical use for clinicians
Open accessAbstract
Using diagnostic testing to determine the presence or absence of a disease is essential in clinical practice. In many cases, test results are obtained as continuous values and require a process of conversion and interpretation and into a dichotomous form to determine the presence of a disease. The primary method used for this process is the receiver operating characteristic (ROC) curve. The ROC curve is used to assess the overall diagnostic performance of a test and to compare the performance of two or more diagnostic tests. It is also used to select an optimal cut-off value for determining the presence or absence of a disease. Although clinicians who do not have expertise in statistics do not need to understand both the complex mathematical equation and the analytic process of ROC curves, understanding the core concepts of the ROC curve analysis is a prerequisite for the proper use and interpretation of the ROC curve. This review describes the basic concepts for the correct use and interpretation of the ROC curve, including parametric/nonparametric ROC curves, the meaning of the area under the ROC curve (AUC), the partial AUC, methods for selecting the best cut-off value, and the statistical software to use for ROC curve analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 2×
“5 for the null hypothesis), the significance level (α), power (1 – β), and the ratio of negative/positive results should be considered [16].”
BackgroundMethodpROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,026
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
(2013) · Europe PMC (PubMed Central) · Cited by 2,089
Understanding diagnostic tests 3: receiver operating characteristic curves
Akobeng, A. K. (2007) · Acta Paediatrica · doi:10.1111/j.1651-2227.2006.00178.x · Cited by 1,882 · cited 2×
“Therefore, the distance between the coordinates (0, 1) and the ROC curve should be minimized [25,26].”
BackgroundROC Methodology in Radiologic Imaging
METZ, C. E. (1986) · Investigative Radiology · doi:10.1097/00004424-198609000-00009 · Cited by 1,642
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
A decision-making theory of visual detection.
Tanner, W. P., & Swets, J. A. (1954) · Psychological Review · doi:10.1037/h0058700 · Cited by 1,317
Receiver Operating Characteristic Curves and Their Use in Radiology
Obuchowski, N. A. (2003) · Radiology · doi:10.1148/radiol.2291010898 · Cited by 843
Defining an Optimal Cut-Point Value in ROC Analysis: An Alternative Approach
Unal, I. (2017) · Computational and Mathematical Methods in Medicine · doi:10.1155/2017/3762651 · Cited by 789
OptimalCutpoints: An R Package for Selecting Optimal Cutpoints in Diagnostic Tests
López-Ratón, M., Rodríguez-Álvarez, M. X., Suárez, C. C., & Sampedro, F. G. (2014) · Journal of Statistical Software · doi:10.18637/jss.v061.i08 · Cited by 548
plotROC: A Tool for Plotting ROC Curves
Sachs, M. C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v079.c02 · Cited by 384
easyROC: An Interactive Web-tool for ROC Curve Analysis Using R Language Environment
Goksuluk, D., Korkmaz, S., Zararsiz, G., & Karaagaoglu, A. (2016) · The R Journal · doi:10.32614/rj-2016-042 · Cited by 377
Obuchowski (2005) · doi:10.2214/ajr.184.2.01840364 · Cited by 321
Lusted, L. B. (1971) · Science · doi:10.1126/science.171.3977.1217 · Cited by 304
A receiver operating characteristic partial area index for highly sensitive diagnostic tests.
Jiang, Y., Metz, C. E., & Nishikawa, R. M. (1996) · Radiology · doi:10.1148/radiology.201.3.8939225 · Cited by 275
Muller, M. P., Tomlinson, G., Marrie, T. J., Tang, P., McGeer, A., Low, D. E., Detsky, A. S., & Gold, W. L. (2005) · Clinical Infectious Diseases · doi:10.1086/428577 · Cited by 195
ROC analysis: applications to the classification of biological sequences and 3D structures
Sonego, P., Kocsor, A., & Pongor, S. (2008) · Briefings in Bioinformatics · doi:10.1093/bib/bbm064 · Cited by 149
How Well Can Physicians Estimate Mortality in a Medical Intensive Care Unit?
McClish, D. K., & Powell, S. H. (1989) · Medical Decision Making · doi:10.1177/0272989x8900900207 · Cited by 136
Greiner, M. (1996) · Journal of Immunological Methods · doi:10.1016/0022-1759(96)00013-0 · Cited by 135
Habibzadeh, F., & Yadollahie, M. (2012) · Epidemiology · doi:10.1097/ede.0b013e31827825f2 · Cited by 86
Sui, Y., Lu, K., & Fu, L. N. (2021) · PeerJ · doi:10.7717/peerj.11272 · Cited by 37
Hobden, B., Schwandt, M. L., Carey, M. L., Lee, M. R., Farokhnia, M., Bouhlal, S., Oldmeadow, C. J., & Leggio, L. (2017) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13400 · Cited by 15
(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Cited by
Çorbacıoğlu, Ş. K., & Aksel, G. (2023) · Turkish Journal of Emergency Medicine · doi:10.4103/tjem.tjem_182_23 · Cited by 799
Hassanzad, M., & Hajian-Tilaki, K. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02198-2 · Cited by 208
A diagnostic questionnaire for childbirth related posttraumatic stress disorder: a validation study
Arora, I. H., Woscoboinik, G. G., Mokhtar, S., Quagliarini, B., Bartal, A., Jagodnik, K. M., Barry, R. L., Edlow, A. G., Orr, S. P., & Dekel, S. (2024) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.11.1229 · Cited by 32
Nursing workload: use of artificial intelligence to develop a classifier model
Rosa, N. G. D., Vaz, T. A., & Lucena, A. D. F. (2024) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.7131.4239 · Cited by 13
Mendoza, A., Tume, S., Puri, K., Acosta, S., & Cavallaro, J. R. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3510217 · Cited by 4
Metadata
- Authors
- Nahm, F. S.
- Venue
- Korean Journal of Anesthesiology
- Published
- 2022-02-01
- Volume
- 75
- Issue
- 1
- Pages
- 25-36
- ISSN
- 0302-5780 (ISSN-L)
- 2005-6419
- 2005-7563
- OpenAlex
- W4205134630
- Cited by
- 1,484
- References
- 28
- FWCI
- 209.35
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.