The choice of methods in determining the optimal cut-off value for quantitative diagnostic test evaluation
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Introduction: The choice of criteria in determining optimal cut-off value is a matter of concern in quantitative diagnostic tests. Several indexes such as Youden’s index, Euclidean index, product of sensitivity and specificity in receiver operator characteristic space and diagnostic odds ratio have been used in clinical practices but their advantages and limitations are not well understood by clinicians. This study aimed to compare these methods in determining optimal cut-off values for quantitative diagnostic test. Methods: The different configurations of binormal and bilogistic distributions with equal and unequal variances for nondiseased and diseased subjects were examined. The cut-off values with increment of 0.1 in Z-scale were varied. Then, the Youden’s index, Euclidean index, product of sensitivity and specificity, and diagnostic odds ratio were calculated over various cut-off values under distributional assumptions with confirmed parameters. Results: According to the obtained data from binormal model and equal variances, the optimal cut-off values derived from Youden’s index, Euclidean index, and product method were similar but the diagnostic odds ratio yielded either extremely low or extremely high optimal cut-off value. For bilogistic pair distributions with equal variances, the Youden’s, Euclidean indexes and product method resulted in an identical cut-off value but the diagnostic odds ratio was constant over various cut-points. By both binormal and bilogistic data with more variations in nondiseased population, the Youden’s index produced a higher sensitive optimal cut-off value; but with more variation for diseased distribution, the Euclidean index showed a more sensitive optimal cut-off. For bilogistic data with unequal variance, the log(diagnostic odds ratio) had a straight line relationship over cut-off values with either positive or negative slope. Conclusion: As a measure of association, diagnostic odds ratio cannot be informative in determining an optimal cut-off value. The advantage of receiver operator characteristic analysis to obtain the optimal cut-off value is to use Youden’s index, Euclidean index, or product index which is recommended. The choice between them depends on variability of test results in diseased and nondiseased subjects and the desired sensitivity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 2×
“The area under the curve (AUC) as a single measure of accuracy has a meaningful interpretation.(10,11) Despite the well-understood statistical property of ROC curve and the AUC, the physicians tend to determine the optimal cut-off value for quantitative diagnostic tests in clinical practices.”
BackgroundThe diagnostic odds ratio: a single indicator of test performance
Glas, A. S., Lijmer, J. G., Prins, M. H., Bonsel, G. J., & Bossuyt, P. M. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00177-x · Cited by 2,261 · cited 1×
“in equation (14): s1⁄4 1), then the log(DOR) would be constant across cut-off values.”
BackgroundGreiner, M., Pfeiffer, D., & Smith, R. D. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00115-x · Cited by 1,923
Pepe, M. S. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh101 · Cited by 1,276
Cited by
Hassanzad, M., & Hajian-Tilaki, K. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02198-2 · Cited by 208
Self-citationFoundational Considerations for Artificial Intelligence Using Ophthalmic Images
Abràmoff, M. D., Cunningham, B., Patel, B., Eydelman, M. B., Leng, T., Sakamoto, T., Blodi, B., Grenon, S. M., Wolf, R. M., Manrai, A. K., et al. (2022) · Ophthalmology · doi:10.1016/j.ophtha.2021.08.023 · Cited by 96
Vanoverschelde, L., Kelchtermans, H., Musial, J., de Laat, B., & Devreese, K. M. J. (2019) · Research and Practice in Thrombosis and Haemostasis · doi:10.1002/rth2.12207 · Cited by 33
Tulipani, L. J., Meyer, B., Allen, D., Solomon, A. J., & McGinnis, R. S. (2022) · Gait & Posture · doi:10.1016/j.gaitpost.2022.02.016 · Cited by 32
Metadata
- Authors
- Hajian-Tilaki, K.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2017-07-04
- Volume
- 27
- Issue
- 8
- Pages
- 2374-2383
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2775075663
- Cited by
- 232
- References
- 4
- FWCI
- 8.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.