The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Estimation of the Youden Index and its Associated Cutoff Point
Abstract
The Youden Index is a frequently used summary measure of the ROC (Receiver Operating Characteristic) curve. It both, measures the effectiveness of a diagnostic marker and enables the selection of an optimal threshold value (cutoff point) for the marker. In this paper we compare several estimation procedures for the Youden Index and its associated cutoff point. These are based on (1) normal assumptions; (2) transformations to normality; (3) the empirical distribution function; (4) kernel smoothing. These are compared in terms of bias and root mean square error in a large variety of scenarios by means of an extensive simulation study. We find that the empirical method which is the most commonly used has the overall worst performance. In the estimation of the Youden Index the kernel is generally the best unless the data can be well transformed to achieve normality whereas in estimation of the optimal threshold value results are more variable. (© 2005 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Greiner, M., Pfeiffer, D., & Smith, R. D. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00115-x · Cited by 1,923
Some Practical Issues of Experimental Design and Data Analysis in Radiological ROC Studies
METZ, C. E. (1989) · Investigative Radiology · doi:10.1097/00004424-198903000-00012 · Cited by 859
Introductory Statistics with R
(2002) · Statistics and Computing · doi:10.1007/b97671 · Cited by 730
Estimation of the area under the ROC curve
Faraggi, D., & Reiser, B. (2002) · Statistics in Medicine · doi:10.1002/sim.1228 · Cited by 432
Self-citationThe interpretation of diagnostic tests
Shapiro, D. E. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800203 · Cited by 383
Diagnosing Diagnoses: Receiver Operating Characteristic Methods and Psychiatry
Hsiao, J. K. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810070090014 · Cited by 268
Andrews, D. F., & Herzberg, A. M. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4612-5098-2 · Cited by 265
Knight, K. (1999) · Chapman & Hall/CRC Texts in Statistical Science · doi:10.1201/9781584888567 · Cited by 186
Receiver operator characteristic (ROC) curves and non‐normal data: An empirical study
Goddard, M., & Hinberg, I. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090315 · Cited by 121
Research works printed but not linked: 4
- 10.1186/cc1352 · doi:10.1186/cc1352
- 10.1016/S0167-7152(03)00150-0 · doi:10.1016/s0167-7152(03)00150-0
- 10.1002/ajmg.1320130107 · doi:10.1002/ajmg.1320130107
- Strike P. W.(1995).Measurement in laboratory medicine: a primer control and interpretation. Butterworth‐Heinemann Oxford.
Cited by
(2013) · Europe PMC (PubMed Central) · Cited by 2,089
Understanding diagnostic tests 3: receiver operating characteristic curves
Akobeng, A. K. (2007) · Acta Paediatrica · doi:10.1111/j.1651-2227.2006.00178.x · Cited by 1,882
A re‐examination of Montreal Cognitive Assessment (MoCA) cutoff scores
Carson, N., Leach, L., & Murphy, K. J. (2018) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4756 · Cited by 935
A Basic Guide to Real Time PCR in Microbial Diagnostics: Definitions, Parameters, and Everything
Kralik, P., & Ricchi, M. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.00108 · Cited by 927
Defining an Optimal Cut-Point Value in ROC Analysis: An Alternative Approach
Unal, I. (2017) · Computational and Mathematical Methods in Medicine · doi:10.1155/2017/3762651 · Cited by 789
Classification accuracy and cut point selection
Liu, X. (2012) · Statistics in Medicine · doi:10.1002/sim.4509 · Cited by 676
Matics, T. J., & Sanchez-Pinto, L. N. (2017) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2017.2352 · Cited by 664
Chiu, H.-Y., Chen, P.-Y., Chuang, L.-P., Chen, N.-H., Tu, Y.-K., Hsieh, Y.-J., Wang, Y.-C., & Guilleminault, C. (2017) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2016.10.004 · Cited by 650
Mitchell, A. J. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2006.10.0438 · Cited by 468
Translation of proteomic biomarkers into FDA approved cancer diagnostics: issues and challenges
Füzéry, A. K., Levin, J., Chan, M. M., & Chan, D. W. (2013) · Clinical Proteomics · doi:10.1186/1559-0275-10-13 · Cited by 428
Multidimensional Frailty Score for the Prediction of Postoperative Mortality Risk
Kim, S.-W., Han, H.-S., Jung, H.-W., Kim, K.-I., Hwang, D. W., Kang, S.-B., & Kim, C.-H. (2014) · JAMA Surgery · doi:10.1001/jamasurg.2014.241 · Cited by 416
Bihorac, A., Ozrazgat-Baslanti, T., Ebadi, A., Motaei, A., Madkour, M., Pardalos, P. M., Lipori, G., Hogan, W. R., Efron, P. A., Moore, F., et al. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000002706 · Cited by 377
Leeflang, M. M. G., Moons, K. G. M., Reitsma, J. B., & Zwinderman, A. H. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096032 · Cited by 346
Ng, B., Chu, A., & Khan, M. M. (2013) · BMJ Open · doi:10.1136/bmjopen-2012-002468 · Cited by 301
Prediction model and risk scores of ICU admission and mortality in COVID-19
Zhao, Z., Chen, A., Hou, W., Graham, J. M., Li, H., Richman, P. S., Thode, H. C., Singer, A. J., & Duong, T. Q. (2020) · PLOS ONE · doi:10.1371/journal.pone.0236618 · Cited by 301
Diagnostic Validity of the Generalized Anxiety Disorder - 7 (GAD-7) among Pregnant Women
Zhong, Q.-Y., Gelaye, B., Zaslavsky, A. M., Fann, J. R., Rondon, M. B., Sánchez, S. E., & Williams, M. A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0125096 · Cited by 297
Choi, J. Y., Yoo, T. K., Seo, J. G., Kwak, J., Um, T. T., & Rim, T. H. (2017) · PLOS ONE · doi:10.1371/journal.pone.0187336 · Cited by 282
Zhang, Z., Wang, Z.-X., Chen, Y.-X., Wu, H.-X., Yin, L., Zhao, Q., Luo, H.-Y., Zeng, Z.-L., Qiu, M.-Z., & Xu, R.-H. (2022) · Genome Medicine · doi:10.1186/s13073-022-01050-w · Cited by 273
McPherson, A. L., Feller, J. A., Hewett, T. E., & Webster, K. E. (2019) · The American Journal of Sports Medicine · doi:10.1177/0363546518825258 · Cited by 269
Gómez-Valverde, J. J., Antón, A., Fatti, G., Liefers, B., Herranz, A., Santos, A., Sánchez, C. I., & Ledesma-Carbayo, M. J. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.000892 · Cited by 265
Cao, R., Yang, F., Ma, S.-C., Liu, L., Zhao, Y., Li, Y., Wu, D.-H., Wang, T., Lu, W.-J., Cai, W.-J., et al. (2020) · Theranostics · doi:10.7150/thno.49864 · Cited by 261
Serum ferritin as an indicator of iron status: What do we need to know?
Daru, J., Colman, K., Stanworth, S. J., De La Salle, B., Wood, E. M., & Pasricha, S.-R. (2017) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.117.155960 · Cited by 246
Ye, Z. J., Qiu, H. Z., Li, P. F., Chen, P., Liang, M. Z., Liu, M. L., Yu, Y. L., Wang, S. N., & Quan, X. M. (2017) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2017.01.004 · Cited by 225
Lee, P.-C., Wu, C.-J., Hung, Y.-W., Lee, C. J., Chi, C.-T., Lee, I.-C., Yu-Lun, K., Chou, S.-H., Luo, J.-C., Hou, M.-C., et al. (2022) · Journal for ImmunoTherapy of Cancer · doi:10.1136/jitc-2022-004779 · Cited by 217
Esser, P., Hartung, T. J., Friedrich, M., Johansen, C., Wittchen, H., Faller, H., Koch, U., Härter, M., Keller, M., Schulz, H., et al. (2018) · Psycho-Oncology · doi:10.1002/pon.4681 · Cited by 185
Guo, F., Moellering, D. R., & Garvey, W. T. (2014) · Metabolic Syndrome and Related Disorders · doi:10.1089/met.2013.0128 · Cited by 139
Comparing the Areas Under Two Correlated ROC Curves: Parametric and Non‐Parametric Approaches
Molodianovitch, K., Faraggi, D., & Reiser, B. (2006) · Biometrical Journal · doi:10.1002/bimj.200610223 · Cited by 131
Self-citationRisk factors associated with mortality at a milk-fed veal calf facility: A prospective cohort study
Renaud, D. L., Duffield, T. F., LeBlanc, S. J., Ferguson, S., Haley, D. B., & Kelton, D. F. (2018) · Journal of Dairy Science · doi:10.3168/jds.2017-13581 · Cited by 118
Validity of the posttraumatic stress disorders (PTSD) checklist in pregnant women
Gelaye, B., Zheng, Y., Medina-Mora, M. E., Rondon, M. B., Sánchez, S. E., & Williams, M. A. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1304-4 · Cited by 114
A multi-analyte assay for the non-invasive detection of bladder cancer
Goodison, S., Chang, M., Dai, Y., Urquidi, V., & Rosser, C. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047469 · Cited by 109
Expression of the iron hormone hepcidin distinguishes different types of anemia in African children
Pasricha, S.-R., Atkinson, S. H., Armitage, A. E., Khandwala, S., Veenemans, J., Cox, S. E., Eddowes, L. A., Hayes, T., Doherty, C. P., Demir, A. Y., et al. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008249 · Cited by 108
Lindberg, D. S., Prosperi, M., Bjarnadottir, R. I., Thomas, J., Crane, M., Chen, Z., Shear, K., Solberg, L. M., Snigurska, U. A., Wu, Y., et al. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104272 · Cited by 95
Statistical Shape Modeling of the Left Ventricle: Myocardial Infarct Classification Challenge
Suinesiaputra, A., Dhooge, J., Duchateau, N., Ehrhardt, J., Frangi, A. F., Gooya, A., Grau, V., Lekadir, K., Lu, A., Mukhopadhyay, A., et al. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2652449 · Cited by 95
Genital hiatus size is associated with and predictive of apical vaginal support loss
Lowder, J. L., Oliphant, S. S., Shepherd, J. P., Ghetti, C., & Sutkin, G. (2016) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2015.12.027 · Cited by 83
Prognostication and risk factors for cystic fibrosis via automated machine learning
Alaa, A. M., & van der Schaar, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29523-2 · Cited by 80
Early PREdiction of sepsis using leukocyte surface biomarkers: the ExPRES-sepsis cohort study
Shankar-Hari, M., Datta, D., Wilson, J., Assi, V., Stephen, J., Weir, C. J., Rennie, J., Antonelli, J., Bateman, A., Felton, J. M., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5389-0 · Cited by 74
Wilson, E. J., Stapinski, L., Dueber, D. M., Rapee, R. M., Burton, A. L., & Abbott, M. J. (2020) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2020.102309 · Cited by 71
Renaud, D. L., Duffield, T. F., LeBlanc, S. J., Haley, D. B., & Kelton, D. F. (2018) · Journal of Dairy Science · doi:10.3168/jds.2017-14042 · Cited by 70
Screening for low energy availability in male athletes: attempted validation of LEAM-Q
Lundy, B., Torstveit, M. K., Stenqvist, T. B., Burke, L. M., Garthe, I., Slater, G. J., Ritz, C., & Melin, A. K. (2022) · Nutrients · doi:10.3390/nu14091873 · Cited by 70
Guo, J., Chen, S., Chen, Y., Li, S., & Xu, D. (2018) · Cancer Management and Research · doi:10.2147/cmar.s156071 · Cited by 54
Freeman, L. M., Michel, K. E., Zanghi, B. M., Vester Boler, B. M., & Fages, J. (2019) · American Journal of Veterinary Research · doi:10.2460/ajvr.80.6.595 · Cited by 53
Scott, K., Kelton, D. F., Duffield, T. F., & Renaud, D. L. (2019) · Journal of Dairy Science · doi:10.3168/jds.2019-16829 · Cited by 52
A Single-Item Visual Analogue Scale (VAS) Measure for Assessing Depression among College Students
Huang, Z., Kohler, I. V., & Kämpfen, F. (2020) · Community Mental Health Journal · doi:10.1007/s10597-019-00469-7 · Cited by 51
Patkar, S., Chen, A., Basnet, A., Bixby, A., Rajendran, R., Chernet, R., Faso, S., Kumar, P. A., Desai, D., El-Zammar, O., et al. (2024) · npj Precision Oncology · doi:10.1038/s41698-024-00765-w · Cited by 41
A diagnostic questionnaire for childbirth related posttraumatic stress disorder: a validation study
Arora, I. H., Woscoboinik, G. G., Mokhtar, S., Quagliarini, B., Bartal, A., Jagodnik, K. M., Barry, R. L., Edlow, A. G., Orr, S. P., & Dekel, S. (2024) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.11.1229 · Cited by 32
Nunez do Rio, J. M., Nderitu, P., Raman, R., Rajalakshmi, R., Kim, R., Rani, P. K., Sivaprasad, S., Bergeles, C., for the SMART India Study Group, Raman, R., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-28347-z · Cited by 31
Jung, J., Nitzsche, A., Neumann, M., Wirtz, M., Kowalski, C., Wasem, J., Stieler-Lorenz, B., & Pfaff, H. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-550 · Cited by 29
AI Advances in ICU with an Emphasis on Sepsis Prediction: An Overview
Stylianides, C., Nicolaou, A., Sulaiman, W. A., Alexandropoulou, C.-A., Panagiotopoulos, I., Karathanasopoulou, K., Dimitrakopoulos, G., Kleanthous, S., Politi, E., Ntalaperas, D., et al. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7010006 · Cited by 28
Landsheer, J. A. (2018) · Diagnostics · doi:10.3390/diagnostics8020032 · Cited by 27
Schiefenhövel, F., Trauzeddel, R. F., Sander, M., Heringlake, M., Groesdonk, H. V., Grubitzsch, H., Kruppa, J., Berger, C., Treskatsch, S., & Balzer, F. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10173945 · Cited by 19
Yang, L., Gabriel, N., Hernandez, I., Winterstein, A. G., & Guo, J. (2021) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5206 · Cited by 17
Deep learning improves utility of tau PET in the study of Alzheimer's disease
Zou, J., Park, D., Johnson, A., Feng, X., Pardo, M., France, J., Tomljanovic, Z., Brickman, A. M., Devanand, D. P., Luchsinger, J. A., et al. (2021) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12264 · Cited by 15
Erol, S. A., Tanacan, A., Firat Oguz, E., Anuk, A. T., Goncu Ayhan, S., Neselioglu, S., & Sahin, D. (2021) · Congenital Anomalies · doi:10.1111/cga.12432 · Cited by 12
“PCSK9 levels in predicting fetal open NTDs, receiver operating characteristic (ROC) curve analysis was applied and the cut-off values were calculated according to the Youden index.(23) The level of statistical significance was set as a two-tailed p value <0.”
MethodBAT and MAT for diagnosis of peanut allergy: A systematic review and meta‐analysis
Piletta‐Zanin, A., Ricci, C., Santos, A. F., & Eigenmann, P. A. (2024) · Pediatric Allergy and Immunology · doi:10.1111/pai.14140 · Cited by 11
Tumminia, A., Santoro, G. M., Oteri, V., Galeano, F., Baratta, R., Gullo, D., Frittitta, L., Sciacca, L., Moli, R. L., Piticchio, T., et al. (2025) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2025.112173 · Cited by 9
Kishikawa, R., Kodera, S., Setoguchi, N., Tanabe, K., Kushida, S., Nanasato, M., Maki, H., Fujita, H., Kato, N., Watanabe, H., et al. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae097 · Cited by 8
Eilifsen, T. N., Shrestha, B., & Bours, P. (2023) · 2023 21st International Conference on Emerging eLearning Technologies and Applications (ICETA) · doi:10.1109/iceta61311.2023.10343952 · Cited by 3
Detecting Data Contamination from Reinforcement Learning Post-training for Large Language Models
Tao, Y., Wang, T., Dong, Y., Liu, H., Zhang, K., Hu, X., & Li, G. (2025) · arXiv · doi:10.48550/arxiv.2510.09259 · Cited by 1
“We also report the F1 score at the Youden threshold (Fluss et al., 2005) as a threshold-specific reference.”
Metadata
- Authors
- Fluss, R., Faraggi, D., & Reiser, B.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2005-08
- Volume
- 47
- Issue
- 4
- Pages
- 458-472
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2150780222
- Cited by
- 2,608
- References
- 17
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.