Limitations of the Odds Ratio in Gauging the Performance of a Diagnostic, Prognostic, or Screening Marker
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
A marker strongly associated with outcome (or disease) is often assumed to be effective for classifying persons according to their current or future outcome. However, for this assumption to be true, the associated odds ratio must be of a magnitude rarely seen in epidemiologic studies. In this paper, an illustration of the relation between odds ratios and receiver operating characteristic curves shows, for example, that a marker with an odds ratio of as high as 3 is in fact a very poor classification tool. If a marker identifies 10% of controls as positive (false positives) and has an odds ratio of 3, then it will correctly identify only 25% of cases as positive (true positives). The authors illustrate that a single measure of association such as an odds ratio does not meaningfully describe a marker's ability to classify subjects. Appropriate statistical methods for assessing and reporting the classification power of a marker are described. In addition, the serious pitfalls of using more traditional methods based on parameters in logistic regression models are illustrated.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, for diagnostic, prognostic, or screening markers in epidemiologic studies, the limited magnitude of the OR considered meaningful (i.e., about or >70) is rarely discussed (36).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [36]
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 1×
“Examples include the Framingham risk score for cardiovascular events (2) and the Gail model risk score for breast cancer (3).”
BackgroundA Gene-Expression Signature as a Predictor of Survival in Breast Cancer
van de Vijver, M. J., He, Y. D., van 't Veer, L. J., Dai, H., Hart, A. A. M., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa021967 · Cited by 6,488
Ridker, P. M., Hennekens, C. H., Buring, J. E., & Rifai, N. (2000) · New England Journal of Medicine · doi:10.1056/nejm200003233421202 · Cited by 5,850 · cited 1×
“Examples from other popular journals are Ridker et al. ( 11 ), Zhang et al. (12), Liou et al. (13), and Hogue et al. (14).”
BackgroundGail, M. H., Brinton, L. A., Byar, D. P., Corle, D. K., Green, S. B., Schairer, C., & Mulvihill, J. J. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.24.1879 · Cited by 3,334
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
Self-citationCarney, P. A., Miglioretti, D. L., Yankaskas, B. C., Kerlikowske, K., Rosenberg, R., Rutter, C. M., Geller, B. M., Abraham, L. A., Taplin, S. H., Dignan, M., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-3-200302040-00008 · Cited by 1,142
Association Between Myeloperoxidase Levels and Risk of Coronary Artery Disease
Zhang, R. (2001) · JAMA · doi:10.1001/jama.286.17.2136 · Cited by 918
Loss of IGF2 Imprinting: A Potential Marker of Colorectal Cancer Risk
Cui, H., Cruz-Correa, M., Giardiello, F. M., Hutcheon, D. F., Kafonek, D. R., Brandenburg, S., Wu, Y., He, X., Powe, N. R., & Feinberg, A. P. (2003) · Science · doi:10.1126/science.1080902 · Cited by 735
A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
WIEAND, S., GAIL, M. H., JAMES, B. R., & JAMES, K. L. (1989) · Biometrika · doi:10.1093/biomet/76.3.585 · Cited by 355
Cited by
Items 301–400 of 1,000
Iranmanesh, S. M., & Guo, N. L. (2014) · Cancer Informatics · doi:10.4137/cin.s14055 · Cited by 69
Zhou, Q. M., Zhe, L., Brooke, R. J., Hudson, M. M., & Yuan, Y. (2021) · Diagnostic and Prognostic Research · doi:10.1186/s41512-021-00102-w · Cited by 73
Amarasinghe, H. K., Johnson, N. W., Lalloo, R., Kumaraarachchi, M., & Warnakulasuriya, S. (2010) · British Journal of Cancer · doi:10.1038/sj.bjc.6605778 · Cited by 72
A boosting method for maximizing the partial area under the ROC curve
Komori, O., & Eguchi, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-314 · Cited by 72
Yarwood, A., Han, B., Raychaudhuri, S., Bowes, J., Lunt, M., Pappas, D. A., Kremer, J. M., Greenberg, J. D., Plenge, R. M., Worthington, J., et al. (2013) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2013-204133 · Cited by 73
Mitchell, D. G., Snyder, B. S., Coakley, F. V., Reinhold, C., Thomas, G., Amendola, M. A., Schwartz, L. H., Woodward, P. J., Pannu, H. K., Atri, M., et al. (2008) · Gynecologic Oncology · doi:10.1016/j.ygyno.2008.10.005 · Cited by 72
Javaid, M. K., Kiran, A., Guermazi, A., Kwoh, C. K., Zaïm, S., Carbone, L. D., Harris, T. B., McCulloch, C. E., Arden, N., Lane, N. E., et al. (2012) · Arthritis & Rheumatism · doi:10.1002/art.34594 · Cited by 71
Enhanced formation of advanced oxidation protein products in IBD
Krzystek‐Korpacka, M., Neubauer, K., Berdowska, I., Boehm, D., Zieliński, B., Petryszyn, P. W., Terlecki, G., Paradowski, L., & Gamian, A. (2008) · Inflammatory Bowel Diseases · doi:10.1002/ibd.20383 · Cited by 71
Improving the Accuracy of a Direct Route Screening Process
Johnson, E. S., Jenkins, J. R., & Petscher, Y. (2010) · Assessment for Effective Intervention · doi:10.1177/1534508409348375 · Cited by 71
Impact of diabetes/metabolic syndrome in patients with established cardiovascular disease
Stern, M. P., Williams, K., & Hunt, K. J. (2005) · Atherosclerosis Supplements · doi:10.1016/j.atherosclerosissup.2005.02.002 · Cited by 71
Predicting the risk of coronary heart disease
Dent, T. H. S. (2010) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2010.06.019 · Cited by 70
Lindström, S., Schumacher, F. R., Cox, D. G., Travis, R. C., Albanes, D., Allen, N. E., Andriole, G. L., Berndt, S. I., Boeing, H., Bueno-de-Mesquita, H. B., et al. (2012) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-11-1038 · Cited by 70
Wemrell, M., Merlo, J., Mulinari, S., & Hornborg, A. (2016) · Sociology Compass · doi:10.1111/soc4.12345 · Cited by 56
Matsushita, K., Kwak, L., Yang, C., Pang, Y., Ballew, S. H., Sang, Y., Hoogeveen, R. C., Jaar, B. G., Selvin, E., Ballantyne, C. M., et al. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy106 · Cited by 70
New cardiovascular risk factors exist, but are they clinically useful?
Wang, T. J. (2008) · European Heart Journal · doi:10.1093/eurheartj/ehm644 · Cited by 58
Diouf, M., Filleron, T., Barbare, J., Fin, L., Picard, C., Bouché, O., Dahan, L., Paolettí, X., & Bonnetain, F. (2012) · Journal of Hepatology · doi:10.1016/j.jhep.2012.11.019 · Cited by 69
Fan, V. S., Ramsey, S. D., Make, B. J., & Martínez, F. J. (2007) · COPD Journal of Chronic Obstructive Pulmonary Disease · doi:10.1080/15412550601169430 · Cited by 69
Logistic regression and other statistical tools in diagnostic biomarker studies
Elkahwagy, D. M. A. S., Kiriacos, C. J., & Mansour, M. (2024) · Clinical & Translational Oncology · doi:10.1007/s12094-024-03413-8 · Cited by 68
Screening for chronic kidney disease: which strategy?
Hallan, S. I., & Stevens, P. E. (2010) · Journal of Nephrology · doi:10.1093/joneph/23.2.147 · Cited by 68
Meneton, P., Galan, P., Bertrais, S., Heudes, D., Herçberg, S., & Ménard, J. (2008) · Journal of Human Hypertension · doi:10.1038/jhh.2008.27 · Cited by 68
Overview of Risk Prediction Models in Cardiovascular Disease Research
Cui, J. S. (2009) · Annals of Epidemiology · doi:10.1016/j.annepidem.2009.05.005 · Cited by 68
Graphical presentation of diagnostic information
Whiting, P. F., Sterne, J. A. C., Westwood, M. E., Bachmann, L. M., Harbord, R. M., Egger, M., & Deeks, J. J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-20 · Cited by 68
Red Blood Cell Fatty Acid Patterns and Acute Coronary Syndrome
Shearer, G. C., Pottala, J. V., Spertus, J. A., & Harris, W. S. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005444 · Cited by 68
Key Concepts and Limitations of Statistical Methods for Evaluating Biomarkers of Kidney Disease
Parikh, C. R., & Thiessen‐Philbrook, H. (2014) · Journal of the American Society of Nephrology · doi:10.1681/asn.2013121300 · Cited by 68
Commentary: The Limits of Risk Factors Revisited Is It Time for a Causal Architecture Approach?
Keyes, K. M., & Galea, S. (2017) · Epidemiology · doi:10.1097/ede.0000000000000578 · Cited by 62
Pregnancy-associated plasma protein-A (PAPP-A) and cardiovascular risk
Consuegra‐Sánchez, L., Fredericks, S., & Kaski, J. C. (2008) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2008.07.042 · Cited by 68
Standardizing Diagnostic Markers to Evaluate and Compare Their Performance
PEPE, M. S., & Longton, G. (2005) · Epidemiology · doi:10.1097/01.ede.0000173041.03470.8b · Cited by 67
Self-citationGiugliano, G., Brevetti, G., Lanero, S., Schiano, V., Laurenzano, E., & Chiariello, M. (2009) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2009.11.009 · Cited by 65
Robin, X., Turck, N., Hainard, A., Lisacek, F., Sanchez, J.-C., & Müller, M. (2009) · Expert Review of Proteomics · doi:10.1586/epr.09.83 · Cited by 59
Wang, Y., Koh, W., Talaei, M., Yuan, J., & Pan, A. (2016) · Journal of Diabetes · doi:10.1111/1753-0407.12477 · Cited by 65
Wu, H.-C., Yang, H., Wang, Q., Chen, C., & Santella, R. M. (2017) · Carcinogenesis · doi:10.1093/carcin/bgx078 · Cited by 65
Oncologic Imaging and Radiomics: A Walkthrough Review of Methodological Challenges
Stanzione, A., Cuocolo, R., Ugga, L., Verde, F., Romeo, V., Brunetti, A., & Maurea, S. (2022) · Cancers · doi:10.3390/cancers14194871 · Cited by 64
Training, Wellbeing and Recovery Load Monitoring in Female Youth Athletes
Temm, D. A., Standing, R. J., & Best, R. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191811463 · Cited by 64
Elevated HbA1c and Fasting Plasma Glucose in Predicting Diabetes Incidence Among Older Adults
Lipska, K. J., Inzucchi, S. E., Ness, P. H. V., Gill, T. M., Kanaya, A. M., Strotmeyer, E. S., Koster, A., Johnson, K., Goodpaster, B. H., Harris, T. B., et al. (2013) · Diabetes Care · doi:10.2337/dc12-2631 · Cited by 64
den Broeck, T. V., Joniau, S., Clinckemalie, L., Helsen, C., Preković, S., Spans, L., Tosco, L., Poppel, H. V., & Claessens, F. (2014) · BioMed Research International · doi:10.1155/2014/627510 · Cited by 64
Added predictive value of high-throughput molecular data to clinical data and its validation
Boulesteix, A., & Sauerbrei, W. (2011) · Briefings in Bioinformatics · doi:10.1093/bib/bbq085 · Cited by 64
Davis, J. L., Worodria, W. O., Kisembo, H. N., Metcalfe, J. Z., Cattamanchi, A., Kawooya, M. G., Kyeyune, R. B., den Boon, S., Powell, K., Okello, R., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009859 · Cited by 63
Beetz, I., Schilstra, C., van Luijk, P., Christianen, M. E. M. C., Doornaert, P., Bijl, H. P., Chouvalova, O., van den Heuvel, E. R., Steenbakkers, R. J. H. M., & Langendijk, J. A. (2011) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2011.11.006 · Cited by 63
Prediction of Bone Mineral Density and Fragility Fracture by Genetic Profiling
Ho-Le, T. P., Eisman, J. A., Nguyen, H. T., & Nguyen, T. V. (2016) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2998 · Cited by 63
Young Maternal Age and Poor Child Development: Predictive Validity From a Birth Cohort
Chittleborough, C., Lawlor, D. A., & Lynch, J. W. (2011) · PEDIATRICS · doi:10.1542/peds.2010-3222 · Cited by 63
Etzioni, R., Ankerst, D. P., Weiss, N. S., Inoue, L. Y. T., & Thompson, I. M. (2007) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djm171 · Cited by 63
Prediction of Type 2 Diabetes Using Alternate Anthropometric Measures in a Multi-Ethnic Cohort
MacKay, M. F., Haffner, S. M., Wagenknecht, L. E., D'Agostino, R. B., & Hanley, A. J. G. (2009) · Diabetes Care · doi:10.2337/dc08-1663 · Cited by 50
Development and Evaluation of a Composite Risk Score to Predict Kidney Transplant Failure
Moore, J., He, X., Shabir, S., Hanvesakul, R., Benavente, D., Cockwell, P., Little, M. A., Ball, S. T., Inston, N. G., Johnston, A. E., et al. (2011) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2010.12.017 · Cited by 62
Belinson, J. L., Wu, R., Belinson, S. E., Qu, X., Yang, B., Du, H., Wu, R., Wang, C., Zhang, L., Zhou, Y., et al. (2011) · American Journal of Clinical Pathology · doi:10.1309/ajcpka6atapbz6jq · Cited by 61
Thomas, L. E., O'Brien, E. C., Piccini, J. P., D’Agostino, R. B., & Pencina, M. J. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy345 · Cited by 63
A comprehensive review of the literature on the biological effects from dental X-ray exposures
Chauhan, V., & Wilkins, R. C. (2018) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1547436 · Cited by 62
Parodi, S., Verda, D., Bagnasco, F., & Muselli, M. (2022) · Epidemiology and Health · doi:10.4178/epih.e2022088 · Cited by 61
Dundas, R., Leyland, A. H., & Macintyre, S. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu110 · Cited by 49
Karlson, E. W., Ding, B., Keenan, B. T., Liao, K. P., Costenbader, K. H., Klareskog, L., Alfredsson, L. S., & Chibnik, L. B. (2013) · Arthritis Care & Research · doi:10.1002/acr.22005 · Cited by 60
Using Proteomic Analysis of the Human Amniotic Fluid to Identify Histologic Chorioamnionitis
Buhimschi, I. A., Zambrano, E. V., Pettker, C. M., Bahtiyar, M. O., Paidas, M. J., Rosenberg, V. A., Thung, S., Salafia, C. M., & Buhimschi, C. S. (2008) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e31816102aa · Cited by 60
Lovasi, G. S., Underhill, L. J., Jack, D., Richards, C., Weiss, C., & Rundle, A. (2012) · The Open Epidemiology Journal · doi:10.2174/1874297101205010013 · Cited by 55
Czerniecki, J. M., Turner, A. P., Williams, R. M., Thompson, M. L., Landry, G., Hakimi, K. N., Speckman, R. A., & Norvell, D. C. (2016) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2016.08.078 · Cited by 60
Persmark, A., Wemrell, M., Zettermark, S., Leckie, G., Subramanian, S. V., & Merlo, J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220322 · Cited by 60
Evaluating technologies for classification and prediction in medicine
Pepe, M. S. (2005) · Statistics in Medicine · doi:10.1002/sim.2431 · Cited by 60
Self-citationCan Survival Prediction Be Improved By Merging Gene Expression Data Sets?
Yasrebi, H., Sperisen, P., Praz, V., & Bücher, P. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007431 · Cited by 60
Matabuena, M., & Petersen, A. (2023) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1093/jrsssc/qlad007 · Cited by 59
Urinary proteomics in chronic kidney disease: diagnosis and risk of progression beyond albuminuria
Øvrehus, M. A., Zürbig, P., Vikse, B. E., & Hallan, S. I. (2015) · Clinical Proteomics · doi:10.1186/s12014-015-9092-7 · Cited by 59
The predictive and external validity of the STarT Back Tool in Danish primary care
Morsø, L., Kent, P. M., Albert, H., Hill, J. C., Kongsted, A., & Manniche, C. (2013) · European Spine Journal · doi:10.1007/s00586-013-2690-z · Cited by 59
Evaluating prognostic accuracy of biomarkers in nested case-control studies
Cai, T., & Zheng, Y. (2011) · Biostatistics · doi:10.1093/biostatistics/kxr021 · Cited by 59
Estimating the capacity for improvement in risk prediction with a marker
Gu, W., & Pepe, M. S. (2008) · Biostatistics · doi:10.1093/biostatistics/kxn025 · Cited by 59
Self-citationKuhn, A. N., van der Giet, M., Kuhlmann, M. K., Martus, P., Mielke, N., Ebert, N., & Schäeffner, E. (2020) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2020.09.015 · Cited by 58
Evaluation of Prediction Models for Decision-Making: Beyond Calibration and Discrimination
Holmberg, L., & Vickers, A. J. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001491 · Cited by 58
Bozorgmanesh, M., Sardarinia, M., Hajsheikholeslami, F., Azizi, F., & Hadaegh, F. (2015) · European Journal of Nutrition · doi:10.1007/s00394-015-0833-1 · Cited by 58
The efficacy of combining several risk factors as a screening test
Wald, N. J., Morris, J. K., & Rish, S. (2005) · Journal of Medical Screening · doi:10.1258/096914105775220642 · Cited by 57
Patel, R. B., Ilkhanoff, L., Ng, J., Chokshi, M., Mouchli, A., Chacko, S. J., Subacius, H. P., Bhojraj, S., Goldberger, J. J., & Kadish, A. H. (2012) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2012.04.042 · Cited by 57
Khan, F. A., Verkuijl, S. E., Parrish, A., Chikwava, F., Ntumy, R., El‐Sadr, W., & Howard, A. A. (2014) · AIDS · doi:10.1097/qad.0000000000000278 · Cited by 57
Krishna, V., Diamond, G. A., & Kaul, S. (2012) · Circulation · doi:10.1161/circulationaha.111.075242 · Cited by 56
Lorenzo, C., Haffner, S. M., Stančáková, A., Kuusisto, J., & Laakso, M. (2015) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-2299 · Cited by 50
Brain Injury Biomarkers as Outcome Predictors in Pediatric Severe Traumatic Brain Injury
Daoud, H., Alharfi, I. M., Alhelali, I., Stewart, T. C., Qasem, H., & Fraser, D. D. (2013) · Neurocritical Care · doi:10.1007/s12028-013-9879-1 · Cited by 56
Ness, K. K., Hudson, M. M., Jones, K., Leisenring, W. M., Yasui, Y., Chen, Y., Stovall, M. A., Gibson, T. M., Green, D. M., Neglia, J. P., et al. (2017) · Annals of Internal Medicine · doi:10.7326/m16-0742 · Cited by 57
Hybrid Models Identified a 12-Gene Signature for Lung Cancer Prognosis and Chemoresponse Prediction
Wan, Y., Sabbagh, E., Raese, R. A., Qian, Y. R., Luo, D., Denvir, J., Vallyathan, V., Castranova, V., & Guo, N. L. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012222 · Cited by 55
Can We Predict Daily Adherence to Warfarin?
Platt, A. B., Localio, A. R., Brensinger, C. M., Cruess, D. G., Christie, J. D., Gross, R., Parker, C. S., Price, M., Metlay, J. P., Cohen, A. L., et al. (2009) · CHEST Journal · doi:10.1378/chest.09-0039 · Cited by 55
Fukuda, T., Bouchi, R., Takeuchi, T., Nakano, Y., Murakami, M., Minami, I., Izumiyama, H., Hashimoto, K., Yoshimoto, T., & Ogawa, Y. (2017) · Journal of Diabetes Investigation · doi:10.1111/jdi.12713 · Cited by 55
Assessing the Clinical Utility of Biomarkers in Medicine
Parikh, N. I., & Vasan, R. S. (2007) · Biomarkers in Medicine · doi:10.2217/17520363.1.3.419 · Cited by 57
The Impact of a Prevention Effort on the Community
Wacholder, S. (2004) · Epidemiology · doi:10.1097/01.ede.0000147633.09891.16 · Cited by 55
Novel markers of inflammation in atherosclerosis
Virani, S. S., Polsani, V. R., & Nambi, V. (2008) · Current Atherosclerosis Reports · doi:10.1007/s11883-008-0024-0 · Cited by 55
Okser, S., Lehtimäki, T., Elo, L. L., Mononen, N., Peltonen, N., Kähönen, M., Juonala, M., Fan, Y.-M., Hernesniemi, J. A., Laitinen, T., et al. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1001146 · Cited by 47
O’Shea, L. E., Picchioni, M., & Dickens, G. L. (2015) · Assessment · doi:10.1177/1073191115573301 · Cited by 54
Dent, T. (2010) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2010.06.021 · Cited by 54
Kim, Y., Molnar, M. Z., Rattanasompattikul, M., Hatamizadeh, P., Benner, D., Kopple, J. D., Kovesdy, C. P., & Kalantar‐Zadeh, K. (2012) · International Urology and Nephrology · doi:10.1007/s11255-012-0170-8 · Cited by 54
Forsblom, C. M., Moran, J. L., Harjutsalo, V., Loughman, T., Wadén, J., Tolonen, N., Thorn, L. M., Saraheimo, M., Gordin, D., Groop, P., et al. (2014) · Diabetes Care · doi:10.2337/dc14-0225 · Cited by 54
Subramanian, S. V., Kim, R., & Christakis, N. A. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.04.027 · Cited by 54
Endometrial Cancer Risk Factors, Hormone Receptors, and Mortality Prediction
Busch, E. L., Crous‐Bou, M., Prescott, J., Chen, M. M., Downing, M. J., ROSNER, B. A., Mutter, G. L., & Vivo, I. D. (2017) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-16-0821 · Cited by 53
Bittker, S. S., & Bell, K. (2018) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s158811 · Cited by 53
Shafi, T., Matsushita, K., Selvin, E., Sang, Y., Astor, B. C., Inker, L. A., & Coresh, J. (2012) · BMC Nephrology · doi:10.1186/1471-2369-13-42 · Cited by 52
Roscoe, C. M. P., James, R. S., & Duncan, M. J. (2017) · European Journal of Pediatrics · doi:10.1007/s00431-017-2948-2 · Cited by 52
Multicategory reclassification statistics for assessing improvements in diagnostic accuracy
Li, J., Jiang, B., & Fine, J. P. (2012) · Biostatistics · doi:10.1093/biostatistics/kxs047 · Cited by 52
The 12-lead electrocardiogram and risk of sudden death: current utility and future prospects
Narayanan, K., & Chugh, S. S. (2015) · EP Europace · doi:10.1093/europace/euv121 · Cited by 52
Othus, M. K. D., Gale, R. P., Hourigan, C. S., & Walter, R. B. (2019) · Bone Marrow Transplantation · doi:10.1038/s41409-019-0729-4 · Cited by 52
A reproducibility crisis for clinical metabolomics studies
Cochran, D., Noureldein, M., Bezdeková, D., Schram, A., Howard, R., & Powers, R. (2024) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2024.117918 · Cited by 51
Lei, X., Huang, K., Liu, Q., Jie, Y.-F., & Tang, S. (2016) · Infectious Diseases of Poverty · doi:10.1186/s40249-016-0134-9 · Cited by 51
Cainzos‐Achirica, M., Enjuanes, C., Greenland, P., McEvoy, J. W., Cushman, M., Dardari, Z., Nasir, K., Budoff, M. J., Al-Mallah, M. H., Yeboah, J., et al. (2018) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2018.09.034 · Cited by 51
Austin, P. C., & Steyerberg, E. W. (2013) · Statistics in Medicine · doi:10.1002/sim.5598 · Cited by 47
Bansal, A., & PEPE, M. S. (2013) · Statistics in Medicine · doi:10.1002/sim.5736 · Cited by 51
Self-citationNewton, F., McCall, A., Ryan, D., Blackburne, C., der Fünten, K. A., Meyer, T., Lewin, C., & McCunn, R. (2017) · Science and Medicine in Football · doi:10.1080/24733938.2017.1283436 · Cited by 50
Discrimination of fractures by low-frequency axial transmission ultrasound in postmenopausal females
Moilanen, P., Määttä, M., Kilappa, V., Xu, L., Nicholson, P., Alén, M., TIMONEN, J., Jämsä, T. J., & Cheng, S. (2012) · Osteoporosis International · doi:10.1007/s00198-012-2022-x · Cited by 50
Role of C-Reactive Protein in Coronary Risk Reduction: Focus on Primary Prevention
Gotto, A. M. (2007) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2006.10.026 · Cited by 51
Setting the Agenda for a New Discipline: Population Health Science
Keyes, K. M., & Galea, S. (2016) · American Journal of Public Health · doi:10.2105/ajph.2016.303101 · Cited by 50
Walter, R. B., & Estey, E. H. (2020) · Blood Reviews · doi:10.1016/j.blre.2020.100679 · Cited by 49
Zhang, Z., Huang, X., & Lu, H. (2013) · European Journal of Pediatrics · doi:10.1007/s00431-013-2148-7 · Cited by 49
Metadata
- Authors
- Pepe, M. S.
- Affiliations
- Fred Hutch Cancer Center (US)
- Corresponding author
- Pepe, M. S.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-05-01
- Volume
- 159
- Issue
- 9
- Pages
- 882-890
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2121514893
- Cited by
- 1,276
- References
- 27
- Citations by year
- 2026: 56 · 2025: 44 · 2024: 21 · 2023: 35 · 2022: 39 · 2021: 46 · 2020: 46 · 2019: 46 · 2018: 68 · 2017: 63 · 2016: 69 · 2015: 69 · 2014: 72 · 2013: 73 · 2012: 82
- FWCI
- 41.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Cancer Institute (U01CA86368, U01CA074794, P01 CA18029, U01CA086368, P01CA018029)
- National Institute of General Medical Sciences (R01 GM 54438, R01GM054438)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- odds ratio, diagnostic biomarkers, prognostic factors, screening marker, receiver operating characteristic, classification accuracy, false positives, true positives, logistic regression, association measures
- MeSH terms
- Classification, Data Interpretation, Statistical, Epidemiologic Methods, False Positive Reactions, Humans, Mass Screening, Predictive Value of Tests, Prognosis, Risk Factors, ROC Curve, Reproducibility of Results, Biomarkers, Discriminant Analysis, Logistic Models, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.