Limitations of the Odds Ratio in Gauging the Performance of a Diagnostic, Prognostic, or Screening Marker
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
A marker strongly associated with outcome (or disease) is often assumed to be effective for classifying persons according to their current or future outcome. However, for this assumption to be true, the associated odds ratio must be of a magnitude rarely seen in epidemiologic studies. In this paper, an illustration of the relation between odds ratios and receiver operating characteristic curves shows, for example, that a marker with an odds ratio of as high as 3 is in fact a very poor classification tool. If a marker identifies 10% of controls as positive (false positives) and has an odds ratio of 3, then it will correctly identify only 25% of cases as positive (true positives). The authors illustrate that a single measure of association such as an odds ratio does not meaningfully describe a marker's ability to classify subjects. Appropriate statistical methods for assessing and reporting the classification power of a marker are described. In addition, the serious pitfalls of using more traditional methods based on parameters in logistic regression models are illustrated.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, for diagnostic, prognostic, or screening markers in epidemiologic studies, the limited magnitude of the OR considered meaningful (i.e., about or >70) is rarely discussed (36).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [36]
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 1×
“Examples include the Framingham risk score for cardiovascular events (2) and the Gail model risk score for breast cancer (3).”
BackgroundA Gene-Expression Signature as a Predictor of Survival in Breast Cancer
van de Vijver, M. J., He, Y. D., van 't Veer, L. J., Dai, H., Hart, A. A. M., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa021967 · Cited by 6,488
Ridker, P. M., Hennekens, C. H., Buring, J. E., & Rifai, N. (2000) · New England Journal of Medicine · doi:10.1056/nejm200003233421202 · Cited by 5,850 · cited 1×
“Examples from other popular journals are Ridker et al. ( 11 ), Zhang et al. (12), Liou et al. (13), and Hogue et al. (14).”
BackgroundGail, M. H., Brinton, L. A., Byar, D. P., Corle, D. K., Green, S. B., Schairer, C., & Mulvihill, J. J. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.24.1879 · Cited by 3,334
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
Self-citationCarney, P. A., Miglioretti, D. L., Yankaskas, B. C., Kerlikowske, K., Rosenberg, R., Rutter, C. M., Geller, B. M., Abraham, L. A., Taplin, S. H., Dignan, M., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-3-200302040-00008 · Cited by 1,142
Association Between Myeloperoxidase Levels and Risk of Coronary Artery Disease
Zhang, R. (2001) · JAMA · doi:10.1001/jama.286.17.2136 · Cited by 918
Loss of IGF2 Imprinting: A Potential Marker of Colorectal Cancer Risk
Cui, H., Cruz-Correa, M., Giardiello, F. M., Hutcheon, D. F., Kafonek, D. R., Brandenburg, S., Wu, Y., He, X., Powe, N. R., & Feinberg, A. P. (2003) · Science · doi:10.1126/science.1080902 · Cited by 735
A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
WIEAND, S., GAIL, M. H., JAMES, B. R., & JAMES, K. L. (1989) · Biometrika · doi:10.1093/biomet/76.3.585 · Cited by 355
Cited by
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
“Ware and Pepe show simple examples in which enormous odds ratios are required to meaningfully increase the AUC [ 19 , 21].”
BackgroundAssessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
Cook, N. R. (2007) · Circulation · doi:10.1161/circulationaha.106.672402 · Cited by 2,112
Towards better clinical prediction models: seven steps for development and an ABCD for validation
Steyerberg, E. W., & Vergouwe, Y. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu207 · Cited by 1,928
Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research
Steyerberg, E. W., Moons, K. G. M., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & for the PROGRESS Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001381 · Cited by 1,508
The job demands–resources model: challenges for future research.
Demerouti, E., & Bakker, A. B. (2011) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v37i2.974 · Cited by 1,426
Multiple Biomarkers for the Prediction of First Major Cardiovascular Events and Death
Wang, T. J., Gona, P., Larson, M. G., Tofler, G. H., Levy, D., Newton-Cheh, C., Jacques, P. F., Rifai, N., Selhub, J., Robins, S. J., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa055373 · Cited by 1,343
Biomarkers of Cardiovascular Disease: Molecular Basis and Practical Considerations
Vasan, R. S. (2006) · Circulation · doi:10.1161/circulationaha.104.482570 · Cited by 1,212
Hlatky, M. A., Greenland, P., Arnett, D. K., Ballantyne, C. M., Criqui, M. H., Elkind, M. S. V., Go, A. S., Harrell, F. E., Hong, Y., Howard, B. V., et al. (2009) · Circulation · doi:10.1161/circulationaha.109.192278 · Cited by 1,139
Rahimi, K., Bidel, Z., Nazarzadeh, M., Copland, E., Canoy, D., Ramakrishnan, R., Pinho-Gomes, A.-C., Woodward, M., Adler, A., Agodoa, L., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00590-0 · Cited by 1,074
Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): Explanation and Elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001216 · Cited by 1,013
Assessing Prostate Cancer Risk: Results from the Prostate Cancer Prevention Trial
Thompson, I. M., Ankerst, D. P., Chi, C., Goodman, P. J., Tangen, C. M., Lucia, M. S., Feng, Z., Parnes, H. L., & Coltman, C. A. (2006) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djj131 · Cited by 938
(2014) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2013.10.012 · Cited by 914
“[39] Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P.”
BackgroundMatsushita, K., Coresh, J., Sang, Y., Chalmers, J., Fox, C., Guallar, E., Jafar, T., Jassal, S. K., Landman, G. W. D., Muntner, P., et al. (2015) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00040-6 · Cited by 903
Use of Multiple Biomarkers to Improve the Prediction of Death from Cardiovascular Causes
Zethelius, B., Berglund, L., Sundström, J., Ingelsson, E., Basu, S., Larsson, A., Venge, P., & Ärnlöv, J. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0707064 · Cited by 889
Predicting nursing home admission in the U.S: a meta-analysis
Gaugler, J. E., Duval, S., Anderson, K. A., & Kane, R. L. (2007) · BMC Geriatrics · doi:10.1186/1471-2318-7-13 · Cited by 884
Diagnostic Criteria and Classification of Hyperglycaemia First Detected in Pregnancy
Agarwal, M., Boulvain, M., Coetzee, E. J., Colagiuri, S., Falavigna, M., Hod, M., Meltzer, S. J., Metzger, B. E., Omori, Y., Rasa, I., et al. (2013) · Cited by 759
Stern, M. P., Williams, K., González-Villalpando, C., Hunt, K. J., & Haffner, S. M. (2004) · Diabetes Care · doi:10.2337/diacare.27.11.2676 · Cited by 735
Shlipak, M. G., Fried, L. F., Cushman, M., Manolio, T. A., Peterson, D., Stehman-Breen, C., Bleyer, A., Newman, A., Siscovick, D., & Psaty, B. (2005) · JAMA · doi:10.1001/jama.293.14.1737 · Cited by 735
Cardiovascular Risk Prediction: Basic Concepts, Current Status, and Future Directions
Lloyd-Jones, D. M. (2010) · Circulation · doi:10.1161/circulationaha.109.849166 · Cited by 705
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Biomarkers for the diagnosis and risk stratification of acute kidney injury: A systematic review
Coca, S. G., Yalavarthy, R., Concato, J., & Parikh, C. R. (2008) · Kidney International · doi:10.1038/sj.ki.5002729 · Cited by 685
Lorenzo, C., Williams, K., Hunt, K. J., & Haffner, S. M. (2007) · Diabetes Care · doi:10.2337/dc06-1414 · Cited by 662
Mayers, J. R., Wu, C., Clish, C. B., Kraft, P., Torrence, M. E., Fiske, B. P., Yuan, C., Bao, Y., Townsend, M. K., Tworoger, S. S., et al. (2014) · Nature Medicine · doi:10.1038/nm.3686 · Cited by 649
Dupuy, A., & Simon, R. M. (2007) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djk018 · Cited by 632
Wendland, E. M., Torloni, M. R., Falavigna, M., Trujillo, J., Dode, M. A., Campos, M. A., Duncan, B. B., & Schmidt, M. I. (2012) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-12-23 · Cited by 626
“Nevertheless, even if GDM diagnostic criteria were to reach relative risks close to 3 for these adverse outcomes in such settings, the relative risks would still be unlikely to reflect major diagnostic discrimination in terms of post test probabilities [21].”
C-Reactive Protein and the Prediction of Cardiovascular Events Among Those at Intermediate Risk
Ridker, P. M. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.02.052 · Cited by 623
Leening, M. J. G., Vedder, M. M., Witteman, J. C. M., Pencina, M. J., & Steyerberg, E. W. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1522 · Cited by 594
Why screening tests to predict injury do not work—and probably never will…: a critical review
Bahr, R. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-096256 · Cited by 562
Buckley, D. I., Fu, R., Freeman, M., Rogers, K., & Helfand, M. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-7-200910060-00009 · Cited by 559
Novel and Conventional Biomarkers for Prediction of Incident Cardiovascular Events in the Community
Melander, O. (2009) · JAMA · doi:10.1001/jama.2009.943 · Cited by 551
Tice, J. A., Cummings, S. R., Smith-Bindman, R., Ichikawa, L., Barlow, W. E., & Kerlikowske, K. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-5-200803040-00004 · Cited by 537
Pischon, T., Girman, C. J., Sacks, F. M., Rifai, N., Stampfer, M. J., & Rimm, E. B. (2005) · Circulation · doi:10.1161/circulationaha.104.532499 · Cited by 514
Developing prediction models for clinical use using logistic regression: an overview
Shipe, M. E., Deppen, S. A., Farjah, F., & Grogan, E. L. (2019) · Journal of Thoracic Disease · doi:10.21037/jtd.2019.01.25 · Cited by 512
Interpreting Incremental Value of Markers Added to Risk Prediction Models
Pencina, M. J., D'Agostino, R. B., Pencina, K. M., Janssens, A. C. J. W., & Greenland, P. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kws207 · Cited by 506
Statistical Evaluation of a Biomarker
Ray, P., Manach, Y. L., Riou, B., Houle, T. T., & Warner, D. S. (2010) · Anesthesiology · doi:10.1097/aln.0b013e3181d47604 · Cited by 503
Sattar, N., McConnachie, A., Shaper, A. G., Blauw, G. J., Buckley, B. M., de Craen, A. J., Ford, I., Forouhi, N. G., Freeman, D. J., Jukema, J. W., et al. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60602-9 · Cited by 493
Rangaka, M. X., Wilkinson, K. A., Glynn, J. R., Ling, D., Menzies, D., Mwansa-Kambafwile, J., Fielding, K., Wilkinson, R. J., & Pai, M. (2012) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(11)70210-9 · Cited by 476
The Limitations of Risk Factors as Prognostic Tools
Ware, J. H. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068249 · Cited by 466
Meuwese, M. C., Stroes, E. S. G., Hazen, S. L., van Miert, J. N., Kuivenhoven, J. A., Schaub, R. G., Wareham, N. J., Luben, R., Kastelein, J. J. P., Khaw, K.-T., et al. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.03.033 · Cited by 441
Exploiting Gene-Environment Interaction to Detect Genetic Associations
Kraft, P., Yen, Y.-C., Stram, D. O., Morrison, J., & Gauderman, W. J. (2007) · Human Heredity · doi:10.1159/000099183 · Cited by 439
Combining GFR and Albuminuria to Classify CKD Improves Prediction of ESRD
Hallan, S. I., Ritz, E., Lydersen, S., Romundstad, S., Kvenild, K., & Orth, S. R. (2009) · Journal of the American Society of Nephrology · doi:10.1681/asn.2008070730 · Cited by 439
Causal thinking and complex system approaches in epidemiology
Galea, S., Riddle, M., & Kaplan, G. A. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp296 · Cited by 426
Plasma Parathyroid Hormone and the Risk of Cardiovascular Mortality in the Community
Hagström, E., Hellman, P., Larsson, T. E., Ingelsson, E., Berglund, L., Sundström, J., Melhus, H., Held, C., Lind, L., Michaëlsson, K., et al. (2009) · Circulation · doi:10.1161/circulationaha.108.808733 · Cited by 416
Evaluating Prediction Rules for t -Year Survivors With Censored Regression Models
Uno, H., Cai, T., Tian, L., & Wei, L. J. (2007) · Journal of the American Statistical Association · doi:10.1198/016214507000000149 · Cited by 413
Uno, H., Tian, L., Cai, T., Kohane, I. S., & Wei, L. J. (2013) · Statistics in Medicine · doi:10.1002/sim.5647 · Cited by 385
Helfand, M., Buckley, D. I., Freeman, M., Fu, R., Rogers, K., Fleming, C., & Humphrey, L. L. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-7-200910060-00010 · Cited by 382
Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-51 · Cited by 372
Rambod, M., Bross, R., Zitterkoph, J., Benner, D., Pithia, J., Colman, S., Kovesdy, C. P., Kopple, J. D., & Kalantar-Zadeh, K. (2009) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2008.09.018 · Cited by 357
The versatile use of exhaled volatile organic compounds in human health and disease
Boots, A. W., van Berkel, J. J. B. N., Dallinga, J. W., Smolinska, A., Wouters, E. F., & van Schooten, F. J. (2012) · Journal of Breath Research · doi:10.1088/1752-7155/6/2/027108 · Cited by 352
Gene Expression-Based Prognostic Signatures in Lung Cancer: Ready for Clinical Use?
Subramanian, J., & Simon, R. (2010) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djq025 · Cited by 351
Risk factors and biomarkers of age-related macular degeneration
Lambert, N. G., ElShelmani, H., Singh, M. K., Mansergh, F. C., Wride, M. A., Padilla, M., Keegan, D., Hogg, R. E., & Ambati, B. K. (2016) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2016.04.003 · Cited by 351
Prognostic factors for musculoskeletal pain in primary care: a systematic review.
(2007) · PubMed Central · Cited by 349
Pencina, M. J., D'Agostino, R. B., & Demler, O. V. (2012) · Statistics in Medicine · doi:10.1002/sim.4348 · Cited by 349
Mammographic density, breast cancer risk and risk prediction
Vachon, C. M., van Gils, C. H., Sellers, T. A., Ghosh, K., Pruthi, S., Brandt, K. R., & Pankratz, V. S. (2007) · Breast Cancer Research · doi:10.1186/bcr1829 · Cited by 346
Thankappan, K. R., Shah, B., Mathur, P., Sarma, P. S., Srinivas, G., Mini, G., Daivadanam, M., Soman, B., & Vasan, R. S. (2010) · PubMed · Cited by 344
Childhood forecasting of a small segment of the population with large economic burden
Caspi, A., Houts, R. M., Belsky, D. W., Harrington, H., Hogan, S., Ramrakha, S., Poulton, R., & Moffitt, T. E. (2016) · Nature Human Behaviour · doi:10.1038/s41562-016-0005 · Cited by 339
Mosley, J. D., Gupta, D. K., Tan, J., Yao, J., Wells, Q. S., Shaffer, C. M., Kundu, S., Robinson-Cohen, C., Psaty, B. M., Rich, S. S., et al. (2020) · JAMA · doi:10.1001/jama.2019.21782 · Cited by 332
Reflection on modern methods: Revisiting the area under the ROC Curve
Janssens, A. C. J. W., & Martens, F. K. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyz274 · Cited by 328
Goldenberg, I., Moss, A. J., Hall, W. J., Foster, E., Goldberger, J. J., Santucci, P., Shinn, T., Solomon, S., Steinberg, J. S., Wilber, D., et al. (2011) · Circulation · doi:10.1161/circulationaha.110.014324 · Cited by 328
Small-sample precision of ROC-related estimates
Hanczar, B., Hua, J., Sima, C., Weinstein, J., Bittner, M., & Dougherty, E. R. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq037 · Cited by 323
Effect of Finasteride on the Sensitivity of PSA for Detecting Prostate Cancer
Thompson, I. M., Chi, C., Ankerst, D. P., Goodman, P. J., Tangen, C. M., Lippman, S. M., Lucia, M. S., Parnes, H. L., & Coltman, C. A. (2006) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djj307 · Cited by 323
Dawson, S.-J., Makretsov, N., Blows, F. M., Driver, K. E., Provenzano, E., Le Quesne, J., Baglietto, L., Severi, G., Giles, G. G., McLean, C. A., et al. (2010) · British Journal of Cancer · doi:10.1038/sj.bjc.6605736 · Cited by 317
Biomarkers and surrogate end points—the challenge of statistical validation
Buyse, M., Sargent, D. J., Grothey, A., Matheson, A., & de Gramont, A. (2010) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2010.43 · Cited by 314
Tammemagi, C. M., Pinsky, P. F., Caporaso, N. E., Kvale, P. A., Hocking, W. G., Church, T. R., Riley, T. L., Commins, J., Oken, M. M., Berg, C. D., et al. (2011) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djr173 · Cited by 310
THE GOLDEN AGE : MASA EFEKTIF MERANCANG KUALITAS ANAK
Uce, L. (2017) · Bunayya Jurnal Pendidikan Anak · doi:10.22373/bunayya.v1i2.1322 · Cited by 308
Rutter, M. K., Meigs, J. B., Sullivan, L. M., D’Agostino, R. B., & Wilson, P. W. (2005) · Diabetes · doi:10.2337/diabetes.54.11.3252 · Cited by 307
C-Reactive Protein and Reclassification of Cardiovascular Risk in the Framingham Heart Study
Wilson, P. W. F., Pencina, M., Jacques, P., Selhub, J., D'Agostino, R., & O'Donnell, C. J. (2008) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.831198 · Cited by 299
Integrating the Predictiveness of a Marker with Its Performance as a Classifier
Pepe, M. S., Feng, Z., Huang, Y., Longton, G., Prentice, R., Thompson, I. M., & Zheng, Y. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm305 · Cited by 294
Self-citationMerlo, J. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.026 · Cited by 294
Carmienke, S., Freitag, M. H., Pischon, T., Schlattmann, P., Fankhaenel, T., Goebel, H., & Gensichen, J. (2013) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2013.61 · Cited by 288
Kopperdahl, D. L., Aspelund, T., Hoffmann, P. F., Sigurdsson, S., Siggeirsdottir, K., Harris, T. B., Gudnason, V., & Keaveny, T. M. (2014) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2069 · Cited by 286
McGorrian, C., Yusuf, S., Islam, S., Jung, H., Rangarajan, S., Avezum, A., Prabhakaran, D., Almahmeed, W., Rumboldt, Z., Budaj, A., et al. (2011) · European Heart Journal · doi:10.1093/eurheartj/ehq448 · Cited by 281
Whiteley, W., Jackson, C., Lewis, S., Lowe, G., Rumley, A., Sandercock, P., Wardlaw, J., Dennis, M., & Sudlow, C. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000145 · Cited by 279
Lacey, J. V., Sherman, M. E., Rush, B. B., Ronnett, B. M., Ioffe, O. B., Duggan, M. A., Glass, A. G., Richesson, D. A., Chatterjee, N., & Langholz, B. (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2009.24.1315 · Cited by 277
Narrative Review: Assessment of C-Reactive Protein in Risk Prediction for Cardiovascular Disease
Lloyd-Jones, D. M., Liu, K., Tian, L., & Greenland, P. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-1-200607040-00129 · Cited by 274
Misrepresentation and distortion of research in biomedical literature
Boutron, I., & Ravaud, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710755115 · Cited by 273
Pepe, M. S., Cai, T., & Longton, G. (2006) · Biometrics · doi:10.1111/j.1541-0420.2005.00420.x · Cited by 272
Self-citationRubinstein, S. M., Pool, J. J. M., van Tulder, M. W., Riphagen, I. I., & de Vet, H. C. W. (2007) · European Spine Journal · doi:10.1007/s00586-006-0225-6 · Cited by 272
Austin, P. C., & Steyerberg, E. W. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-82 · Cited by 270
“First, it is widely known that greater discrimination is possible when the regression model contains independent explanatory variables that are strongly associated with the outcome [20].”
BackgroundHanley, A. J. G., Karter, A. J., Williams, K., Festa, A., D’Agostino, R. B., Wagenknecht, L. E., & Haffner, S. M. (2005) · Circulation · doi:10.1161/circulationaha.105.559633 · Cited by 266
Paynter, N. P., Chasman, D. I., Buring, J. E., Shiffman, D., Cook, N. R., & Ridker, P. M. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-2-200901200-00003 · Cited by 262
Intra-abdominal hypertension in the critically ill: it is time to pay attention
Malbrain, M. L. N. G., Deeren, D., & De Potter, T. J. R. (2005) · Current Opinion in Critical Care · doi:10.1097/01.ccx.0000155355.86241.1b · Cited by 261
Horne, D. J., Royce, S. E., Gooze, L., Narita, M., Hopewell, P. C., Nahid, P., & Steingart, K. R. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70071-2 · Cited by 259
Cardiorespiratory Fitness and Classification of Risk of Cardiovascular Disease Mortality
Gupta, S., Rohatgi, A., Ayers, C. R., Willis, B. L., Haskell, W. L., Khera, A., Drazner, M. H., de Lemos, J. A., & Berry, J. D. (2011) · Circulation · doi:10.1161/circulationaha.110.003236 · Cited by 253
Jakobsdottir, J., Gorin, M. B., Conley, Y. P., Ferrell, R. E., & Weeks, D. E. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000337 · Cited by 245
Tice, J. A., Cummings, S. R., Ziv, E., & Kerlikowske, K. (2005) · Breast Cancer Research and Treatment · doi:10.1007/s10549-005-5152-4 · Cited by 245
Tsuta, K., Kawago, M., Inoue, E., Yoshida, A., Takahashi, F., Sakurai, H., Watanabe, S.-I., Takeuchi, M., Furuta, K., Asamura, H., et al. (2013) · Lung Cancer · doi:10.1016/j.lungcan.2013.06.012 · Cited by 240
Liu, J., Sempos, C., Donahue, R. P., Dorn, J., Trevisan, M., & Grundy, S. M. (2005) · Diabetes Care · doi:10.2337/diacare.28.8.1916 · Cited by 239
Shah, T., Casas, J. P., Cooper, J. A., Tzoulaki, I., Sofat, R., McCormack, V., Smeeth, L., Deanfield, J. E., Lowe, G. D., Rumley, A., et al. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn217 · Cited by 238
Sudden cardiac death risk stratification in patients with nonischemic dilated cardiomyopathy
Goldberger, J. J., Subačius, H., Patel, T., Cunnane, R., & Kadish, A. H. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.12.021 · Cited by 237
Hajian-Tilaki, K. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280216680383 · Cited by 232
On criteria for evaluating models of absolute risk
Gail, M. H. (2005) · Biostatistics · doi:10.1093/biostatistics/kxi005 · Cited by 231
Merlo, J., Wagner, P., Ghith, N., & Leckie, G. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153778 · Cited by 230
Gerds, T. A., Kattan, M. W., Schumacher, M., & Yu, C. (2013) · Statistics in Medicine · doi:10.1002/sim.5681 · Cited by 229
Nishimura, K., Okamura, T., Watanabe, M., Nakai, M., Takegami, M., Higashiyama, A., Kokubo, Y., Okayama, A., & Miyamoto, Y. (2014) · Journal of Atherosclerosis and Thrombosis · doi:10.5551/jat.19356 · Cited by 228
King, M., Walker, C., Levy, G., Bottomley, C., Royston, P., Weich, S., Bellón-Saameño, J. Á., Moreno, B., Švab, I., Rotar, D., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.12.1368 · Cited by 221
Trémollieres, F. A., Pouillès, J.-M., Drewniak, N., Laparra, J., Ribot, C. A., & Dargent-Molina, P. (2010) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.12 · Cited by 218
Evans, J. P., Meslin, E. M., Marteau, T. M., & Caulfield, T. (2011) · Science · doi:10.1126/science.1198039 · Cited by 218
Metadata
- Authors
- Pepe, M. S.
- Affiliations
- Fred Hutch Cancer Center (US)
- Corresponding author
- Pepe, M. S.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-05-01
- Volume
- 159
- Issue
- 9
- Pages
- 882-890
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2121514893
- Cited by
- 1,276
- References
- 27
- Citations by year
- 2026: 56 · 2025: 44 · 2024: 21 · 2023: 35 · 2022: 39 · 2021: 46 · 2020: 46 · 2019: 46 · 2018: 68 · 2017: 63 · 2016: 69 · 2015: 69 · 2014: 72 · 2013: 73 · 2012: 82
- FWCI
- 41.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Cancer Institute (U01CA86368, U01CA074794, P01 CA18029, U01CA086368, P01CA018029)
- National Institute of General Medical Sciences (R01 GM 54438, R01GM054438)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- odds ratio, diagnostic biomarkers, prognostic factors, screening marker, receiver operating characteristic, classification accuracy, false positives, true positives, logistic regression, association measures
- MeSH terms
- Classification, Data Interpretation, Statistical, Epidemiologic Methods, False Positive Reactions, Humans, Mass Screening, Predictive Value of Tests, Prognosis, Risk Factors, ROC Curve, Reproducibility of Results, Biomarkers, Discriminant Analysis, Logistic Models, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.