Limitations of the Odds Ratio in Gauging the Performance of a Diagnostic, Prognostic, or Screening Marker
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
A marker strongly associated with outcome (or disease) is often assumed to be effective for classifying persons according to their current or future outcome. However, for this assumption to be true, the associated odds ratio must be of a magnitude rarely seen in epidemiologic studies. In this paper, an illustration of the relation between odds ratios and receiver operating characteristic curves shows, for example, that a marker with an odds ratio of as high as 3 is in fact a very poor classification tool. If a marker identifies 10% of controls as positive (false positives) and has an odds ratio of 3, then it will correctly identify only 25% of cases as positive (true positives). The authors illustrate that a single measure of association such as an odds ratio does not meaningfully describe a marker's ability to classify subjects. Appropriate statistical methods for assessing and reporting the classification power of a marker are described. In addition, the serious pitfalls of using more traditional methods based on parameters in logistic regression models are illustrated.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, for diagnostic, prognostic, or screening markers in epidemiologic studies, the limited magnitude of the OR considered meaningful (i.e., about or >70) is rarely discussed (36).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [36]
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 1×
“Examples include the Framingham risk score for cardiovascular events (2) and the Gail model risk score for breast cancer (3).”
BackgroundA Gene-Expression Signature as a Predictor of Survival in Breast Cancer
van de Vijver, M. J., He, Y. D., van 't Veer, L. J., Dai, H., Hart, A. A. M., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa021967 · Cited by 6,488
Ridker, P. M., Hennekens, C. H., Buring, J. E., & Rifai, N. (2000) · New England Journal of Medicine · doi:10.1056/nejm200003233421202 · Cited by 5,850 · cited 1×
“Examples from other popular journals are Ridker et al. ( 11 ), Zhang et al. (12), Liou et al. (13), and Hogue et al. (14).”
BackgroundGail, M. H., Brinton, L. A., Byar, D. P., Corle, D. K., Green, S. B., Schairer, C., & Mulvihill, J. J. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.24.1879 · Cited by 3,334
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
Self-citationCarney, P. A., Miglioretti, D. L., Yankaskas, B. C., Kerlikowske, K., Rosenberg, R., Rutter, C. M., Geller, B. M., Abraham, L. A., Taplin, S. H., Dignan, M., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-3-200302040-00008 · Cited by 1,142
Association Between Myeloperoxidase Levels and Risk of Coronary Artery Disease
Zhang, R. (2001) · JAMA · doi:10.1001/jama.286.17.2136 · Cited by 918
Loss of IGF2 Imprinting: A Potential Marker of Colorectal Cancer Risk
Cui, H., Cruz-Correa, M., Giardiello, F. M., Hutcheon, D. F., Kafonek, D. R., Brandenburg, S., Wu, Y., He, X., Powe, N. R., & Feinberg, A. P. (2003) · Science · doi:10.1126/science.1080902 · Cited by 735
A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
WIEAND, S., GAIL, M. H., JAMES, B. R., & JAMES, K. L. (1989) · Biometrika · doi:10.1093/biomet/76.3.585 · Cited by 355
Cited by
Items 101–200 of 1,000
Discriminatory Accuracy From Single-Nucleotide Polymorphisms in Models to Predict Breast Cancer Risk
Gail, M. H. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn180 · Cited by 218
Beetz, I., Schilstra, C., van der Schaaf, A., van den Heuvel, E. R., Doornaert, P., van Luijk, P., Vissink, A., van der Laan, B. F. A. M., Leemans, C. R., Bijl, H. P., et al. (2012) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2012.03.004 · Cited by 216
Janes, H., & Pepe, M. S. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn099 · Cited by 212
Self-citationValidation of Biomarker-Based Risk Prediction Models
Taylor, J. M. G., Ankerst, D. P., & Andridge, R. R. (2008) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-07-4534 · Cited by 207
Simon, R. (2010) · Personalized Medicine · doi:10.2217/pme.09.49 · Cited by 206
Castle, P. E., Stoler, M. H., Solomon, D., Schiffmanx, M., & for the ALTS Group (2007) · American Journal of Clinical Pathology · doi:10.1309/pt3pnc1ql2f4d2vl · Cited by 202
Hilden, J., & Gerds, T. A. (2014) · Statistics in Medicine · doi:10.1002/sim.5804 · Cited by 200
One statistical test is sufficient for assessing new predictive markers
Vickers, A. J., Cronin, A. M., & Begg, C. B. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-13 · Cited by 200
Quantifying the added value of new biomarkers: how and how not
Cook, N. R. (2018) · Diagnostic and Prognostic Research · doi:10.1186/s41512-018-0037-2 · Cited by 198
Griffin, A., Kenny, I. C., Comyns, T. M., & Lyons, M. (2019) · Sports Medicine · doi:10.1007/s40279-019-01218-2 · Cited by 202
Models for predicting risk of dementia: a systematic review
Hou, X.-H., Feng, L., Zhang, C., Cao, X.-P., Tan, L., & Yu, J.-T. (2019) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2018-318212 · Cited by 190
Evaluating the Clinical Utility of a Biomarker: A Review of Methods for Estimating Health Impact
Pletcher, M. J., & Pignone, M. (2011) · Circulation · doi:10.1161/circulationaha.110.943860 · Cited by 152
The Job Demands‐Resources Model
Taris, T. W., & Schaufeli, W. B. (2015) · The Wiley Blackwell Handbook of the Psychology of Occupational Safety and Workplace Health · doi:10.1002/9781118979013.ch8 · Cited by 187
How Can We Improve the Accuracy of Screening Instruments?
Johnson, E. S., Jenkins, J. R., Petscher, Y., & Catts, H. W. (2009) · Learning Disabilities Research & Practice · doi:10.1111/j.1540-5826.2009.00291.x · Cited by 148
Age as a modifiable risk factor for cardiovascular disease
Sniderman, A. D., & Furberg, C. D. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60313-x · Cited by 186
Penaloza, A., Verschuren, F., Meyer, G., Quentin-Georget, S., Soulie, C., Thys, F., & Roy, P.-M. (2013) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.11.002 · Cited by 185
Predictive Validity Performance Indicators in Violence Risk Assessment: A Methodological Primer
Singh, J. P. (2013) · Behavioral Sciences & the Law · doi:10.1002/bsl.2052 · Cited by 184
Comparison of fecal indicators with pathogenic bacteria and rotavirus in groundwater
Ferguson, A. S., Layton, A. C., Mailloux, B. J., Culligan, P. J., Williams, D. E., Smartt, A. E., Sayler, G. S., Feighery, J., McKay, L. D., Knappett, P. S. K., et al. (2012) · Science of The Total Environment · doi:10.1016/j.scitotenv.2012.05.060 · Cited by 157
Urinary Biomarkers for Acute Kidney Injury: Perspectives on Translation
Coca, S. G., & Parikh, C. R. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.03520807 · Cited by 183
Risk estimation and risk prediction using machine-learning methods
Kruppa, J., Ziegler, A., & König, I. R. (2012) · Human Genetics · doi:10.1007/s00439-012-1194-y · Cited by 181
Cortical Porosity Identifies Women With Osteopenia at Increased Risk for Forearm Fractures
Bala, Y., Zebaze, R., Ghasem-Zadeh, A., Atkinson, E. J., Iuliano, S., Peterson, J. M., Amin, S., Bjørnerem, Å., Melton, L. J., Johansson, H., et al. (2014) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2167 · Cited by 181
Validation of a high-sensitivity assay for C-reactive protein in human saliva
Ouellet-Morin, I., Danese, A., Williams, B., & Arseneault, L. (2011) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2010.12.020 · Cited by 180
(2016) · Advances in Clinical Chemistry · doi:10.1016/bs.acc.2016.03.002 · Cited by 177
Prediction of HIV Acquisition Among Men Who Have Sex With Men
Menza, T. W., Hughes, J. P., Celum, C. L., & Golden, M. R. (2009) · Sexually Transmitted Diseases · doi:10.1097/olq.0b013e3181a9cc41 · Cited by 177
Igo, R. P., Kinzy, T. G., & Bailey, J. N. C. (2019) · Current Protocols in Human Genetics · doi:10.1002/cphg.95 · Cited by 177
Matsushita, K., Ballew, S. H., Coresh, J., Arima, H., Ärnlöv, J., Cirillo, M., Ebert, N., Hiramoto, J. S., Kimm, H., Shlipak, M. G., et al. (2017) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(17)30183-3 · Cited by 170
Aro, A. L., Reinier, K., Rusinaru, C., Uy‐Evanado, A., Darouian, N., Phan, D. Q., Mack, W. J., Jui, J., Soliman, E. Z., Tereshchenko, L. G., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehx331 · Cited by 169
Regularized ROC method for disease classification and biomarker selection with microarray data
Ma, S., & Huang, J. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti724 · Cited by 168
A score to estimate the likelihood of detecting advanced colorectal neoplasia at colonoscopy
Kaminski, M. F., Polkowski, M., Kraszewska, E., Rupinski, M., Butruk, E., & Regula, J. (2014) · Gut · doi:10.1136/gutjnl-2013-304965 · Cited by 168
Risk Stratification for Arrhythmic Sudden Cardiac Death: Identifying the Roadblocks
Goldberger, J. J., Buxton, A. E., Cain, M., Costantini, O., Exner, D. V., Knight, B. P., Lloyd-Jones, D., Kadish, A. H., Lee, B., Moss, A., et al. (2011) · Circulation · doi:10.1161/circulationaha.110.959734 · Cited by 167
Barr, E. L. M., Boyko, E. J., Zimmet, P. Z., Wolfe, R., Tonkin, A. M., & Shaw, J. E. (2009) · Diabetologia · doi:10.1007/s00125-008-1246-y · Cited by 167
A Meta-Analytic Comparison of Preoperative Stress Echocardiography and Nuclear Scintigraphy Imaging
Beattie, W. S., Abdelnaem, E., Wijeysundera, D. N., & Buckley, D. N. (2006) · Anesthesia & Analgesia · doi:10.1213/01.ane.0000189614.98906.43 · Cited by 166
van der Steeg, W. A., Boekholdt, S. M., Stein, E. A., El-Harchaoui, K., Stroes, E. S. G., Sandhu, M. S., Wareham, N. J., Jukema, J. W., Luben, R., Zwinderman, A. H., et al. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-9-200705010-00007 · Cited by 165
Bagherzadeh-Khiabani, F., Ramezankhani, A., Azizi, F., Hadaegh, F., Steyerberg, E. W., & Khalili, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.002 · Cited by 163
Han, K., Song, K., & Choi, B. W. (2016) · Korean Journal of Radiology · doi:10.3348/kjr.2016.17.3.339 · Cited by 162
Riley, R. D., Sauerbrei, W., & Altman, D. G. (2009) · British Journal of Cancer · doi:10.1038/sj.bjc.6604999 · Cited by 161
Markovitz, A. R., Stuart, J. J., Horn, J., Williams, P. L., Rimm, E. B., Missmer, S. A., Tanz, L. J., Haug, E. B., Fraser, A., Timpka, S., et al. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehy863 · Cited by 147
Srisawat, N., on behalf of the Genetic and Inflammatory Markers of Sepsis (GenIMS) Study Investigators, Murugan, R., Lee, M., Kong, L., Carter, M., Angus, D. C., & Kellum, J. A. (2011) · Kidney International · doi:10.1038/ki.2011.160 · Cited by 159
Beyond odds ratios — communicating disease risk based on genetic profiles
Kraft, P. L., Wacholder, S., Cornelis, M. C., Hu, F. B., Hayes, R. B., Thomas, G. D., Hoover, R. N., Hunter, D. J., & Chanock, S. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2516 · Cited by 158
Vu, Q. M., Le, Q. B., Frossard, E., & Vlek, P. L. G. (2013) · Land Use Policy · doi:10.1016/j.landusepol.2013.10.012 · Cited by 162
Hypertensive Disorders of Pregnancy and 10-Year Cardiovascular Risk Prediction
Stuart, J. J., Tanz, L. J., Cook, N. R., Spiegelman, D., Missmer, S. A., Rimm, E. B., Rexrode, K. M., Mukamal, K. J., & Rich-Edwards, J. W. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.05.077 · Cited by 154
“Because the C index is largely insensitive to change, it was not surprising to find that inclusion of HDP and parity did not improve predictive discrimination, despite being statistically significant and independently associated with CVD risk in this population (31,32).”
BackgroundHillier, T. A. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.2.155 · Cited by 139
AUC-RF: A New Strategy for Genomic Profiling with Random Forest
Calle, M. L., Urrea, V., Boulesteix, A.-L., & Malats, N. (2011) · Human Heredity · doi:10.1159/000330778 · Cited by 140
Blood Biomarkers MMP-7 and SP-A
Song, J. W., Do, K., Jang, S. J., Colby, T. V., Han, S., & Kim, D. S. (2013) · CHEST Journal · doi:10.1378/chest.11-2735 · Cited by 154
Quantifying the Added Value of a Diagnostic Test or Marker
Moons, K. G. M., de Groot, J. A. H., Linnet, K., Reitsma, J. B., & Bossuyt, P. M. M. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2012.182550 · Cited by 152
Beyond the Usual Prediction Accuracy Metrics: Reporting Results for Clinical Decision Making
Localio, A. R., & Goodman, S. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-4-201208210-00014 · Cited by 139
Direct-to-consumer genetic testing
Horton, R., Crawford, G., Freeman, L., Fenwick, A., Wright, C. F., & Lucassen, A. (2019) · BMJ · doi:10.1136/bmj.l5688 · Cited by 151
Criteria for the use of omics-based predictors in clinical trials: explanation and elaboration
McShane, L. M., Cavenagh, M. M., Lively, T. G., Eberhard, D. A., Bigbee, W. L., Williams, P. M., Mesirov, J. P., Polley, M.-Y. C., Kim, K. Y., Tricoli, J. V., et al. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-220 · Cited by 140
Morris, R. K., Bilagi, A., Devani, P., & Kilby, M. D. (2017) · Prenatal Diagnosis · doi:10.1002/pd.5001 · Cited by 123
Prostate specific antigen for early detection of prostate cancer: longitudinal study
Holmström, B., Johansson, M., Bergh, A. R. J., Stenman, U., Hallmans, G., & Stattin, P. (2009) · BMJ · doi:10.1136/bmj.b3537 · Cited by 150
A urinary peptide biomarker set predicts worsening of albuminuria in type 2 diabetes mellitus
Roscioni, S. S., de Zeeuw, D., Hellemons, M. E., Mischak, H., Zürbig, P., Bakker, S. J. L., Gansevoort, R. T., Reinhard, H., Persson, F., Lajer, M., et al. (2012) · Diabetologia · doi:10.1007/s00125-012-2755-2 · Cited by 150
Brown, J. A., Rudie, J. D., Bandrowski, A., Van Horn, J. D., & Bookheimer, S. Y. (2012) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2012.00028 · Cited by 131
Early changes, attrition, and dose–response in low intensity psychological interventions
Delgadillo, J., McMillan, D., Lucock, M., Leach, C., Ali, S., & Gilbody, S. (2014) · British Journal of Clinical Psychology · doi:10.1111/bjc.12031 · Cited by 122
Rambod, M., Kovesdy, C. P., Bross, R., Kopple, J. D., & Kalantar‐Zadeh, K. (2008) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.2008.25906 · Cited by 149
Whiteley, W. N., Wardlaw, J. M., Dennis, M. S., Lowe, G. D. O., Rumley, A., Sattar, N. A., Welsh, P. I., Green, A., Andrews, M., & Sandercock, P. A. (2011) · Stroke · doi:10.1161/strokeaha.111.634089 · Cited by 148
Wei, Y., & He, X. (2006) · The Annals of Statistics · doi:10.1214/009053606000000623 · Cited by 148
Meynaar, I. A., Droog, W., Batstra, M., Vreede, R., & Herbrink, P. (2011) · Critical Care Research and Practice · doi:10.1155/2011/594645 · Cited by 121
Texture Features from Mammographic Images and Risk of Breast Cancer
Manduca, A., Carston, M. J., Heine, J., Scott, C. G., Pankratz, V. S., Brandt, K. R., Sellers, T. A., Vachon, C. M., & Cerhan, J. R. (2009) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-08-0631 · Cited by 146
Ganesh, S. K., Arnett, D. K., Assimes, T. L., Basson, C. T., Chakravarti, A., Ellinor, P. T., Engler, M. B., Goldmuntz, E., Herrington, D. M., Hershberger, R. E., et al. (2013) · Circulation · doi:10.1161/01.cir.0000437913.98912.1d · Cited by 127
Metabolic syndrome—what is the clinical usefulness?
Kahn, R. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60731-x · Cited by 143
Predicting Death: An Empirical Evaluation of Predictive Tools for Mortality
Siontis, G. C. M. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.334 · Cited by 129
Schröder, F. H., & Kattan, M. W. (2008) · European Urology · doi:10.1016/j.eururo.2008.05.022 · Cited by 141
Chemoprevention of Prostate Cancer
Thompson, I. M., Tangen, C. M., Goodman, P. J., Lucia, M. S., & Klein, E. A. (2009) · The Journal of Urology · doi:10.1016/j.juro.2009.04.015 · Cited by 141
Fisk, S. A., Mulinari, S., Wemrell, M., Leckie, G., Vicente, R. P., & Merlo, J. (2018) · SSM - Population Health · doi:10.1016/j.ssmph.2018.03.005 · Cited by 143
Regulatory polymorphisms modulate the expression of HLA class II molecules and promote autoimmunity
Raj, P., Rai, E., Song, R., Khan, S., Wakeland, B. E., Viswanathan, K., Arana, C., Liang, C., Zhang, B., Dozmorov, I., et al. (2016) · eLife · doi:10.7554/elife.12089 · Cited by 133
Risk prediction models of breast cancer: a systematic review of model performances
Anothaisintawee, T., Teerawattananon, Y., Wiratkapun, C., Kasamesup, V., & Thakkinstian, A. (2011) · Breast Cancer Research and Treatment · doi:10.1007/s10549-011-1853-z · Cited by 138
Núñez, J. E., Sanchís, J. M., Bodí, V., Fonarow, G. C., Núñez, E., Bertomeu‐González, V., Miñana, G., Consuegra, L., Bosch, M. J., Carratalá, A., et al. (2010) · European Heart Journal · doi:10.1093/eurheartj/ehq142 · Cited by 138
Performance of reclassification statistics in comparing risk prediction models
Cook, N. R., & Paynter, N. P. (2011) · Biometrical Journal · doi:10.1002/bimj.201000078 · Cited by 122
Khan, F. A., Majidulla, A., Tavaziva, G., Nazish, A., Abidi, S. K., Benedetti, A., Menzies, D., Johnston, J. C., Khan, A. J., & Saeed, S. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30221-1 · Cited by 134
Findings of a U.S. National Cardiometabolic Screening Program Among 10,084 Psychiatric Outpatients
Correll, C. (2010) · Psychiatric Services · doi:10.1176/appi.ps.61.9.892 · Cited by 116
The Role of Neopterin in Atherogenesis and Cardiovascular Risk Assessment
Fuchs, D., Avanzas, P., Arroyo-Espliguero, R., Jenny, M., Consuegra-Sanchez, L., & Kaski, J. (2009) · Current Medicinal Chemistry · doi:10.2174/092986709789878247 · Cited by 125
Rambod, M., Kovesdy, C. P., & Kalantar-Zadeh, K. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.01070308 · Cited by 111
Biomarkers to Predict Recurrent Cardiovascular Disease: The Heart and Soul Study
Shlipak, M. G., Ix, J. H., Bibbins-Domingo, K. B., Lin, F., & Whooley, M. A. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2007.06.030 · Cited by 133
Clinical utility of HPV genotyping
Meijer, C. J. L. M., Snijders, P. J. F., & Castle, P. E. (2006) · Gynecologic Oncology · doi:10.1016/j.ygyno.2006.07.031 · Cited by 132
Systematic Review: Family History in Risk Assessment for Common Diseases
Wilson, B. J., Qureshi, N., Santaguida, P. L., Little, J., Carroll, J. C., Allanson, J. E., & Raina, P. (2009) · Annals of Internal Medicine · doi:10.7326/0000605-200912150-00177 · Cited by 132
Poland, G. A., Kennedy, R. B., McKinney, B. A., Ovsyannikova, I. G., Lambert, N. D., Jacobson, R. M., & Oberg, A. L. (2013) · Seminars in Immunology · doi:10.1016/j.smim.2013.04.007 · Cited by 122
Lambert, J., & Chevret, S. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280213515571 · Cited by 132
Merlo, J. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu108 · Cited by 130
Rosella, L. C., Manuel, D. G., Burchill, C., Stukel, T. A., & for the PHIAT-DM team (2011) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2009.102244 · Cited by 109
Khoury, M. J., Little, J., Gwinn, M., & Ioannidis, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dyl253 · Cited by 119
Greenland, P., & O’Malley, P. G. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.21.2454 · Cited by 129
Savanović, N., Toskovic, A., Petrović, A., Zivkovic, M. Z., Damaševičius, R., Jovanović, L., Bačanin, N., & Nikolić, B. (2023) · Sustainability · doi:10.3390/su151612563 · Cited by 128
Autoantibodies in breast cancer sera: candidate biomarkers and reporters of tumorigenesis
Fernández-Madrid, F. (2005) · Cancer Letters · doi:10.1016/j.canlet.2004.12.017 · Cited by 127
Association of four DNA polymorphisms with acute rejection after kidney transplantation
Grinyo, J. M., Vanrenterghem, Y. F. C., Nashan, B., Vincenti, F. G., Ekberg, H., Lindpaintner, K., Rashford, M., Nasmyth‐Miller, C., Voulgari, A., Spleiss, O., et al. (2008) · Transplant International · doi:10.1111/j.1432-2277.2008.00679.x · Cited by 127
Strope, S. A., & Montie, J. E. (2008) · The Journal of Urology · doi:10.1016/j.juro.2008.03.045 · Cited by 127
Multimarker Prediction of Coronary Heart Disease Risk
Kim, H. C., Greenland, P., Rossouw, J. E., Manson, J. E., Cochrane, B. B., Lasser, N. L., Limacher, M. C., Lloyd‐Jones, D. M., Margolis, K. L., & Robinson, J. G. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2009.12.047 · Cited by 126
Merlo, J., Mulinari, S., Wemrell, M., Subramanian, S. V., & Hedblad, B. (2017) · SSM - Population Health · doi:10.1016/j.ssmph.2017.08.005 · Cited by 132
Erectile Function and Risk of Parkinson's Disease
Gao, X., Chen, H., Schwarzschild, M. A., Glasser, D. B., Logroscino, G., Rimm, E. B., & Ascherio, A. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm246 · Cited by 112
UNIVERSITE PIERRE ET MARIE CURIE (PARIS 6)
de Médecine, F., Curie, M., Générale, M., & Pelizzari, M. (2011) · Cited by 125
Visualizing and assessing discrimination in the logistic regression model
Royston, P., & Altman, D. G. (2010) · Statistics in Medicine · doi:10.1002/sim.3994 · Cited by 111
Risk factors for oesophageal squamous dysplasia in adult inhabitants of a high risk region of China
Wei, W.-Q., Abnet, C. C., Lu, N., Roth, M. J., Wang, G.-Q., Dye, B. A., Dong, Z.-W., Taylor, P. R., Albert, P., Qiao, Y.-L., et al. (2005) · Gut · doi:10.1136/gut.2004.062331 · Cited by 123
Effects of sample size on robustness and prediction accuracy of a prognostic gene signature
Kim, S. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-147 · Cited by 122
Precision Rehabilitation: Optimizing Function, Adding Value to Health Care
French, M. A., Roemmich, R. T., Daley, K. N., Beier, M. L., Penttinen, S., Raghavan, P., Searson, P. C., Wegener, S. T., & Celnik, P. A. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2022.01.154 · Cited by 121
Steiner, J. F., Ho, P. M., Beaty, B. L., Dickinson, L. M., Hanratty, R., Zeng, C., Tavel, H. M., Havranek, E. P., Davidson, A. J., Magid, D. J., et al. (2009) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.841635 · Cited by 110
Fanchini, M., Rampinini, E., Riggio, M., Coutts, A. J., Pecci, C., & McCall, A. (2018) · Science and Medicine in Football · doi:10.1080/24733938.2018.1429014 · Cited by 118
Zettermark, S., Vicente, R. P., & Merlo, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194773 · Cited by 120
Clinical features of symptomatic patellofemoral joint osteoarthritis
Peat, G., Duncan, R. C., Wood, L., Thomas, E., & Müller, S. (2012) · Arthritis Research & Therapy · doi:10.1186/ar3779 · Cited by 115
What should physicians look for in evaluating prognostic gene-expression signatures?
Subramanian, J., & Simon, R. M. (2010) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2010.60 · Cited by 113
Hinton-Bayre, A. D. (2010) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acq008 · Cited by 101
Analysis of biomarker data: logs, odds ratios, and receiver operating characteristic curves
Grund, B., & Sabin, C. A. (2010) · Current Opinion in HIV and AIDS · doi:10.1097/coh.0b013e32833ed742 · Cited by 112
Metadata
- Authors
- Pepe, M. S.
- Affiliations
- Fred Hutch Cancer Center (US)
- Corresponding author
- Pepe, M. S.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-05-01
- Volume
- 159
- Issue
- 9
- Pages
- 882-890
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2121514893
- Cited by
- 1,276
- References
- 27
- Citations by year
- 2026: 56 · 2025: 44 · 2024: 21 · 2023: 35 · 2022: 39 · 2021: 46 · 2020: 46 · 2019: 46 · 2018: 68 · 2017: 63 · 2016: 69 · 2015: 69 · 2014: 72 · 2013: 73 · 2012: 82
- FWCI
- 41.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Cancer Institute (U01CA86368, U01CA074794, P01 CA18029, U01CA086368, P01CA018029)
- National Institute of General Medical Sciences (R01 GM 54438, R01GM054438)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- odds ratio, diagnostic biomarkers, prognostic factors, screening marker, receiver operating characteristic, classification accuracy, false positives, true positives, logistic regression, association measures
- MeSH terms
- Classification, Data Interpretation, Statistical, Epidemiologic Methods, False Positive Reactions, Humans, Mass Screening, Predictive Value of Tests, Prognosis, Risk Factors, ROC Curve, Reproducibility of Results, Biomarkers, Discriminant Analysis, Logistic Models, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.