False Alarms and Pseudo-Epidemics: The Limitations of Observational Epidemiology
Abstract
Most reported associations in observational clinical research are false, and the minority of associations that are true are often exaggerated. This credibility problem has many causes, including the failure of authors, reviewers, and editors to recognize the inherent limitations of these studies. This issue is especially problematic for weak associations, variably defined as relative risks (RRs) or odds ratios (ORs) less than 4. Such associations, commonly reported in the medical literature, are more likely to be attributable to bias than to causal association. All observational research has bias (which can include selection, information, and confounding bias). Hence, detection of small associations falls below the discriminatory ability of observational studies. In general, unless RRs in cohort studies exceed 2 to 3 or ORs in case-control studies exceed 3 or 4, associations in observational research findings should not be considered credible. However, these guidelines are not foolproof: strong (yet spurious) associations can result when large amounts of bias are present. Only in a properly performed randomized controlled trial, free of bias, should small associations merit attention. Better training and more circumspection on the part of investigators, tougher editorial standards on the part of journals, and hefty skepticism on the part of referees and readers are necessary to avoid the dangers of false alarms, pseudo-epidemics, and their unfortunate consequences.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Following Grimes and Schultz, odds ratios were considered clinically significant only if greater than 3.5 or 4.
“In accordance with recommendations of Grimes and Schultz (23), we considered odds ratios to be clinically significant only if they were greater than 3.5 or 4.”
From Urinary incontinence and disability in community-dwelling women: A cross-sectional study: Urinary Incontinence and Disability in Ambulatory Women (2015) · cites this paper as [23]
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329 · see citing works
Self-citationThe environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,302 · see citing works
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698 · see citing works
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075 · see citing works
Bias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553 · see citing works
Self-citationWhy Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · see citing works
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466 · see citing works
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465 · see citing works
Causation and Causal Inference in Epidemiology
Rothman, K. J., & Greenland, S. (2005) · American Journal of Public Health · doi:10.2105/ajph.2004.059204 · Cited by 1,265 · see citing works
Whittmore, A. S., Harris, R. B., & Itnyre, J. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116427 · Cited by 1,011 · see citing works
<i>Meta-analysis</i> Spurious precision? Meta-analysis of observational studies
Egger, M., Schneider, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7125.140 · Cited by 997 · see citing works
The scandal of poor medical research.
Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.308.6924.283 · Cited by 897 · see citing works
Grey zones of clinical practice: some limits to evidence-based medicine
Naylor, C. D. (1995) · The Lancet · doi:10.1016/s0140-6736(95)92969-x · Cited by 661 · see citing works
Causation and disease: the Henle-Koch postulates revisited.
Evans, A. S. (1976) · PubMed · Cited by 641 · see citing works
What is a Cause and How Do We Know One? A Grammar for Pragmatic Epidemiology
Susser, M. W. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115939 · Cited by 536 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 473 · see citing works
The Medical School Objectives Writing Group (1999) · Journal of the Association of American Medical Colleges · doi:10.1097/00001888-199901000-00010 · Cited by 452 · see citing works
Dougados, M., Nguyen, M., Berdah, L., Mazi�res, B., Vignon, E. P., Lequesne, M. G., & for the ECHODIAH Investigators Study Group (2001) · Arthritis & Rheumatism · doi:10.1002/1529-0131(200111)44:11 · Cited by 320 · see citing works
Issues in the reporting of epidemiological studies: a survey of recent practice.
Pocock, S. J., Collier, T. J., Dandreo, K. J., de Stavola, B. L., Goldman, M. B., Kalish, L. A., Kasten, L. E., & McCormack, V. A. (2004) · BMJ · doi:10.1136/bmj.38250.571088.55 · Cited by 313 · see citing works
Use of Copper Intrauterine Devices and the Risk of Tubal Infertility among Nulligravid Women
Hubacher, D., Lara-Ricalde, R., Taylor, D. J., Guerra-Infante, F. M., & Guzmán-Rodríguez, R. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa010438 · Cited by 300 · see citing works
Scientific Standards in Epidemiologic Studies of the Menace of Daily Life
Feinstein, A. R. (1988) · Science · doi:10.1126/science.3057627 · Cited by 297 · see citing works
Deming, Data and Observational Studies
Young, S. S., & Karr, A. F. (2011) · Significance · doi:10.1111/j.1740-9713.2011.00506.x · Cited by 235 · see citing works
Practical causal inference for ecoepidemiologists
Fox, G. A. (1991) · Journal of Toxicology and Environmental Health · doi:10.1080/15287399109531535 · Cited by 209 · see citing works
False-Positive Results in Cancer Epidemiology: A Plea for Epistemological Modesty
Boffetta, P., McLaughlin, J. K., Vecchia, C. L., Tarone, R. E., Lipworth, L., & Blot, W. J. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn191 · Cited by 199 · see citing works
Davey Smith, G., Phillips, A. N., & Neaton, J. D. (1992) · The Lancet · doi:10.1016/0140-6736(92)92242-8 · Cited by 149 · see citing works
Hormone Replacement Therapy and Heart Disease Prevention
Petitti, D. B. (1998) · JAMA · doi:10.1001/jama.280.7.650 · Cited by 142 · see citing works
Epidemiologic Research Using Administrative Databases
Grimes, D. A. (2010) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e3181f98300 · Cited by 136 · see citing works
Self-citationThe scandal of poor epidemiological research: ***
von Elm, E. B., & Egger, M. (2004) · BMJ · doi:10.1136/bmj.329.7471.868 · Cited by 134 · see citing works
Selection in Reported Epidemiological Risks: An Empirical Assessment
Kavvoura, F. K., Liberopoulos, G., & Ioannidis, J. P. A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040079 · Cited by 114 · see citing works
Brent, R. L. (1995) · Reproductive Toxicology · doi:10.1016/0890-6238(95)00020-b · Cited by 95 · see citing works
Nonspecific side effects of oral contraceptives: nocebo or noise?
Grimes, D. A., & Schulz, K. F. (2010) · Contraception · doi:10.1016/j.contraception.2010.06.010 · Cited by 93 · see citing works
Self-citationIs meta-analysis a valid approach to the evaluation of small effects in observational studies?
Shapiro, S. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00360-5 · Cited by 92 · see citing works
Bias in the Evaluation of Low-Magnitude Associations: An Empirical Perspective
Shapiro, S. (2000) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010135 · Cited by 91 · see citing works
Khoury, M. J., James, L. M., Flanders, W. D., & Erickson, J. D. (1992) · Teratology · doi:10.1002/tera.1420460110 · Cited by 91 · see citing works
Pelvic inflammatory disease and the intrauterine device: findings in a large cohort study.
Vessey, M. P., Yeates, D., Flavel, R., & McPherson, K. (1981) · BMJ · doi:10.1136/bmj.282.6267.855 · Cited by 87 · see citing works
A Collection of 56 Topics with Contradictory Results in Case-Control Research
Mayes, L. C., Horwitz, R. I., & FHNSTEIN, A. R. (1988) · International Journal of Epidemiology · doi:10.1093/ije/17.3.680 · Cited by 86 · see citing works
Reflections on the limitations to epidemiology
Smith, G. D. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00334-6 · Cited by 79 · see citing works
Perspectives on the Women's Health Initiative trial of hormone replacement therapy
Grimes, D. A. (2002) · Obstetrics and Gynecology · doi:10.1016/s0029-7844(02)02503-6 · Cited by 78 · see citing works
Self-citationLindefors-Harris, B.-M., EKLUND, G. A., Adami, H., & Meirik, O. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116173 · Cited by 74 · see citing works
Oral Contraceptive Use and the Occurrence of Pituitary Prolactinoma
Shy, K. K. (1983) · JAMA · doi:10.1001/jama.1983.03330400050024 · Cited by 64 · see citing works
Intrauterine devices and pelvic inflammatory disease: Recent developments
Grimes, D. A. (1987) · Contraception · doi:10.1016/0010-7824(87)90063-1 · Cited by 64 · see citing works
Self-citationBuchan, H., VILLARD‐MACKINTOSH, L., Vessey, M. P., Yeates, D., & McPherson, K. (1990) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.1990.tb02571.x · Cited by 62 · see citing works
Breast Implant Rupture and Connective Tissue Disease: A Review of the Literature
Hölmich, L. R., Lipworth, L. P., McLaughlin, J. K., & Friis, S. (2007) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000286664.50274.f2 · Cited by 58 · see citing works
False positive outcomes and design characteristics in occupational cancer epidemiology studies.
Swaen, G., Teggeler, O., & van Amelsvoort, L. V. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.5.948 · Cited by 52 · see citing works
Living Can Be Hazardous to Your Health: How the News Media Cover Cancer Risks
Russell, C. (1999) · JNCI Monographs · doi:10.1093/oxfordjournals.jncimonographs.a024194 · Cited by 50 · see citing works
Parascandola, M. J., Weed, D. L., & Dasgupta, A. (2006) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-3-1 · Cited by 49 · see citing works
Deming, data and observational studies: A process out of control and needing fixing
Young, S. S., & Karr, A. F. (2013) · Quality Engineering · Cited by 43 · see citing works
Practical limitations of epidemiologic methods.
Lilienfeld, A. M. (1983) · Environmental Health Perspectives · doi:10.1289/ehp.83523 · Cited by 43 · see citing works
Poor-Quality Medical Research: What Can Journals Do?
Altman, D. G. (2002) · JAMA · doi:10.1001/jama.287.21.2765 · Cited by 34 · see citing works
Causation, bias and confounding: a hitchhiker's guide to the epidemiological galaxy
Shapiro, S. (2008) · Journal of Family Planning and Reproductive Health Care · doi:10.1783/147118908784734873 · Cited by 31 · see citing works
Looking to the 21st century: have we learned from our mistakes, or are we doomed to compound them?
Shapiro, S. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.903 · Cited by 28 · see citing works
Data mining in pharmacovigilance: lessons from phantom ships
Hauben, M., Reich, L., van Puijenbroek, E., Gerrits, C. M., & Patadia, V. K. (2006) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-006-0181-4 · Cited by 23 · see citing works
The triumph of the null hypothesis: epidemiology in an age of change
Maziak, W. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dyn268 · Cited by 22 · see citing works
β-Carotene: a Miss for Epidemiology
Marshall, J. R. (1999) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/91.24.2068 · Cited by 21 · see citing works
Epidemiological Issues in Weak Associations
Wynder, E. L. (1990) · International Journal of Epidemiology · doi:10.1093/ije/19.supplement_1.s5 · Cited by 20 · see citing works
Bartholomew, L. (1998) · doi:10.1097/00006254-199811000-00024 · Cited by 18 · see citing works
Self-citationWeak Associations in Epidemiological Research: Some Examples and Their Interpretation
Florey, C. D. V. (1988) · International Journal of Epidemiology · doi:10.1093/ije/17.4.950 · Cited by 16 · see citing works
The Pursuit of Clinical Truth: Role of Epidemiology/Observation Studies
Spector, R., & Vesell, E. S. (2000) · The Journal of Clinical Pharmacology · doi:10.1177/009127000004001105 · Cited by 13 · see citing works
The epidemiology of life and death: a critical commentary.
Newman, T. B., & Browner, W. S. (1988) · American Journal of Public Health · doi:10.2105/ajph.78.2.161 · Cited by 6 · see citing works
Progestins, breast cancer, and the limitations of epidemiology
Grimes, D. A. (1992) · Fertility and Sterility · doi:10.1016/s0015-0282(16)54889-4 · Cited by 5 · see citing works
Self-citationRaising the standards of clinical trials and research.
Chalmers, I. (2007) · PubMed · doi:10.2471/blt.07.100907 · Cited by 4 · see citing works
Is "junk science" finally on the way out?
Crane, M. (1996) · PubMed · Cited by 4 · see citing works
Howard, B. R. (2004) · Animal Welfare · doi:10.1017/s096272860002710x · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 70 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Interpretation of the evidence for the efficacy and safety of statin therapy
Collins, R., Reith, C., Emberson, J., Armitage, J., Baigent, C., Blackwell, L., Blumenthal, R., Danesh, J., Smith, G. D., DeMets, D., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31357-5 · Cited by 1,857 · see citing works
Self-citationACG Clinical Guideline for the Diagnosis and Management of Gastroesophageal Reflux Disease
Katz, P. O., Dunbar, K. B., Schnoll‐Sussman, F. H., Greer, K. B., Yadlapati, R. H., & Spechler, S. J. (2021) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000001538 · Cited by 1,064 · see citing works
The 2017 hormone therapy position statement of The North American Menopause Society
The North American Menopause Society (2017) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0000000000000921 · Cited by 1,018 · see citing works
Prevalence and Trends of Symptomatic Pelvic Floor Disorders in U.S. Women
Wu, J. M., Vaughan, C. P., Goode, P. S., Redden, D. T., Burgio, K. L., Richter, H. E., & Markland, A. D. (2013) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000000057 · Cited by 947 · see citing works
Complications of Proton Pump Inhibitor Therapy
Vaezi, M. F., Yang, Y., & Howden, C. W. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.04.047 · Cited by 484 · see citing works
Calcium intake and risk of fracture: Systematic review
Bolland, M. J., Leung, W., Tai, V., Bastin, S., Gamble, G. D., Grey, A., & Reid, I. R. (2015) · BMJ · doi:10.1136/bmj.h4580 · Cited by 351 · see citing works
Trends in Use of and Reproductive Outcomes Associated With Intracytoplasmic Sperm Injection
Boulet, S. L., Mehta, A., Kissin, D. M., Warner, L., Kawwass, J. F., & Jamieson, D. J. (2015) · JAMA · doi:10.1001/jama.2014.17985 · Cited by 347 · see citing works
Prevalence and Predictors of Herbal Medicine Use Among Adults in the United States
Rashrash, M., Schommer, J. C., & Brown, L. M. (2017) · Journal of Patient Experience · doi:10.1177/2374373517706612 · Cited by 311 · see citing works
Corona, G., Maseroli, E., Rastrelli, G., Isidori, A. M., Sforza, A., Mannucci, E., & Maggi, M. (2014) · Expert Opinion on Drug Safety · doi:10.1517/14740338.2014.950653 · Cited by 297 · see citing works
Heinemann, K., Reed, S., Moehner, S., & Minh, T. D. (2015) · Contraception · doi:10.1016/j.contraception.2015.01.007 · Cited by 235 · see citing works
Risk Factors for Atonic Postpartum Hemorrhage
Ende, H. B., Lozada, M. J., Chestnut, D. H., Osmundson, S. S., Walden, R. L., Shotwell, M. S., & Bauchat, J. R. (2021) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000004228 · Cited by 220 · see citing works
Advances in the diagnosis and management of gastroesophageal reflux disease
Katzka, D. A., & Kahrilas, P. J. (2020) · BMJ · doi:10.1136/bmj.m3786 · Cited by 202 · see citing works
Racial Disparities in Postpartum Pain Management
Badreldin, N., Grobman, W. A., & Yee, L. M. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003561 · Cited by 191 · see citing works
The 2017 hormone therapy position statement of The North American Menopause Society
(2018) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0000000000001241 · Cited by 172 · see citing works
Gestational diabetes: new criteria may triple the prevalence but effect on outcomes is unclear
Cundy, T., Ackermann, E. W., & Ryan, E. A. (2014) · BMJ · doi:10.1136/bmj.g1567 · Cited by 157 · see citing works
Proton pump inhibitors and risk of hip fracture: a meta-analysis of observational studies
Poly, T. N., Islam, M. M., Yang, H., Wu, C., & Li, Y. (2018) · Osteoporosis International · doi:10.1007/s00198-018-4788-y · Cited by 155 · see citing works
Heinemann, K., Reed, S., Moehner, S., & Minh, T. D. (2015) · Contraception · doi:10.1016/j.contraception.2015.01.011 · Cited by 154 · see citing works
Cardiovascular and metabolic morbidity after hysterectomy with ovarian conservation: a cohort study
Laughlin-Tommaso, S. K., Khan, Z., Weaver, A. L., Smith, C. Y., Rocca, W. A., & Stewart, E. A. (2017) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0000000000001043 · Cited by 146 · see citing works
Drug Exposure and Risk of Microscopic Colitis
Bonderup, O. K., Fenger‐Grøn, M., Wigh, T., Pedersen, L. H., & Nielsen, G. L. (2014) · Inflammatory Bowel Diseases · doi:10.1097/mib.0000000000000143 · Cited by 130 · see citing works
Association between Use of Statin and Risk of Dementia: A Meta-Analysis of Observational Studies
Poly, T. N., Islam, M. M., Walther, B. A., Yang, H., Wu, C.-C., Lin, M., & Li, Y. (2019) · Neuroepidemiology · doi:10.1159/000503105 · Cited by 126 · see citing works
Wang, Y., Fu, Y., Ghazi, P., Gao, Q., Tian, T., Kong, F., Zhan, S., Liu, C., Bloom, D. E., & Qiao, J. (2022) · The Lancet Global Health · doi:10.1016/s2214-109x(22)00098-5 · Cited by 127 · see citing works
Light, lighting and human health
Boyce, P. R. (2021) · Lighting Research & Technology · doi:10.1177/14771535211010267 · Cited by 118 · see citing works
Holland, C. L., Rubio, D. M., Rodriguez, K. L., Kraemer, K. L., Day, N. L., Arnold, R. M., Tarr, J. A., & Chang, J. C. (2016) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000001343 · Cited by 107 · see citing works
Maternal Obesity and the Risk of Early-Onset and Late-Onset Hypertensive Disorders of Pregnancy
Bicocca, M. J., Figueroa, H. M., Chauhan, S. P., & Sibai, B. M. (2020) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003901 · Cited by 103 · see citing works
Etiology, occurrence, and consequences of implant loss
Tomasi, C., & Derks, J. (2022) · Periodontology 2000 · doi:10.1111/prd.12408 · Cited by 97 · see citing works
Pregnancy outcome in women with endometriosis achieving pregnancy with IVF
Benaglia, L., Candotti, G., Papaleo, E., Pagliardini, L., Leonardi, M., Reschini, M., Quaranta, L., Munaretto, M., Viganò, P., Candiani, M., et al. (2016) · Human Reproduction · doi:10.1093/humrep/dew210 · Cited by 95 · see citing works
Breathett, K. K., Muhlestein, D. B., Foraker, R. E., & Gulati, M. (2014) · Journal of Women s Health · doi:10.1089/jwh.2014.4749 · Cited by 92 · see citing works
Battarbee, A. N., Venkatesh, K. K., Aliaga, S. R., & Boggess, K. (2019) · Journal of Perinatology · doi:10.1038/s41372-019-0516-5 · Cited by 87 · see citing works
Johnson, D. A., Katz, P. O., Armstrong, D., Cohen, H., Delaney, B. C., Howden, C. W., Katelaris, P., Tutuian, R. I., & Castell, D. O. (2017) · Drugs · doi:10.1007/s40265-017-0712-6 · Cited by 85 · see citing works
Freitas, F., Braga, A., Viggiano, M., Velarde, L. G. C., Maestá, I., Uberti, E. M. H., Madi, J. M., Yela, D. A., Fernandes, K. G., Silveira, E., et al. (2020) · Gynecologic Oncology · doi:10.1016/j.ygyno.2020.04.704 · Cited by 74 · see citing works
Jackson, R., Gardner, S., Torres, L. N., Huchko, M. J., Zlatnik, M. G., & Williams, J. C. (2015) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000000971 · Cited by 69 · see citing works
Swain, M. S., Kamper, S. J., Maher, C. G., Broderick, C. R., McKay, D., & Henschke, N. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098418 · Cited by 69 · see citing works
Choice of Prophylactic Antibiotics and Surgical Site Infections After Cesarean Delivery
Kawakita, T., Huang, C.-C., & Landy, H. J. (2018) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000002863 · Cited by 69 · see citing works
Larney, S., Bohnert, A. S. B., Ganoczy, D. A., Ilgen, M. A., Hickman, M., Blow, F. C., & Degenhardt, L. J. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.12.019 · Cited by 67 · see citing works
Simón, C., & Bellver, J. (2014) · Human Reproduction · doi:10.1093/humrep/deu126 · Cited by 67 · see citing works
Incidence and Risk Factors for Chronic Pelvic Pain After Hysteroscopic Sterilization
Yunker, A., Ritch, J. M. B., Robinson, E. F., & Golish, C. T. (2014) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2014.06.007 · Cited by 66 · see citing works
Perforation risk and intra-uterine devices: results of the EURAS-IUD 5-year extension study
Barnett, C., Moehner, S., Minh, T. D., & Heinemann, K. (2017) · The European Journal of Contraception & Reproductive Health Care · doi:10.1080/13625187.2017.1412427 · Cited by 65 · see citing works
Potential proton pump inhibitor–related adverse effects
Perry, I. E., Sonu, I. S., Scarpignato, C., Akiyama, J., Hongo, M., & Vega, K. J. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14428 · Cited by 64 · see citing works
Relationship Between Labor and Delivery Unit Management Practices and Maternal Outcomes
Plough, A. C., Galvin, G. E., Li, Z., Lipsitz, S. R., Alidina, S., Henrich, N. J., Hirschhorn, L. R., Berry, W. R., Gawande, A. A., Peter, D., et al. (2017) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000002128 · Cited by 60 · see citing works
Urologic Injury and Fistula After Hysterectomy for Benign Indications
Dallas, K. B., Rogo-Gupta, L. J., & Elliott, C. S. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003353 · Cited by 54 · see citing works
Alimena, S., Yang, D. D., Melamed, A., Mahal, B. A. V., Worley, M. J., Feldman, S., Elias, K. M., Orio, P. F., Lee, L. J., & King, M. T. (2019) · Gynecologic Oncology · doi:10.1016/j.ygyno.2019.06.022 · Cited by 53 · see citing works
Ganz, T., Aronoff, G. R., Gaillard, S., Goodnough, L. T., Macdougall, I. C., Mayer, G. J., Porto, G., Winkelmayer, W. C., & Wish, J. B. (2020) · Kidney Medicine · doi:10.1016/j.xkme.2020.01.006 · Cited by 53 · see citing works
Onagbiye, S. O., Guddemi, A., Baruwa, O. J., Alberti, F., Odone, A., Ricci, H., Gaeta, M., Schmid, D., & Ricci, C. (2023) · Preventive Medicine · doi:10.1016/j.ypmed.2023.107812 · Cited by 56 · see citing works
Testosterone Replacement Therapy and Cardiovascular Risk: A Review
Giovanni Corona, G., Rastrelli, G., Maseroli, E., Sforza, A., & Maggi, M. (2015) · The World Journal of Men s Health · doi:10.5534/wjmh.2015.33.3.130 · Cited by 51 · see citing works
TURRENTINE, M. A., Greisinger, A. J., Brown, K. S., Wehmanen, O. A., & Mouzoon, M. E. (2013) · Infectious Diseases in Obstetrics and Gynecology · doi:10.1155/2013/525878 · Cited by 49 · see citing works
Jatoi, I., & Parsons, H. M. (2014) · Breast Cancer Research and Treatment · doi:10.1007/s10549-014-3160-y · Cited by 49 · see citing works
The “dangers” of chronic proton pump inhibitor use
Yadlapati, R. H., & Kahrilas, P. J. (2017) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2017.06.017 · Cited by 48 · see citing works
Lewkowitz, A. K., Rosenbloom, J. I., Keller, M., López, J. D., Macones, G. A., Olsen, M. A. A., & Cahill, A. G. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003434 · Cited by 47 · see citing works
Association between apgar score at 5 minutes and adverse outcomes among Low-Risk pregnancies
Chen, H.-Y., Blackwell, S. C., & Chauhan, S. P. (2020) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2020.1754789 · Cited by 47 · see citing works
Relationship Between Ultrasound Viewing and Proceeding to Abortion
Gatter, M. A., Kimport, K., Foster, D. G., Weitz, T. A., & Upadhyay, U. D. (2013) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000000053 · Cited by 45 · see citing works
Menopausal hormone therapy and breast cancer: what is the evidence from randomized trials?
Hodis, H. N., & Sarrel, P. M. (2018) · Climacteric · doi:10.1080/13697137.2018.1514008 · Cited by 45 · see citing works
Simulation Training for Operative Vaginal Delivery Among Obstetrics and Gynecology Residents
Bligard, K. H., Lipsey, K. L., & Young, O. M. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003431 · Cited by 44 · see citing works
Randomized Controlled Trials in Environmental Health Research: Unethical or Underutilized?
Allen, R. W., Barn, P. K., & Lanphear, B. P. (2015) · PLoS Medicine · doi:10.1371/journal.pmed.1001775 · Cited by 42 · see citing works
Dallas, K., Elliott, C. S., Syan, R., Sohlberg, E., Enemchukwu, E., & Rogo-Gupta, L. (2018) · Obstetrics & Gynecology · doi:10.1097/aog.0000000000002913 · Cited by 40 · see citing works
Marconi, N., Raja, E. A., Bhattacharya, S., & Maheshwari, A. (2019) · Human Reproduction · doi:10.1093/humrep/dez133 · Cited by 40 · see citing works
Lee, J. C., Badell, M. L., & Kawwass, J. F. (2022) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-021-00869-z · Cited by 41 · see citing works
Vercellini, P., Salmeri, N., Somigliana, E., Piccini, M., Caprara, F., Viganò, P., & Matteis, S. D. (2024) · Human Reproduction · doi:10.1093/humrep/deae086 · Cited by 39 · see citing works
Spechler, S. J. (2018) · Medical Clinics of North America · doi:10.1016/j.mcna.2018.08.001 · Cited by 37 · see citing works
Prognostic Factors for the Failure of Endometrial Ablation
Beelen, P., Reinders, I. M. A., Scheepers, W. F. W., Herman, M. C., Geomini, P. M. A. J., van Kuijk, S. M. J., & Bongers, M. Y. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003556 · Cited by 37 · see citing works
Busnelli, A., Beltratti, C., Cirillo, F., Bulfoni, A., Lania, A., & Levi-Setti, P. E. (2022) · Thyroid · doi:10.1089/thy.2021.0656 · Cited by 36 · see citing works
Grimes, D. A. (2015) · Human Reproduction · doi:10.1093/humrep/dev151 · Cited by 34 · see citing works
Self-citationRecent intrauterine device use and the risk of precancerous cervical lesions and cervical cancer
Averbach, S., Silverberg, M. J., Leyden, W. A., Smith‐McCune, K., Raine‐Bennett, T. R., & Sawaya, G. F. (2018) · Contraception · doi:10.1016/j.contraception.2018.04.008 · Cited by 32 · see citing works
Desired Sterilization Procedure at the Time of Cesarean Delivery According to Insurance Status
Morris, J., Ascha, M. S., Wilkinson, B. E., Verbus, E. A., Montague, M., Mercer, B. M., & Arora, K. S. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003552 · Cited by 32 · see citing works
Perspective: Standards for Research and Reporting on Low-Energy (“Artificial”) Sweeteners
Mela, D. J., McLaughlin, J. T., & Rogers, P. J. (2019) · Advances in Nutrition · doi:10.1093/advances/nmz137 · Cited by 32 · see citing works
Influence of paternal age on assisted reproductive technology cycles and perinatal outcomes
Marsidi, A. M., Kipling, L. M., Kawwass, J. F., & Mehta, A. (2021) · Fertility and Sterility · doi:10.1016/j.fertnstert.2021.03.033 · Cited by 32 · see citing works
Ricci, H., Gaeta, M., Franchi, C., Poli, A., Battino, M. A., Dolci, A., Schmid, D., & Ricci, C. (2023) · Nutrients · doi:10.3390/nu15214539 · Cited by 31 · see citing works
Manual Compared With Electric Vacuum Aspiration for Treatment of Molar Pregnancy
Padrón, L., Filho, J. R., Amim, J., Sun, S. Y., Charry, R., Maestá, I., Elias, K. M., Horowitz, N. S., Braga, A., & Berkowitz, R. S. (2018) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000002522 · Cited by 31 · see citing works
Association of Acculturation With Adverse Pregnancy Outcomes
Premkumar, A., Debbink, M. P., Silver, R. M., Haas, D. M., Simhan, H. N., Wing, D. A., Parry, S. I., Mercer, B. M., Iams, J. D., Reddy, U. M., et al. (2020) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003659 · Cited by 31 · see citing works
An Evaluation of Serum 25-Hydroxy Vitamin D Levels in Patients with COVID-19 in New York City
Gavioli, E. M., Miyashita, H., Hassaneen, O., & Siau, E. (2021) · Journal of the American Nutrition Association · doi:10.1080/07315724.2020.1869626 · Cited by 31 · see citing works
Conway, L. J., Carter, E. J., & Larson, E. (2015) · Urologic Nursing · doi:10.7257/1053-816x.2015.35.4.191 · Cited by 31 · see citing works
Kamal, F., Khan, M. A., Molnar, M. Z., & Howden, C. W. (2018) · Journal of Clinical Gastroenterology · doi:10.1097/mcg.0000000000001035 · Cited by 31 · see citing works
Kao, W., Su, C., Tan, E. C., Lee, P., Chen, P., Tang, J., Huang, Y., Huo, T., Chang, C., Hou, M., et al. (2018) · Hepatology · doi:10.1002/hep.30247 · Cited by 28 · see citing works
Pitfalls of Research Linking the Intrauterine Device to Pelvic Inflammatory Disease
Hubacher, D., Grimes, D. A., & Gemzell‐Danielsson, K. (2013) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e31828ac03a · Cited by 29 · see citing works
Self-citationOutcomes of Subsequent Births After Placenta Accreta Spectrum
Baldwin, H., Nippita, T. A. C., Torvaldsen, S., Ibiebele, I., Ford, J. B., & Patterson, J. A. (2020) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000004051 · Cited by 29 · see citing works
Nicholson, J. M., Kellar, L. C., Henning, G., Waheed, A., Colon-Gonzalez, M., & Ural, S. (2015) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.13301 · Cited by 29 · see citing works
Obesity, depression and hip pain
Schwarze, M., Häuser, W., Schmutzer, G., Brähler, E., Beckmann, N. A., & Schiltenwolf, M. (2019) · Musculoskeletal Care · doi:10.1002/msc.1380 · Cited by 28 · see citing works
Berger, B. O., Wolfson, C., Reid, L. D., & Strobino, D. M. (2020) · Women s Health Issues · doi:10.1016/j.whi.2020.08.008 · Cited by 28 · see citing works
Bartal, M. F., Chen, H.-Y., Figueroa, H. M., Wagner, S., & Chauhan, S. S. P. (2022) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000004953 · Cited by 27 · see citing works
Adverse Obstetric Outcomes Among Early-Onset Cancer Survivors in Finland
Melin, J. M., Heinävaara, S. H., Malila, N. K., Tiitinen, A. E., Gissler, M., & Madanat‐Harjuoja, L. M. (2015) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000001035 · Cited by 26 · see citing works
Regional and Racial–Ethnic Differences in Perinatal Interventions Among Periviable Births
Boghossian, N. S., Geraci, M., Edwards, E. M., Ehret, D. E. Y., Saade, G. R., & Horbar, J. D. (2020) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003747 · Cited by 26 · see citing works
Results of Observational Studies: Analysis of Findings from the Nurses’ Health Study
Tai, V., Grey, A. B., & Bolland, M. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110403 · Cited by 26 · see citing works
Intriguing data on inflammation and prostate cancer
Vignozzi, L., & Maggi, M. (2014) · Nature Reviews Urology · doi:10.1038/nrurol.2014.143 · Cited by 25 · see citing works
Pérez-López, F. R., Calvo‐Latorre, J., Alonso‐Ventura, V., Bueno‐Notivol, J., Martínez‐Domínguez, S. J., & Chedraui, P. A. (2018) · Pregnancy Hypertension · doi:10.1016/j.preghy.2018.01.003 · Cited by 24 · see citing works
Paffoni, A., Reschini, M., Pisaturo, V., Guarneri, C., Palini, S., & Viganò, P. (2021) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-021-00784-3 · Cited by 24 · see citing works
Comprehensive analysis of proton pump inhibitors and risk of digestive tract cancers
Zeng, R., Cheng, Y., Luo, D., Wang, J., Yang, J. H., Jiang, L., Zhuo, Z., Guo, K., Wu, H., Leung, F. W., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.07.030 · Cited by 24 · see citing works
Neighborhood Socioeconomic Disadvantage and Abnormal Birth Weight
Venkatesh, K. K., Yee, L. M., Johnson, J., Wu, J., McNeil, B., Mercer, B. M., Simhan, H. N., Reddy, U. M., Silver, R. M., Parry, S. I., et al. (2023) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000005384 · Cited by 24 · see citing works
Greer, J. A., Xu, R., Propert, K. J., & Arya, L. A. (2015) · Neurourology and Urodynamics · doi:10.1002/nau.22615 · Cited by 24 · see citing works
Pharmacological treatment of gestational diabetes mellitus: point/counterpoint
Langer, O. (2018) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2018.01.024 · Cited by 23 · see citing works
Du, W., Bo, L., Xu, Z., & Liu, Z. (2022) · Journal of Pain Research · doi:10.2147/jpr.s379580 · Cited by 27 · see citing works
Proton pump inhibitors and risk of Clostridium difficile infection
Villafuerte-Gálvez, J., & Kelly, C. P. (2017) · Current Opinion in Gastroenterology · doi:10.1097/mog.0000000000000414 · Cited by 23 · see citing works
Risks associated with chronic PPI use — signal or noise?
Kia, L., & Kahrilas, P. J. (2016) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/nrgastro.2016.44 · Cited by 22 · see citing works
Chetty, D., Abrahams, S., van Coller, R., Carr, J. A., Kenyon, C. P., & Bardien, S. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15324 · Cited by 22 · see citing works
Sinkey, R. G., Habli, M. A., South, A. P., Gibler, W., Burns, P., Eschenbacher, M. A., & Warshak, C. R. (2015) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2015.09.081 · Cited by 22 · see citing works
Late onset hypogonadism of men is not equivalent to the menopause
Saad, F., & Gooren, L. J. (2014) · Maturitas · doi:10.1016/j.maturitas.2014.06.016 · Cited by 22 · see citing works
Observational research on sodium glucose co‐transporter‐2 inhibitors: A real breakthrough?
Raschi, E., Poluzzi, E., Fadini, G. P., Marchesini, G., & Ponti, F. D. (2018) · Diabetes Obesity and Metabolism · doi:10.1111/dom.13468 · Cited by 21 · see citing works
Huang, J., Yan, K., Wu, C., Tan, Q., Bai, H., Wang, J., Liao, B., & Wu, Z. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000365 · Cited by 19 · see citing works
Pérez-Rubio, G., Pérez‐Rodríguez, M., Fernández-López, J. C., Ramírez‐Venegas, A., García‐Colunga, J., Ávila‐Moreno, F., Camarena, Á., Sansores, R. H., & Falfán‐Valencia, R. (2016) · Pharmacogenomics · doi:10.2217/pgs-2016-0020 · Cited by 20 · see citing works
DeFranco, E., Conyac, T., Adams, M. G., Zhou, Y., Magner, K., O’Rourke, L., Bernhard, K. A., Siddiqui, D., McCormick, A., Abramowicz, J. S., et al. (2015) · American Journal of Perinatology Reports · doi:10.1055/s-0035-1548544 · Cited by 17 · see citing works
Bennett, D., Brayne, C., Feigin, V. L., Barker-Collo, S. L., Brainin, M., Davis, D. H. J., Gallo, V., Jetté, N., Karch, A., Kurtzke, J. F., et al. (2015) · Neuroepidemiology · doi:10.1159/000439132 · Cited by 17 · see citing works
Lackie, E., & Fairchild, A. L. (2016) · Contraception · doi:10.1016/j.contraception.2016.06.009 · Cited by 18 · see citing works
- Authors
- Grimes, D. A., & Schulz, K. F.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- Obstetrics & Gynecology
- Published
- 2012-10
- Volume
- 120
- Issue
- 4
- Pages
- 920-927
- ISSN
- 0029-7844 (ISSN-L)
- OpenAlex
- W2130635109
- Cited by
- 254
- References
- 70
- Citations by year
- 2026: 5 · 2025: 13 · 2024: 14 · 2023: 13 · 2022: 17 · 2021: 23 · 2020: 27 · 2019: 18 · 2018: 30 · 2017: 19 · 2016: 18 · 2015: 25 · 2014: 19 · 2013: 10 · 2012: 2
- FWCI
- 17.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Obstetrics and Gynecology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- false alarms, weak associations, spurious association, bias in observational studies, confounding, selection bias, information bias, relative risk, odds ratio, editorial standards, peer review, randomized controlled trials
- MeSH terms
- Data Interpretation, Statistical, Risk, Reproducibility of Results, Cohort Studies, Bias, Causality, Odds Ratio, Case-Control Studies, Observation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review