The DOI matches its Crossref record, with a small difference in title or year; 69 of the 70 references it cites were found in a registry or an index.
False Alarms and Pseudo-Epidemics: The Limitations of Observational Epidemiology
Abstract
Most reported associations in observational clinical research are false, and the minority of associations that are true are often exaggerated. This credibility problem has many causes, including the failure of authors, reviewers, and editors to recognize the inherent limitations of these studies. This issue is especially problematic for weak associations, variably defined as relative risks (RRs) or odds ratios (ORs) less than 4. Such associations, commonly reported in the medical literature, are more likely to be attributable to bias than to causal association. All observational research has bias (which can include selection, information, and confounding bias). Hence, detection of small associations falls below the discriminatory ability of observational studies. In general, unless RRs in cohort studies exceed 2 to 3 or ORs in case-control studies exceed 3 or 4, associations in observational research findings should not be considered credible. However, these guidelines are not foolproof: strong (yet spurious) associations can result when large amounts of bias are present. Only in a properly performed randomized controlled trial, free of bias, should small associations merit attention. Better training and more circumspection on the part of investigators, tougher editorial standards on the part of journals, and hefty skepticism on the part of referees and readers are necessary to avoid the dangers of false alarms, pseudo-epidemics, and their unfortunate consequences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In accordance with recommendations of Grimes and Schultz (23), we considered odds ratios to be clinically significant only if they were greater than 3.5 or 4.”
From Urinary incontinence and disability in community-dwelling women: A cross-sectional study: Urinary Incontinence and Disability in Ambulatory Women (2015) · cites this paper as [23]
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Self-citationThe environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,804
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
Bias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553
Self-citation
Research works printed but not linked: 7
- Chalmers, 2007, Bull World Health Organ, 85, 658
- Russell, 1999, J Nat Cancer Inst Monographs, 167-, 70
- Smith, 1992, ancet, 340, 709
- Grimes, 2002, Obstet Gynecol, 100, 1344
- Bartholomew, 1998, urv, 53, 708
- Evans, 1976, Yale J Biol Med, 49, 175
- Shapiro, 1997, pidemiol, 50, 223
Cited by
Sorted by citations
Items 201–254 of 254
Berger, B. O., Horton, L. G., Gemmill, A., & Strobino, D. M. (2022) · Women s Health Issues · doi:10.1016/j.whi.2022.08.005 · Cited by 1
Rasiah, S. S., Young, A., Raker, C., Lewkowitz, A. K., Gupta, M., Bartal, M. F., & Wagner, S. (2022) · Minerva Obstetrics and Gynecology · doi:10.23736/s2724-606x.22.05174-0 · Cited by 1
Danieli‐Gruber, S., Levy, H., Gomez, R., Houri, O., Geron, Y., & Hadar, E. (2023) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.14893 · Cited by 1
Estrogen-progestins and endometriosis-associated depression: of causation, bias, and confounding
Salmeri, N., Cipriani, S., & Vercellini, P. (2025) · Fertility and Sterility · doi:10.1016/j.fertnstert.2025.01.026 · Cited by 1
Abdalla, M., Jabak, S., & Hameed, A. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70491 · Cited by 1
Modeling uncertain outcomes of genetic testing: factor V Leiden mutation and pregnant women
Grosse, S. D., & Caughey, A. B. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.17 · Cited by 1
Cohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-31420-4_54-1 · Cited by 1
McCrary, J. M., Großbach, M., & ALTENMÜLLER, E. O. (2022) · Perspectives in Public Health · doi:10.1177/17579139221081397 · Cited by 1
Maternal Education Level Among People with Diabetes and Associated Adverse Outcomes
Bartal, M. F., Chen, H.-Y., Cornthwaite, J. A. A., Wagner, S., Nazeer, S. A., Chauhan, S. P., & Figueroa, H. M. (2022) · American Journal of Perinatology · doi:10.1055/a-1883-0064 · Cited by 1
Jude, G., Fain, A. C., Raker, C., Rubenstein, S., Bicocca, M. J., Wagner, S., & Gupta, M. (2023) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-023-07113-6 · Cited by 1
Andhale, A., Abraham, P., Dhoble, P., Desai, D., Joshi, A. G., Gupta, T., Kothari, J., & Bhangale, N. (2024) · Indian Journal of Gastroenterology · doi:10.1007/s12664-023-01515-9 · Cited by 1
Vyver, E., & Hwang, L. Y. (2019) · Paediatrics & Child Health · doi:10.1093/pch/pxy169 · Cited by 1
Franceschini, G., Lello, S., Leone, A. D., Orlandi, A., & Masetti, R. (2019) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2019.12.004 · Cited by 1
Adverse maternal and neonatal outcomes among low-risk women with obesity at 37-41 weeks gestation
Bicocca, M. J., Gupta, M., Wagner, S., Figueroa, H. M., & Chauhan, S. P. (2020) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2020.08.053 · Cited by 1
Wagner, S., Chen, H.-Y., Ocon, A. L., Gupta, M., & Chauhan, S. P. (2021) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2021.1893295 · Cited by 1
Wagner, S., Chen, H.-Y., Gupta, M., Bicocca, M. J., Figueroa, H. M., & Chauhan, S. P. (2021) · Hypertension in Pregnancy · doi:10.1080/10641955.2021.1974879 · Cited by 1
El Grupo de San Ildefonso o La Ofrenda de Orestes y Pílades: de Roma a Madrid
Sanz, M. J. H. (2010) · Reales Sitios: Revista del Patrimonio Nacional · Cited by 1
Cohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2023) · Springer eBooks · doi:10.1007/978-3-031-06231-5_54 · Cited by 1
Coulam, C. B. (2012) · American Journal of Reproductive Immunology · doi:10.1111/aji.12058 · Cited by 1
Early-Life Milk and Late-Life Fracture
Howland, R. H. (2014) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2014.175 · Cited by 1
Letter: possible association between PPI use and spontaneous bacterial peritonitis
Khan, M. A., & Howden, C. W. (2015) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13311 · Cited by 1
A phenome-wide approach to identify causal risk factors for deep vein thrombosisPreprint
Constantinescu, A., Bull, C. J., Goudswaard, L. J., Zheng, J., Elsworth, B., Timpson, N. J., Moore, S., Hers, I., & Vincent, E. E. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/476135 · Cited by 1
Survival after Breast-Conserving Operation Compared with Mastectomy
Jatoi, I. (2021) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2021.01.004 · Cited by 1
Cundy, T. (2016) · Wiley eBooks · doi:10.1002/9781118924853.ch61 · Cited by 1
Los inhibidores de la bomba de protones en la pandemia por la COVID-19
Domingo, J. J. S. (2021) · Gastroenterología y Hepatología · doi:10.1016/j.gastrohep.2021.04.008 · Cited by 1
Ethics and Conflicts of Interest
Sennewald, C. A., & Baillie, C. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-802774-5.00007-1
Chandrasekaran, S., Sammel, M. D., & Srinivas, S. K. (2012) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2012.11.029
Eke, A. C., Barnard, E., Desai, A. N., & Chescheir, N. C. (2016) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000001539
Prior uterine evacuation and risk for preterm birth
MacAfee, L. K., & Dalton, V. K. (2016) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2016.07.021
Oral Contraceptive Use and Crohn’s Disease Complications
Gawron, L. M., & Kane, S. V. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.06.054
Gerdts, C., Fuentes, L., Grossman, D., White, K., Keefe‐Oates, B., Baum, S. E., Hopkins, K., Stolp, C. W., & Potter, J. E. (2017) · American Journal of Public Health · doi:10.2105/ajph.2016.303636
Piech, C. T., Lefèbvre, P., & Pike, C. T. (2017) · Springer eBooks · doi:10.1007/978-981-10-3262-2_5
Wie hoch ist das Blutungsrisiko bei Älteren?
Medizin, S. (2018) · InFo Neurologie + Psychiatrie · doi:10.1007/s15005-018-2508-y
Islam, M. M., Poly, T. N., Walther, B. A., Dubey, N. K., Ningrum, D. N. A., Syed-Abdul, S., & Li, Y. (2018) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000001309
Dua, A., & Venu, M. (2018) · Diseases of the Esophagus · doi:10.1093/dote/doy103
Shepherd, M., Elmezzi, K., Pearl, S. A., & Chescheir, N. C. (2018) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000002655
Connect the Dots—February 2019
Regens, A., Mehta, S., Jorgensen, K., & Chescheir, N. C. (2019) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000003097
Association of Cerclage with Composite Adverse Outcomes among Women Delivered at 36 Weeks or Later
Stephens, A. J., Chen, H.-Y., Chauhan, S. P., & Sibai, B. M. (2020) · American Journal of Perinatology · doi:10.1055/s-0040-1712962
Riesgo de cáncer de mama en portadoras de DIU de levonorgestrel. Revisión sistemática
Ángel-Parra, C., Pascual-Domenech, A. M., & Mirasol, E. G. (2021) · Clínica e Investigación en Ginecología y Obstetricia · doi:10.1016/j.gine.2021.100668
Cohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2022) · Springer eBooks · doi:10.1007/978-3-319-31420-4_54-2
Evers, J. L. H. (2013) · Human Reproduction · doi:10.1093/humrep/det435
Comment on L. Ellis et al. “Estimating cancers attributable to physical inactivity in Australia”
Stuart, G. W. (2024) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2024.03.013
Liu, F., Wang, X., & Fu, P. (2024) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2024.111577
Jaber, M. A., Natour, A. R. A., Alnatour, M., & Mansoor, K. (2024) · Trees Forests and People · doi:10.1016/j.tfp.2024.100671
Artioli, T., Batista, L. B., Franchini, K. G., & de Alencar, J. N. (2025) · Arquivos Brasileiros de Cardiologia · doi:10.36660/abc.20250244
PPIs and Dementia: The Final Nail in the Coffin?
Howden, C. W., & Katz, P. O. (2025) · Digestive Diseases and Sciences · doi:10.1007/s10620-025-09575-x
Antimuscarinic Use and Dementia Incidence in Women With Overactive Bladder
Painter, C. E., Stram, D. A., Velasco, V. S., Cheng, W., Korn, A. P., & Ramm, O. (2025) · Urogynecology · doi:10.1097/spv.0000000000001708 · Cited by 1
Bandini, V., Salmeri, N., Preda, A., Bracci, B., Cosentino, E., Vignali, M., & Vercellini, P. (2026) · Gynecologic and Obstetric Investigation · doi:10.1159/000552113
Chen, H.-Y., Stafford, I., & Chauhan, S. P. (2026) · American Journal of Perinatology · doi:10.1055/a-2936-5889
Application of a Pediatric Tracheostomy-Specific Risk Tier System Using Administrative Data
Johnson, R. F., Zaniletti, I., Wang, C. S., Kou, Y., & Chorney, S. R. (2026) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2026.2840
Precision Phenotyping With Audiometric Data and Gene Discovery for Sensorineural Hearing Loss
DeFreese, A. J., du Mérac, T. R., Sheng, Q., Nayak, S., & Jan, T. A. (2026) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2026.3089
Clinical Heterogeneity Across Oropharyngeal Cancer Datasets and Implications for Outcome Prediction
Cabrera, C. I., Tamaki, A., Koroukian, S. M., Love, T. E., Singer, M. E., Teknos, T. N., Rezaee, R. P., & Zhang, L. (2026) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2026.3290
Metadata
- Authors
- Grimes, D. A., & Schulz, K. F.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- Obstetrics & Gynecology
- Published
- 2012-10
- Volume
- 120
- Issue
- 4
- Pages
- 920-927
- ISSN
- 0029-7844 (ISSN-L)
- OpenAlex
- W2130635109
- Cited by
- 254
- References
- 70
- Citations by year
- 2026: 5 · 2025: 13 · 2024: 14 · 2023: 13 · 2022: 17 · 2021: 23 · 2020: 27 · 2019: 18 · 2018: 30 · 2017: 19 · 2016: 18 · 2015: 25 · 2014: 19 · 2013: 10 · 2012: 2
- FWCI
- 17.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Obstetrics and Gynecology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- false alarms, weak associations, spurious association, bias in observational studies, confounding, selection bias, information bias, relative risk, odds ratio, editorial standards, peer review, randomized controlled trials
- MeSH terms
- Data Interpretation, Statistical, Risk, Reproducibility of Results, Cohort Studies, Bias, Causality, Odds Ratio, Case-Control Studies, Observation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review