Bias and causal associations in observational research
The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index.
Abstract
Readers of medical literature need to consider two types of validity, internal and external. Internal validity means that the study measured what it set out to; external validity is the ability to generalise from the study to the reader's patients. With respect to internal validity, selection bias, information bias, and confounding are present to some degree in all observational research. Selection bias stems from an absence of comparability between groups being studied. Information bias results from incorrect determination of exposure, outcome, or both. The effect of information bias depends on its type. If information is gathered differently for one group than for another, bias results. By contrast, non-differential misclassification tends to obscure real differences. Confounding is a mixing or blurring of effects: a researcher attempts to relate an exposure to an outcome but actually measures the effect of a third factor (the confounding variable). Confounding can be controlled in several ways: restriction, matching, stratification, and more sophisticated multivariate techniques. If a reader cannot explain away study results on the basis of selection, information, or confounding bias, then chance might be another explanation. Chance should be examined last, however, since these biases can account for highly significant, though bogus results. Differentiation between spurious, indirect, and causal associations can be difficult. Criteria such as temporal sequence, strength an…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The underpowered sample size of the studies threatens the validity of the findings, since results are subject to selection, information, and confounding biases, which are often poorly controlled in observational research (Grimes and Schultz 2002;; Simunovic et al. 2009).”
From Analysis of sex-based differences in energy substrate utilization during moderate-intensity aerobic exercise (2022) · cites this paper as Grimes and Schultz 2002
In the citing paper
“Findings from this longitudinal child-to-adult study therefore provide crucial data and appear to meet several criteria suggestive of a causal association between childhood maltreatment and adult inflammation (27).”
From Childhood maltreatment predicts adult inflammation in a life-course study (2007) · cites this paper as [27]
Citations
Cites
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,285
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Clinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,476
Hennekens, C. H., Buring, J. E., & Mayrent, S. L. (1987) · Medical Entomology and Zoology · Cited by 2,319
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
(1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-316_4 · Cited by 1,926
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Clinical Epidemiology: The Architecture of Clinical Research.
(1985) · Annals of Internal Medicine · doi:10.7326/0003-4819-103-4-649_2 · Cited by 949
Designing clinical research: An epidemiologic approach
(1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90023-8 · Cited by 948
Bias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
Clinical Epidemiology - a basic science for clinical medicine
Hoffbrand, B. I. (1992) · Postgraduate Medical Journal · doi:10.1136/pgmj.68.806.987-a · Cited by 783
Statistical Power, Sample Size, and Their Reporting in Randomized Controlled Trials
Moher, D. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020048013 · Cited by 608
Kjellberg, L., Hallmans, G., Åhren, A.-M., Johansson, R., Bergman, F., Wadell, G., Ångström, T., & Dillner, J. (2000) · British Journal of Cancer · doi:10.1054/bjoc.1999.1100 · Cited by 349
Rothman, J. (1978) · New England Journal of Medicine · doi:10.1056/nejm197812142992410 · Cited by 303
The National Diet-Heart Study-Final Report
Buskirk, E. R. (1969) · The Gerontologist · doi:10.1093/geront/9.1.78a · Cited by 239
Induced Abortion and the Risk of Breast Cancer
Melbye, M., Wohlfahrt, J., Olsen, J. H., Frisch, M., Westergaard, T., Helweg-Larsen, K., & Andersen, P. K. (1997) · New England Journal of Medicine · doi:10.1056/nejm199701093360201 · Cited by 210
Primary prevention of gynecologic cancers
Grimes, D. A., & Economy, K. E. (1995) · American Journal of Obstetrics and Gynecology · doi:10.1016/0002-9378(95)90125-6 · Cited by 207
Self-citationType of intrauterine device and the risk of pelvic inflammatory disease.
Nc, L., Gl, R., Ory, H. W., & Rt, B. (1983) · PubMed · Cited by 204
Bendectin and birth defects: I. A meta‐analysis of the epidemiologic studies
McKeigue, P. M., Lamm, S. H., Linn, S., & Kutcher, J. S. (1994) · Teratology · doi:10.1002/tera.1420500105 · Cited by 184
Introduction to modern epidemiology
Ahlbom, A., & Norell, S. E. (1984) · Medical Entomology and Zoology · Cited by 152
Technology Follies: The Uncritical Acceptance of Medical Innovation
Grimes, D. A. (1993) · JAMA · doi:10.1001/jama.269.23.3030 · Cited by 145
Self-citationNc, L., Gl, R., & Borucki, R. (1988) · PubMed · Cited by 129
Designing Clinical Research: an Epidemiologic Approach, 2nd Ed.
Walline, J. J. (2001) · Optometry and Vision Science · doi:10.1097/00006324-200108000-00005 · Cited by 125
Association between Intrauterine Device and Pelvic Inflammatory Disease
BURKMAN, R. T., & WOMENʼS STUDY, T. (1981) · Obstetrical & Gynecological Survey · doi:10.1097/00006254-198108000-00020 · Cited by 121
Abramson, J. H., & Abramson, Z. H. (2001) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195145250.001.0001 · Cited by 112
Oral contraceptives as risk factors for cervical adenocarcinomas and squamous cell carcinomas.
Lacey, J. V., Brinton, L. A., Abbas, F. M., Barnes, W. A., Gravitt, P. E., Greenberg, M., Greene, S. M., Hadjimichael, O. C., McGowan, L., Mortel, R., et al. (1999) · PubMed · Cited by 112
Cancer of the breast and reproductive tract in relation to use of oral contraceptives
Schlesselman, J. J. (1989) · Contraception · doi:10.1016/0010-7824(89)90025-5 · Cited by 83
Lindefors-Harris, B.-M., Eklund, G., Adami, H.-O., & Meirik, O. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116173 · Cited by 74
Association Between Oral Contraceptives and Myocardial Infarction: A Review
Ory, H. W. (1977) · JAMA · doi:10.1001/jama.237.24.2619 · Cited by 68
Risk of cancer of the breast after legal abortion during first trimester: a Swedish register study.
Harris, B., EKLUND, G. A., Meirik, O., Rutqvist, L. E., & Wiklund, K. (1989) · BMJ · doi:10.1136/bmj.299.6713.1430 · Cited by 67
Cigarette smoking, use of oral contraceptives, and myocardial infarction
Jain, A. K. (1976) · American Journal of Obstetrics and Gynecology · doi:10.1016/0002-9378(76)90539-1 · Cited by 63
Schwingl, P. J., Ory, H. W., & Visness, C. M. (1999) · American Journal of Obstetrics and Gynecology · doi:10.1016/s0002-9378(99)70182-1 · Cited by 62
How to Report Statistics in Medicine
(1997) · Nature Medicine · doi:10.1038/nm0697-692 · Cited by 62
Moinpour, C. M., Lovato, L., Thompson, I. M., Ware, J. E., Ganz, P. A., Patrick, D. L., Shumaker, S. A., Donaldson, G. W., Ryan, A. M., & Coltman, C. A. (2000) · Journal of Clinical Oncology · doi:10.1200/jco.2000.18.9.1942 · Cited by 61
The intrauterine device and pelvic inflammatory disease: the women's health study reanalyzed
Kronmal, R. A., Whitney, C. W., & Mumford, S. D. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90259-c · Cited by 60
MAIL SURVEY RESPONSE BY SMOKING STATUS
SELTZER, C. C., BOSSE, R., & GARVEY, A. J. (1974) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112057 · Cited by 53
Measures of sexual behavior and the risk of pelvic inflammatory disease
Lee, N., Rubin, G., & Grimes, D. (1992) · International Journal of Gynecology & Obstetrics · doi:10.1016/0020-7292(92)90502-a · Cited by 50
Self-citationHalbert, J. A., Silagy, C. A., Finucane, P., Withers, R. T., & Hamdorf, P. A. (1999) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1999.tb07242.x · Cited by 44
The intrafamilial transmission of rheumatoid arthritis—III
Schull, W. J., & Cobb, S. (1969) · Journal of Chronic Diseases · doi:10.1016/0021-9681(69)90015-0 · Cited by 27
Bartholomew, L. (1998) · doi:10.1097/00006254-199811000-00024 · Cited by 18
Self-citationThe case for confidence intervals.
Grimes, D. A. (1992) · PubMed · Cited by 14
Self-citationOestrogen treatment and endometrial carcinoma.
Feinstein, A. R., & Horwitz, R. I. (1977) · BMJ · doi:10.1136/bmj.2.6089.766-b · Cited by 4
Cited by
Shankar-Hari, M., Phillips, G. S., Levy, M. L., Seymour, C. W., Liu, V. X., Deutschman, C. S., Angus, D. C., Rubenfeld, G. D., Singer, M., & for the Sepsis Definitions Task Force (2016) · JAMA · doi:10.1001/jama.2016.0289 · Cited by 2,424
Saposnik, G., Barinagarrementeria, F., Brown, R. D., Bushnell, C. D., Cucchiara, B., Cushman, M., deVeber, G., Ferro, J. M., & Tsai, F. Y. (2011) · Stroke · doi:10.1161/str.0b013e31820a8364 · Cited by 1,970
Interpretation of the evidence for the efficacy and safety of statin therapy
Collins, R., Reith, C., Emberson, J., Armitage, J., Baigent, C., Blackwell, L., Blumenthal, R., Danesh, J., Smith, G. D., DeMets, D., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31357-5 · Cited by 1,857
Self-citationChildhood maltreatment predicts adult inflammation in a life-course study
Danese, A., Pariante, C. M., Caspi, A., Taylor, A., & Poulton, R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610362104 · Cited by 1,264
Management of acute organophosphorus pesticide poisoning
Eddleston, M., Buckley, N. A., Eyer, P., & Dawson, A. H. (2008) · The Lancet · doi:10.1016/s0140-6736(07)61202-1 · Cited by 1,190
Metadata
- Authors
- Grimes, D. A., & Schulz, K. F.
- Affiliations
- Family Health International 360 (US)
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2002-01
- Volume
- 359
- Issue
- 9302
- Pages
- 248-252
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2100097418
- Cited by
- 1,553
- References
- 48
- Citations by year
- 2026: 123 · 2025: 109 · 2024: 84 · 2023: 94 · 2022: 77 · 2021: 78 · 2020: 93 · 2019: 81 · 2018: 75 · 2017: 70 · 2016: 59 · 2015: 64 · 2014: 71 · 2013: 64 · 2012: 56
- FWCI
- 35.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- selection bias, information bias, confounding, internal validity, generalizability, observational studies, misclassification, confounding adjustment, causal inference, spurious association, indirect association, dose-response relationship, temporal sequence, research design
- MeSH terms
- Data Collection, Humans, Research Design, Reproducibility of Results, Bias, Selection Bias, Causality, Confounding Factors, Epidemiologic, Multivariate Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.