CoChat

Mendelian randomization with invalid instruments: effect estimation and bias detection through Egger regression

Open access
Bowden, J., Davey Smith, G., Burgess, S. · 2015 · International Journal of Epidemiology

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.

Abstract

BACKGROUND: The number of Mendelian randomization analyses including large numbers of genetic variants is rapidly increasing. This is due to the proliferation of genome-wide association studies, and the desire to obtain more precise estimates of causal effects. However, some genetic variants may not be valid instrumental variables, in particular due to them having more than one proximal phenotypic correlate (pleiotropy). METHODS: We view Mendelian randomization with multiple instruments as a meta-analysis, and show that bias caused by pleiotropy can be regarded as analogous to small study bias. Causal estimates using each instrument can be displayed visually by a funnel plot to assess potential asymmetry. Egger regression, a tool to detect small study bias in meta-analysis, can be adapted to test for bias from pleiotropy, and the slope coefficient from Egger regression provides an estimate of the causal effect. Under the assumption that the association of each genetic variant with the exposure is independent of the pleiotropic effect of the variant (not via the exposure), Egger's test gives a valid test of the null causal hypothesis and a consistent causal effect estimate even when all the genetic variants are invalid instrumental variables. RESULTS: We illustrate the use of this approach by re-analysing two published Mendelian randomization studies of the causal effect of height on lung function, and the causal effect of blood pressure on coronary artery disease risk. The conservative nature of this approach is illustrated with these examples. CONCLUSIONS: An adaption of Egger regression (which we call MR-Egger) can detect some violations of the standard instrumental variable assumptions, and provide an effect estimate which is not subject to these violations. The approach provides a sensitivity analysis for the robustness of the findings from a Mendelian randomization investigation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/ije/dyv080

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Illustrative diagram showing the standard instrumental variable assumptions for genetic variant Gj (solid lines) with potential violations of the assumptions shown by dotted lines (which are marked with a ‘cross’). The genetic effect on the exposure X is γj, the direct genetic effect on the outcome Y is αj and the causal effect of the exposure X on the outcome Y is β.
Figure 1. Illustrative diagram showing the standard instrumental variable assumptions for genetic variant Gj (solid lines) with potential violations of the assumptions shown by dotted lines (which are marked with a ‘cross’). The genetic effect on the exposure X is γj, the direct genetic effect on the outcome Y is αj and the causal effect of the exposure X on the outcome Y is β.CC BY · PubMed Central
Figure 2. Plot of the gene–outcome (Γ^) vs gene–exposure (γ^) regression coefficients for a fictional Mendelian randomization analysis with 15 genetic variants. The true slope is shown by a dotted line, the inverse-variance weighted (IVW) estimate by a red line, and the MR-Egger regression estimate by a blue line. Refer to text for explanation of points (i) and (ii).
Figure 2. Plot of the gene–outcome (Γ^) vs gene–exposure (γ^) regression coefficients for a fictional Mendelian randomization analysis with 15 genetic variants. The true slope is shown by a dotted line, the inverse-variance weighted (IVW) estimate by a red line, and the MR-Egger regression estimate by a blue line. Refer to text for explanation of points (i) and (ii).CC BY · PubMed Central
Figure 3. Genetic associations with height and lung function from 180 variants measured in the ALSPAC dataset. Left: scatter plot of genetic associations with forced vital capacity (Γ^j) against associations with height (γ^j), with causal estimate of height on lung function estimated by inverse-variance weighted method. Right: funnel plot of minor allele frequency corrected genetic associations with height ((γ^)j^C) against causal estimates based on each genetic variant individually (β^j).
Figure 3. Genetic associations with height and lung function from 180 variants measured in the ALSPAC dataset. Left: scatter plot of genetic associations with forced vital capacity (Γ^j) against associations with height (γ^j), with causal estimate of height on lung function estimated by inverse-variance weighted method. Right: funnel plot of minor allele frequency corrected genetic associations with height ((γ^)j^C) against causal estimates based on each genetic variant individually (β^j).CC BY · PubMed Central
Figure 4. Genetic associations with blood pressure and coronary artery disease risk from 29 variants—funnel plots of minor allele frequency corrected genetic associations with blood pressure ((γ^)j^C) against causal estimates of blood pressure on CAD based on each genetic variant individually (β^j). Left: funnel plot for systolic blood pressure. Right: funnel plot for diastolic blood pressure. The inverse-variance weighted (IVW) and MR-Egger causal effect estimates are also shown.
Figure 4. Genetic associations with blood pressure and coronary artery disease risk from 29 variants—funnel plots of minor allele frequency corrected genetic associations with blood pressure ((γ^)j^C) against causal estimates of blood pressure on CAD based on each genetic variant individually (β^j). Left: funnel plot for systolic blood pressure. Right: funnel plot for diastolic blood pressure. The inverse-variance weighted (IVW) and MR-Egger causal effect estimates are also shown.CC BY · PubMed Central
Figure 5. Funnel plots of minor allele frequency corrected genetic associations with exposure ((γ^)j^C) against causal estimates based on each genetic variant individually (β^j) for 50 IV estimates in four scenarios: (a) no pleiotropy; (b) balanced pleiotropy; (c) directional pleiotropy, InSIDE assumption satisfied; and (d) directional pleiotropy, InSIDE assumption not satisfied. The inverse-variance weighted (IVW, red) and MR-Egger (blue) causal effect estimates are also shown.
Figure 5. Funnel plots of minor allele frequency corrected genetic associations with exposure ((γ^)j^C) against causal estimates based on each genetic variant individually (β^j) for 50 IV estimates in four scenarios: (a) no pleiotropy; (b) balanced pleiotropy; (c) directional pleiotropy, InSIDE assumption satisfied; and (d) directional pleiotropy, InSIDE assumption not satisfied. The inverse-variance weighted (IVW, red) and MR-Egger (blue) causal effect estimates are also shown.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

8 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 50 references

Research works printed but not linked: 12

  1. 2014, Human Molecular Genetics, 23, 89, 10.1093/hmg/ddu328 · DOI · Paper page
  2. 2010, Clinical Chemistry, 56, 723, 10.1373/clinchem.2009.141564 · DOI · Paper page
  3. 2015, International Journal of Epidemiology, 44, 496, 10.1093/ije/dyv071 · DOI · Paper page
  4. 2013, International Journal of Epidemiology, 42, 1157, 10.1093/ije/dyt110 · DOI · Paper page
  5. 2013, International Journal of Epidemiology, 42, 1497, 10.1093/ije/dyt179 · DOI · Paper page
  6. 2013, International Journal of Epidemiology, 42, 1134, 10.1093/ije/dyt093 · DOI · Paper page
  7. 2015, Statistics in medicine, 34, 454, 10.1002/sim.6358 · DOI · Paper page
  8. 2013, International Journal of Epidemiology, 42, 111, 10.1093/ije/dys064 · DOI · Paper page
  9. 2014, Economics and human biology, 13, 99, 10.1016/j.ehb.2013.12.002 · DOI · Paper page
  10. 2011, International Journal of Epidemiology, 40, 755, 10.1093/ije/dyr036 · DOI · Paper page
  11. 2013, American Journal of Epidemiology, 178, 1177, 10.1093/aje/kwt084 · DOI · Paper page
  12. Angrist J Pischke J-S Instrumental variables in action: sometimes you get whatyou need. In: Mostly Harmless Econometrics: An Empiricist’scompanion. Princeton, NJ: Princeton University Press, 2009.

Cited by

Items 901–1,000 of 1,058

Metadata

Authors
Bowden, J., Davey Smith, G., & Burgess, S.
Affiliations
University of Cambridge (GB)
Corresponding author
Bowden, J.
Venue
International Journal of Epidemiology
Published
2015-04-01
Volume
44
Issue
2
Pages
512-525
ISSN
  • 0300-5771 (ISSN-L)
  • 1464-3685
OpenAlex
W2113699335
Cited by
9,816
References
50
Citations by year
2026: 937 · 2025: 1929 · 2024: 2977 · 2023: 1482 · 2022: 797 · 2021: 590 · 2020: 379 · 2019: 283 · 2018: 205 · 2017: 123 · 2016: 88 · 2015: 21
FWCI
100.13
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • International Journal of Epidemiology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Bristol Research (University of Bristol) (submittedVersion, cc-by)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • Explore Bristol Research (submittedVersion, cc-by)
Funders
  • Wellcome Trust (MC_UU_12013_8, 100114)
  • National Institute for Health and Care Research (NF-SI-0512-10165)
  • British Heart Foundation (SP/08/007/23628, RG/08/014/24067)
  • University of Bristol (MC_UU_12013/2)
  • Medical Research Council (MC_UU_12013_2, MC_UU_12013_5, MR/N501906/1, MC UU 12013/8, MR/L012286/1, MR/L003120/1)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
Mendelian randomization, invalid instruments, pleiotropy, MR-Egger, small-study bias, multiple instruments, causal effect estimation, bias detection, sensitivity analysis
MeSH terms
Blood Pressure, Body Height, Coronary Artery Disease, Humans, Models, Biological, Regression Analysis, Respiration, Statistics as Topic, Genetic Variation, Meta-Analysis as Topic, Bias, Causality, Risk Assessment, Mendelian Randomization Analysis, Genetic Pleiotropy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.