E-Values for Mendelian Randomization
Abstract
To the Editor: The Mendelian randomization (MR) approach uses genetic variants to attempt to estimate causal effects of an exposure on an outcome with instrumental variable (IV) techniques.1 The traditional application of this approach requires several assumptions, including that the genetic variants do not affect the outcome except through the exposure (i.e., exclusion restriction) and share no cause with the outcome. These assumptions are often not evaluated and are often even not stated. One concern with the latter assumption is that there may be confounding of the effect of the variant on the outcome by ancestry (i.e., population stratification). Such confounding can also arise from assortative mating or dynastic effects. Although the assumption cannot be verified, the sensitivity or robustness of estimates to violations of this assumption can be evaluated using traditional bias analysis techniques. A particularly simple, easy-to-use approach to evaluate the sensitivity of estimates to confounding is the E-value. The E-value is defined as the minimum strength of association on the risk ratio scale that an unmeasured confounder would need to have with both the exposure and the outcome, conditional on the measured covariates, to completely explain away an observed exposure–outcome association.2 The E-value can be reported for both the estimate and the limit of the confidence interval closest to the null. It is straightforward to calculate, and for an observed risk ratio of magnitude RRobs, it can be obtained by If the initial risk ratio is less than 1, then it is inverted first before applying the formula. The E-value is nothing more than a simple transformation of the risk ratio to the confounding scale of the minimum association required between the unmeasured confounder and the exposure and the outcome, assuming both confounding associations are equal. It would be straightforward to report in MR analyses. To compute the E-value, all that is needed is the variant–outcome association. This is all that is needed because, when using the standard IV ratio, for example, a numerator equal to zero, of course, implies an effect estimate of zero. Similar logic pertains to any consistent IV-based estimator such that a zero causal effect of the exposure on the outcome implies a null variant–outcome association.3 To demonstrate the ease of computation, consider a recent MR study that suggested 3.6 additional years of education decreased the risk of coronary heart disease (CHD) by about one-third.4 The analyses used 162 genetic variants that have been previously associated with education, with the strongest variant–CHD association to be an odds ratio of 1.07. The E-value for this particular variant is then 1.34; for other variants, the E-value would be less than 1.34. Modest confounding could explain these away. In contrast, Chen et al.5 used a single variant in the ALDH2 gene to study the effects of alcohol intake on risk of hypertension. Among males, the variant–hypertension association was an odds ratio of 2.42. The E-value then is 4.27. The E-value for the lower limit of the confidence interval (1.66) is 2.71. As the analysis was conducted in an ethnically homogeneous Asian population, this E-value may be large enough to reasonably conclude that any residual confounding by ancestry is unlikely to explain away the effect. Unfortunately, the variant–outcome association is rarely reported, as many MR analyses report only IV estimates of the causal effect. We believe this should change. Ultimately, the statistical evidence for a non-null causal effect for the exposure on the outcome derives from the variant–outcome association and it is therefore important to evaluate the robustness of this association to both confounding and exclusion restriction violations. The reporting of the variant–outcome association itself is therefore of central importance. It allows for evaluating robustness to confounding using the E-value or similar techniques. It also directly allows for evaluating robustness to violations of the exclusion restriction, because the magnitude of the variant–outcome association itself is precisely equal to the magnitude of the exclusion restriction violation that would be required to explain away the IV estimate.6,7 The reporting of the variant–outcome association directly is further advantageous insofar as it is all that is needed to test a causal null hypothesis and is subject to far fewer assumptions and thus biases than IV estimation of the effect of the exposure on the outcome.7,8 Indeed, many of the issues regarding exposure definitions and well-defined interventions are rendered moot when viewing the variant–outcome association as a test of a causal null hypothesis.3,7 The reporting of the E-value and the variant–outcome association certainly does not resolve all biases concerning MR analyses. Moreover, this reporting also focuses on understanding the magnitude of bias that may explain away a non-nu
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reporting associations between measured covariates that might confound the variant-outcome association can also prove helpful, particularly if scaled by instrument strength or presented alongside a related bias analytical approach.
“Reporting associations between measured covariates that might confound the variant-outcome association can also prove helpful, particularly if scaled by instrument strength67 68 or presented alongside a related bias analytical approach.69”
From Strengthening the Reporting of Observational Studies in Epidemiology using Mendelian Randomisation (STROBE-MR): explanation and elaboration. (2021) · cites this paper as [69]
The E value can be used to understand the degree to which unmeasured confounding might explain findings.
“The E value69 can be used to understand the degree to which unmeasured confounding might explain findings.”
From Strengthening the Reporting of Observational Studies in Epidemiology using Mendelian Randomisation (STROBE-MR): explanation and elaboration. (2021) · cites this paper as [69]
Cites
Sensitivity analysis in observational research: Introducing the E-value
VanderWeele, T. J., & Ding, P. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2607 · Cited by 6,350 · see citing works
Self-citationDavey Smith, G., & Ebrahim, S. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg070 · Cited by 5,882 · see citing works
Conley, T. G., Hansen, C., & Rossi, P. E. (2008) · The Review of Economics and Statistics · doi:10.1162/rest_a_00139 · Cited by 1,189 · see citing works
Good practices for quantitative bias analysis
Lash, T. L., Fox, M. P., MacLehose, R. F., Maldonado, G., McCandless, L. C., & Greenland, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu149 · Cited by 651 · see citing works
Methodological Challenges in Mendelian Randomization
VanderWeele, T. J., Tchetgen Tchetgen, E. J., Cornelis, M., & Kraft, P. (2014) · Epidemiology · doi:10.1097/ede.0000000000000081 · Cited by 555 · see citing works
Self-citationChen, L., Davey Smith, G., Harbord, R. M., & Lewis, S. J. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050052 · Cited by 314 · see citing works
Education and coronary heart disease: mendelian randomisation study
Tillmann, T., Vaucher, J., Okbay, A., Pikhart, H., Peasey, A., Kubinova, R., Pajak, A., Tamosiunas, A., Malyutina, S., Hartwig, F. P., et al. (2017) · BMJ · doi:10.1136/bmj.j3542 · Cited by 225 · see citing works
Swanson, S. A., Tiemeier, H., Ikram, M. A., & Hernán, M. A. (2017) · Epidemiology · doi:10.1097/ede.0000000000000699 · Cited by 202 · see citing works
Self-citationToward a Clearer Portrayal of Confounding Bias in Instrumental Variable Applications
Jackson, J. W., & Swanson, S. A. (2015) · Epidemiology · doi:10.1097/ede.0000000000000287 · Cited by 74 · see citing works
Self-citationSwanson, S. A., Labrecque, J. A., & Hernán, M. Á. (2018) · European Journal of Epidemiology · doi:10.1007/s10654-018-0396-6 · Cited by 40 · see citing works
Self-citation
Flagged first, then by citations
2 of the 12 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Skrivankova, V. W., Richmond, R. C., Woolf, B. A. R., Davies, N. M., Swanson, S. A., VanderWeele, T. J., Timpson, N. J., Higgins, J. P. T., Dimou, N., Langenberg, C., et al. (2021) · BMJ · doi:10.1136/bmj.n2233 · Cited by 1,648 · see citing works
Self-citationMendelian randomization study of diabetes and dementia in the Million Veteran Program
LITKOWSKI, E. M., Logue, M. W., Zhang, R., CHAREST, B. R., Lange, E. M., Hokanson, J. E., Lynch, J. A., Vujković, M., Phillips, L. S., Hauger, R. L., et al. (2023) · Alzheimer s & Dementia · doi:10.1002/alz.13373 · Cited by 40 · see citing works
Cinelli, C., LaPierre, N., Hill, B. L., Sankararaman, S., & Eskin, E. (2022) · Nature Communications · doi:10.1038/s41467-022-28553-9 · Cited by 29 · see citing works
Hou, L., Li, H., Si, S., Yu, Y., Sun, X., Liu, X., Yan, R., Yu, Y., Wang, C., Yang, F., et al. (2020) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2020.12.005 · Cited by 26 · see citing works
Hou, L., Yu, Y., Sun, X., Liu, X., Yu, Y., Yan, R., Li, H., & Xue, F. (2022) · Statistical Methods in Medical Research · doi:10.1177/09622802221084599 · Cited by 7 · see citing works
Diemer and Swanson Reply to “Considerations Before Using Pandemic as Instrument”
Diemer, E. W., & Swanson, S. A. (2021) · American Journal of Epidemiology · doi:10.1093/aje/kwab175 · Cited by 3 · see citing works
Self-citationDuan, H., Arbeev, K. G., Holmes, R., Bagley, O., Wu, D., Akushevich, I. V., Schupf, N., Yashin, A. I., & Ukraintseva, S. V. (2024) · Frontiers in Aging · doi:10.3389/fragi.2024.1442017 · Cited by 2 · see citing works
Re. E-values for Mendelian Randomization
Sjölander, A., & Gabriel, E. E. (2023) · Epidemiology · doi:10.1097/ede.0000000000001673
Duan, H., Arbeev, K. G., Holmes, R., Bagley, O., Wu, D., Akushevich, I. V., Schupf, N., Yashin, A. I., & Ukraintseva, S. V. (2024) · medRxiv · doi:10.1101/2024.05.30.24308211
- Authors
- Swanson, S. A., & VanderWeele, T. J.
- Affiliations
- Harvard University (US)
- Venue
- Epidemiology
- Published
- 2020-05
- Volume
- 31
- Issue
- 3
- Pages
- e23-e24
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W3004031001
- Cited by
- 9
- References
- 12
- Citations by year
- 2024: 2 · 2023: 2 · 2022: 2 · 2021: 2 · 2020: 1
- FWCI
- 1.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- E-value, Mendelian randomization, confounding, population stratification, assortative mating, exclusion restriction, sensitivity analysis, genetic variants, coronary artery disease
- MeSH terms
- Data Interpretation, Statistical, Humans, Mendelian Randomization Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review