Commentary: Two-sample Mendelian randomization: opportunities and challenges
Open accessAbstract
In this volume of the IJE , Gao and colleagues explore the causal effect of adiposity on several cancers using two-sample Mendelian randomization (MR), and find some evidence that greater adult body mass index (BMI) causally reduces the risk of breast cancer while increasing ovarian, lung and colorectal cancer. 1 The authors conclude that the study provides ‘…additional understanding of the complex relationship between adiposity and cancer risks’. Beyond the study findings themselves, this paper is interesting in its use of publicly available genome-wide association study (GWAS) summary data in a two-sample MR approach. Whereas MR has been increasingly used over the past decade since it was first proposed in the IJE , 2 two-sample MR is a relatively recent extension. 3 With the increasing availability of complete summary results from GWAS consortia that are easily accessible on the internet, the use of two-sample MR is likely to increase considerably over the next decade. 4 By complete summary data I mean results for all genetic loci with a trait or disease outcome, and not just those reaching a pre-specified P -value threshold as shown in journal publications. It is this extensive availability of results that allows Gao et al. to relate genetic variants used as instrumental variables for adiposity traits to the cancer outcomes that they are interested in; the published GWAS for the cancer outcomes would not have reported on the adiposity variants unless they reached a pre-specified GWAS significance value. MR is a form of instrumental variable analysis that uses genetic variants as instrumental variables. It has been described as nature’s or your god’s randomized controlled trial (RCT), referring to the random allocation of genetic variants at conception that mean genetic variants are less likely to violate some of the assumptions of instrumental variable analyses than non-genetic instruments. 5,6 That analogy with RCTs is also useful when teaching MR to epidemiologists who feel anxious about genetics, as illustrated in Figure 1 which provides a revision of instrumental variable analyses and the key assumptions of this approach using an example of determining the causal effect of low-density lipoprotein cholesterol (LDLc) on coronary heart disease (CHD) via an RCT ( Figure 1 a and b) and via MR ( Figure 1 c and d). In both approaches the assumption that is most likely to be violated is the ‘exclusion restriction criteria’, 7–9 which states that the instrumental variable is only related to the outcome via its effect on the risk factor. Figure 1 also shows that, if the instrumental variable assumptions are correct, the estimate of the causal effect of the risk factor on outcome can be obtained from a simple ratio of the effect of the instrumental variable on outcome divided by the effect of the instrumental variable on risk factor. In the paper by Gao and colleagues, causal effect = log odds of cancer per allele of combined adiposity genetic variants ÷ regression coefficient of adiposity measure per allele of combined adiposity genetic variants. DAG of instrumental variable analyses in an RCT and MR study exploring the effect of LDLc on CHD. These are directed acyclic graphs (DAGs), thus the absence of an arrow between any two variables (nodes) indicates we do not consider it plausible that there is a causal effect between those two. Figure shows DAGs of instrumental variable (IV) analyses to test the causal effect of low-density lipoprotein cholesterol (LDLc) on CHD. In Figure 1 a and b, the IV is randomization to receiving a statin or not (i.e this is an example of IV analyses in an RCT). In Figure 1 c and d, the IV is genetic variants that are robustly related to LDLc (i.e. this is a Mendelian randomization study). Figure 1 a and c both illustrate the three key assumptions of IV analyses: i. that the IV ‘Z’ (randomization to statins in Figure 1 a and genetic variants related to LDLc in Figure 1 c) is (or is plausibly) causally related to the risk factor (LDLc in all figures); ii. that confounding factors for the risk factor-outcome ‘X’-’Y’ association (here LDLc on CHD in all figures) are not related to the instrumental variable; iii. that the instrumental variable ‘Z’ only affects the outcome ‘Y’ (CHD) through its effect on the risk factor ‘X’ (LDLc). Two-sample MR exploits the fact that it is not necessary to obtain the effect of the instrumental variable-risk factor association (ratio denominator) and instrumental variable-outcome association (ratio numerator) from the same sample of participants. Indeed, there are some advantages to obtaining them from two different sets of participants. In particular ‘winners’ curse’, which can underestimate true causal effects in one-sample MR, 10 is unlikely to happen in two-sample MR, and unlike the impact of weak instrument bias in one-sample MR (which biases effects towards the confounded multivariable regression result), in two-sample MR weak instrument bias is
AI snapshot
Written from the paper’s full text.
TL;DR
This commentary reviews the opportunities and challenges of two-sample Mendelian randomization (MR), using Gao and colleagues' study of adiposity and cancer risk as an illustrative case. It argues that while two-sample MR using publicly available GWAS summary data increases statistical power and avoids winner's curse, it introduces pitfalls around sample overlap, non-sex-specific instruments, covariate adjustment, and weak instrument bias that authors must address.
Key findings
- Two-sample MR has key advantages over one-sample MR: winner's curse is avoided, and weak instrument bias is towards the null rather than towards the confounded multivariable regression result; the main advantage of GWAS summary data is increased statistical power, illustrated by Gao et al.'s cancer case numbers (15,748 breast, 5,100 colorectal, 12,160 lung, 4,369 ovarian, 14,160 prostate).
- The commentary critiques Gao et al.'s conclusions: they largely base conclusions on P < 0.05 after multiple testing, and some BMI and WHR point estimates are similar (e.g. BMI–breast cancer OR 0.66 [95% CI 0.57, 0.77] concluded, but WHR 0.73 [0.53, 1.00] not; BMI–lung cancer OR 1.27 [1.09, 1.49] declared positive, but WHR–squamous lung cancer OR 1.33 [0.75, 2.36] not).
- Potential biases in Gao et al. are identified: WHR variants were adjusted for BMI (biasing the MR estimate towards the null); the adult BMI instrument is stronger than others (R² for adult BMI 0.027, birthweight 0.008, child BMI 0.020, WHR 0.013); and sex-combined instrument–adiposity associations were used for sex-specific cancers, though 7 of 14 WHR variants were stronger in females (combined variants explained 1.34% of WHR variation in women vs 0.46% in men).
- The commentary notes MR cannot easily distinguish effects at different life stages because 12 of 15 child BMI variants overlapped with adult BMI variants, and MR-Egger cannot differentiate adult from child BMI effects.
Methods
Not a primary study; a commentary/review. It synthesizes methodological literature on one- and two-sample MR, presents a comparison table (Table 1) of assumptions and issues across the two designs, and critically appraises Gao et al.'s two-sample MR study of adiposity traits and five cancers, including re-examination of the original GWAS papers for sex-specific effects (Table 2).
Limitations
The paper states that the extent to which bias towards the null (from weak instrument bias and WHR adjustment for BMI) is balanced by possible exaggeration from using non-sex-specific instruments is "impossible to tell." It also notes that for birthweight and child BMI, the original GWAS made no attempt to explore sex differences, so it is impossible to know whether the no-sex-difference assumption holds. Evident from the text: as a commentary, it offers no new primary data or formal analysis, and its critique of Gao et al. relies on the authors' supplementary materials and original GWAS publications rather than reanalysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 35 cited sources checked · 0 supported · 0 flagged
- Findingown data
Some point estimates for body mass index and waist-hip ratio in Gao et al. are not that dissimilar.
“However, some of the point estimates for BMI and WHR are not that dissimilar.”
Quote in the paperSubstantial claim - Premisecitation
Gao et al. do not provide any information on the strength of the different instrumental variables, such as the F-statistic or R2 for the genetic instrument-adiposity trait associations.
“Gao and colleagues do not provide any information on the strength of the different instrumental variables, such as the F-statistic or R 2 for the genetic instrument-adiposity trait associations.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
- Premisereasoning
Gao et al. were unable with the summary data available to test differences in effect between pre- and postmenopausal breast cancer because GWAS separated by these sub-phenotypes are not presented by the breast cancer consortia.
“They are unable with the summary data available to test differences in effect between pre- and postmenopausal breast cancer, as GWAS separated by these sub-phenotypes are not presented by the breast cancer consortia.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
- Premisecitation
The waist-hip ratio variants used by Gao et al. were adjusted for body mass index, which the authors do not seem to acknowledge.
“The WHR variants used by Gao and colleagues were adjusted for BMI, which the authors do not seem to acknowledge.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
- Interpretationown data
A further potential explanation for why most emphasized Mendelian randomization results are for adult body mass index rather than other adiposity risk factors is that the genetic instrument for adult body mass index is stronger than for the other traits.
“A further potential explanation for why most of the emphasized (based on statistical testing) MR results are seen for adult BMI, rather than any of the other adiposity risk factors, is that the genetic instrument for adult BMI is stronger than for the other traits.”
Quote in the paperNot a substantial claim
- Premisecitation
Gao et al. found the same inverse association with estrogen receptor-positive cancers as seen for all breast cancer cases combined.
“but Gao and colleagues are able to examine effects with estrogen receptor-positive cancers and they find the same inverse association with these as seen for all breast cancer cases combined.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
- Interpretationreasoning
The Mendelian randomization estimate of the effect of unadjusted waist-hip ratio on cancer would be biased towards the null because the denominator of the ratio (the genetic instrument-waist-hip ratio association) will be exaggerated due to adjustment for body mass index.
“Thus, the MR estimate of the effect of unadjusted WHR on cancer would be to bias it towards the null because the denominator of the ratio (the genetic instrument-WHR association) will be exaggerated due to adjustment for BMI.”
Quote in the paperSubstantial claim - Premisecitation
Adjustment of waist-hip ratio variants for body mass index is likely to have biased the effect of genome-wide variants associated with unadjusted waist-hip ratio away from the null.
“This adjustment is likely to have biased the effect of genome-wide variants associated with unadjusted WHR (away from the null).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [17] source
Not checked in the free run.
- Interpretationnone given
In the case of childhood and adult body mass index, it is unlikely that the effect of the genetic instrument on the risk factor is independent of its effect on other phenotypes.
“In the case of childhood and adult BMI, we know that is unlikely to be the case.”
Quote in the paperNot a substantial claim - Premisecitation
The main advantage of using summary data from GWAS consortia in two-sample Mendelian randomization is increased statistical power, particularly for testing effects on binary disease outcomes.
“The main advantage of using summary data from GWAS consortia in two-sample MR is the increased statistical power, particularly in relation to testing effects on binary disease outcomes.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [4] source
Not checked in the free run.
- Premisecitation
Mendelian randomization is limited in the extent to which it can explore different life course models, such as whether exposure effects differ at different points in the life course.
“this also brings a disadvantage in that MR is limited in the extent to which it can explore different life course models, such as whether exposure effects differ at different points in the life course.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [12] Smith ADAC Hardy R Heron J . Model selection of life course hypotheses involving continuous exposures. Int J Epidemiol 2016; in review.
Not checked in the free run.
- cites [13] Smith, 2015, Model selection of the effect of binary exposures over the life course, Epidemiology source
Not checked in the free run.
- Premisereasoning
Contrary to IJE author recommendations and recent guidance from the American Statistics Society, Gao et al. largely base their conclusions on findings with a P-value equivalent to <0.05 after multiple testing.
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Wasserstein RL Lazar NA . The ASA’s statement on p-values: context, process, and purpose. Am Stat 2016. doi: 10.1080/00031305.2016.1154108. source
Not checked in the free run.
- Interpretationcitation
For the sex-specific cancers in Gao et al., the two samples do not seem to be from the same underlying population.
“but for the sex-specific cancers in the paper by Gao et al. , this does not seem to be the case.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
- Interpretationreasoning
It is impossible to know whether the assumption of no sex differences holds for birthweight and child body mass index.
“Thus, it is impossible to know whether the assumption of no sex differences holds for these two risk factors.”
Quote in the paperSubstantial claim - Premisenone given
For two-sample Mendelian randomization to be valid, the two samples have to be from the same underlying population.
“For two-sample MR to be valid, the two samples have to be from the same underlying population”
Quote in the paperNot a substantial claim - Premisecitation
Lau et al. demonstrated that had a cumulative meta-analysis been regularly updated, the beneficial effect of streptokinase in patients who had experienced an acute myocardial infarction would have been established by 1973.
“Lau and colleagues demonstrated that, had a cumulative meta-analysis been regularly updated, the beneficial effect of streptokinase in patients who had experienced an acute myocardial infarction would have been established by 1973”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Premisecitation
Gao et al. seem to have used sex-combined results for determining effects of waist-hip ratio adjusted for body mass index, despite the original GWAS paper examining and finding sex differences.
“What is more surprising is that they seem to have also used sex-combined results for determining effects of WHR adjusted for BMI, despite the fact that it is clear from the title of the original GWAS paper that sex differences were examined and found 19 ( Table 2 ).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
- Premisecitation
From the original papers, the instrument for adult body mass index is stronger than for the other traits (R2 for adult body mass index, birthweight, child body mass index and waist-hip ratio are 0.027, 0.008, 0.020 and 0.013, respectively).
“From the original papers it can be seen that the instrument for adult BMI is stronger than for the other traits (the respective R 2 for adult BMI, birthweight, child BMI and WHR, are: 0.027, 0.008, 0.020 and 0.013;”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [14] source
Not checked in the free run.
- cites [18] Horikoshi, 2013, New loci associated with birth weight identify genetic links between intrauterine growth and adult height and metabolism, Nat Genet source
Not checked in the free run.
- cites [19] source
Not checked in the free run.
- cites [20] source
Not checked in the free run.
- Premisereasoning
For birthweight and child body mass index, there seemed to have been no attempt to explore sex differences in the original GWAS, likely reflecting low power.
“For birthweight and child BMI, there seemed to have been no attempt to explore sex differences, which likely reflects the low power in those studies to do that.”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
In both GWAS, the per allele effect of the genetic instrument on waist-hip ratio adjusted for body mass index is notably stronger in females than males.
“In both GWAS, the results of the per allele effect of the genetic instrument on WHR adjusted for BMI is notably stronger in females than males.”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationreasoning
Differences in just two of the 77 variants might not have been sufficient to bias the results for adult body mass index with the sex-specific outcomes.
“Differences in just two of the 77 variants might not have been sufficient to bias the results for adult BMI with the sex-specific outcomes”
Quote in the paperNot a substantial claim - Premisecitation
Egger and Davey Smith showed the same with respect to beta-blockers and mortality after acute myocardial infarction.
“In 1997, Egger and Davey Smith showed the same with respect to beta-blockers and mortality after acute myocardial infarction.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] source
Not checked in the free run.
- May combine two claims. 14
- Classified as probably not a substantial claim. 6
May combine two claims.
InterpretationreasoningGao et al. are not really able to determine effects of body mass index at different life stages because body mass index assessed at different ages is correlated and because of the nature of Mendelian randomization.
“Gao and colleagues examine the effects of childhood BMI and adult BMI, but they are not really able to determine effects at different life stages because of the correlation between BMI assessed at different ages and because of the nature of MR.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationGreater adult body mass index, but not waist-hip ratio, is concluded by Gao et al. to decrease breast cancer and increase ovarian, lung and colorectal cancer risk.
“Greater adult BMI, but not waist-hip ratio (WHR), is concluded to decrease breast cancer and increase ovarian, lung and colorectal cancer risk.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
May combine two claims.
PremisecitationIn two-sample Mendelian randomization, weak instrument bias is towards the null, unlike one-sample Mendelian randomization where it biases effects towards the confounded multivariable regression result.
“unlike the impact of weak instrument bias in one-sample MR (which biases effects towards the confounded multivariable regression result), in two-sample MR weak instrument bias is towards the null.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] source
Not checked in the free run.
May combine two claims.
Premisecitation'Winner's curse' is unlikely to happen in two-sample Mendelian randomization, whereas it can underestimate true causal effects in one-sample Mendelian randomization.
“In particular ‘winners’ curse’, which can underestimate true causal effects in one-sample MR, 10 is unlikely to happen in two-sample MR”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [10] source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationGao et al. analysed large numbers of cancer cases: 15,748 breast, 5,100 colorectal, 12,160 lung, 4,369 ovarian, and 14,160 prostate cancer.
“The paper by Gao and colleagues illustrates this with the large numbers of cancer cases that they analyse: 15 748, 5100, 12 160, 4369 and 14 160, respectively, for breast, colorectal, lung, ovarian and prostate cancer.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
May combine two claims.
PremisecitationMendelian randomization generally assesses cumulative effects of a risk factor over a long period of the life course without requiring repeat risk factor assessment and with little chance of regression dilution bias or reverse causation.
“Whereas one of the noted advantages of MR is that it generally assesses the cumulative effects of a risk factor over a long period of the life course (potentially from conception) without requiring repeat risk factor assessment and with little chance of regression dilution bias or reverse causation (confounding by prevalent disease), 7”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [7] source
Not checked in the free run.
May combine two claims.
PremisecitationOf the 15 child body mass index variants, 12 overlapped with known adult body mass index variants, illustrating the difficulty of distinguishing child and adult body mass index effects.
“From the original GWAS, 12 of the 15 child BMI overlapped with known adult BMI variants, 14 which illustrates the difficulty of distinguishing these two.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationGao et al. found some evidence that greater adult body mass index causally reduces the risk of breast cancer while increasing ovarian, lung and colorectal cancer.
“Gao and colleagues explore the causal effect of adiposity on several cancers using two-sample Mendelian randomization (MR), and find some evidence that greater adult body mass index (BMI) causally reduces the risk of breast cancer while increasing ovarian, lung and colorectal cancer.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
May combine two claims.
PremisecitationMR-Egger cannot be used to differentiate effects of adult from child body mass index because it is only valid if the effect of the genetic instrument on the risk factor is independent of its effect on other phenotypes that might violate the exclusion restriction.
“Furthermore the MR-Egger test, 9 which the authors used to test violation of the exclusion restriction criteria, cannot be used to differentiate effects of adult from child BMI, as Gao and colleagues acknowledge. This is because MR-Egger is only valid if the effect of the genetic instrument on the risk factor of interest is independent of its effect on any other phenotypes that might violate that”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9] source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThis study illustrates some of the pitfalls of using summary GWAS data and methods that might be used to limit these.
“But this study does illustrate some of the pitfalls of using summary GWAS data and methods that might be used to limit these.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationcitationThose retrospective findings could have been identified prospectively with easy open access to complete summary data of everything tested in all randomized controlled trials.
“Those retrospective findings could have been identified prospectively with easy open access to complete summary data of everything tested in all RCTs.”
Quote in the paperNot a substantial claim- Rests on an assumption: We still lack open access to complete summary data of everything tested in all randomized controlled trials.
May combine two claims.
PremisecitationFor adult body mass index, sex differences were reported and marked differences were found for two of the 77 variants (stronger associations in women compared with men).
“For adult BMI, sex differences were reported and marked differences were found for two of the 77 variants (stronger associations in women compared with men).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [20] source
Not checked in the free run.
May combine two claims.
InterpretationreasoningBecause the per allele effect of the genetic instrument on waist-hip ratio adjusted for body mass index is the denominator of the Mendelian randomization ratio estimate, the estimated effect of waist-hip ratio adjusted for body mass index for female cancers (breast and ovarian) may be exaggerated and those for prostate cancers underestimated.
“As this is the denominator of the MR ratio estimate, it means that the estimated effect of WHR adjusted for BMI for female cancers (breast and ovarian) may be exaggerated and those for prostate cancers underestimated.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationAlthough Gao et al. use the most up-to-date body mass index GWAS data, they do not do the same for waist-hip ratio, despite the most recent GWAS for waist-hip ratio adjusted for body mass index identifying 33 additional variants and being published around the same time.
“Interestingly, although Gao et al. use the most up-to-date BMI GWAS data, 20 they do not do the same for WHR, despite the most recent GWAS for WHR adjusted for BMI identifying 33 additional variants (as well as confirming the 14 used here from the earlier GWAS) and being published around the same time as the most up-to-date BMI GWAS.”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationAccording to Gao's Supplementary Table 1, the association of the genetic instrumental variable with each adiposity trait was taken from samples combining females and males, whereas for breast and ovarian cancer females only were included and for prostate cancer males only were included.
“According to data presented by Gao in their Supplementary Table 1, it seems that the association of the genetic instrumental variable with each adiposity trait has been taken from samples that combine females and males, whereas for the association of the genetic instrument with breast and ovarian cancer, females only are included and with prostate cancer males only are included.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Gao, 2016, Mendelian randomization study of adiposity-related traits and risk of breast, ovarian, prostate, lung and colorectal cancer, Int J Epidemiol source
Not checked in the free run.
May combine two claims.
PremisecitationSeven of the 14 waist-hip ratio adjusted for body mass index variants used by Gao et al. were stronger in females compared with males, with 19 of the 44 variants in the more up-to-date GWAS being stronger in females (and one stronger in males).
“Seven of the 14 WHR adjusted for BMI variants used by Gao and colleagues were stronger in females compared with males ( Table 2 ), with 19 of the 44 variants in the more up-to-date GWAS being stronger in females (and one stronger in males).”
Quote in the paperSubstantial claim0 of 2 sources checkedClassified as probably not a substantial claim.
InterpretationreasoningThe extent to which bias towards the null from weak instrument bias and adjustment of waist-hip ratio for body mass index is balanced by possible exaggeration from not using sex-specific data for the genetic instrument-waist-hip ratio association in female cancers is impossible to tell.
“The extent to which bias towards the null as a possible result of weak instrument bias and adjustment of WHR for BMI (discussed above) is balanced by possible exaggeration of the true effect as a result of not using sex-specific data for the genetic instrument-WHR association in the female cancers, is impossible to tell.”
Quote in the paperSubstantial claim
The paper relies on this without support.
We still lack open access to complete summary data of everything tested in all randomized controlled trials.
“However, we still lack such access.”
The authors state this as an assumption.
The instrumental variable is only related to the outcome via its effect on the risk factor (the exclusion restriction criterion).
“the assumption that is most likely to be violated is the ‘exclusion restriction criteria’, 7–9 which states that the instrumental variable is only related to the outcome via its effect on the risk factor.”
The authors state this as an assumption.
Confounding factors for the risk factor-outcome association are not related to the instrumental variable.
“ii. that confounding factors for the risk factor-outcome ‘X’-’Y’ association (here LDLc on CHD in all figures) are not related to the instrumental variable;”
The authors state this as an assumption.
The instrumental variable is causally related to the risk factor.
“i. that the IV ‘Z’ (randomization to statins in Figure 1 a and genetic variants related to LDLc in Figure 1 c) is (or is plausibly) causally related to the risk factor (LDLc in all figures);”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Two methods (MR-Egger and the weighted median estimator) are likely to become increasingly used in MR sensitivity analyses as two-sample MR using summary GWAS data becomes more common.
“Two of these methods in particular (MR-Egger36 and the weighted median estimator37) are likely to become increasingly used in MR sensitivity analyses, as two-sample MR using summary genome-wide association studies (GWAS) data becomes more common.38”
From Triangulation in aetiological epidemiology (2017) · cites this paper as [38]
MR-Egger and weighted median estimator could be used as a sensitivity analysis to assess violation of the exclusion restriction criteria when several different treatment IVs are used in RCTs.
“Although these approaches have been developed for use in MR, and in particular in the case of MR-Egger for two-sample MR,36,38 they could clearly be used as a sensitivity analysis to assess violation of the exclusion restriction criteria when several different treatment IVs are used in RCTs.”
From Triangulation in aetiological epidemiology (2017) · cites this paper as [38]
Many genome-wide association consortia have now made their aggregate results fully available, with massive potential for these to increase aetiological understanding, including mechanistic insights, through two-sample MR.
“Many genome-wide association consortia have now made their aggregate results fully available (i.e. all genetic associations for up to several million genetic variants with an ever-increasing number of outcomes from molecular to behavioural phenotypes, irrespective of P-values), with massive potential for these to increase aetiological understanding, including mechanistic insights, through two”
From Triangulation in aetiological epidemiology (2017) · cites this paper as [38]
Cites
Bowden, J., Davey Smith, G., & Burgess, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv080 · Cited by 9,816 · see citing works
The ASA Statement on <i>p</i> -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · see citing works
Davey Smith, G., & Ebrahim, S. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg070 · Cited by 5,882 · see citing works
Mendelian randomization: genetic anchors for causal inference in epidemiological studies
Davey Smith, G., & Hemani, G. (2014) · Human Molecular Genetics · doi:10.1093/hmg/ddu328 · Cited by 4,677 · see citing works
Mendelian randomization: Using genes as instruments for making causal inferences in epidemiology
Lawlor, D. A., Harbord, R. M., Sterne, J. A. C., Timpson, N., & Davey Smith, G. (2008) · Statistics in Medicine · doi:10.1002/sim.3034 · Cited by 4,618 · see citing works
Self-citationGenetic studies of body mass index yield new insights for obesity biology
Study, T. L. C., Locke, A. E., The ADIPOGen Consortium, The AGEN-BMI Working Group, The CARDIOGRAMplusC4D Consortium, The CKDGen Consortium, The, G. L. G. C., The, I. C. B. P., The MAGIC Investigators, The MuTHER Consortium, et al. (2015) · Nature · doi:10.1038/nature14177 · Cited by 4,534 · see citing works
EPIC- InterAct Consortium, Burgess, S., Scott, R. A., Timpson, N. J., Davey Smith, G., & Thompson, S. G. (2015) · European Journal of Epidemiology · doi:10.1007/s10654-015-0011-z · Cited by 1,803 · see citing works
Burgess, S., & Thompson, S. G. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu283 · Cited by 1,605 · see citing works
New genetic loci link adipose and insulin biology to body fat distribution
The ADIPOGen Consortium, Shungin, D., The CARDIOGRAMplusC4D Consortium, The CKDGen Consortium, The GEFOS Consortium, The GENIE Consortium, The, G. L. G. C., The, I. C. B. P., The International Endogene Consortium, Study, T. L. C., et al. (2015) · Nature · doi:10.1038/nature14132 · Cited by 1,580 · cited 3× · see citing works
“From the original papers it can be seen that the instrument for adult BMI is stronger than for the other traits (the respective R2 for adult BMI, birthweight, child BMI and WHR, are: 0.027, 0.008, 0.020 and 0.013; the R2 for child BMI is only for the three novel SNPs but, as the authors of the original paper point out…”
MethodInfluentialCumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140 · see citing works
Burgess, S., Dudbridge, F., & Thompson, S. G. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv017 · Cited by 945 · see citing works
MAGIC, Heid, I. M., Jackson, A. U., Randall, J. C., Winkler, T. W., Qi, L., Steinthorsdottir, V., Thorleifsson, G., Zillikens, M. C., Speliotes, E. K., et al. (2010) · Nature Genetics · doi:10.1038/ng.685 · Cited by 931 · see citing works
Self-citation<i>Meta-analysis:</i> Potentials and promise
Egger, M., & Smith, G. D. (1997) · BMJ · doi:10.1136/bmj.315.7119.1371 · Cited by 646 · see citing works
Smith, G. D., Lawlor, D. A., Harbord, R., Timpson, N., Day, I., & Ebrahim, S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040352 · Cited by 569 · see citing works
Self-citationUK biobank data: come and get it
Allen, N. E., Sudlow, C., Peakman, T., Collins, R., & Biobank, O. B. O. U. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008601 · Cited by 399 · see citing works
Felix, J. F., Bradfield, J. P., Monnereau, C., van der Valk, R. J. P., Stergiakouli, E., Chesi, A., Gaillard, R., Feenstra, B., Thiering, E., Kreiner-Møller, E., et al. (2016) · Human Molecular Genetics · doi:10.1093/hmg/ddv472 · Cited by 343 · see citing works
The Meta-Analyses of Glucose- and Insulin-related traits Consortium (MAGIC), Horikoshi, M., Early Growth Genetics (EGG) Consortium, Yaghootkar, H., Mook-Kanamori, D. O., Sovio, U., Taal, H. R., Hennig, B. J., Bradfield, J. P., St Pourcain, B., et al. (2013) · Nature Genetics · doi:10.1038/ng.2477 · Cited by 309 · see citing works
Adjusting for Heritable Covariates Can Bias Effect Estimates in Genome-Wide Association Studies
Aschard, H., Vilhjálmsson, B. J., Joshi, A. D., Price, A. L., & Kraft, P. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2014.12.021 · Cited by 287 · see citing works
Hingorani, A. D., & Humphries, S. E. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67767-7 · Cited by 277 · see citing works
Instrumental Variable Analysis with a Nonlinear Exposure–Outcome Relationship
Burgess, S., Davies, N. M., & Thompson, S. G. (2014) · Epidemiology · doi:10.1097/ede.0000000000000161 · Cited by 208 · see citing works
Metabolomic Profiling of Statin Use and Genetic Inhibition of HMG-CoA Reductase
Würtz, P., Wang, Q., Soininen, P., Kangas, A. J., Fatemifar, G., Tynkkynen, T., Tiainen, M., Perola, M., Tillin, T., Hughes, A. D., et al. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.12.060 · Cited by 188 · see citing works
Self-citationTaylor, A. E., Davies, N. M., Ware, J. J., VanderWeele, T., Smith, G. D., & Munafò, M. R. (2014) · Economics & Human Biology · doi:10.1016/j.ehb.2013.12.002 · Cited by 166 · see citing works
Gao, C., Patel, C. J., Michailidou, K., Peters, U., Gong, J., Schildkraut, J., Schumacher, F. R., Zheng, W., Boffetta, P., Stucker, I., et al. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw129 · Cited by 163 · see citing works
A genome-wide association study of body mass index across early life and childhood
Warrington, N. M., Howe, L. D., Paternoster, L., Kaakinen, M., Herrala, S., Huikari, V., Wu, Y., Kemp, J. P., Timpson, N. J., Pourcain, B. S., et al. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv077 · Cited by 134 · see citing works
Self-citationSilverwood, R. J., Holmes, M. V., Dale, C. E., Lawlor, D. A., Whittaker, J. C., Smith, G. D., Leon, D. A., Palmer, T., Keating, B. J., Zuccolo, L., et al. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu187 · Cited by 66 · see citing works
Self-citationModel Selection of the Effect of Binary Exposures over the Life Course
Smith, A. D. A. C., Heron, J., Mishra, G., Gilthorpe, M. S., Ben-Shlomo, Y., & Tilling, K. (2015) · Epidemiology · doi:10.1097/ede.0000000000000348 · Cited by 63 · see citing works
A structured approach to hypotheses involving continuous exposures over the life course
Smith, A. D. A. C., Hardy, R., Heron, J., Joinson, C. J., Lawlor, D. A., Macdonald-Wallis, C., & Tilling, K. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw164 · Cited by 59 · see citing works
Self-citationRandomised by (your) god: robust inference from an observational study design
Smith, G. D. (2006) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2004.031880 · Cited by 39 · see citing works
Smith, A., Heron, J., Ben‐Shlomo, Y., Gilthorpe, M. S., Hardy, R., Joinson, C. J., Lawlor, D. A., Macdonald-Wallis, C. M., Mishra, G. D., & Tilling, K. M. (2015) · Oral Presentations · doi:10.1136/jech-2015-206256.78 · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Smith ADAC Hardy R Heron J . Model selection of life course hypotheses involving continuous exposures. Int J Epidemiol 2016; in review.
Cited by
Sorted by citations
Triangulation in aetiological epidemiology
Lawlor, D. A., Tilling, K., & Davey Smith, G. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyw314 · Cited by 1,129 · see citing works
Self-citationHartwig, F. P., Davies, N. M., Hemani, G., & Davey Smith, G. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyx028 · Cited by 860 · see citing works
An atlas of genetic influences on osteoporosis in humans and mice
23andMe Research Team, Morris, J. A., Kemp, J. P., Youlten, S. E., Laurent, L., Logan, J. G., Chai, R. C., Vulpescu, N. A., Forgetta, V., Kleinman, A., et al. (2019) · Nature Genetics · doi:10.1038/s41588-018-0302-x · Cited by 773 · see citing works
Mendelian Randomization: Concepts and Scope
Richmond, R. C., & Davey Smith, G. (2022) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a040501 · Cited by 841 · see citing works
Rosoff, D. B., Smith, G. D., & Lohoff, F. W. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.3554 · Cited by 186 · see citing works
Smithers, L. G., Sawyer, A. C. P., Chittleborough, C. R., Davies, N. M., Davey Smith, G., & Lynch, J. W. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0461-x · Cited by 175 · see citing works
Plasma lipids and risk of aortic valve stenosis: a Mendelian randomization study
Nazarzadeh, M., Pinho-Gomes, A.-C., Bidel, Z., Dehghan, A., Canoy, D., Hassaine, A., Ayala Solares, J. R., Salimi-Khorshidi, G., Smith, G. D., Otto, C. M., et al. (2020) · European Heart Journal · doi:10.1093/eurheartj/ehaa070 · Cited by 163 · see citing works
Gao, C., Patel, C. J., Michailidou, K., Peters, U., Gong, J., Schildkraut, J., Schumacher, F. R., Zheng, W., Boffetta, P., Stucker, I., et al. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw129 · Cited by 163 · see citing works
Interpretation and Potential Biases of Mendelian Randomization Estimates With Time-Varying Exposures
Labrecque, J. A., & Swanson, S. A. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwy204 · Cited by 139 · see citing works
Depression and Interleukin-6 Signaling: A Mendelian Randomization Study
Kelly, K. M., Smith, J. A., & Mezuk, B. (2021) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2021.02.019 · Cited by 117 · see citing works
Xu, L., Borges, M. C., Hemani, G., & Lawlor, D. A. (2017) · Diabetologia · doi:10.1007/s00125-017-4396-y · Cited by 104 · see citing works
Self-citationIntimate Relationships and Depression: Searching for Causation in the Sea of Association
Whisman, M. A., Sbarra, D. A., & Beach, S. R. H. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-103323 · Cited by 104 · see citing works
Herpesvirus infections and Alzheimer's disease: a mendelian randomization study
Huang, S.-Y., Yang, Y.-X., Kuo, K., Li, H.-Q., Shen, X.-N., Chen, S.-D., Cui, M., Tan, L., Dong, Q., & Yu, J.-T. (2021) · Alzheimer's Research & Therapy · doi:10.1186/s13195-021-00905-5 · Cited by 82 · see citing works
Yang, Q., Sanderson, E., Tilling, K., Borges, M. C., & Lawlor, D. A. (2019) · doi:10.1101/19009605 · Cited by 85 · see citing works
Self-citationAmbati, J., Magagnoli, J., Leung, H., Wang, S.-B., Andrews, C. A., Fu, D., Pandey, A., Sahu, S., Narendran, S., Hirahara, S., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18528-z · Cited by 66 · see citing works
O’Loughlin, J., Casanova, F., Jones, S. E., Hagenaars, S. P., Beaumont, R. N., Freathy, R. M., Watkins, E. R., Vetter, C., Rutter, M. K., Cain, S. W., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-021-01157-3 · Cited by 44 · see citing works
Haworth, S., Kho, P. F., Holgerson, P. L., Hwang, L.-D., Timpson, N. J., Rentería, M. E., Johansson, I., & Cuellar-Partida, G. (2021) · European Journal of Human Genetics · doi:10.1038/s41431-020-00734-4 · Cited by 29 · see citing works
Lor, G. C. Y., Risch, H. A., Fung, W. T., Au Yeung, S. L., Wong, I. O. L., Zheng, W., & Pang, H. (2019) · Cancer Epidemiology · doi:10.1016/j.canep.2019.101577 · Cited by 27 · see citing works
Constrained instruments and their application to Mendelian randomization with pleiotropy
Jiang, L., Oualkacha, K., Didelez, V., Ciampi, A., Rosa‐Neto, P., Benedet, A. L., Mathotaarachchi, S., Richards, J. B., Greenwood, C. M. T., & Initiative, A. F. T. A. D. N. (2019) · Genetic Epidemiology · doi:10.1002/gepi.22184 · Cited by 23 · see citing works
- Authors
- Lawlor, D. A.
- Affiliations
- University of Bristol (GB)
- Corresponding author
- Lawlor, Debbie A
- ORCID
- Lawlor, Debbie A
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-06
- Volume
- 45
- Issue
- 3
- Pages
- 908-915
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- PMC
- PMC5005949
- OpenAlex
- W2490528887
- Cited by
- 810
- References
- 29
- Citations by year
- 2026: 42 · 2025: 97 · 2024: 172 · 2023: 170 · 2022: 81 · 2021: 83 · 2020: 48 · 2019: 59 · 2018: 38 · 2017: 14 · 2016: 6
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- International Journal of Epidemiology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Universidade Federal de Pelotas
- National Institute for Health and Care Research (NF-SI-0611-10196, SI-0611-10196)
- University of Exeter
- University of Bristol (NF-SI-0611-10196, MC_UU_12013, MC_UU_12013/5)
- Medical Research Council (MC_UU_12013_5, MC_UU_12013, NF-SI-0611-10196)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetics and Physical Performance
- Keywords
- two-sample Mendelian randomization, adiposity, body mass index, cancer risk, breast cancer, ovarian cancer, lung cancer, colorectal cancer, exclusion restriction, GWAS summary data, causal inference, genetic variants, causal effect estimation, confounding
- MeSH terms
- Genotype, Humans, Random Allocation, Mendelian Randomization Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review