Recommendations for presenting analyses of effect modification and interaction
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index; 5 of the 32 sources its claims cite were checked for support.
Abstract
Authors often do not give sufficient information to draw conclusions about the size and statistical significance of interaction on the additive and multiplicative scales. To improve this, we provide four steps, template tables and examples to assess interaction on additive (RERI, AP, S) and multiplicative scales.
Overview
CoChat Summary
TL;DR
The paper recommends a four-step template for presenting effect modification and interaction analyses, distinguishing effect modification (one exposure across strata of another factor) from interaction (joint effects of two exposures). It argues that reporting stratum-specific effects, within-stratum effects, additive and multiplicative interaction measures with CIs/P-values, and confounders gives readers enough information to assess interaction on both scales.
Key findings
- Proposes four pieces of information: (i) RRs, ORs or RDs for each (A, X) stratum with a single reference category, possibly the stratum with lowest risk of D; (ii) RRs, ORs or RDs for A within strata of X; (iii) interaction measures on additive and multiplicative scales with CIs and P-values; and (iv) the A–D confounders adjusted for. For interaction between A and B, step 2 also presents A within strata of B and B within strata of A, and step 4 lists A–D and B–D confounders.
- A cited survey of 225 cohort and case–control studies found 61% addressed effect modification or interaction, but only 11% presented individual effects of both exposures and the joint effect of both exposures; most used multiple reference categories. In a random sample of 50 case–control and 25 cohort studies, only one reported a synergy index and none reported RERI.
- Effect-modification example: antidepressant use and diabetes modified by chronic disease score. RRs were 1.16 (0.95–1.42) for antidepressant use only, 1.55 (1.30–1.84) for chronic disease score ≥1 only, and 2.07 (1.73–2.47) for both; RERI was 0.36 (95% CI −0.003–0.73), P = 0.052; ratio of RRs was 1.15 (0.89–1.49), P = 0.282.
- Interaction example: dietary vitamin E and XRCC1 codon 399 genotype on prostate cancer. ORs were 1.04 (0.42–2.60) for Arg/Arg genotype only, 1.22 (0.53–2.82) for low vitamin E intake only, and 2.40 (1.02–5.63) for both; RERI was 1.14 (95% CI −0.57 to 2.85), P = 0.19; ratio of ORs was 1.89 (0.56–6.34), P = 0.30.
Methods
- Methodological recommendations paper with template tables and examples, distinguishing “effect modification” (causal effect of intervening on one exposure across strata of another factor) from “interaction” (causal effect of intervening on two exposures).
- Uses two illustrative examples: a cohort study by Knol et al. on antidepressant use and diabetes modified by chronic disease score, and a case–control study by van Gils et al. on dietary vitamin E and XRCC1 codon 399 genotype on prostate cancer risk.
- Analysis focuses on presenting RRs, ORs or RDs with CIs and P-values, calculating RERI and ratio of RRs/ORs for additive and multiplicative interaction, using the delta method for CIs, and recommending RRs over ORs when possible.
Limitations
- Stated: the paper focuses on RERI as the additive interaction measure; the synergy index is also sometimes considered but should only be used if the doubly unexposed group has the lowest absolute risk. ORs are non-collapsible, so effect modification may vary by covariates, and when the outcome is common ORs may exaggerate interaction measures. In the gene–environment example, population stratification was not controlled, so causal interaction interpretation depends on absence of genetic confounding.
- Evident from the text: the recommendations are prescriptive and template-based rather than empirically validated in this paper; the illustrative examples show interaction estimates whose CIs include the null, so they demonstrate presentation format rather than confirm interaction.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 16 Not checked · 11 Own results and interpretations
In the paper
“A survey of 225 cohort and case–control studies showed that 61% of the studies addressed effect modification or interaction in their publications.1”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“For over 30 years, there has been general consensus in the epidemiological community that measuring interaction on the additive scale is most appropriate for assessing the public health importance of interactions.2–4”
What the sources say
- Not checked — no full text of the sourcecites [2] Blot, 1979, Synergism and interaction: are they equivalent?, Am J Epidemiol source
- Not checked — no full text of the sourcecites [3] Rothman, 1980, Concepts of interaction, Am J Epidemiol source
- Not checked — no full text of the sourcecites [4] Saracci, 1980, Interaction and synergism, Am J Epidemiol source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the vast majority of these studies did not give sufficient information to the reader to draw conclusions on the size and statistical significance of the interaction on an additive and multiplicative scale.”
- Also stated in: § Abstract · plain
“Authors often do not give sufficient information to draw conclusions about the size and statistical significance of interaction on the additive and multiplicative scales.”
- Also stated in: § Conclusion · hedged
“A recent survey of cohort and case–control studies indicated that measures and P-values or CIs for interaction on the additive or multiplicative scale were often not reported.1”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Abstract · plain
In the paper
“Only 11% of the studies presented individual effects of both exposures and the joint effect of both exposures”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Without controlling for confounding factors for genetic variants, a joint analysis of both factors can always be interpreted as effect modification of the environmental factors across strata of the genetic factor so long as control is made for the confounders of the environmental exposure.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
2 more claims
Create a free account to see all 30 claims and every source verdict.
- It may state two separate claims as one. 12
- Probably not a substantial claim. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“If the test involved inclusion of a product term in a regression model, we assessed whether the presentation yielded sufficient information to interpret interaction on an additive and on a multiplicative scale (Knol et al., 2009; Knol & VanderWeele, 2012).”
From Syndemics of psychosocial problems and HIV risk: A systematic review of empirical tests of the disease interaction concept (2015) · cites this paper as Knol & VanderWeele, 2012
In the citing paper
“To date, a few reports 8,9 have addressed some of these aspects but they were mainly intended for an epidemiological audience.”
From Understanding of interaction (subgroup) analysis in clinical trials (2019) · cites this paper as [8]
Citations
Cites
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
Calculating measures of biological interaction
Andersson, T., Alfredsson, L., Källberg, H., Zdravkovic, S., & Ahlbom, A. (2005) · European Journal of Epidemiology · doi:10.1007/s10654-005-7835-x · Cited by 1,498
Confidence interval estimation of interaction
Hosmer, D. W., & Lemeshow, S. (1992) · Epidemiology · doi:10.1097/00001648-199209000-00012 · Cited by 1,239
ROTHMAN, K. J., GREENLAND, S., & WALKER, A. M. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113015 · Cited by 859
Estimating measures of interaction on an additive scale for preventive exposures
Knol, M. J., VanderWeele, T. J., Groenwold, R. H. H., Klungel, O. H., Rovers, M. M., & Grobbee, D. E. (2011) · European Journal of Epidemiology · doi:10.1007/s10654-011-9554-9 · Cited by 776
Self-citationROTHMAN, K. J. (1976) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112335 · Cited by 776
Schottenfeld, D. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf028 · Cited by 622
Test for additive interaction in proportional hazards models
Li, R., & Chambless, L. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2006.10.009 · Cited by 548
Sadowski, L. S., Kee, R. A., VanderWeele, T. J., & Buchanan, D. (2009) · JAMA · doi:10.1001/jama.2009.561 · Cited by 508
Self-citation
Research works printed but not linked: 2
- Rothman, 1986, Modern Epidemiology
- Rothman, 2002, Measuring interactions, 168
Cited by
Bauer, G. R. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.03.022 · Cited by 1,620
“Knol and VanderWeele (2012) provide recommendations, and even templates, for presentation of effect-measure modification and interaction results, though they assume both a causal research question and a reader’s familiarity with epidemiological terminology.”
BackgroundVanderWeele, T. J., & Knol, M. J. (2014) · Epidemiologic Methods · doi:10.1515/em-2013-0005 · Cited by 1,127
“The view of this tutorial is that it is almost always best to present both additive and multiplicative measures of interaction (Botto and Khoury, 2001; Vandenbroucke et al., 2007; Knol and VanderWeele, 2012).”
BackgroundInfluentialSelf-citationRodgers, K. M., Udesky, J. O., Rudel, R. A., & Brody, J. G. (2018) · Environmental Research · doi:10.1016/j.envres.2017.08.045 · Cited by 443
Yao, X. I., Wang, X., Speicher, P. J., Hwang, E. S., Cheng, P., Harpole, D. H., Berry, M. F., Schrag, D., & Pang, H. H. (2017) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djw323 · Cited by 386
Huang, B.-H., Duncan, M. J., Cistulli, P. A., Nassar, N., Hamer, M., & Stamatakis, E. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-104046 · Cited by 345
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Where greenspace matters most: A systematic review of urbanicity, greenspace, and physical health
Browning, M. H. E. M., Rigolon, A., McAnirlin, O., & Yoon, H. (. (2022) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2021.104233 · Cited by 311
Hoyo, C., Cook, M. B., Kamangar, F., Freedman, N. D., Whiteman, D. C., Bernstein, L., Brown, L. M., Risch, H. A., Ye, W., Sharp, L., et al. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys176 · Cited by 300
Latino Immigrants, Acculturation, and Health: Promising New Directions in Research
Abraído-Lanza, A. F., Echeverría, S. E., & Flórez, K. R. (2016) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032315-021545 · Cited by 286
“Joint effects models (41, 58, 64, 108) and complex systems approaches (10, 50) offer fruitful avenues to pursue in these endeavors.”
BackgroundProbst, C., Kilian, C., Sanchez, S., Lange, S., & Rehm, J. (2020) · The Lancet Public Health · doi:10.1016/s2468-2667(20)30052-9 · Cited by 279
Humidity’s Role in Heat-Related Health Outcomes: A Heated Debate
Baldwin, J. W., Benmarhnia, T., Ebi, K. L., Jay, O., Lutsko, N. J., & Vanos, J. K. (2023) · Environmental Health Perspectives · doi:10.1289/ehp11807 · Cited by 250
“80,81 The absolute scale may be more suitable for inferring recommendations for targeted policies (i.e., to optimize the bene fi ts of early warning systems).”
Niedzwiedz, C. L., Richardson, E. A., Tunstall, H., Shortt, N. K., Mitchell, R. J., & Pearce, J. R. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.07.016 · Cited by 241
Chen, Q., Hartman, C. A., Haavik, J., Harro, J., Klungsøyr, K., Hegvik, T.-A., Wanders, R., Ottosen, C., Dalsgaard, S., Faraone, S. V., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204516 · Cited by 236
“There is general consensus among epidemiologists that assessing additive effect modification is most appropriate for public health decision-making [19].”
BackgroundExtreme Temperature Events, Fine Particulate Matter, and Myocardial Infarction Mortality
Xu, R., Huang, S., Shi, C., Wang, R., Liu, T., Li, Y., Zheng, Y., Lv, Z., Wei, J., Sun, H., et al. (2023) · Circulation · doi:10.1161/circulationaha.122.063504 · Cited by 231
“39 To quantify excess mortality due to exposure to ETEs and PM 2.5 , we further estimated excess fraction and number of excess deaths according to exposure to level 2, level 3, and level 4, separately.”
InfluentialMerlo, J., Wagner, P., Ghith, N., & Leckie, G. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153778 · Cited by 230
Tsai, A. C., & Burns, B. F. O. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.06.024 · Cited by 227
“If the test involved inclusion of a product term in a regression model, we assessed whether the presentation yielded sufficient information to interpret interaction on an additive and on a multiplicative scale (Knol et al., 2009; Knol & VanderWeele, 2012).”
MethodWard, J. B., Gartner, D. R., Keyes, K. M., Fliss, M. D., McClure, E. S., & Robinson, W. R. (2019) · Annals of Epidemiology · doi:10.1016/j.annepidem.2018.09.007 · Cited by 228
“While one goal of health disparities researchers may be to answer the question, “Would changing the prevalence of an exposure in specific racial groups reduce racial disparities in an outcome?”, the methods often utilized in epidemiolo gic literature operationalize this question as, “Is there an interaction between ra…”
BackgroundMethodInfluential(2016) · International Journal Of Epidemiology · doi:10.1093/ije/dyw346 · Cited by 229
“We used modified Poisson regression(46) to estimate risk ratios (RRs) comparing risk of LBW among infants born after Postville to those in the comparison period, and used Knol and VanderWeele’s recommended methods for presenting analyses of effect modification.(47) This involved presenting: (i) RRs for each stratum of…”
MethodElmore, A. L., & Crouch, E. (2020) · Academic Pediatrics · doi:10.1016/j.acap.2020.02.012 · Cited by 226
Environmental risk factors for multiple sclerosis
Salzer, J. (2013) · DiVA at Umeå University (Umeå University) · Cited by 202
Predicting the atopic march: Results from the Canadian Healthy Infant Longitudinal Development Study
Tran, M. M., Lefebvre, D. L., Dharma, C., Dai, D., Lou, W. Y. W., Subbarao, P., Becker, A. B., Mandhane, P. J., Turvey, S. E., Sears, M. R., et al. (2018) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2017.08.024 · Cited by 193
“Moreover, wewere able to report interaction on both the additive and multiplicative scales, which is a recommended practice in assessing the biological mechanism and public health effect of a disease.(27,28) Caremust be taken in interpreting these results because of the wide CIs for some outcomes resulting from a low…”
Association of night eating habits with metabolic syndrome and its components: a longitudinal study
Yoshida, J., Eguchi, E., Nagaoka, K., Ito, T., & Ogino, K. (2018) · BMC Public Health · doi:10.1186/s12889-018-6262-3 · Cited by 192
Guloksuz, S., Pries, L., Delespaul, P., Kenis, G., Luykx, J. J., Lin, B. D., Richards, A. L., Akdede, B., Binbay, T., Altınyazar, V., et al. (2019) · World Psychiatry · doi:10.1002/wps.20629 · Cited by 187
“The RERI is considered the standard measure for interaction on the additive scale in case-control studies 49 .”
Burgoine, T., Forouhi, N. G., Griffin, S. J., Brage, S., Wareham, N. J., & Monsivais, P. (2016) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.128132 · Cited by 181
“We tested for interaction on an additive scale using relative excess risk due to interaction (RERI), calculated as RERI = OR11 2 OR10 2 OR01 + 1, where ORs are odds ratios for being obese for those who are least educated and most exposed to fast-food outlets (OR11), those who are least educated and least exposed to fa…”
BackgroundMethodInfluentialBrunes, A., B. Hansen, M., & Heir, T. (2019) · Health and Quality of Life Outcomes · doi:10.1186/s12955-019-1096-y · Cited by 177
“We also tested for effect-measure modification between loneliness and each covariate using the likelihood ratio test to compare models with and without the product term [28].”
MethodSmithers, L. G., Sawyer, A. C. P., Chittleborough, C. R., Davies, N. M., Davey Smith, G., & Lynch, J. W. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0461-x · Cited by 175
Burgoine, T., Sarkar, C., Webster, C. J., & Monsivais, P. (2018) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-018-0699-8 · Cited by 168
Denham, J. W., Joseph, D., Lamb, D. S., Spry, N. A., Duchesne, G., Matthews, J., Atkinson, C., Tai, K.-H., Christie, D., Kenny, L., et al. (2014) · The Lancet Oncology · doi:10.1016/s1470-2045(14)70328-6 · Cited by 160
Wallach, J. D., Sullivan, P. G., Trepanowski, J. F., Sainani, K. L., Steyerberg, E. W., & Ioannidis, J. P. A. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.9125 · Cited by 148
“When the choice was unclear, we calculatedrelativeeffectmeasuresbecausemultiplicativescale interactions are more often assessed and reported based on logistic or Cox proportional hazards regression models in RCTs.(17-19)Anonlinedigitizer (WebPlotDigitizer;http://arohatgi .”
MethodRecommendations for accurate reporting in medical research statistics
Mansournia, M. A., & Nazemipour, M. (2024) · The Lancet · doi:10.1016/s0140-6736(24)00139-9 · Cited by 160
Lv, Y., Zuo, L., Zhu, X., Zhao, J., Xue, H., Jiang, Z., Zhuge, Y., Zhang, C., Sun, J., Ding, P., et al. (2018) · Gut · doi:10.1136/gutjnl-2018-317057 · Cited by 156
Cylus, J., Glymour, M. M., & Avendaño, M. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu106 · Cited by 149
Understanding of interaction (subgroup) analysis in clinical trials
Brankovic, M., Kardys, I., Steyerberg, E. W., Lemeshow, S., Markovic, M., Rizopoulos, D., & Boersma, E. (2019) · European Journal of Clinical Investigation · doi:10.1111/eci.13145 · Cited by 130
Choi, Y., Hu, H., Mukherjee, B., Miller, J., & Park, S. K. (2012) · Environmental Health Perspectives · doi:10.1289/ehp.1104863 · Cited by 132
Arsenic, Tobacco Smoke, and Occupation: Associations of Multiple Agents with Lung and Bladder Cancer
Ferreccio, C., Yuan, Y., Calle, J., Benítez, H., Parra, R. L., Acevedo, J., Smith, A. H., Liaw, J., & Steinmaus, C. (2013) · Epidemiology · doi:10.1097/ede.0b013e31829e3e03 · Cited by 127
Swilley-Martinez, M. E., Coles, S. A., Miller, V. E., Alam, I. Z., Fitch, K. V., Cruz, T. H., Hohl, B., Murray, R., & Ranapurwala, S. I. (2023) · Epidemiologic Reviews · doi:10.1093/epirev/mxad010 · Cited by 123
Tobacco Smoking and Risk for Pulmonary Fibrosis
Bellou, V., Belbasis, L., & Εvangelou, Ε. (2021) · CHEST Journal · doi:10.1016/j.chest.2021.04.035 · Cited by 136
He, L., Biddle, S., Lee, J. T., Duolikun, N., Zhang, L., Wang, Z., & Zhao, Y. W. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01150-7 · Cited by 125
“the relative excess risk due to interaction, RERI) and multiplicative scales with CIs were presented [45, 46].”
BackgroundA step towards understanding the mechanisms of running-related injuries
Malisoux, L., Nielsen, R. O., Urhausen, A. J. P., & Theisen, D. (2014) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2014.07.014 · Cited by 143
Kendzerska, T., Leung, R. S. T., Aaron, S. D., Ayas, N., Sandoz, J. S., & Gershon, A. S. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201802-136oc · Cited by 121
Fang, A., Chen, P., Wang, X., Liu, Z.-Y., Zhang, D., Luo, Y., Liao, G., Long, J., Zhong, R., Zhou, Z., et al. (2018) · International Journal of Cancer · doi:10.1002/ijc.31991 · Cited by 122
“Measures for additive interaction (including the relative excess risk due to interaction [RERI], the attributable proportion due to interaction [AP] and the synergy index [S]) and corresponding CIs were estimated using the delta method.(29,30) The statistical analyses were performed in SAS, version 9.”
MethodGene‐Environment Interactions in Cancer Epidemiology: A National Cancer Institute Think Tank Report
Hutter, C. M., Mechanic, L. E., Chatterjee, N., Kraft, P. L., & Gillanders, E. M. (2013) · Genetic Epidemiology · doi:10.1002/gepi.21756 · Cited by 120
“However, such practice is not ideal from a biological or public health point of view [Knol, et al. 2009; Knol and VanderWeele 2012].”
BackgroundSabanayagam, C., Chee, M. L., Banu, R., Cheng, C.-Y., Lim, S. C., Tai, E. S., Coffman, T., & Wong, T. Y. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.1540 · Cited by 108
Malisoux, L., Chambon, N., Delattre, N., Gueguen, N., Urhausen, A., & Theisen, D. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2015-095031 · Cited by 86
Antidepressant Use and Risk for Preeclampsia
Palmsten, K., Huybrechts, K. F., Michels, K. B., Williams, P. L., Mogun, H., Setoguchi, S., & Hernández-Díaz, S. (2013) · Epidemiology · doi:10.1097/ede.0b013e31829e0aaa · Cited by 106
Smart, D., Youssef, G. J., Sanson, A. V., Prior, M. R., Toumbourou, J. W., & Olsson, C. A. (2017) · British Journal of Educational Psychology · doi:10.1111/bjep.12150 · Cited by 128
“The additive interaction approach quantifies the degree to which the effect of two factors exceeds the summed effect of each factor’s individual contribution and is argued to be themost appropriate method for assessing the public health importance of interactions (Knol & VanderWeele, 2012).”
MethodFatty fish intake is associated with decreased occurrence of multiple sclerosis
Bäärnhielm, M., Olsson, T. P., & Alfredsson, L. S. (2013) · Multiple Sclerosis Journal · doi:10.1177/1352458513509508 · Cited by 119
“2) Missing information 27 74 Smoker Ever 998 (53) 1841 (45) Never 878 (47) 2281 (55) Missing information 3 13 Scandinavian ancestry Yes 1612 (86) 3422 (83) No 265 (14) 699 (17) Missing information 2 14 UVR exposure Index categorization 3 (low) 121 (6) 201 (5) 4-5 555 (30) 1066 (26) 6 396 (21) 797 (19) 7-8 544 (29) 125…”
Jensen, E. T., Kuhl, J. T., Martin, L. J., Langefeld, C. D., Dellon, E. S., & Rothenberg, M. E. (2017) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2017.07.010 · Cited by 113
“Finally, we calculated the relative excess risk due to interaction (RERI) to assess for interaction on the additive scale.(25,26)We generated both crude and adjusted estimates for both primary and secondary analyses.”
Fleisch Marcus, A., Illescas, A. H., Hohl, B. C., & Llanos, A. A. M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173370 · Cited by 103
Qu, G., Ma, S., Liu, H., Han, T., Zhang, H., Ding, X., Sun, L., Qin, Q., Chen, M., & Sun, Y. (2022) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2022.105511 · Cited by 123
Timpka, S., Stuart, J. J., Tanz, L. J., Rimm, E. B., Franks, P. W., & Rich-Edwards, J. W. (2017) · BMJ · doi:10.1136/bmj.j3024 · Cited by 118
Urine Ammonium Predicts Clinical Outcomes in Hypertensive Kidney Disease
Raphael, K. L., Carroll, D. J., Murray, J. L., Greene, T., & Beddhu, S. (2017) · Journal of the American Society of Nephrology · doi:10.1681/asn.2016101151 · Cited by 104
Sandul, A. L., Nwana, N., Holcombe, J. M., Lobato, M. N., Marks, S. M., Webb, R. M., Wang, S., Stewart, B., Griffin, P., Hunt, G., et al. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix505 · Cited by 105
Nigatu, Y. T., Reijneveld, S. A., de Jonge, P., van Rossum, E. F. C., & Bültmann, U. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148871 · Cited by 119
“On the one hand, knowledge on interaction effects on the additive scale could provide empirical evidence for public health interventions in vulnerable groups; on the other hand, knowledge on interactions on the multiplicative scale is more relevant in disease etiology [22].”
BackgroundSaraiva, M. D., Apolinário, D., Avelino‐Silva, T. J., Tavares, C. A. M., Gattás-Vernaglia, I. F., Fernandes, C. M., RABÊLO, L. M., Yamaguti, S. T. F., Karnakis, T., Filho, R. K., et al. (2020) · The journal of nutrition health & aging · doi:10.1007/s12603-020-1532-z · Cited by 109
Goga, A. E., Dinh, T., Jackson, D. J., Lombard, C. J., Delaney, K. P., Puren, A. J., Sherman, G. G., Woldesenbet, S., Ramokolo, V., Crowley, S., et al. (2014) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-204535 · Cited by 107
Causal Effects of Air Pollution on Mortality Rate in Massachusetts
Wei, Y., Wang, Y., Wu, X., Di, Q., Shi, L., Koutrakis, P., Zanobetti, A., Dominici, F., & Schwartz, J. D. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa098 · Cited by 99
“Compared with multiplicative risk, additive risk is usually of greater public health importance and is more useful for assessing biological interactions (11, 12).”
BackgroundOzone, Heat Wave, and Cardiovascular Disease Mortality: A Population-Based Case-Crossover Study
Xu, R., Sun, H. W., Zhong, Z., Zheng, Y., Liu, T., Li, Y., Liu, L., Lu, L., Wang, S., Lv, Z., et al. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c06889 · Cited by 101
The gut microbiome and type 2 diabetes status in the Multiethnic Cohort
Maskarinec, G., Raquinio, P., Kristal, B. S., Setiawan, V. W., Wilkens, L. R., Franke, A. A., Lim, U., Marchand, L. L., Randolph, T. W., Lampe, J. W., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250855 · Cited by 94
“To examine if CRP, log-transformed to meet model assumptions, mediates the relation between LBP on T2D development [32], mediation PLOS ONE Gut microbiome and diabetes”
BackgroundInteractionR: An R package for full reporting of effect modification and interaction
Alli, B. Y. (2021) · Software Impacts · doi:10.1016/j.simpa.2021.100147 · Cited by 100
Spake, R., Bowler, D. E., Callaghan, C. T., Blowes, S. A., Doncaster, C. P., Antão, L. H., Nakagawa, S., McElreath, R. L., & Chase, J. M. (2023) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12939 · Cited by 107
“Epidemiological guidelines consequently recommend presenting interaction analyses in a way that allows readers to assess interaction measures on multiple scales, and to assess additive interaction from multiplicative models (Knol et al ., 2011; Knol & VanderWeele, 2012).”
Effect modification of perinatal exposure to air pollution and childhood asthma incidence
Lavigne, É., Bélair, M.-A., Rodriguez Duque, D., Do, M. T., Stieb, D. M., Hystad, P., van Donkelaar, A., Martin, R. V., Crouse, D. L., Crighton, E., et al. (2018) · European Respiratory Journal · doi:10.1183/13993003.01884-2017 · Cited by 86
Effects of lead and cadmium co-exposure on bone mineral density in a Chinese population
Chen, X., Wang, K., Wang, Z., Gan, C., He, P., Liang, Y., Jin, T., & Zhu, G. (2014) · Bone · doi:10.1016/j.bone.2014.02.017 · Cited by 93
“Departures from additive joint effects (RERI: relative excess risk due to interaction) were computed as recommended by Knol and VanderWeele [40].”
MethodPriest, N., Slopen, N. B., Woolford, S. J., Philip, J. T., Singer, D., Kauffman, A. D., Mosely, K., Davis, M. M., Ransome, Y., & Williams, D. R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0201696 · Cited by 99
“As recommended, measures of effect measure modification (EMM) on both the additive and multiplicative scale were then computed [57].”
BackgroundMethodTamsulosin and the risk of dementia in older men with benign prostatic hyperplasia
Duan, Y., Grady, J. J., Albertsen, P. C., & Wu, Z. H. (2018) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4361 · Cited by 84
“For both dose‐response and subgroup analyses, we examined effect modification on a multiplicative scale using ratio of HRs, as well as on an additive scale using relative excess risk due to interaction (RERI).(30,31) Details for the ratio of HRs and RERI can be found inTable S5, Supplementary Appendix.”
MethodWang, Y., Shan, Z., Arvizu, M., Pan, A., Manson, J. E., Missmer, S. A., Sun, Q., & Chavarro, J. E. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.27928 · Cited by 86
Elmore, A. L., Crouch, E. L., & Chowdhury, M. A. K. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104616 · Cited by 91
Bress, A. P., King, J. B., Kreider, K. E., Beddhu, S., Simmons, D. L., Cheung, A. K., Zhang, Y., Doumas, M., Nord, J., Sweeney, M. E., et al. (2017) · Diabetes Care · doi:10.2337/dc17-0885 · Cited by 80
“are presented on both the additive and multiplicative scales (9).”
BackgroundFebrile Seizure Risk After Vaccination in Children 6 to 23 Months
Duffy, J., Weintraub, E., Hambidge, S. J., Jackson, L. A., Kharbanda, E. O., Klein, N. P., Lee, G. M., Marcy, S. M., Nakasato, C. C., Naleway, A., et al. (2016) · Pediatrics · doi:10.1542/peds.2016-0320 · Cited by 77
Interaction of marijuana and alcohol on fatal motor vehicle crash risk: a case–control study
Chihuri, S., Li, G., & Chen, Q. (2017) · Injury Epidemiology · doi:10.1186/s40621-017-0105-z · Cited by 75
“BACs for controls were determined from breath samples measured using a preliminary breath test device (National Highway Traffic Safety Administration 2012; Lacey et al. 2009).”
MethodInteractions in statistical models: Three things to know
Duncan, R. P., & Kefford, B. J. (2021) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13714 · Cited by 89
“As previous studies have identified, and our examples show, all three issues have important implications for correctly identifying interactions (Cortina, 1993; Griffen et al., 2016; Karaca- Mandic et al., 2012; Knol & VanderWeele, 2012; Rothman et al., 2008).”
BackgroundResultCarver, A., Barr, A., Singh, A., Badland, H. M., Mavoa, S., & Bentley, R. (2019) · Journal of Transport & Health · doi:10.1016/j.jth.2019.01.003 · Cited by 77
Synergic effect between high temperature and air pollution on mortality in Northeast Asia
Lee, W., Choi, H. M., Kim, D., Honda, Y., Guo, Y. L., & Kim, H. (2019) · Environmental Research · doi:10.1016/j.envres.2019.108735 · Cited by 80
Nakagomi, A., Tsuji, T., Saito, M., Ide, K., Kondo, K., & Shiba, K. (2023) · Social Science & Medicine · doi:10.1016/j.socscimed.2023.115937 · Cited by 90
Widanarko, B., Legg, S. J., Devereux, J. J., & Stevenson, M. A. (2014) · Applied Ergonomics · doi:10.1016/j.apergo.2014.07.016 · Cited by 80
Lin, W., Wang, H., Gong, L., Lai, G., Zhao, X., Ding, H., & Wang, Y. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.081 · Cited by 92
Maternal anxiety, depression and asthma and adverse pregnancy outcomes – a population based study
Rejnö, G., Lundholm, C., Öberg, A. S., Lichtenstein, P., Larsson, H., D'Onofrio, B. M., Larsson, K., Saltvedt, S., Brew, B. K., & Almqvist, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-49508-z · Cited by 74
Synergistic impact of 25-hydroxyvitamin D concentrations and physical activity on delaying aging
Liu, C., Hua, L., & Zhong, X. (2024) · Redox Biology · doi:10.1016/j.redox.2024.103188 · Cited by 77
“Specifically, for the additive scale interaction, we computed the relative excess risk due to interaction (RERI) following the guidelines proposed by Knol and VanderWeele [27].”
MethodSocio-demographic characteristics associated with emotional and social loneliness among older adults
Fierloos, I. N., Tan, S. S., Williams, G., Alhambra‐Borrás, T., Koppelaar, E., Bilajac, L., Verma, A., Markaki, A., Mattace-Raso, F. U. S., Vasiljev, V., et al. (2021) · BMC Geriatrics · doi:10.1186/s12877-021-02058-4 · Cited by 85
The impact of low education and poor health on unemployment varies by work life stage
van Zon, S. K. R., Reijneveld, S. A., de Leon, C. F. M., & Bültmann, U. (2017) · International Journal of Public Health · doi:10.1007/s00038-017-0972-7 · Cited by 89
Stewart, O. T., Moudon, A. V., Saelens, B. E., Lee, C., Kang, B., & Doescher, M. P. (2016) · Environment and Behavior · doi:10.1177/0013916515612253 · Cited by 87
“For BE variables found to have a statistically significant interaction by sample population, incidence rate ratios (IRRs) were presented using a combined model with a single reference category and stratified by Seattle and small town samples (Knol & VanderWeele, 2012).”
Burgoine, T., Mackenbach, J. D., Lakerveld, J., Forouhi, N. G., Griffin, S. J., Brage, S., Wareham, N. J., & Monsivais, P. (2017) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph14111290 · Cited by 78
“additive associations of each risk factor in isolation [23], and a corresponding RERI greater than zero.”
BackgroundInfluentialYe, L., Elstgeest, L. E. M., Zhang, X., Alhambra‐Borrás, T., Tan, S. S., & Raat, H. (2021) · BMC Geriatrics · doi:10.1186/s12877-021-02364-x · Cited by 76
“According to the guidelines of Knol and VanderWeele [40], Bonferroni correction for multivariable logistic regression was applied for analysis of the interaction items (P = 0.05/152 = 0.0003).”
MethodInfluentialHow to Write Statistical Analysis Section in Medical Research
Dwivedi, A. K. (2022) · Journal of Investigative Medicine · doi:10.1136/jim-2022-002479 · Cited by 82
“70 Sometimes, a quantitative variable may emerge as a potential effect modifier for exposure and an outcome relationship.”
InfluentialMo, Y., Booraphun, S., Li, A., Domthong, P., Kayastha, G. K., Lau, Y. H., Chetchotisakd, P., Limmathurotsakul, D., Tambyah, P. A., Cooper, B. S., et al. (2024) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(23)00418-6 · Cited by 82
Whitaker, R. C., Dearth‐Wesley, T., Herman, A. N., Block, A., Holderness, M. H., Waring, N. A., & Oakes, J. M. (2021) · BMC Public Health · doi:10.1186/s12889-021-12058-z · Cited by 81
“By employing methods that stratify the data by combinations of the two risk factors and identify significant departures from the additive associations [34], we can potentially identify synergy between ACEs and gender that may have been previously overlooked.”
MethodNielsen, R. O., Malisoux, L., Møller, M., Theisen, D., & Parner, E. T. (2016) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2016.6510 · Cited by 73
Depression and risk of type 2 diabetes: the potential role of metabolic factors
Schmitz, N., Deschênes, S. S., Burns, R. J., Smith, K. J., LESAGE, A. D., Strychar, I. M., RABASA-LHORET, R. P. R., Freitas, C., Graham, E. A., Awadalla, P., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2016.7 · Cited by 78
Madsen, I. E. H., Lange, T., Borritz, M., & Rugulies, R. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.04.004 · Cited by 64
Sparks, M. A., South, A. M., Badley, A. D., Baker-Smith, C. M., BATLLE, D. C., Bozkurt, B., Cattaneo, R., Crowley, S. D., Dell’Italia, L. J., Ford, A. L., et al. (2020) · Hypertension · doi:10.1161/hypertensionaha.120.15948 · Cited by 72
Albrektsen, G., Heuch, I., Løchen, M., Thelle, D. S., Wilsgaard, T., Njølstad, I., & Bønaa, K. H. (2017) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2017.04.009 · Cited by 72
Socioeconomic status, alcohol use disorders, and depression: A population-based study
Lasserre, A. M., Imtiaz, S., Roerecke, M., Heilig, M. A., Probst, C., & Rehm, J. T. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.12.132 · Cited by 80
Zhou, W., Wang, Q., Li, R., Kadier, A., Wang, W., Zhou, F., & Ling, L. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.161560 · Cited by 68
Suo, C., Yang, Y., Yuan, Z., Zhang, T., Yang, X., Qing, T., Gao, P., Shi, L. M., Fan, M., Cheng, H., et al. (2019) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2018.12.023 · Cited by 68
Maternal education and age: inequalities in neonatal death
Fonseca, S. C., Flores, P. V. G., de Camargo, K. R., Pinheiro, R. S., & Coeli, C. M. (2017) · Revista de Saúde Pública · doi:10.11606/s1518-8787.2017051007013 · Cited by 86
Social connection and mortality in UK Biobank: a prospective cohort analysis
Foster, H. M. E., Gill, J. M. R., Mair, F. S., Celis-Morales, C. A., Jani, B., Nicholl, B. I., Lee, D., & O’Donnell, C. A. (2023) · BMC Medicine · doi:10.1186/s12916-023-03055-7 · Cited by 71
“To provide sufficient data for interpretation, we explored the interactions on both multiplicative and additive scales by calculating estimates for multiplicative interaction, relative excess risk of interaction (RERI), attributable portion (AP), and a synergy index (SI) [46].”
MethodGlass, J. E., Rathouz, P. J., Gattis, M. N., Joo, Y. S., Nelson, J. C., & Williams, E. C. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-017-1362-4 · Cited by 71
“Covariates were selected that were likely to confound the association between poverty status and alcohol outcomes [59].”
BackgroundWesselink, E., Kok, D. E. G., Bours, M. J. L., de Wilt, J. H. W., van Baar, H., van Zutphen, M., Geijsen, A. J. M. R., Keulen, E. T. P., Hansson, B. M. E., van den Ouweland, J., et al. (2020) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqaa049 · Cited by 58
“7] Unknown, n 44 20 24 Supplement use, yes Vitamin D 289 (25) 76 (16) 213 (33) Calcium 238 (21) 80 (16) 158 (24) Magnesium 226 (19) 81 (16) 145 (22) Type of cancer Colon 768 (66) 320 (64) 448 (67) Rectum 401 (34) 180 (36) 221 (33) Tumor stage I 312 (27) 115 (23) 197 (29) II 346 (30) 148 (30) 198 (30) III 511 (44) 237…”
BackgroundMethodPries, L.-K., Ferro, G. A. D., van Os, J., Delespaul, P., Kenis, G., Lin, B. D., Luykx, J. J., Richards, A. L., Akdede, B. B., Binbay, T., et al. (2020) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796020000943 · Cited by 64
“Departure from additivity was tested using the relative excess risk due to interaction (RERI) (Knol and VanderWeele, 2012; VanderWeele and Knol, 2014).”
MethodInfluentialBeaudoin, F. L., Jacka, B. P., Li, Y., Samuels, E. A., Hallowell, B. D., Peachey, A. M., Newman, R., Daly, M. M., Langdon, K. J., & Marshall, B. D. L. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.25582 · Cited by 61
Metadata
- Authors
- Knol, M. J., & VanderWeele, T. J.
- Affiliations
- Harvard University (US)
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-01-09
- Volume
- 41
- Issue
- 2
- Pages
- 514-520
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- PMC
- PMC3324457
- OpenAlex
- W2114647004
- Cited by
- 1,494
- References
- 35
- Citations by year
- 2026: 292 · 2025: 187 · 2024: 161 · 2023: 153 · 2022: 125 · 2021: 123 · 2020: 92 · 2019: 89 · 2018: 64 · 2017: 74 · 2016: 43 · 2015: 32 · 2014: 26 · 2013: 21 · 2012: 7
- FWCI
- 24.79
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Journal of Epidemiology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- effect modification, interaction, reporting recommendations, statistical tables, relative risk, odds ratio, risk difference, confounding adjustment, causal inference
- MeSH terms
- Humans, Risk Factors, Models, Statistical, Causality, Effect Modifier, Epidemiologic, Epidemiologic Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.