Recommendations for presenting analyses of effect modification and interaction
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index; 5 of the 32 sources its claims cite were checked for support.
Abstract
Authors often do not give sufficient information to draw conclusions about the size and statistical significance of interaction on the additive and multiplicative scales. To improve this, we provide four steps, template tables and examples to assess interaction on additive (RERI, AP, S) and multiplicative scales.
Overview
CoChat Summary
TL;DR
The paper recommends a four-step template for presenting effect modification and interaction analyses, distinguishing effect modification (one exposure across strata of another factor) from interaction (joint effects of two exposures). It argues that reporting stratum-specific effects, within-stratum effects, additive and multiplicative interaction measures with CIs/P-values, and confounders gives readers enough information to assess interaction on both scales.
Key findings
- Proposes four pieces of information: (i) RRs, ORs or RDs for each (A, X) stratum with a single reference category, possibly the stratum with lowest risk of D; (ii) RRs, ORs or RDs for A within strata of X; (iii) interaction measures on additive and multiplicative scales with CIs and P-values; and (iv) the A–D confounders adjusted for. For interaction between A and B, step 2 also presents A within strata of B and B within strata of A, and step 4 lists A–D and B–D confounders.
- A cited survey of 225 cohort and case–control studies found 61% addressed effect modification or interaction, but only 11% presented individual effects of both exposures and the joint effect of both exposures; most used multiple reference categories. In a random sample of 50 case–control and 25 cohort studies, only one reported a synergy index and none reported RERI.
- Effect-modification example: antidepressant use and diabetes modified by chronic disease score. RRs were 1.16 (0.95–1.42) for antidepressant use only, 1.55 (1.30–1.84) for chronic disease score ≥1 only, and 2.07 (1.73–2.47) for both; RERI was 0.36 (95% CI −0.003–0.73), P = 0.052; ratio of RRs was 1.15 (0.89–1.49), P = 0.282.
- Interaction example: dietary vitamin E and XRCC1 codon 399 genotype on prostate cancer. ORs were 1.04 (0.42–2.60) for Arg/Arg genotype only, 1.22 (0.53–2.82) for low vitamin E intake only, and 2.40 (1.02–5.63) for both; RERI was 1.14 (95% CI −0.57 to 2.85), P = 0.19; ratio of ORs was 1.89 (0.56–6.34), P = 0.30.
Methods
- Methodological recommendations paper with template tables and examples, distinguishing “effect modification” (causal effect of intervening on one exposure across strata of another factor) from “interaction” (causal effect of intervening on two exposures).
- Uses two illustrative examples: a cohort study by Knol et al. on antidepressant use and diabetes modified by chronic disease score, and a case–control study by van Gils et al. on dietary vitamin E and XRCC1 codon 399 genotype on prostate cancer risk.
- Analysis focuses on presenting RRs, ORs or RDs with CIs and P-values, calculating RERI and ratio of RRs/ORs for additive and multiplicative interaction, using the delta method for CIs, and recommending RRs over ORs when possible.
Limitations
- Stated: the paper focuses on RERI as the additive interaction measure; the synergy index is also sometimes considered but should only be used if the doubly unexposed group has the lowest absolute risk. ORs are non-collapsible, so effect modification may vary by covariates, and when the outcome is common ORs may exaggerate interaction measures. In the gene–environment example, population stratification was not controlled, so causal interaction interpretation depends on absence of genetic confounding.
- Evident from the text: the recommendations are prescriptive and template-based rather than empirically validated in this paper; the illustrative examples show interaction estimates whose CIs include the null, so they demonstrate presentation format rather than confirm interaction.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 16 Not checked · 11 Own results and interpretations
In the paper
“A survey of 225 cohort and case–control studies showed that 61% of the studies addressed effect modification or interaction in their publications.1”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“For over 30 years, there has been general consensus in the epidemiological community that measuring interaction on the additive scale is most appropriate for assessing the public health importance of interactions.2–4”
What the sources say
- Not checked — no full text of the sourcecites [2] Blot, 1979, Synergism and interaction: are they equivalent?, Am J Epidemiol source
- Not checked — no full text of the sourcecites [3] Rothman, 1980, Concepts of interaction, Am J Epidemiol source
- Not checked — no full text of the sourcecites [4] Saracci, 1980, Interaction and synergism, Am J Epidemiol source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the vast majority of these studies did not give sufficient information to the reader to draw conclusions on the size and statistical significance of the interaction on an additive and multiplicative scale.”
- Also stated in: § Abstract · plain
“Authors often do not give sufficient information to draw conclusions about the size and statistical significance of interaction on the additive and multiplicative scales.”
- Also stated in: § Conclusion · hedged
“A recent survey of cohort and case–control studies indicated that measures and P-values or CIs for interaction on the additive or multiplicative scale were often not reported.1”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Abstract · plain
In the paper
“Only 11% of the studies presented individual effects of both exposures and the joint effect of both exposures”
What the sources say
- Not checked — no full text of the sourcecites [1] Knol, 2009, When one depends on the other: reporting of interaction in case-control and cohort studies, Epidemiology source
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Without controlling for confounding factors for genetic variants, a joint analysis of both factors can always be interpreted as effect modification of the environmental factors across strata of the genetic factor so long as control is made for the confounders of the environmental exposure.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
2 more claims
Create a free account to see all 30 claims and every source verdict.
- It may state two separate claims as one. 12
- Probably not a substantial claim. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“If the test involved inclusion of a product term in a regression model, we assessed whether the presentation yielded sufficient information to interpret interaction on an additive and on a multiplicative scale (Knol et al., 2009; Knol & VanderWeele, 2012).”
From Syndemics of psychosocial problems and HIV risk: A systematic review of empirical tests of the disease interaction concept (2015) · cites this paper as Knol & VanderWeele, 2012
In the citing paper
“To date, a few reports 8,9 have addressed some of these aspects but they were mainly intended for an epidemiological audience.”
From Understanding of interaction (subgroup) analysis in clinical trials (2019) · cites this paper as [8]
Citations
Cites
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
Calculating measures of biological interaction
Andersson, T., Alfredsson, L., Källberg, H., Zdravkovic, S., & Ahlbom, A. (2005) · European Journal of Epidemiology · doi:10.1007/s10654-005-7835-x · Cited by 1,498
Confidence interval estimation of interaction
Hosmer, D. W., & Lemeshow, S. (1992) · Epidemiology · doi:10.1097/00001648-199209000-00012 · Cited by 1,239
ROTHMAN, K. J., GREENLAND, S., & WALKER, A. M. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113015 · Cited by 859
Estimating measures of interaction on an additive scale for preventive exposures
Knol, M. J., VanderWeele, T. J., Groenwold, R. H. H., Klungel, O. H., Rovers, M. M., & Grobbee, D. E. (2011) · European Journal of Epidemiology · doi:10.1007/s10654-011-9554-9 · Cited by 776
Self-citationROTHMAN, K. J. (1976) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112335 · Cited by 776
Schottenfeld, D. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf028 · Cited by 622
Test for additive interaction in proportional hazards models
Li, R., & Chambless, L. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2006.10.009 · Cited by 548
Sadowski, L. S., Kee, R. A., VanderWeele, T. J., & Buchanan, D. (2009) · JAMA · doi:10.1001/jama.2009.561 · Cited by 508
Self-citation
Research works printed but not linked: 2
- Rothman, 1986, Modern Epidemiology
- Rothman, 2002, Measuring interactions, 168
Cited by
Items 301–400 of 1,396
Alcohol Use, Socioeconomic Status and Risk of HIV Infections
Probst, C., Simbayi, L. C., Parry, C. D. H., Shuper, P. A., & Rehm, J. T. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1758-x · Cited by 31
Peng, C., Zhang, X., Zhang, F., Liu, L., Shao, Y., Xiang, X., Zhang, W., Xiao, J., Wang, Y., Zhang, B., et al. (2019) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000001630 · Cited by 26
Wennman, H., Kronholm, E., Heinonen, O. J., Kujala, U. M., Kaprio, J., Partonen, T., Bäckmand, H., Sarna, S., & Borodulin, K. (2017) · Progress in Preventive Medicine · doi:10.1097/pp9.0000000000000009 · Cited by 26
“Finally, additive interaction was estimated by the relative excess risk due to interaction (RERI) with corresponding 95% CIs using an excel spreadsheet created by Knol and VanderWeele[51] available as a supplement to their article.”
MethodWu, M., Xie, J., Zhou, Z., Wang, L., Hu, Y., Sun, Y., Wang, Y., & Tian, Y. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.12.009 · Cited by 28
Tan, J., Zeng, Q., Ni, M., Zhang, Y., & Qiu, T. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03925-z · Cited by 26
“was used to calculate the RERI(relative excess risk due to interaction), AP(the attributable proportion due to interaction), and S(the synergy index) values [26].”
MethodMaharani, A., Sinclair, D. R., Chandola, T., Bower, P., Clegg, A. P., Hanratty, B., Nazroo, J. Y., Pendleton, N., Tampubolon, G., Todd, C. J., et al. (2023) · Age and Ageing · doi:10.1093/ageing/afad034 · Cited by 34
“Those significant associations persisted when we added interactions between individual wealth and neighbourhood deprivation quintiles, suggesting that there is no multiplicative effect modification on the link between individual wealth and neighbourhood deprivation on frailty [40].”
Liu, B.-P., & Jia, C.-X. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115206 · Cited by 27
Shi, M., Zong, X., Hur, J., Birmann, B. M., Martínez-Maza, O., Epeldegui, M., Chan, A. T., Giovannucci, E. L., & Cao, Y. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104566 · Cited by 29
Gaston, S. A., Forde, A. T., Green, M. D., Sandler, D. P., & Jackson, C. L. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.44707 · Cited by 29
Wang, S., Rossheim, M. E., Nandy, R. R., & Nguyen, U. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.01.260 · Cited by 31
Dunn, H. K., Gjelsvik, A., Pearlman, D. N., & Clark, M. A. (2014) · Women s Health Issues · doi:10.1016/j.whi.2014.06.008 · Cited by 30
The Longitudinal Joint Effect of Obesity and Major Depression on Work Performance Impairment
Nigatu, Y. T., Reijneveld, S. A., Penninx, B. W. J. H., Schoevers, R. A., & Bültmann, U. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302557 · Cited by 25
“A statistical interaction on the additive scale is more relevant to disease prevention and workplace health promotion programs in vulnerable workers than an interaction on the multiplicative scale, which is relevant in disease etiology (18).”
MethodPersonal Protective Equipment Use and Hazardous Drug Spills Among Ambulatory Oncology Nurses
He, B., Mendelsohn-Victor, K. E., McCullagh, M. C., et al. (2017) · Oncology nursing forum · doi:10.1188/17.onf.60-65 · Cited by 25
“Interaction terms between barriers to PPE and organizational factors were also tested (Knol & VanderWeele, 2012).”
Stoicescu, C., Ameilia, R., Irwanto, I., Praptoraharjo, I., & Mahanani, M. M. (2019) · Journal of Urban Health · doi:10.1007/s11524-019-00352-6 · Cited by 28
“An additional constraint is the inability to test for additive interactions beyond two exposures due to limitations inherent in tests of synergism [82].”
BackgroundDuncan, M. J., Oftedal, S., Kline, C. E., Plotnikoff, R. C., & Holliday, E. G. (2023) · Journal of Sport and Health Science · doi:10.1016/j.jshs.2022.07.003 · Cited by 24
“) sleep duration) were examined.(46) In each series of analyses, 3 models were conducted: first, an unadjusted model (Model 1); second, a minimally adjusted model adjusted for the quadratic term for age (age, age(2)) and sex (Model 2); third, a model adjusted for age, sex, education, ethnicity, work status, body mass…”
MethodGong, X., Sun, F., Wei, L., Zhang, Y., Xia, M., Ge, M., & Xiong, L. (2024) · Environmental Science & Technology · doi:10.1021/acs.est.4c05899 · Cited by 29
Kamphuis, C., Groeniger, J. O., Poelman, M., Beenackers, M., & van Lenthe, F. V. (2019) · BMC Public Health · doi:10.1186/s12889-019-8007-3 · Cited by 15
Kapos, F. P., White, L. A., Schmidt, K. A., Hawes, S. E., & Starr, J. R. (2020) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12727 · Cited by 25
Hao, S., Fang, Y., Pang, P., Yang, B., Jiang, X., & Yan, A. (2021) · Environmental Health and Preventive Medicine · doi:10.1186/s12199-021-00969-7 · Cited by 30
“There are several limitations as follows: First, the small sample size may lead to insufficient power to assess an interaction [56].”
BackgroundZhang, Q., Zhang, X., Li, S., Liu, H., Liu, L., Huang, Q., Hou, Y., Liang, X., Cui, B., Zhang, M., et al. (2021) · Environment International · doi:10.1016/j.envint.2021.106741 · Cited by 26
Sex-Specific Associations of Diabetes With Brain Structure and Function in a Geriatric Population
Thomas, E. G., Rhodius‐Meester, H. F. M., Exalto, L. G., Peters, S. A. E., van Bloemendaal, L., Ponds, R., & Muller, M. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.885787 · Cited by 28
Deng, C., Pu, J., Deng, Y., Xie, L., Li, Y., Liu, L., Guo, X., Sandin, S., Liu, H., & Dai, L. (2022) · Scientific Reports · doi:10.1038/s41598-022-18909-y · Cited by 30
Liu, B.-P., & Jia, C.-X. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115076 · Cited by 30
Cano-Sancho, G., Warembourg, C., Güil-Oumrait, N., Stratakis, N., Lertxundi, A., Irizar, A., Llop, S., López-Espinosa, M.-J., Basagaña, X., González, J. R., et al. (2023) · Environmental Health Perspectives · doi:10.1289/ehp11258 · Cited by 26
“90 Following current recommendations, we reported the interactions in multiplicative and additive scale, 28 and we believe that our fi ndings may help to develop biological hypothesis for future toxicological studies and better interpret inconsistent fi ndings in epidemiological studies.”
Bally, E., Ye, L., van Grieken, A., Tan, S. S., Mattace-Raso, F. U. S., Procaccini, E., Alhambra‐Borrás, T., & Raat, H. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1180914 · Cited by 28
Kovalchik, S. A., Matteis, S. D., Landi, M. T., Caporaso, N. E., Varadhan, R., Consonni, D., Bergen, A. W., Katki, H. A., & Wacholder, S. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-143 · Cited by 24
“It is well known that multiplicative interactions sometimes disappear when modeled on the additive scale [4-6,33] and vice versa, highlighting the dependence of statistical interactions on the choice of a model’s scale.”
BackgroundMoore, B. F., Clark, M. L., Bachand, A. M., Reynolds, S. J., Nelson, T. L., & Peel, J. L. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1510138 · Cited by 26
“These variables were dichotomized based on the recommendation for children to get at least 60 min of moderate-to-vigorous intensity physical activity every day (Strong et al. 2005).”
MethodSun, C., Huang, C., Liu, W., Zou, Z., Hu, Y., & Shen, L. (2017) · Building and Environment · doi:10.1016/j.buildenv.2017.07.033 · Cited by 27
“The multiplicative interaction between household ventilation and dampness-related indicators on cold symptoms of children was addressed by multiple logistic regress model and Cox model, meanwhile the spreadsheet proposed by Knol MJ [43,44] and Andersson [45] was adopted to analyze the additive interaction and 95% conf…”
MethodDrudi, L. M., Ades, M., Asgar, A., Perrault, L. P., Lauck, S., Webb, J. G., Rassi, A. N., Lamy, A. L., Noiseux, N., Peterson, M. D., et al. (2018) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2018.06.037 · Cited by 27
“The reporting of interaction followed the recommendations from the International Epidemiological Association (14).”
MethodState firearm laws, race and law enforcement–related deaths in 16 US states: 2010–2016
Sivaraman, J. J. C., Marshall, S. W., & Ranapurwala, S. I. (2020) · Injury Prevention · doi:10.1136/injuryprev-2020-043681 · Cited by 24
O’Brien, K. S., Arzika, A. M., Maliki, R., Manzo, F., Mamkara, A. K., Lebas, E., Cook, C. A., Bailey, R. L., West, S. K., Oldenburg, C. E., et al. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003285 · Cited by 24
Assessing Heterogeneity of Treatment Effects in Observational Studies
Robertson, S. E., Leith, A., Schmid, C. H., & Dahabreh, I. J. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa235 · Cited by 30
Repeated traumatic brain injury and risk of epilepsy: a Danish nationwide cohort study
Lolk, K., Dreier, J. W., & Christensen, J. (2020) · Brain · doi:10.1093/brain/awaa448 · Cited by 27
Alderton, A., O’Connor, M., Badland, H. M., Gunn, L., Boulangé, C., & Villanueva, K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19116780 · Cited by 28
“Based on template developed by Knol and VanderWeele [67].”
MethodMarital status, labour force activity and mortality: A study in the USA and six European countries
van Hedel, K., van Lenthe, F. J., Avendaño, M., Bopp, M., Esnaola, S., Kovács, K., Martikainen, P., Regidor, E., & Mackenbach, J. P. (2015) · Scandinavian Journal of Public Health · doi:10.1177/1403494815578947 · Cited by 24
“[19] Knol MJ and VanderWeele TJ. Recommendations for presenting analyses of effect modification and interaction.”
BackgroundMethodInfluentialSalzer, J., Stenlund, H. C., & Sundström, P. (2013) · Multiple Sclerosis Journal · doi:10.1177/1352458513507820 · Cited by 23
Echeverría, S. E., Mustafa, M. G., Pentakota, S. R., Kim, S., Hastings, K. G., Amadi, C., & Palaniappan, L. P. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.02.016 · Cited by 23
Molecular signature of response to preoperative radiotherapy in locally advanced breast cancer
Tanić, M., Krivokuća, A., Cavic, M. R., Mladenović, J., Karapandžić, V. P., Beck, S., Radulovic, S. S., Šušnjar, S. V., & Jankovic, R. N. (2018) · Radiation Oncology · doi:10.1186/s13014-018-1129-4 · Cited by 26
Men’s work, women’s work and suicide: a retrospective mortality study in Australia
Milner, A. J., & King, T. L. (2018) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12859 · Cited by 25
Chen, D., Ejlskov, L., Laustsen, L. M., Weye, N., Sørensen, C. L. B., Momen, N. C., Dreier, J. W., Zheng, Y., Damgaard, A. J., McGrath, J. J., et al. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.4316 · Cited by 27
Di, D., Zhou, H., Cui, Z., Zhang, J., Liu, Q., Yuan, T., Zhou, T., Luo, X., Ling, D., & Wang, Q. (2024) · Journal of Advanced Research · doi:10.1016/j.jare.2024.02.021 · Cited by 28
Zhao, T., Wang, Y., Li, Z., Xu, X., Song, L., Huang, L., Xu, L., Zhang, M., & Yang, L. (2020) · Environmental Health · doi:10.1186/s12940-020-0566-3 · Cited by 25
Chen, J., Geng, J., Wang, J., Wu, Z., Fu, T., Sun, Y., Chen, X., Wang, X., & Hesketh, T. M. (2022) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848221127474 · Cited by 27
Arakelyan, M., Freyleue, S. D., Schaefer, A., Austin, A. M., Moen, E. L., O’Malley, A. J., Goodman, D. C., & Leyenaar, J. K. (2024) · The Journal of Rural Health · doi:10.1111/jrh.12827 · Cited by 22
Gustavsson, J., Mehlig, K., Leander, K., Berg, C., Tognon, G., Strandhagen, E., Bjorck, L. M., Rosengren, A., Lissner, L., & Nyberg, F. (2015) · European Journal of Nutrition · doi:10.1007/s00394-015-0842-0 · Cited by 21
“We estimated 95 % CIs for RERI according to Knol and WanderWeele [30].”
MethodFabreau, G. E., Leung, A. A. C., Southern, D. A., James, M. T., Knudtson, M. L., Ghali, W. A., & Ayanian, J. Z. (2016) · Journal of the American Heart Association · doi:10.1161/jaha.115.002447 · Cited by 22
“metropolitan facilities (reference group), using logistic regression models and adjusting for all clinical and demographic covariates.(29) We used this strategy to examine interactions between geographic location of presentation and area-level”
MethodAssociation between sleep duration and breast cancer incidence: The multiethnic cohort
Shigesato, M., Kawai, Y., Guillermo, C., Youkhana, F., Shvetsov, Y. B., Setiawan, V. W., Haiman, C. A., Marchand, L. L., & Maskarinec, G. (2019) · International Journal of Cancer · doi:10.1002/ijc.32292 · Cited by 26
“To evaluate the interaction between sleep and BMI, a method suggested by Knol and VanderWeele was used.(33) Combined categories for sleep (≤6, 7–8 and ≥9 hr) and four BMI categories were created and evaluated in Cox regression models women with 7–8 hr of sleep and normal BMI as reference group.”
MethodTakao, T., Suka, M., Yanagisawa, H., & Kasuga, M. (2020) · Journal of Diabetes Investigation · doi:10.1111/jdi.13265 · Cited by 24
Drake, I., Gullberg, B., Sonestedt, E., Stocks, T., Bjartell, A., Wirfält, E., Wallström, P., & Orho-Melander, M. (2017) · International Journal of Cancer · doi:10.1002/ijc.30824 · Cited by 20
Jobs, A., Schwind, J., Katalinic, A., Babaev, V., Tilz, R. R., Rausch, S., Thiele, H., Eitel, I., & Eitel, C. (2018) · Clinical Research in Cardiology · doi:10.1007/s00392-018-1321-4 · Cited by 24
Fernandez-Lazaro, C. I., Zazpe, I., Santiago, S., Toledo, E., Barbería-Latasa, M., & Martínez‐González, M. Á. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.10.029 · Cited by 21
McCormick, N., Yokose, C., Lu, N., Joshi, A. D., Curhan, G. C., & Choi, H. K. (2021) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2021-221635 · Cited by 24
Duncan, M. J., Holliday, E. G., Burton, N. W., Glozier, N., & Oftedal, S. (2022) · Journal of sport and health science/Journal of Sport and Health Science · doi:10.1016/j.jshs.2022.02.002 · Cited by 22
Demoury, C., Troeyer, K. D., Berete, F., Aerts, R., Schaeybroeck, B. V., der Heyden, J. V., & Clercq, E. M. D. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.158336 · Cited by 29
Harris, H. R., Peres, L. C., Johnson, C. E., Guertin, K. A., Beeghly, A., Bandera, E. V., Bethea, T. N., Joslin, C. E., Wu, A. H., Moorman, P. G., et al. (2023) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000005191 · Cited by 19
Sexual Orientation and Cervical Cancer Screening Among Cisgender Women
Baumann, K., Matzke, H., Peterson, C. E., GELLER, S. E., Flores, R. A., Prachand, N., & Holt, H. K. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.8886 · Cited by 25
Hagihara, A., Onozuka, D., Ono, J., Nagata, T., & Hasegawa, M. (2017) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2017.05.003 · Cited by 22
Relationship between tooth loss and peripheral arterial disease among women
Muñoz‐Torres, F. J., Mukamal, K. J., Pai, J. K., Willett, W. C., & JOSHIPURA, K. J. (2017) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12787 · Cited by 26
“…to interaction (AP) are virtually 0 and the synergy index (S) is essentially 1, so we can conclude that there is no additive nor biological interaction as suggested in the literature (Andersson, Alfredsson, Kallberg, Zdravkovic, & Ahlbom, 2005; Knol & VanderWeele, 2012; VanderWeele & Knol 2014).”
The impact of comorbidities on hip fracture mortality: a retrospective population-based cohort study
Jürisson, M., Raag, M., Kallikorm, R., Lember, M., & Uusküla, A. (2017) · Archives of Osteoporosis · doi:10.1007/s11657-017-0370-z · Cited by 22
Ding, L., Liu, C., Zhou, Q., Feng, M., & Wang, J. (2019) · Oncology Letters · doi:10.3892/ol.2019.10005 · Cited by 25
Diabetes, depressive symptoms, and mortality risk in old age: The role of inflammation
Costa, E., Diniz, B. S., Firmo, J. O. A., Peixoto, S. V., Filho, A. I. D. L., Lima‐Costa, M. F., & Blay, S. L. (2019) · Depression and Anxiety · doi:10.1002/da.22908 · Cited by 22
“We then calculated the HR on the additive and multiplicative scale, reporting confidence intervals (CI) as proposed by Knol and VanderWeele (2012) and VanderWeele and Knol (2014).”
BackgroundMethodFrank, M., Dragano, N., Arendt, M., Forstner, A. J., Nöthen, M. M., Moebus, S., Erbel, R., Jöckel, K., & Schmidt, B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221252 · Cited by 25
“All possible combinations of GRSBMI tertiles and SEP groups were entered as dummy variables into regression models to calculate the joint effects of the GRSBMI and SEP indicators on BMI, separately for income and education, using the group with the highest SEP and lowest GRS tertile as single reference [25].”
MethodVeen, L., Hantikainen, E. M., Bellocco, R., Ye, W., Serafini, M., Ponzano, M., Grotta, A., & Lagerros, Y. T. (2020) · European Journal of Nutrition · doi:10.1007/s00394-020-02239-8 · Cited by 21
Wang, Z., Zhu, L., Peng, M., Zheng, H., & Zhang, Y. (2025) · Environmental Research · doi:10.1016/j.envres.2025.120818 · Cited by 23
Bai, J., Bouwknegt, D. G., Weersma, R. K., Dijkstra, G. D. H., van der Sloot, K. W. J., & Festen, E. A. M. (2025) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaf061 · Cited by 28
“67 This would allow researchers to recalculate and compare re-sults across different studies and increase transparency.”
Costello, R. E., Marsden, A., Movahedi, M., Lunt, M., HUMPHREYS, J. H., Emsley, R., & Dixon, W. G. (2020) · BMC Rheumatology · doi:10.1186/s41927-019-0105-4 · Cited by 24
Thyroid dysfunction and breast cancer risk among women in the UK Biobank cohort
Tran, T., Maringe, C., Majano, S. B., Rachet, B., Boutron‐Ruault, M., & Journy, N. (2021) · Cancer Medicine · doi:10.1002/cam4.3978 · Cited by 22
Titus, A. R., Xie, Y., Thrasher, J. F., Levy, D. T., Elliott, M. R., Patrick, M. E., & Fleischer, N. L. (2021) · Addiction · doi:10.1111/add.15658 · Cited by 20
Ning, H., Du, Y. N., Zhao, Y., Liu, Q., Li, X., Zhang, H., Jiang, D., & Feng, H. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.09.061 · Cited by 23
Rogers, C. R., Perdue, D. G., Boucher, K. M., Korous, K. M., Brooks, E., Petersen, E. M., Inadomi, J. M., Tuuhetaufa, F., Levant, R. F., & Paskett, E. D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19053071 · Cited by 23
“In the presence of effect modification, we used relative excess risk due to interaction (RERI) as a measure of the additive scale [48].”
MethodMarsh, B. J., Kolodzie, K., Robinowitz, D. L., Jacobson, A., & Ferschl, M. B. (2022) · Anesthesiology · doi:10.1097/aln.0000000000004344 · Cited by 20
“For the adjusted and subgroup analyses, we chose the risk ratio as our primary measure of effect, but we also reported main effects on an additive scale as risk difference.(35) We then calculated the numbers needed to harm as appropriate.”
MethodPurpose in life and 8-year mortality by gender and race/ethnicity among older adults in the U.S
Shiba, K., Kubzansky, L. D., Williams, D. R., VanderWeele, T. J., & Kim, E. S. (2022) · Preventive Medicine · doi:10.1016/j.ypmed.2022.107310 · Cited by 26
Self-citationDintica, C. S., Calderón‐Larrañaga, A., Vetrano, D. L., & Xu, W. (2023) · Journal of Alzheimer s Disease · doi:10.3233/jad-230041 · Cited by 22
Zoh, R. S., Esteves, B. H., Yu, X. D., Fairchild, A. J., Vazquez, A. I., Chapple, A. G., Brown, A. W., George, B. J., Gordon, D., Landsittel, D. P., et al. (2023) · Obesity Reviews · doi:10.1111/obr.13635 · Cited by 23
Ni, M. Y., Jiang, C., Cheng, K. K., Zhang, W., Gilman, S. E., Lam, T. H., Leung, G. M., & Schooling, C. M. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4370 · Cited by 21
Ioerger, M., Henry, K. L., Chen, P. Y., Cigularov, K. P., & Tomazic, R. G. (2015) · PLoS ONE · doi:10.1371/journal.pone.0129976 · Cited by 29
Zuk, A. M., Quiñonez, C., Saarela, O., Demmer, R. T., & Rosella, L. C. (2018) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2018-000535 · Cited by 21
Meilstrup, C., Holstein, B. E., Nielsen, L., Due, P., & Koushede, V. (2019) · European Journal of Public Health · doi:10.1093/eurpub/ckz058 · Cited by 26
Simard, J. F., Rossides, M., Arkema, E. V., Svenungsson, E., Wikström, A., Mittleman, M. A., & Salmon, J. E. (2020) · Arthritis Care & Research · doi:10.1002/acr.24160 · Cited by 21
“In this study, we presented the results on effect measure modification using the approach recommended by Knol and VanderWeele (9).”
MethodBeaudrap, P. D., Beninguissé, G., Mouté, C., Temgoua, C. D., Kayiro, P. C., Nizigiyimana, V., Pasquier, E., Zerbo, A., Barutwanayo, E., Niyondiko, D., et al. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100477 · Cited by 21
“Modification of the association between disability and HIV infection by factors related to economic or social categories, violence and risky sexual activity was assessed using the relative excess risk due to interaction (RERI), the synergy index (SI) and the attributable proportion (AP) after estimating the odds ratio…”
MethodChung, G. K.-K., Chan, S., Chan, Y.-H., Yip, T. C., Ma, H. K., Wong, G. L., Chung, R. Y., Wong, H., Wong, S. Y. S., Yeoh, E., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18158168 · Cited by 25
“With reference to the methods and result presentation for effect modification recommended by Knol and VanderWeele [34,35], the odds ratios of multimorbidity within the strata of arealevel income-poverty rate, as well as measures of effect modification on the multiplicative scale and additive scale, in terms of relativ…”
MethodYeh, J. S., Cheng, H., Hsu, P., Sung, S., Liu, W.-L., Fang, H., & Chuang, S. (2014) · Journal of the American Heart Association · doi:10.1161/jaha.114.001008 · Cited by 20
“For assessing the interactions of public health importance, for >30 years, it is the general consensus in the epidemiologic community that measuring interaction on the additive scale is most appropriate.(10,23) As elegantly illustrated in a review article by Knol et al,(23) there have been 3 most popular indices propo…”
BackgroundYoshimasu, K., Barbaresi, W. J., Colligan, R. C., Voigt, R. G., Weaver, A. L., & Katusic, S. K. (2016) · PLoS ONE · doi:10.1371/journal.pone.0157488 · Cited by 21
“[28] and following the recommendations for presenting analyses of effect modification and interaction by Knol and VanderWeele [29].”
MethodClemens, M. S., Janak, J. C., Rizzo, J. A., et al. (2017) · Burns · doi:10.1016/j.burns.2017.01.018 · Cited by 20
Epidemiology of Hajj pilgrimage mortality: Analysis for potential intervention
Gaddoury, M. A., & Armenian, H. K. (2023) · Journal of Infection and Public Health · doi:10.1016/j.jiph.2023.05.021 · Cited by 34
van Kassel, M. N., Gonçalves, B. P., Snoek, L., Sørensen, H. T., Bijlsma, M. W., Lawn, J. E., Horváth–Puhó, E., GBS Danish and Dutch Collaborative Group for Long-Term Outcomes, Sørensen, H. T., Horváth–Puhó, E., et al. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab822 · Cited by 21
“We evaluated the extent to which sex modifies the effect of iGBS on mortality and NDI/special education needs [24, 25].”
BackgroundPopulation and Neighborhood Correlates of Cannabis Dispensary Locations in Oklahoma
Cohn, A. M., Sedani, A. E., Niznik, T., et al. (2023) · Cannabis · doi:10.26828/cannabis/2023.01.008 · Cited by 19
Park, J., Hong, J. Y., Shen, J. J., Han, K., Park, Y. S., & Park, J. O. (2023) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2023.7060 · Cited by 19
Characterizing Treatment Effect Heterogeneity Using Real‐World Data
Thelen, H. E., & Hennessy, S. (2025) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.3627 · Cited by 22
Biomarkers for polycyclic aromatic hydrocarbons and serum liver enzymes
Min, Y., Lim, H., & Kim, H. (2015) · American Journal of Industrial Medicine · doi:10.1002/ajim.22463 · Cited by 20
Echeverría, S. E., Pentakota, S. R., Abraído‐Lanza, A. F., Janevic, T. M., Gundersen, D. A., Ramirez, S. M., & Delnevo, C. D. (2013) · Annals of Epidemiology · doi:10.1016/j.annepidem.2013.07.023 · Cited by 24
“To test for interaction between acculturation and education on smoking and physical activity, we applied the research methods illustrated by Knol and VanderWeele [32] and VanderWeele [33].”
MethodQuantification of Treatment Effect Modification on Both an Additive and Multiplicative Scale
Girerd, N., Rabilloud, M., Pîbarot, P., Mathieu, P., & Roy, P. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153010 · Cited by 21
“This point of view is in line with the work of other authors [10,26].”
ResultRobroek, S. J., Järvholm, B., van der Beek, A. J., Proper, K. I., Wahlström, J., & Burdorf, A. (2017) · Occupational and Environmental Medicine · doi:10.1136/oemed-2016-104059 · Cited by 29
Sharp, G., & Kimbro, R. T. (2020) · Health & Place · doi:10.1016/j.healthplace.2020.102473 · Cited by 23
Bradley, M. C., Black, A., Freedman, A. N., & Barron, T. I. (2016) · Cancer · doi:10.1002/cncr.30004 · Cited by 20
“The separate and joint effects of aspirin exposure and lymph node status are presented using a single reference category (lymph node negative, aspirin nonuser), in addition to the within-strata effects and measures of interaction.(15) Univariate and multivariate Poisson regression models were used to estimate risk rat…”
MethodSociodemographic Heterogeneity in the Associations of Social Isolation With Mortality
Nakagomi, A., Saito, M., Ojima, T., Ueno, T., Hanazato, M., & Kondo, K. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.13132 · Cited by 22
Race, Flourishing, and All-Cause Mortality in the United States, 1995–2016
Louie, P., Upenieks, L., Siddiqi, A., Williams, D. R., & Takeuchi, D. T. (2021) · American Journal of Epidemiology · doi:10.1093/aje/kwab067 · Cited by 19
Moller, H., Sincovich, A., Gregory, T. A., & Smithers, L. G. (2021) · Public Health Nutrition · doi:10.1017/s1368980021004870 · Cited by 37
“conducted according to best epidemiological practice(37).”
Wang, R., Olier, I., Ortega‐Martorell, S., Liu, Y., Ye, Z., Lip, G. Y. H., & Li, G. (2022) · Cardiovascular Diabetology · doi:10.1186/s12933-022-01644-z · Cited by 19
“Furthermore, we performed additional analyses for modification of metabolic status and PA with AF risk among obese individuals, where metabolic status is the exposure of interest and PA is the potential modifier [30].”
MethodHuh, D., Choi, Y., & Moon, K. W. (2016) · PLoS ONE · doi:10.1371/journal.pone.0168718 · Cited by 19
Metadata
- Authors
- Knol, M. J., & VanderWeele, T. J.
- Affiliations
- Harvard University (US)
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-01-09
- Volume
- 41
- Issue
- 2
- Pages
- 514-520
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- PMC
- PMC3324457
- OpenAlex
- W2114647004
- Cited by
- 1,494
- References
- 35
- Citations by year
- 2026: 292 · 2025: 187 · 2024: 161 · 2023: 153 · 2022: 125 · 2021: 123 · 2020: 92 · 2019: 89 · 2018: 64 · 2017: 74 · 2016: 43 · 2015: 32 · 2014: 26 · 2013: 21 · 2012: 7
- FWCI
- 24.79
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Journal of Epidemiology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- effect modification, interaction, reporting recommendations, statistical tables, relative risk, odds ratio, risk difference, confounding adjustment, causal inference
- MeSH terms
- Humans, Risk Factors, Models, Statistical, Causality, Effect Modifier, Epidemiologic, Epidemiologic Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.