When One Depends on the Other: Reporting of Interaction in Case-Control and Cohort Studies
The DOI matches its Crossref record, with a small difference in title or year; 30 of the 30 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Interaction refers to the situation in which the effect of 1 exposure on an outcome differs across strata of another exposure. We did a survey of epidemiologic studies published in leading journals to examine how interaction is assessed and reported. METHODS: We selected 150 case-control and 75 cohort studies published between May 2001 and May 2007 in leading general medicine, epidemiology, and clinical specialist journals. Two reviewers independently extracted data on study characteristics. RESULTS: Of the 225 studies, 138 (61%) addressed interaction. Among these, 25 (18%) presented no data or only a P value or a statement of statistical significance; 40 (29%) presented stratum-specific effect estimates but no meaningful comparison of these estimates; and 58 (42%) presented stratum-specific estimates and appropriate tests for interaction. Fifteen articles (11%) presented the individual effects of both exposures and also their joint effect or a product term, providing sufficient information to interpret interaction on an additive and multiplicative scale. Reporting was poorest in articles published in clinical specialist articles and most adequate in articles published in general medicine journals, with epidemiology journals in an intermediate position. CONCLUSIONS: A majority of articles reporting cohort and case-control studies address possible interactions between exposures. However, in about half of these, the information provided was unsatisfactory, and only 1 in 10 studies reported data that allowed readers to interpret interaction effects on an additive and multiplicative scale.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“If the test involved inclusion of a product term in a regression model, we assessed whether the presentation yielded sufficient information to interpret interaction on an additive and on a multiplicative scale (Knol et al., 2009; Knol & VanderWeele, 2012).”
From Syndemics of psychosocial problems and HIV risk: A systematic review of empirical tests of the disease interaction concept (2015) · cites this paper as Knol et al., 2009
In the citing paper
“Only 11% of the studies presented individual effects of both exposures and the joint effect of both exposures”
From Recommendations for presenting analyses of effect modification and interaction (2012) · cites this paper as [1]
In the citing paper
“A survey of 225 cohort and case–control studies showed that 61% of the studies addressed effect modification or interaction in their publications.1”
From Recommendations for presenting analyses of effect modification and interaction (2012) · cites this paper as [1]
In the citing paper
“most studies used multiple reference categories which makes it impossible to assess overall interaction measures.”
From Recommendations for presenting analyses of effect modification and interaction (2012) · cites this paper as [1]
In the citing paper
“However, the vast majority of these studies did not give sufficient information to the reader to draw conclusions on the size and statistical significance of the interaction on an additive and multiplicative scale.”
From Recommendations for presenting analyses of effect modification and interaction (2012) · cites this paper as [1]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Self-citationvon Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Self-citationVandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · cited 1×
“Level 3 58 (42) 23 (50) 20 (40) 15 (36) Level 4 15 (11) 5 (11) 6 (12) 4 (10)”
Self-citationNo adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965 · cited 1×
“Statement on statistical significance 8 (17) 13 (26) 10 (24)”
BackgroundVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Self-citationRothman, K. J., Greenland, S., & Lash, T. L. (1998) · Cited by 2,096
Malignancies, prothrombotic mutations, and the risk of venous thrombosis
Blom, J. W. (2005) · JAMA · doi:10.1001/jama.293.6.715 · Cited by 1,949
Confidence interval estimation of interaction
Hosmer, D. W., & Lemeshow, S. (1992) · Epidemiology · doi:10.1097/00001648-199209000-00012 · Cited by 1,239 · cited 4×
“Lifestyle factors 9 (12) 15 (20) 10 (13)”
BackgroundInfluentialSubgroup analysis and other (mis)uses of baseline data in clinical trials
Assmann, S. F., Pocock, S. J., Enos, L. E., & Kasten, L. E. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02039-0 · Cited by 1,167 · cited 1×
“Other 22 (29) 18 (24) 17 (23) Country of study participants”
BackgroundSubgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
ROTHMAN, K. J., GREENLAND, S., & WALKER, A. M. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113015 · Cited by 859
García-Closas, M., Malats, N., Silverman, D., Dosemeci, M., Kogevinas, M., Hein, D. W., Tardón, A., Serra, C., Carrato, A., García-Closas, R., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67137-1 · Cited by 627 · cited 1×
“All-cause mortality 12 (16) 11 (15) 6 (8)”
Knol, M. J., van der Tweel, I., Grobbee, D. E., Numans, M. E., & Geerlings, M. I. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym157 · Cited by 444 · cited 2×
“Likelihood ratio test 6 (13) 8 (16) 9 (21)”
Self-citationIssues in the reporting of epidemiological studies: a survey of recent practice.
Pocock, S. J., Collier, T. J., Dandreo, K. J., de Stavola, B. L., Goldman, M. B., Kalish, L. A., Kasten, L. E., & McCormack, V. A. (2004) · BMJ · doi:10.1136/bmj.38250.571088.55 · Cited by 313 · cited 1×
“Likelihood ratio test 6 (13) 8 (16) 9 (21)”
SYNERGY AND ANTAGONISM IN CAUSE-EFFECT RELATIONSHIPS1
ROTHMAN, K. J. (1974) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a121626 · Cited by 250
Interaction: A word with two meanings creates confusion
Ahlbom, A., & Alfredsson, L. (2005) · European Journal of Epidemiology · doi:10.1007/s10654-005-4410-4 · Cited by 229 · cited 2×
“We distinguished 2 types of stratification: (1) the presentation of effect estimates of exposure and outcome in strata of the suspected effect-modifying exposure; (2) the presentation of individual effects of both exposures and their joint effect, each relative to no exposure.”
BackgroundCommentary: facing the challenge of gene-environment interaction: the two-by-four table and beyond
Botto, L. D. (2001) · American Journal of Epidemiology · doi:10.1093/aje/153.10.1016 · Cited by 198
Knol, M. J., Vandenbroucke, J. P., Scott, P., & Egger, M. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn217 · Cited by 189
Self-citationThe identification of synergism in the sufficient-component-cause framework
VanderWeele, T. J., & Robins, J. M. (2007) · Epidemiology · doi:10.1097/01.ede.0000260218.66432.88 · Cited by 183 · cited 1×
“All-cause mortality 12 (16) 11 (15) 6 (8)”
Interaction as departure from additivity in case-control studies: a cautionary note
Skrondal, A. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg113 · Cited by 180 · cited 2×
“Other 22 (29) 18 (24) 17 (23) Country of study participants”
BackgroundBiological Models and Statistical Interactions: an Example from Multistage Carcinogenesis
SIEMIATYCKI, J., & THOMAS, D. C. (1981) · International Journal of Epidemiology · doi:10.1093/ije/10.4.383 · Cited by 175 · cited 1×
“No specific term used 3 (7) 9 (18) 5 (12) Presentation of interaction Stratum-specific effect estimates 33 (72) 36 (72) 29 (69) Individual and joint effect estimates 4 (9) 6 (12) 4 (10)”
BackgroundEffect modification and the limits of biological inference from epidemiologic data
Thompson, W. D. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90033-6 · Cited by 168 · cited 2×
“No specific term used 3 (7) 9 (18) 5 (12) Presentation of interaction Stratum-specific effect estimates 33 (72) 36 (72) 29 (69) Individual and joint effect estimates 4 (9) 6 (12) 4 (10)”
BackgroundInvariants and noninvariants in the concept of interdependent effects.
Greenland, S., & Poole, C. (1988) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.1945 · Cited by 150
Multiple Comparisons, Explained
Goodman, S. N. (1998) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009531 · Cited by 103 · cited 1×
“Prevalent medical conditions 9 (12) 9 (12) 19 (25)”
Prospective study of fibrinolytic markers and venous thromboembolism
Folsom, A. R., Cushman, M., Heckbert, S. R., Rosamond, W. D., & Aleksic, N. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00052-0 · Cited by 81 · cited 4×
“Infectious disease 12 (16) 4 (5) 13 (17)”
InfluentialSchriger, D. L., Sinha, R., Schroter, S., Liu, P. Y., & Altman, D. G. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.06.017 · Cited by 55
Additive Risk versus Additive Relative Risk Models
Greenland, S. (1993) · Epidemiology · doi:10.1097/00001648-199301000-00007 · Cited by 52
Diabetes mellitus as a contributor to the risk of acute myocardial infarction
Tavani, A., Bertuzzi, M., Gallus, S., Negri, E., & Vecchia, C. L. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00486-9 · Cited by 45 · cited 3×
“Infectious disease 12 (16) 4 (5) 13 (17)”
BackgroundReporting on methods of subgroup analysis in clinical trials: a survey of four scientific journals
Moreira, E. D., STEIN, Z. A., & Susser, E. (2001) · Brazilian Journal of Medical and Biological Research · doi:10.1590/s0100-879x2001001100011 · Cited by 33 · cited 3×
“Wald test for product term 11 (24) 11 (22) 6 (14)”
Lazo‐Langner, A., Knoll, G. A., Wells, P. S., Carson, N. L., & Rodger, M. A. (2006) · Blood · doi:10.1182/blood-2006-06-028902 · Cited by 28
Cited by
Recommendations for presenting analyses of effect modification and interaction
Knol, M. J., & VanderWeele, T. J. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dyr218 · Cited by 1,494
Self-citationVanderWeele, T. J., & Knol, M. J. (2014) · Epidemiologic Methods · doi:10.1515/em-2013-0005 · Cited by 1,127
“In a recent review of a random sample of 25 cohort and 50 caseÀcontrol studies from the five most highly ranked epidemiological journals, Knol et al. (2009) noted that although 61% of the studies included at least as secondary analyses an assessment of effect modification or interaction, only one…”
BackgroundSelf-citationA Growing Role for Gender Analysis in Air Pollution Epidemiology
Clougherty, J. E. (2010) · Environmental Health Perspectives · doi:10.1289/ehp.0900994 · Cited by 606
“Issues in assessment of interactions for epidemiology have been detailed elsewhere (Knol et al. 2009).”
BackgroundThe (mis)use of overlap of confidence intervals to assess effect modification
Knol, M. J., Pestman, W. R., & Grobbee, D. E. (2011) · European Journal of Epidemiology · doi:10.1007/s10654-011-9563-8 · Cited by 249
Self-citationCorraini, P., Olsen, M., Pedersen, L., Dekkers, O., & Vandenbroucke, J. (2017) · Clinical Epidemiology · doi:10.2147/clep.s129728 · Cited by 236
“Three types of effects were obtained by regression analysis: the effect of aspirin use alone, the effect of clopidogrel use alone and the joint effect of aspirin and clopidogrel use, in relation to no antithrombotic use at all (Table 3).(19) The odds ratios (ORs) provided in Table 3 can be used to obtain another inter…”
Self-citation
Metadata
- Authors
- Knol, M. J., Egger, M., Scott, P., Geerlings, M. I., & Vandenbroucke, J. P.
- Affiliations
- University of Bern (CH)
- University Medical Center Utrecht (NL)
- Leiden University Medical Center (NL)
- Corresponding author
- Knol, Mirjam J.
- Venue
- Epidemiology
- Published
- 2009-03
- Volume
- 20
- Issue
- 2
- Pages
- 161-166
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2017527646
- Cited by
- 113
- References
- 30
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 4 · 2023: 4 · 2022: 7 · 2021: 6 · 2020: 3 · 2019: 6 · 2018: 6 · 2017: 8 · 2016: 11 · 2015: 10 · 2014: 7 · 2013: 8 · 2012: 6
- FWCI
- 7.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- interaction, effect modification, reporting quality, interaction terms, case-control study, cohort studies, journal types
- MeSH terms
- Cohort Studies, Bibliometrics, Causality, Epidemiologic Studies, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.