Mediation Analysis Is Harder Than It Looks
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Mediators are variables that transmit causal effects from treatments to outcomes. Those who undertake mediation analysis seek to answer “how” questions about causation: how does this treatment affect that outcome? Typically, we desire answers of the form “the treatment affects a causally intermediate variable, which in turn affects the outcome.” Identifying these causally intermediate variables is the challenge of mediation analysis. Conjectures about political mediation effects are as old as the study of politics. But codification of procedures by which to test hypotheses about mediation is a relatively new development. The most common procedures are now ubiquitous in psychology (Quiñones-Vidal et al. 2004) and increasingly popular in the other social sciences, not least political science. Unfortunately, the most common procedures are not very good. They call for indirect effects – the portions of treatment effects that are transmitted through mediators – to be estimated via multiequation regression frameworks. These procedures do not require experimental manipulation of mediators; instead, they encourage the study of mediation with data from unmanipulated mediators (MacKinnon et al. 2002, 86; Spencer, Zanna, and Fong 2005). The procedures are therefore prone to producing biased estimates of mediation effects. Warnings about this problem have been issued for decades by statisticians, psychologists, and political scientists.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Identification and estimation of local average treatment effects
Imbens, G. W., & Angrist, J. D. (1994) · Econometrica · doi:10.2307/2951620 · Cited by 4,101
Spencer, S. J., Zanna, M. P., & Fong, G. T. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.6.845 · Cited by 2,452
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Identification, Inference and Sensitivity Analysis for Causal Mediation Effects
Imai, K., Keele, L., & Yamamoto, T. (2010) · Statistical Science · doi:10.1214/10-sts321 · Cited by 1,628
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
What Triggers Public Opposition to Immigration? Anxiety, Group Cues, and Immigration Threat
Brader, T., Valentino, N. A., & Suhay, E. (2008) · American Journal of Political Science · doi:10.1111/j.1540-5907.2008.00353.x · Cited by 1,313
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Cited by
Green, D. P., Ha, S. E., & Bullock, J. G. (2010) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716209351526 · Cited by 299
Self-citationMeaningful Mediation Analysis: Plausible Causal Inference and Informative Communication
Pieters, R. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx081 · Cited by 266
Bolsen, T., & Druckman, J. N. (2018) · Group Processes & Intergroup Relations · doi:10.1177/1368430217737855 · Cited by 228
Li, X., Grahl, J., & Hinz, O. (2022) · Information Systems Research · doi:10.1287/isre.2021.1074 · Cited by 93
Affective polarization and misinformation belief
Jenke, L. (2024) · Political Behavior · doi:10.1007/s11109-022-09851-w · Cited by 85
Metadata
- Authors
- Bullock, J. G., & Ha, S. E.
- Venue
- Cambridge Handbook of Experimental Political Science
- Publisher
- Cambridge University Press
- Published
- 2011-06-06
- Pages
- 508-522
- OpenAlex
- W2273864059
- Cited by
- 92
- References
- 12
- FWCI
- 11.56
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mediation Analysis Is Harder Than It Looks. https://app.cochat.ai/papers/10.1017/cbo9780511921452.035
- The paper
- Bullock, J. G., & Ha, S. E. (2011). Mediation Analysis Is Harder Than It Looks. Cambridge Handbook of Experimental Political Science. https://doi.org/10.1017/cbo9780511921452.035
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.