Counterfactual graphical models for longitudinal mediation analysis with unobserved confounding
Open accessAbstract
Questions concerning mediated causal effects are of great interest in psychology, cognitive science, medicine, social science, public health, and many other disciplines. For instance, about 60% of recent papers published in leading journals in social psychology contain at least one mediation test (Rucker, Preacher, Tormala, & Petty, 2011). Standard parametric approaches to mediation analysis employ regression models, and either the “difference method” (Judd & Kenny, 1981), more common in epidemiology, or the “product method” (Baron & Kenny, 1986), more common in the social sciences. In this article, we first discuss a known, but perhaps often unappreciated, fact that these parametric approaches are a special case of a general counterfactual framework for reasoning about causality first described by Neyman (1923) and Rubin (1924) and linked to causal graphical models by Robins (1986) and Pearl (2006). We then show a number of advantages of this framework. First, it makes the strong assumptions underlying mediation analysis explicit. Second, it avoids a number of problems present in the product and difference methods, such as biased estimates of effects in certain cases. Finally, we show the generality of this framework by proving a novel result which allows mediation analysis to be applied to longitudinal settings with unobserved confounders.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Shpitser provides complete algorithms for identifying natural direct and indirect effects and extends these results to path-specific effects with multiple treatments and multiple outcomes.
“Shpitser [24] further provides complete algorithms for identifying natural direct and indirect effects and extends these results to path-specific effects with multiple treatments and multiple outcomes.”
From The Deductive Approach to Causal Inference (2014) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.6.1173 · Cited by 91,542 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532 · see citing works
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · see citing works
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771 · see citing works
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581 · see citing works
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,371 · see citing works
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,969 · see citing works
Robins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451 · see citing works
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442 · see citing works
Mediation Analysis in Social Psychology: Current Practices and New Recommendations
Rucker, D. D., Preacher, K. J., Tormala, Z. L., & Petty, R. E. (2011) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2011.00355.x · Cited by 2,430 · see citing works
Smoking and Carcinoma of the Lung
Doll, R., & Hill, A. B. (1950) · BMJ · doi:10.1136/bmj.2.4682.739 · Cited by 1,999 · see citing works
Estimating Mediated Effects in Prevention Studies
MacKinnon, D. P., & Dwyer, J. H. (1993) · Evaluation Review · doi:10.1177/0193841x9301700202 · Cited by 1,936 · see citing works
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793 · see citing works
A Simulation Study of Mediated Effect Measures
MacKinnon, D. P., Warsi, G. M., & Dwyer, J. H. (1995) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3001_3 · Cited by 1,715 · see citing works
Ease of retrieval as information: another look at the availability heuristic
Schwarz, N., Bless, H., Strack, F., Klumpp, G., Rittenauer-Schatka, H., & Simons, A. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.61.2.195 · Cited by 1,412 · see citing works
The nonverbal mediation of self-fulfilling prophecies in interracial interaction
Word, C. O., Zanna, M. P., & Cooper, J. (1974) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(74)90059-6 · Cited by 902 · see citing works
Linking Economic Hardship to Marital Quality and Instability
Conger, R. D., Elder, G. H., Lorenz, F. O., Conger, K. J., Simons, R. L., Whitbeck, L. B., Huck, S. M., & Melby, J. N. (1990) · Journal of Marriage and the Family · doi:10.2307/352931 · Cited by 808 · see citing works
Conceptual issues concerning mediation, interventions and composition
VanderWeele, T. J., & Vansteelandt, S. (2009) · Statistics and Its Interface · doi:10.4310/sii.2009.v2.n4.a7 · Cited by 731 · see citing works
Experimental Designs for Identifying Causal Mechanisms
Imai, K., Tingley, D., & Yamamoto, T. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01032.x · Cited by 408 · see citing works
Tchetgen, E. J. T., & Shpitser, I. (2012) · The Annals of Statistics · doi:10.1214/12-aos990 · Cited by 281 · see citing works
Self-citationKaufman, J. S., MacLehose, R. F., & Kaufman, S. (2004) · Epidemiologic Perspectives & Innovations · doi:10.1186/1742-5573-1-4 · Cited by 253 · see citing works
Rebonato, R., & Denev, A. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781107256736.003 · Cited by 241 · see citing works
Multiple Roles for Source Credibility Under High Elaboration: It's all in the Timing
Tormala, Z. L., Briñol, P., & Petty, R. E. (2007) · Social Cognition · doi:10.1521/soco.2007.25.4.536 · Cited by 160 · see citing works
Causality and Psychopathology: Finding the Determinants of Disorders and their Cures
Shrout, P. E., Keyes, K. M., & Ornstein, K. A. (2010) · Cited by 147 · see citing works
Genetic Variants on 15q25.1, Smoking, and Lung Cancer: An Assessment of Mediation and Interaction
VanderWeele, T. J., Asomaning, K., Tchetgen, E. J. T., Han, Y., Spitz, M. R., Shete, S. S., Wu, X., Gaborieau, V., Wang, Y., McLaughlin, J. R., et al. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr467 · Cited by 146 · see citing works
Complete Identification Methods for the Causal Hierarchy
Shpitser, I., & Spirtes, P. (2007) · ePrints Soton (University of Southampton) · Cited by 136 · see citing works
Self-citationProceedings of the Eighteenth Conference on Uncertainty in Artificial Intelligence (2002)Preprint
Darwiche, A. Y., & Friedman, N. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.4608 · Cited by 117 · see citing works
Introductory Remarks on Neyman (1923)
Speed, T. P. (1990) · Statistical Science · doi:10.1214/ss/1177012030 · Cited by 116 · see citing works
Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence (2011)Preprint
Cozman, F. G., & Pfeffer, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2596 · Cited by 89 · see citing works
Ease of retrieval effects in social judgment: The role of unrequested cognitions.
Tormala, Z. L., Falces, C., Briñol, P., & Petty, R. E. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.2.143 · Cited by 81 · see citing works
Lead editorial: The need for greater perspective and innovation in epidemiology
Phillips, C. V., Goodman, K. J., Poole, C., & Innovations, T. E. O. E. P. &. (2004) · Epidemiologic Perspectives & Innovations · doi:10.1186/1742-5573-1-1 · Cited by 39 · see citing works
The Causal Mediation Formula - A Guide to the Assessment of Pathways and Mechanisms
Pearl, J. (2011) · doi:10.21236/ada557663 · Cited by 34 · see citing works
Kaufman, J. S., & MacLehose, R. F. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/q6ng-db08 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 9
- Huang, Y., & Valtorta, M. (2006). Pearl's calculus of interventions is complete. In Proceedings of the twenty-second annual conference on uncertainty in artificial intelligence (UAI-06) (pp. 217-224).
- Pearl, J. (2001). Direct and indirect effects. In Proceedings of the seventeenth conference annual conference on uncertainty in artificial intelligence (UAI-01) (pp. 411-420). San Francisco: Morgan Kaufmann.
- Richardson, T. S. (2009). A factorization criterion for acyclic directed mixed graphs. In Proceedings of the twenty-fifth annual conference on uncertainty in artificial intelligence (UAI-09) (pp. 463-470). Corvallis, OR: AUAI Press.
- Richardson, T. S., Robins, J. M., & Shpitser, I. (2012). Nested markov properties for acyclic directed mixed graphs. In Proceedings of the twenty-fifth conference annual conference on uncertainty in artificial intelligence (UAI-12) (pp. 13-13). Corvallis, OR: AUAI Press.
- Robins, J. M., & Wasserman, L. (1997). Estimation of effects of sequential treatments by reparameterizing directed acyclic graphs. In Proceedings of the 13th annual conference on uncertainty in artificial intelligence (UAI-97) (pp. 409-420). San Francisco: Morgan Kaufmann.
- Shpitser, I., & Pearl, J. (2006a). Identification of conditional interventional distributions. In R. Dechter and T.S. Richardson (Eds.), Proceedings of the twenty-second conference on uncertainty in artificial intelligence (UAI-06) (pp. 437-444). Corvallis, OR: AUAI Press.
- Shpitser, I., & Pearl, J. (2006b). Identification of joint interventional distributions in recursive semi- markovian causal models. In Proceedings of the 21st national conference on artificial intelligence (AAAI 06) (pp. 1219-1226). Palo Alto, CA: AAAI Press.
- Tian, J., & Pearl, J. (2002a). A general identification condition for causal effects. In Proceedings of the eighteenth national conference on artificial intelligence (AAAI 02) (pp. 567-573). Menlo Park, CA: American Association for Artificial Intelligence.
- Woodworth, R. S. (1928). Dynamic psychology. In C. Murchison (Ed.), Psychologies of 1925. Worcester, MA: Clark University Press.
Cited by
Sorted by citations
Interpretation and identification of causal mediation
Pearl, J. (2014) · Psychological Methods · doi:10.1037/a0036434 · Cited by 554 · see citing works
Anti-discrimination learning: a causal modeling-based framework
Zhang, L., & Wu, X. (2017) · International Journal of Data Science and Analytics · doi:10.1007/s41060-017-0058-x · Cited by 48 · see citing works
Kangaslampi, S., & Peltonen, K. (2022) · Current Psychology · doi:10.1007/s12144-019-00478-5 · Cited by 45 · see citing works
“searchers might wish to frame their analyses in the formal language of counterfactuals (Imai et al. 2015; Pearl 2001; Shpitser 2013).”
BackgroundInfluentialThe Deductive Approach to Causal Inference
Pearl, J. (2014) · Journal of Causal Inference · doi:10.1515/jci-2014-0016 · Cited by 28 · see citing works
Nabi, R., & Shpitser, I. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11553 · Cited by 20 · see citing works
Self-citationPath-Specific Counterfactual Fairness
Chiappa, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017801 · Cited by 16 · see citing works
- Authors
- Shpitser, I.
- Affiliations
- University of Southampton (GB)
- Corresponding author
- Shpitser, Ilya
- ORCID
- Shpitser, Ilya
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2013-07-30
- Volume
- 37
- Issue
- 6
- Pages
- 1011-1035
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2152431454
- Cited by
- 106
- References
- 33
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 2 · 2023: 8 · 2022: 12 · 2021: 10 · 2020: 19 · 2019: 13 · 2018: 10 · 2017: 8 · 2016: 3 · 2015: 4 · 2014: 6
- FWCI
- 3.81
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cognitive Science (publishedVersion)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- unmeasured confounding, product method, difference method, causal inference, causal graphical models, counterfactual reasoning
- MeSH terms
- Humans, Models, Theoretical, Models, Statistical, Causality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review