The DOI matches its Crossref record; 67 of the 69 references it cites were found in a registry or an index, and 2 are not checked yet.
That’s a Lot to Process! Pitfalls of Popular Path Models
Open accessPublished version of a preprint
Abstract
Path models to test claims about mediation and moderation are a staple of psychology. But applied researchers may sometimes not understand the underlying causal inference problems and thus endorse conclusions that rest on unrealistic assumptions. In this article, we aim to provide a clear explanation for the limited conditions under which standard procedures for mediation and moderation analysis can succeed. We discuss why reversing arrows or comparing model fit indices cannot tell us which model is the right one and how tests of conditional independence can at least tell us where our model goes wrong. Causal modeling practices in psychology are far from optimal but may be kept alive by domain norms that demand every article makes some novel claim about processes and boundary conditions. We end with a vision for a different research culture in which causal inference is pursued in a much slower, more deliberate, and collaborative manner.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Further, researchers must measure and model all reasonably relevant variables, or risk obfuscating the causal relationships present within the data (Rohrer et al., 2021).”
From Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them (2023) · cites this paper as Rohrer et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Unobservable Selection and Coefficient Stability: Theory and Evidence
Oster, E. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1227711 · Cited by 5,367
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
A general approach to causal mediation analysis.
Imai, K., Keele, L., & Tingley, D. (2010) · Psychological Methods · doi:10.1037/a0020761 · Cited by 4,143 · cited 3×
“For example, alternative models with alternative sets of assumptions may be reported, and quantitative methods can be used to estimate to what extent conclusions are sensitive to unobserved confounding (e.g., Blackwell, 2014; Imai et al., 2010; Oster, 2019; VanderWeele, 2010).”
BackgroundMethodBias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401 · cited 1×
“Even in the absence of confounders, mediation chains unfold over time, and trying to recover the longitudinal effects from cross-sectional data works only under very narrow conditions (Maxwell & Cole, 2007; Maxwell et al., 2011; O’Laughlin et al., 2018).”
BackgroundInternational Journal of Epidemiology
(1973) · Journal of Medical Genetics · doi:10.1136/jmg.10.1.100-a · Cited by 2,838
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
Causal Inference in Statistics
Pearl, J., Glymour, M., & Jewell, N. P. (2016) · Cited by 2,024
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
Identification, Inference and Sensitivity Analysis for Causal Mediation Effects
Imai, K., Keele, L., & Yamamoto, T. (2010) · Statistical Science · doi:10.1214/10-sts321 · Cited by 1,628 · cited 3×
“For example, alternative models with alternative sets of assumptions may be reported, and quantitative methods can be used to estimate to what extent conclusions are sensitive to unobserved confounding (e.g., Blackwell, 2014; Imai et al., 2010; Oster, 2019; VanderWeele, 2010).”
BackgroundMethodIMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
Research works printed but not linked: 6
- Avin C., Shpitser I., Pearl J. (2005, June 1). Identifiability of path-specific effects [Conference session]. 19th International Joint Conference on Artificial Intelligence, IJCAI 2005, Edinburgh. https://escholarship.org/uc/item/45x689gq
- Bareinboim E., Pearl J. (2012). Causal inference by surrogate experiments: z-identifiability. arXiv. http://arxiv.org/abs/1210.4842 · arXiv
- Hayes A. F., 2017, Introduction to mediation, moderation, and conditional process analysis, second edition: A regression-based approach
- 10.1037/0033-2909.114.1.185 · doi:10.1037/0033-2909.114.1.185 · Paper page
- Morgan S. L., 2015, Counterfactuals and causal inference
- Pearl J., 2014, Schweizerische Monatsschrift Fur Zahnheilkunde = Revue Mensuelle Suisse d’odonto-stomatologie / SSO, 29, 579
Cited by
Rohrer, J. M., & Murayama, K. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221140842 · Cited by 216
Self-citationTutorial: Power Analyses for Interaction Effects in Cross-Sectional Regressions
Baranger, D. A. A., Finsaas, M. C., Goldstein, B. L., Vize, C. E., Lynam, D. R., & Olino, T. M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231187531 · Cited by 275
Chen, H., Shao, B., Yang, X., Kang, W., & Fan, W. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108216 · Cited by 168
Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them
Arch, J. J., Fishbein, J. N., Finkelstein, L. B., & Luoma, J. B. (2023) · Behavior Therapy · doi:10.1016/j.beth.2022.07.005 · Cited by 72
Tutorial: Power analyses for interaction effects in cross-sectional regressionsPreprint
Baranger, D. A. A., Finsaas, M. C., Goldstein, B. L., Vize, C. E., Lynam, D. R., & Olino, T. M. (2022) · doi:10.31234/osf.io/5ptd7 · Cited by 73
Metadata
- Authors
- Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M.
- Affiliations
- Leipzig University (DE)
- Copenhagen Business School (DK)
- Max Planck Institute for Human Development (DE)
- Ruhr University Bochum (DE)
- Corresponding author
- Rohrer, Julia M.
- Venue
- Advances in Methods and Practices in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2022-04
- Volume
- 5
- Issue
- 2
- ISSN
- 2515-2459 (ISSN-L)
- 2515-2467
- OpenAlex
- W4288766776
- Cited by
- 267
- References
- 64
- Citations by year
- 2026: 67 · 2025: 61 · 2024: 74 · 2023: 47 · 2022: 15
- FWCI
- 36.33
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Advances in Methods and Practices in Psychological Science (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- CBS Research Portal (Copenhagen Business School) (submittedVersion, cc-by-nc)
- Funders
- ministerium für kultur und wissenschaft des landes nordrhein-westfalen (1706dgn006)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- path analysis, mediation analysis, moderation analysis, causal inference, model selection, model fit indices, conditional independence testing, reverse causality, boundary conditions, research culture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: That’s a Lot to Process! Pitfalls of Popular Path Models. https://app.cochat.ai/papers/10.1177/25152459221095827
- The paper
- Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022). That’s a Lot to Process! Pitfalls of Popular Path Models. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/25152459221095827
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.