On the (In)Validity of Tests of Simple Mediation: Threats and Solutions
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Mediation analysis is a popular framework for identifying underlying mechanisms in social psychology. In the context of simple mediation, we review and discuss the implications of three facets of mediation analysis: (a) conceptualization of the relations between the variables, (b) statistical approaches, and (c) relevant elements of design. We also highlight the issue of equivalent models that are inherent in simple mediation. The extent to which results are meaningful stem directly from choices regarding these three facets of mediation analysis. We conclude by discussing how mediation analysis can be better applied to examine causal processes, highlight the limits of simple mediation, and make recommendations for better practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions
Preacher, K. J., Rucker, D. D., & Hayes, A. F. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701341316 · Cited by 9,973
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Introduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
A general approach to causal mediation analysis.
Imai, K., Keele, L., & Tingley, D. (2010) · Psychological Methods · doi:10.1037/a0020761 · Cited by 4,143
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605
Bias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401
Spencer, S. J., Zanna, M. P., & Fong, G. T. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.6.845 · Cited by 2,452
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Mediation Analysis in Social Psychology: Current Practices and New Recommendations
Rucker, D. D., Preacher, K. J., Tormala, Z. L., & Petty, R. E. (2011) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2011.00355.x · Cited by 2,430
Bootstrapping goodness-of-fit measures in structural equation models.
Bollen, K. A., & Stine, R. A. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002004 · Cited by 1,831
Bauer, D. J., Preacher, K. J., & Gil, K. M. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.142 · Cited by 1,704
Iacobucci, D., Saldanha, N., & Deng, X. (2007) · Journal of Consumer Psychology · doi:10.1016/s1057-7408(07)70020-7 · Cited by 1,362
Yes, but what’s the mechanism? (don’t expect an easy answer).
Bullock, J. G., Green, D. P., & Ha, S. E. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018933 · Cited by 1,063
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
Mediation Models for Longitudinal Data in Developmental Research
Selig, J. P., & Preacher, K. J. (2009) · Research in Human Development · doi:10.1080/15427600902911247 · Cited by 804
Lower level mediation in multilevel models.
Kenny, D. A., Korchmaros, J. D., & Bolger, N. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.115 · Cited by 687
Interpretation and identification of causal mediation
Pearl, J. (2014) · Psychological Methods · doi:10.1037/a0036434 · Cited by 554 · cited 1×
“Typically, levels of X undergo random assignment such that causality in X→M and X→Y could be inferred because randomization reduces the possibility of confounding in these pathways (c.f., Pearl, 2014).”
BackgroundAssessing Mediational Models: Testing and Interval Estimation for Indirect Effects
Biesanz, J. C., Falk, C. F., & Savalei, V. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171.2010.498292 · Cited by 394
Reversing Arrows in Mediation Models Does Not Distinguish Plausible Models
Thoemmes, F. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1049351 · Cited by 208
Interpreting and estimating indirect effects assuming time lags really matter.
Gollob, H. F., & Reichardt, C. S. (1991) · Best methods for the analysis of change: Recent advances, unanswered questions, future directions. · doi:10.1037/10099-015 · Cited by 198
Tein, J.-Y., Sandler, I. N., MacKinnon, D. P., & Wolchik, S. A. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.4.617 · Cited by 186
Research works printed but not linked: 37
- 10.1037/a0019625 · DOI · Paper page
- 10.1002/9781118619179 · DOI · Paper page
- 10.1080/10705511.2011.582001 · DOI
- 10.1037/a0029311 · DOI · Paper page
- 10.4135/9781412986212 · DOI · Paper page
- 10.1037/0278-6133.25.4.474 · DOI · Paper page
- 10.1016/j.paid.2012.07.025 · DOI
- 10.3200/GENP.136.2.153-178 · DOI · Paper page
- Hershberger S. L., 2006, Structural equation modeling: A second course, 13
- Hoyle R. H., 1999, Statistical strategies for small sample research, 195
- 10.1037/a0014207 · DOI · Paper page
- 10.1177/0146167208331253 · DOI · Paper page
- Kenny D. A., 1998, Handbook of Social Psychology, 233
- 10.1037/a0024776 · DOI · Paper page
- 10.1207/s15327906mbr2503 4 · doi:10.1207/s15327906mbr2503
- 10.1080/00031305.2000.10474549 · DOI · Paper page
- 10.1207/S15327906MBR3801_5 · DOI · Paper page
- 10.1037/0033-2909.114.1.185 · doi:10.1037/0033-2909.114.1.185 · Paper page
- 10.3758/BF03193007 · DOI · Paper page
- 10.1177/1740774507083434 · DOI · Paper page
- 10.1037/1082-989X.7.1.83 · DOI · Paper page
- 10.1177/1088868314542878 · DOI · Paper page
- 10.1177/0146167208323104 · DOI · Paper page
- 10.1080/00273171.2011.606716 · DOI · Paper page
- 10.1037/0022-3514.89.6.852 · DOI · Paper page
- Murnane R. J., 2011, Methods matter: Improving causal inference in educational and social science research
- Muthén L. K., 2012, Mplus user's guide
- 10.1007/s11336-014-9435-8 · DOI · Paper page
- 10.1146/annurev-psych-010814-015258 · DOI · Paper page
- 10.1207/S15328007SEM0801 8 · doi:10.1207/s15328007sem0801
- 10.1037/a0018326 · DOI · Paper page
- 10.1080/10705511.2013.824793 · DOI · Paper page
- Shadish W. R., 2002, Experimental and quasi‐experimental designs for generalized causal inference
- 10.2307/270723 · DOI · Paper page
- 10.2307/270922 · DOI · Paper page
- 10.1037/h0027108 · DOI · Paper page
- 10.1037/0022-006X.58.3.360 · doi:10.1037/0022-006x.58.3.360
Cited by
The Analysis of Mechanisms and Their Contingencies: PROCESS versus Structural Equation Modeling
Hayes, A. F., Montoya, A. K., & Rockwood, N. J. (2017) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2017.02.001 · Cited by 1,534
Hayes, A. F., & Rockwood, N. J. (2020) · American Behavioral Scientist · doi:10.1177/0002764219859633 · Cited by 1,000
Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses!
Sarstedt, M., Hair, J. F., Nitzl, C., Ringle, C. M., & Howard, M. C. (2020) · International Journal of Market Research · doi:10.1177/1470785320915686 · Cited by 898
Facebook news and (de)polarization: reinforcing spirals in the 2016 US election
Beam, M. A., Hutchens, M. J., & Hmielowski, J. D. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2018.1444783 · Cited by 214
“This treats the model as the process we are proposing rather than a series of disconnected links, and most importantly accounts for all shared variance between our focal variables (Pek & Hoyle, 2016).”
BackgroundJohannsen, M., Nissen, E. R., Lundorff, M., & O'Toole, M. S. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102156 · Cited by 116
Metadata
- Authors
- Pek, J., & Hoyle, R. H.
- Venue
- Social and Personality Psychology Compass
- Publisher
- Wiley
- Published
- 2016-03
- Volume
- 10
- Issue
- 3
- Pages
- 150-163
- ISSN
- 1751-9004 (ISSN-L)
- OpenAlex
- W2312181596
- Cited by
- 108
- References
- 25
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National Institute on Drug Abuse (P30 DA023026)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.