On the (In)Validity of Tests of Simple Mediation: Threats and Solutions
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Mediation analysis is a popular framework for identifying underlying mechanisms in social psychology. In the context of simple mediation, we review and discuss the implications of three facets of mediation analysis: (a) conceptualization of the relations between the variables, (b) statistical approaches, and (c) relevant elements of design. We also highlight the issue of equivalent models that are inherent in simple mediation. The extent to which results are meaningful stem directly from choices regarding these three facets of mediation analysis. We conclude by discussing how mediation analysis can be better applied to examine causal processes, highlight the limits of simple mediation, and make recommendations for better practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions
Preacher, K. J., Rucker, D. D., & Hayes, A. F. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701341316 · Cited by 9,973
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Introduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
A general approach to causal mediation analysis.
Imai, K., Keele, L., & Tingley, D. (2010) · Psychological Methods · doi:10.1037/a0020761 · Cited by 4,143
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605
Bias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401
Research works printed but not linked: 37
- 10.1037/a0019625 · DOI · Paper page
- 10.1002/9781118619179 · DOI · Paper page
- 10.1080/10705511.2011.582001 · DOI
- 10.1037/a0029311 · DOI · Paper page
- 10.4135/9781412986212 · DOI · Paper page
- 10.1037/0278-6133.25.4.474 · DOI · Paper page
- 10.1016/j.paid.2012.07.025 · DOI
- 10.3200/GENP.136.2.153-178 · DOI · Paper page
- Hershberger S. L., 2006, Structural equation modeling: A second course, 13
- Hoyle R. H., 1999, Statistical strategies for small sample research, 195
- 10.1037/a0014207 · DOI · Paper page
- 10.1177/0146167208331253 · DOI · Paper page
- Kenny D. A., 1998, Handbook of Social Psychology, 233
- 10.1037/a0024776 · DOI · Paper page
- 10.1207/s15327906mbr2503 4 · doi:10.1207/s15327906mbr2503
- 10.1080/00031305.2000.10474549 · DOI · Paper page
- 10.1207/S15327906MBR3801_5 · DOI · Paper page
- 10.1037/0033-2909.114.1.185 · doi:10.1037/0033-2909.114.1.185 · Paper page
- 10.3758/BF03193007 · DOI · Paper page
- 10.1177/1740774507083434 · DOI · Paper page
- 10.1037/1082-989X.7.1.83 · DOI · Paper page
- 10.1177/1088868314542878 · DOI · Paper page
- 10.1177/0146167208323104 · DOI · Paper page
- 10.1080/00273171.2011.606716 · DOI · Paper page
- 10.1037/0022-3514.89.6.852 · DOI · Paper page
- Murnane R. J., 2011, Methods matter: Improving causal inference in educational and social science research
- Muthén L. K., 2012, Mplus user's guide
- 10.1007/s11336-014-9435-8 · DOI · Paper page
- 10.1146/annurev-psych-010814-015258 · DOI · Paper page
- 10.1207/S15328007SEM0801 8 · doi:10.1207/s15328007sem0801
- 10.1037/a0018326 · DOI · Paper page
- 10.1080/10705511.2013.824793 · DOI · Paper page
- Shadish W. R., 2002, Experimental and quasi‐experimental designs for generalized causal inference
- 10.2307/270723 · DOI · Paper page
- 10.2307/270922 · DOI · Paper page
- 10.1037/h0027108 · DOI · Paper page
- 10.1037/0022-006X.58.3.360 · doi:10.1037/0022-006x.58.3.360
Cited by
The Analysis of Mechanisms and Their Contingencies: PROCESS versus Structural Equation Modeling
Hayes, A. F., Montoya, A. K., & Rockwood, N. J. (2017) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2017.02.001 · Cited by 1,534
Hayes, A. F., & Rockwood, N. J. (2020) · American Behavioral Scientist · doi:10.1177/0002764219859633 · Cited by 1,000
Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses!
Sarstedt, M., Hair, J. F., Nitzl, C., Ringle, C. M., & Howard, M. C. (2020) · International Journal of Market Research · doi:10.1177/1470785320915686 · Cited by 898
Facebook news and (de)polarization: reinforcing spirals in the 2016 US election
Beam, M. A., Hutchens, M. J., & Hmielowski, J. D. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2018.1444783 · Cited by 214
“This treats the model as the process we are proposing rather than a series of disconnected links, and most importantly accounts for all shared variance between our focal variables (Pek & Hoyle, 2016).”
BackgroundJohannsen, M., Nissen, E. R., Lundorff, M., & O'Toole, M. S. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102156 · Cited by 116
Goldsmith, K. A., MacKinnon, D. P., Chalder, T., White, P. D., Sharpe, M., & Pickles, A. (2018) · Psychological Methods · doi:10.1037/met0000154 · Cited by 99
“…now generally accepted that if mediation is of interest an analysis should be done regardless of whether there is a significant total effect (Emsley et al., 2010; Goldsmith et al., 2016; MacKinnon, 2008; MacKinnon & Dwyer, 1993; O'Rourke & MacKinnon, 2015; Pek & Hoyle, 2016; Shrout & Bolger, 2002).”
BackgroundMindfulness-based cognitive therapy in COPD: a cluster randomised controlled trial
Farver-Vestergaard, I., O'Toole, M. S., O'Connor, M., Løkke, A., Bendstrup, E., Basdeo, S. A., Cox, D. J., Dunne, P. J., Ruggeri, K., Early, F., et al. (2018) · European Respiratory Journal · doi:10.1183/13993003.02082-2017 · Cited by 86
O’Toole, M. S., Renna, M. E., Mennin, D. S., & Fresco, D. M. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.005 · Cited by 66
Kangaslampi, S., & Peltonen, K. (2022) · Current Psychology · doi:10.1007/s12144-019-00478-5 · Cited by 45
“This substantial limitation weakens the level of evidence these studies provide for causal roles of the mechanisms studied in the interventions’ effects (Johansson and Høglend 2007; Pek and Hoyle 2016).”
BackgroundCentrality of event and mental health outcomes in child and adolescent natural disaster survivors
Mordeno, I. G., Galela, D. S., Nalipay, M. J. N., & Cue, M. P. (2018) · The Spanish Journal of Psychology · doi:10.1017/sjp.2018.58 · Cited by 13
Metadata
- Authors
- Pek, J., & Hoyle, R. H.
- Venue
- Social and Personality Psychology Compass
- Publisher
- Wiley
- Published
- 2016-03
- Volume
- 10
- Issue
- 3
- Pages
- 150-163
- ISSN
- 1751-9004 (ISSN-L)
- OpenAlex
- W2312181596
- Cited by
- 108
- References
- 25
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National Institute on Drug Abuse (P30 DA023026)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.