A Robust Bootstrap Test for Mediation Analysis
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Mediation analysis is central to theory building and testing in organizational sciences. Scholars often use linear regression analysis based on normal-theory maximum likelihood estimators to test mediation. However, these estimators are very sensitive to deviations from normality assumptions, such as outliers, heavy tails, or skewness of the observed distribution. This sensitivity seriously threatens the empirical testing of theory about mediation mechanisms. To overcome this threat, we develop a robust mediation method that yields reliable results even when the data deviate from normality assumptions. We demonstrate the mechanics of our proposed method in an illustrative case, while simulation studies show that our method is both superior in estimating the effect size and more reliable in assessing its significance than the existing methods. Furthermore, we provide freely available software in R and SPSS to enhance its accessibility and adoption by empirical researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117 · cited 3×
“ROBMED is an integrated set of procedures that builds upon the widely used bootstrap test for mediation (Bollen & Stine, 1990; MacKinnon et al., 2004; Preacher & Hayes, 2004, 2008; Shrout & Bolger, 2002).”
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602 · cited 1×
“A comprehensive review of these methods is beyond the scope of this study, yet we note that the bootstrap—a computerintensive resampling technique first introduced by Efron (1979)—is found to be superior to other methods.”
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383
Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models
Sobel, M. E. (1982) · Sociological Methodology · doi:10.2307/270723 · Cited by 12,810
Mediation in experimental and nonexperimental studies: New procedures and recommendations.
Shrout, P. E., & Bolger, N. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.4.422 · Cited by 11,335
A comparison of methods to test mediation and other intervening variable effects
MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.83 · Cited by 9,406 · cited 4×
“Several methods have been proposed for testing mediation (see MacKinnon et al., 2002, for a review) where the most widely adopted technique is regression analysis (Wood et al., 2008).1 The statistical performance of these methods has been vastly tested via simulation studies (e.g., MacKinnon et…”
InfluentialConfidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods
MacKinnon, D. P., Lockwood, C. M., & Williams, J. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3901_4 · Cited by 7,806 · cited 4×
“ROBMED is an integrated set of procedures that builds upon the widely used bootstrap test for mediation (Bollen & Stine, 1990; MacKinnon et al., 2004; Preacher & Hayes, 2004, 2008; Shrout & Bolger, 2002).”
InfluentialBootstrap Methods and their Application
Davison, A. C., & Hinkley, D. V. (1997) · doi:10.1017/cbo9780511802843 · Cited by 7,350
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688 · cited 2×
“The figure also illustrates that the product of coefficients bab is equal to the difference in coefficients ĉ0 ĉ (MacKinnon et al., 2007).”
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Hawkins, D. M. (1980) · doi:10.1007/978-94-015-3994-4 · Cited by 2,982
Best-practice recommendations for defining, identifying, and handling outliers
Aguinis, H., Gottfredson, R. K., & Joo, H. (2013) · Organizational Research Methods · doi:10.1177/1094428112470848 · Cited by 1,341 · cited 17×
“…of (close to) 0 are potential outliers, and researchers should follow Aguinis et al. (2013) to identify the type of outliers. a. Error outliers: ROBMED already applies the correct outlier treatment following Aguinis et al. (2013) by excluding them, and we recommend reporting the results of ROBMED.”
InfluentialDirect and Indirect Effects: Classical and Bootstrap Estimates of Variability
Bollen, K. A., & Stine, R. (1990) · Sociological Methodology · doi:10.2307/271084 · Cited by 1,305
Odds Ratios for Mediation Analysis for a Dichotomous Outcome
VanderWeele, T. J., & Vansteelandt, S. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq332 · Cited by 809 · cited 1×
“Developing robust methods for mediation models with binary, nominal, ordinal or count variables (e.g., Huang et al., 2004; Preacher, 2015; VanderWeele & Vansteelandt, 2010) is a fruitful venue for further research.”
Influence functions of the Spearman and Kendall correlation measures
Croux, C., & Dehon, C. (2010) · Statistical Methods & Applications · doi:10.1007/s10260-010-0142-z · Cited by 634
Statistical assessment of mediational effects for logistic mediational models
Huang, B., Sivaganesan, S., Succop, P., & Goodman, E. (2004) · Statistics in Medicine · doi:10.1002/sim.1847 · Cited by 89 · cited 1×
“Developing robust methods for mediation models with binary, nominal, ordinal or count variables (e.g., Huang et al., 2004; Preacher, 2015; VanderWeele & Vansteelandt, 2010) is a fruitful venue for further research.”
Metadata
- Authors
- Alfons, A., Ateş, N. Y., & Groenen, P. J. F.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2021-04-12
- Volume
- 25
- Issue
- 3
- Pages
- 591-617
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2887716294
- Cited by
- 218
- References
- 17
- FWCI
- 17.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.