The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Small sample mediation testing: Misplaced confidence in bootstrapped confidence intervals.
Abstract
Bootstrapping is an analytical tool commonly used in psychology to test the statistical significance of the indirect effect in mediation models. Bootstrapping proponents have particularly advocated for its use for samples of 20-80 cases. This advocacy has been heeded, especially in the Journal of Applied Psychology, as researchers are increasingly utilizing bootstrapping to test mediation with samples in this range. We discuss reasons to be concerned with this escalation, and in a simulation study focused specifically on this range of sample sizes, we demonstrate not only that bootstrapping has insufficient statistical power to provide a rigorous hypothesis test in most conditions but also that bootstrapping has a tendency to exhibit an inflated Type I error rate. We then extend our simulations to investigate an alternative empirical resampling method as well as a Bayesian approach and demonstrate that they exhibit comparable statistical power to bootstrapping in small samples without the associated inflated Type I error. Implications for researchers testing mediation hypotheses in small samples are presented. For researchers wishing to use these methods in their own research, we have provided R syntax in the online supplemental materials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383
Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models
Sobel, M. E. (1982) · Sociological Methodology · doi:10.2307/270723 · Cited by 12,810
Mediation in experimental and nonexperimental studies: New procedures and recommendations.
Shrout, P. E., & Bolger, N. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.4.422 · Cited by 11,335
Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods
MacKinnon, D. P., Lockwood, C. M., & Williams, J. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3901_4 · Cited by 7,806
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Cheung, G. W., & Lau, R. S. (2008) · Organizational Research Methods · doi:10.1177/1094428107300343 · Cited by 1,965
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Tests of the three-path mediated effect
Taylor, A. B., MacKinnon, D. P., & Tein, J.-Y. (2008) · Organizational Research Methods · doi:10.1177/1094428107300344 · Cited by 1,209
Cited by
The role of psychosocial processes in the development and maintenance of chronic pain
Edwards, R. R., Dworkin, R. H., Sullivan, M. D., Turk, D. C., & Wasan, A. D. (2016) · The Journal of Pain · doi:10.1016/j.jpain.2016.01.001 · Cited by 954
Partial least squares path modeling: Time for some serious second thoughts
Rönkkö, M., McIntosh, C. N., Antonakis, J., & Edwards, J. R. (2016) · Journal of Operations Management · doi:10.1016/j.jom.2016.05.002 · Cited by 303
Zavyalova, A., Pfarrer, M. D., Reger, R. K., & Hubbard, T. D. (2016) · Academy of Management Journal · doi:10.5465/amj.2013.0611 · Cited by 294
Smid, S. C., McNeish, D., Miočević, M., & van de Schoot, R. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1577140 · Cited by 280
Sample Size Requirements for Simple and Complex Mediation Models
Sim, M., Kim, S.-Y., & Suh, Y. (2022) · Educational and Psychological Measurement · doi:10.1177/00131644211003261 · Cited by 269
Mindfulness as a way to cope with COVID‐19‐related stress and anxiety.
Weis, R., Ray, S. D., & Cohen, T. A. (2021) · Counselling and Psychotherapy Research · doi:10.1002/capr.12375 · Cited by 82
Bogosian, A., Hughes, A., Norton, S., Silber, E., & Moss‐Morris, R. (2016) · British Journal of Health Psychology · doi:10.1111/bjhp.12201 · Cited by 75
The Role of Religiosity in Ethical Decision-Making: A Study on Islam and the Malaysian Workplace
Sulaiman, R., Toulson, P., Brougham, D., Lempp, F., & Haar, J. (2022) · Journal of Business Ethics · doi:10.1007/s10551-021-04836-x · Cited by 62
Debrot, A., Stellar, J. E., MacDonald, G., Keltner, D., & Impett, E. A. (2021) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220977709 · Cited by 53
Metadata
- Authors
- Koopman, J., Howe, M., Hollenbeck, J. R., & Sin, H.-P.
- Venue
- Journal of Applied Psychology
- Published
- 2015
- Volume
- 100
- Issue
- 1
- Pages
- 194-202
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W2027023877
- Cited by
- 201
- References
- 13
- FWCI
- 11.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.