The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
A Practical Primer To Power Analysis for Simple Experimental Designs
Open accessAbstract
Power analysis is an important tool to use when planning studies. This contribution aims to remind readers what power analysis is, emphasize why it matters, and articulate when and how it should be used. The focus is on applications of power analysis for experimental designs often encountered in psychology, starting from simple two-group independent and paired groups and moving to one-way analysis of variance, factorial designs, contrast analysis, trend analysis, regression analysis, analysis of covariance, and mediation analysis. Special attention is given to the application of power analysis to moderation designs, considering both dichotomous and continuous predictors and moderators. Illustrative practical examples based on G*Power and R packages are provided throughout the article. Annotated code for the examples with R and dedicated computational tools are made freely available at a dedicated web page (https://github.com/mcfanda/primerPowerIRSP). Applications of power analysis for more complex designs are briefly mentioned, and some important general issues related to power analysis are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models
Sobel, M. E. (1982) · Sociological Methodology · doi:10.2307/270723 · Cited by 12,810
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“In the presence of publication bias, systematically performing studies that lack the power to detect effect sizes of interest results in a prevalence of false-positive findings in the literature (Button et al., 2013; Maxwell, 2004).”
BackgroundCohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“However, given a certain α level, increasing statistical power by collecting larger samples increases the accuracy of any result that emerges, which means that inferences from data are in general more correct (Maxwell et al., 2008; see also Ioannidis, 2005; Sterne & Davey Smith, 2001).”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Eta squared and partial eta squared as measures of effect size in educational research
Richardson, J. T. E. (2011) · Educational Research Review · doi:10.1016/j.edurev.2010.12.001 · Cited by 3,465
Interaction Effects in Multiple Regression.
Richardson, S. C., Jacard, J., Turrisi, R., & Wan, C. K. (1991) · The Statistician · doi:10.2307/2348747 · Cited by 3,309
Statistical difficulties of detecting interactions and moderator effects.
McClelland, G. H., & Judd, C. M. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.2.376 · Cited by 3,270
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
Self-citationEllis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Hayes, A. F., & Scharkow, M. (2013) · Psychological Science · doi:10.1177/0956797613480187 · Cited by 2,387
At what sample size do correlations stabilize?
Schönbrodt, F. D., & Perugini, M. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.05.009 · Cited by 2,232
Self-citation(2011) · Cited by 2,025
Advantages of Monte Carlo confidence intervals for indirect effects
Preacher, K. J., & Selig, J. P. (2012) · Communication Methods and Measures · doi:10.1080/19312458.2012.679848 · Cited by 1,908
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
Determining power and sample size for simple and complex mediation models
Schoemann, A. M., Boulton, A. J., & Short, S. D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617715068 · Cited by 1,837
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Interaction Effects in Multiple Regression
Jaccard, J., & Turrisi, R. (2003) · doi:10.4135/9781412984522 · Cited by 1,797
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Brysbaert, M., & Stevens, M. (2018) · Journal of Cognition · doi:10.5334/joc.10 · Cited by 1,420 · cited 1×
“For more complex designs, such as factorial within-subjects designs and mixed designs, accessible introductions to power analysis can be found in Brysbaert and Stevens (2018) and Guo, Logan, Glueck and Muller (2013).”
MethodContrast Analysis: Focused Comparisons in the Analysis of Variance.
Levin, J. R., Rosenthal, R., & Rosnow, R. L. (1987) · Journal of the American Statistical Association · doi:10.2307/2289419 · Cited by 1,251
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationThe rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800
Bayes factor design analysis: Planning for compelling evidence
Schönbrodt, F. D., & Wagenmakers, E.-J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1230-y · Cited by 729
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 654
semPLS: Structural Equation Modeling Using Partial Least Squares
Monecke, A., & Leisch, F. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i03 · Cited by 616
Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences.
Schönbrodt, F. D., Wagenmakers, E.-J., Zehetleitner, M., & Perugini, M. (2017) · Psychological Methods · doi:10.1037/met0000061 · Cited by 567
Self-citationSample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
Lakens, D., Adolfi, F. G., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S. E., Baguley, T., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 458
Why most published research findings are false
Brooks, J. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2008.07.015 · Cited by 423
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414
Anderson, S. F., Kelley, K., & Maxwell, S. E. (2017) · Psychological Science · doi:10.1177/0956797617723724 · Cited by 406
A probability-based measure of effect size: Robustness to base rates and other factors.
Ruscio, J. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.1.19 · Cited by 398
Albers, C., & Lakens, D. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.09.004 · Cited by 357
Sifting the evidence—what's wrong with significance tests?
Sterne, J. A. C., & Smith, G. D. (2001) · Physical Therapy · doi:10.1093/ptj/81.8.1464 · Cited by 301
Power Analysis for Complex Mediational Designs Using Monte Carlo Methods
Thoemmes, F., MacKinnon, D., & Reiser, M. (2010) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2010.489379 · Cited by 298
Minimum Detectable Effects: A Simple Way to Report the Statistical Power of Experimental Designs
Bloom, H. S. (1995) · Evaluation Review · doi:10.1177/0193841x9501900504 · Cited by 280
Shieh, G. (2009) · Organizational Research Methods · doi:10.1177/1094428108320370 · Cited by 198
Safeguard Power as a Protection Against Imprecise Power Estimates
Perugini, M., Gallucci, M., & Costantini, G. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528519 · Cited by 198
Self-citationSimulation methods to estimate design power: an overview for applied research
Arnold, B. F., Hogan, D. R., Colford, J. M., & Hubbard, A. E. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-94 · Cited by 198
Power struggles: Estimating sample size for multilevel relationships research
Lane, S. P., & Hennes, E. P. (2018) · Journal of Social and Personal Relationships · doi:10.1177/0265407517710342 · Cited by 162
Monte Carlo based statistical power analysis for mediation models: methods and software
Zhang, Z. J. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0424-0 · Cited by 159
An Unbiased Correlation Ratio Measure
Kelley, T. L. (1935) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.21.9.554 · Cited by 153
LeBel, E. P., & Paunonen, S. V. (2011) · Personality and Social Psychology Bulletin · doi:10.1177/0146167211400619 · Cited by 148
Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Świątkowski, W., & Dompnier, B. (2017) · International Review of Social Psychology · doi:10.5334/irsp.66 · Cited by 132
Is Omega Squared Less Biased? a Comparison of Three Major Effect Size Indices in One-Way Anova
Okada, K. (2013) · Behaviormetrika · doi:10.2333/bhmk.40.129 · Cited by 128
Sample size to detect a planned contrast and a one degree-of-freedom interaction effect.
Wahłsten, D. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.3.587 · Cited by 125
A Note on Misconceptions Concerning Prospective and Retrospective Power
Zumbo, B. D., & Hubley, A. M. (1998) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1111/1467-9884.00139 · Cited by 121
Ruscio, J., & Mullen, T. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.658329 · Cited by 112
[17] No-way InteractionsPreprint
Simonsohn, U. (2015) · doi:10.15200/winn.142559.90552 · Cited by 98
Unreliable Yet Still Replicable: A Comment on LeBel and Paunonen (2011)
Schryver, M. D., Hughes, S., Rosseel, Y., & Houwer, J. D. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.02039 · Cited by 58
Porter, K. E. (2016) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2017.1342887 · Cited by 20
Cited by
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
Simulation-Based Power Analysis for Factorial Analysis of Variance Designs
Lakens, D., & Caldwell, A. R. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920951503 · Cited by 602
Do (microtargeted) deepfakes have real effects on political attitudes?
Dobber, T., Metoui, N., Trilling, D., Helberger, N., & de Vreese, C. (2021) · The International Journal of Press/Politics · doi:10.1177/1940161220944364 · Cited by 256
Soncini, A., Matteucci, M. C., & Butera, F. (2021) · European Journal of Psychology of Education · doi:10.1007/s10212-020-00494-1 · Cited by 39
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36
Metadata
- Authors
- Perugini, M., Gallucci, M., & Costantini, G.
- Venue
- International Review of Social Psychology
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2018
- Volume
- 31
- Issue
- 1
- ISSN
- 0992-986X (ISSN-L)
- 2397-8570
- OpenAlex
- W2818161558
- Cited by
- 408
- References
- 66
- FWCI
- 24.19
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.