The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Sample-Size Planning for More Accurate Statistical Power: A Method Adjusting Sample Effect Sizes for Publication Bias and Uncertainty
Abstract
The sample size necessary to obtain a desired level of statistical power depends in part on the population value of the effect size, which is, by definition, unknown. A common approach to sample-size planning uses the sample effect size from a prior study as an estimate of the population value of the effect to be detected in the future study. Although this strategy is intuitively appealing, effect-size estimates, taken at face value, are typically not accurate estimates of the population effect size because of publication bias and uncertainty. We show that the use of this approach often results in underpowered studies, sometimes to an alarming degree. We present an alternative approach that adjusts sample effect sizes for bias and uncertainty, and we demonstrate its effectiveness for several experimental designs. Furthermore, we discuss an open-source R package, BUCSS, and user-friendly Web applications that we have made available to researchers so that they can easily implement our suggested methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, sample sizes are often underpowered (4-6), at times leading to conclusions that do not hold up with larger-sized replications or metaanalyses (7).”
From Generic language in scientific communication (2019) · cites this paper as [4]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“However, even when researchers conduct a well-intentioned power analysis to determine the sample size of a replication study, the power of the original study limits their ability to determine an accurate sample size, sometimes severely (Anderson & Maxwell, 2016, 2017; Button et al., 2013).”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Ioannidis (2005) showed that, all other things being equal, there is a higher probability that a published research claim is false in a literature with lower-powered studies.”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Flagged first, then by citations
Cited by
Sorted by citations
Items 401–416 of 416
Vazquez, L. O., Ruvalcaba-Delgadillo, Y., Escobedo, V. H. C., & Huerta, F. J. (2026) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2026.100189
Shi, R., & Gao, H. (2026) · Attention Perception & Psychophysics · doi:10.3758/s13414-026-03275-y
Gali, A. M., & Heil, D. (2026) · Open Journal of Business and Management · doi:10.4236/ojbm.2026.144092
975 Statistical power and power analysis in quantitative communication science
Sun, Y., & Qian, S. (2026) · De Gruyter eBooks · doi:10.1515/9783111087139-005
Parrotta, E., Bach, P., Pezzulo, G., Zaccaro, A., Perrucci, M. G., Costantini, M., & Ferri, F. (2026) · eLife · doi:10.7554/elife.90013.3.sa3
Rethinking Type S and Type M Errors
Lakens, D., Mesquida, C., Xavier-Quintais, G., Rasti, S., Toffalini, E., & Altoè, G. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261432530
Brief mindful breathing exercises and word retrieval performance in young and older adults
James, L. E., Wagenen, D. V., & Levitt, H. (2026) · Journal of Language and Aging Research · doi:10.15460/jlar.2026.4.1.0003
Work-to-rest ratios in repeated sprint assessments: A replication study
Jutlah, L. B. L., Stevens, K. A., Meelu, A., Cohen, J. N., Murphy, J., Warne, J. P., & Au, J. S. (2026) · Sports Medicine International Open · doi:10.1055/a-2940-7047
Generative AI in Brand Activism: Impacts on Consumers’ Negative Affect and Decision Comfort
Lin, Z., Yim, A., & Cui, A. P. (2026) · Journal of Consumer Affairs · doi:10.1111/joca.70072
Social-Cognitive Dysregulation Model of Misophonia: Perspective from a Behavioural StudyPreprint
Erfanian, M., & Kumar, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.03.749152
Liu, Y., & Lourenco, S. F. (2026) · Cognition · doi:10.1016/j.cognition.2026.106723
DMAR: Design, Measurement, and Analysis in R (DMAR)
Kelley, K. (2026) · doi:10.32614/cran.package.dmar
Self-citationLearn AI with AI: Designing conversational agents to support older adults in learning about AI
KangJie, E. T., Song, T., Shi, M., & Lee, Y. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103953
High-Performance Work Systems: A Methodological Review of Quantitative Studies from 2001-2025Preprint
Memon, M. A., Niazi, A., Jehanzeb, H., Muenjohn, N., & Ting, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7641082
Metadata
- Authors
- Anderson, S. F., Kelley, K., & Maxwell, S. E.
- Affiliations
- University of Notre Dame (US)
- Corresponding author
- Anderson, Samantha F.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2017-09-13
- Volume
- 28
- Issue
- 11
- Pages
- 1547-1562
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2756450828
- Cited by
- 406
- References
- 63
- Citations by year
- 2026: 31 · 2025: 39 · 2024: 46 · 2023: 55 · 2022: 52 · 2021: 53 · 2020: 44 · 2019: 47 · 2018: 34 · 2017: 3
- FWCI
- 31.51
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- sample size determination, statistical power, effect size estimation, publication bias, underpowered studies
- MeSH terms
- Data Interpretation, Statistical, Humans, Publication Bias, Sample Size, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
