The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Sample-Size Planning for More Accurate Statistical Power: A Method Adjusting Sample Effect Sizes for Publication Bias and Uncertainty
Abstract
The sample size necessary to obtain a desired level of statistical power depends in part on the population value of the effect size, which is, by definition, unknown. A common approach to sample-size planning uses the sample effect size from a prior study as an estimate of the population value of the effect to be detected in the future study. Although this strategy is intuitively appealing, effect-size estimates, taken at face value, are typically not accurate estimates of the population effect size because of publication bias and uncertainty. We show that the use of this approach often results in underpowered studies, sometimes to an alarming degree. We present an alternative approach that adjusts sample effect sizes for bias and uncertainty, and we demonstrate its effectiveness for several experimental designs. Furthermore, we discuss an open-source R package, BUCSS, and user-friendly Web applications that we have made available to researchers so that they can easily implement our suggested methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, sample sizes are often underpowered (4-6), at times leading to conclusions that do not hold up with larger-sized replications or metaanalyses (7).”
From Generic language in scientific communication (2019) · cites this paper as [4]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“However, even when researchers conduct a well-intentioned power analysis to determine the sample size of a replication study, the power of the original study limits their ability to determine an accurate sample size, sometimes severely (Anderson & Maxwell, 2016, 2017; Button et al., 2013).”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Ioannidis (2005) showed that, all other things being equal, there is a higher probability that a published research claim is false in a literature with lower-powered studies.”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Cited by
Sorted by citations
Items 301–400 of 416
Assessment of Factors Causing Bias in Marketing- Related Publications
Morkūnas, M., Rudienė, E., Giriūnas, L., & Daučiūnienė, L. (2020) · Publications · doi:10.3390/publications8040045 · Cited by 2
Perera, D., Reisenhofer, E., Hussein, S., Higgins, E., Huber, C. D., & Long, Q. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14168 · Cited by 1
Verónica, V., & Surja, S. (2023) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech59029.2023.10277697 · Cited by 1
Song, J., Breitmeyer, B. G., & Brown, J. M. (2024) · Vision · doi:10.3390/vision8020028 · Cited by 1
Visual background information modulates motor contagions in humans
Saito, H., Fukuchi, K., İnami, M., & Ganesh, G. (2024) · Scientific Reports · doi:10.1038/s41598-024-69535-9 · Cited by 1
Song, J., & Brown, J. M. (2024) · Attention Perception & Psychophysics · doi:10.3758/s13414-024-02956-w · Cited by 1
van Lent, T., Bijlstra, G., Holland, R. W., Bijleveld, E., & Veling, H. (2025) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2025.104754 · Cited by 1
How body knowledge shapes motion perception
Parmigiani, S., Sebastiano, A. R., Romeo, M., Cattaneo, L., Garbarini, F., & Sinigaglia, C. (2025) · Scientific Reports · doi:10.1038/s41598-025-00213-0 · Cited by 1
Nagatani, T., Vial, S., Kendall, K. L., Comfort, P., & Haff, G. G. (2025) · PubMed · doi:10.1519/jsc.0000000000005178 · Cited by 1
Chitha, N., Tshabalala, R., Mnyaka, O. R., Nanjoh, M. K.-K., Khosa, N. V., Makola, T. V., & Maake, K. (2025) · Healthcare · doi:10.3390/healthcare13162058 · Cited by 1
Hotta, L. M., César, A. D. T., Martínez, E. Z., Demarzo, M., & Adler, U. C. (2018) · Homeopathy · doi:10.1055/s-0038-1637009 · Cited by 1
The Effect of Simultaneously Presented Words and Auditory Tones on Visuomotor Performance
Mendonça, R., Garrido, M. V., & Semin, G. R. (2021) · Multisensory Research · doi:10.1163/22134808-bja10052 · Cited by 1
Tahriri, A., & afsay, A. (2021) · Iranian journal of Value and Behavioral Accounting · doi:10.52547/aapc.6.11.1 · Cited by 1
Ramadhan, A., & Gomera, W. C. (2022) · International Journal of Research in Business and Social Science (2147-4478) · doi:10.20525/ijrbs.v11i10.2147 · Cited by 2
Memory retrieval effects as a function of differences in phenomenal experience
Schmidt, A. H., & Kirwan, C. B. (2024) · Brain Imaging and Behavior · doi:10.1007/s11682-024-00892-9 · Cited by 1
Atay, N., Edanur, T. A. R., & Dere, S. (2024) · Journal of Pediatric Nursing · doi:10.1016/j.pedn.2024.08.011 · Cited by 1
Bayesian Evaluation of Replication Studies
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. J. A. (2024) · Meta-Psychology · doi:10.15626/mp.2020.2554 · Cited by 1
Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk7e · Cited by 1
Collaborating to Bring the Credibility Revolution to Giftedness and Talent Development ResearchPreprint
Makel, M. C., Smith, K. N., Miller, E. M., Peters, S. J., & McBee, M. T. (2019) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/ac3h6 · Cited by 1
Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple ImputationPreprint
Dang, H.-A. H., & Carletto, C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4114521 · Cited by 1
Beyond Statistical Significance: Five Principles for the New Era of Data Analysis and ReportingPreprint
Wedel, M., & Gal, D. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6kvnf · Cited by 1
Ptsd Symptoms Comparison Emdr and Nfb With Ipv Survivors: Ex- Post-facto StudyPreprint
Shaikh, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3185697/v1 · Cited by 1
The impact of organisational energy dimensions on project success
Brown, G.-J. (2018) · UpSpace Institutional Repository (University of Pretoria)
Generation Z, Employee Enagement And Leadership Communication Behaviors
Kompa, N. (2019) · DUNE - DigitalUNE (University of New England)
I Can’t Stand Thinking Anymore: An Analysis of Directed Attention on Posture
Gibbons, C. T. (2019)
Pritz-Mirtakis, J. (2020) · Sigmund Freud PrivatUniversität Wien (SFU) · doi:10.15135/2020.8.1.67-83
The effect of an unexpected modality on time reproduction: Clock speed or memory mixing?Preprint
Stanfield-Wiswell, C., & Wiener, M. (2020) · doi:10.31234/osf.io/vbqrj
Li, M., Yasin, M. A. I., Hashim, N. B., Ang, L. H., & Kang, H. (2021) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v11-i3/8960
Kell, H. J., & Roohr, K. C. (2021) · doi:10.31234/osf.io/caq4r
New&Now規格情報 欧州のR&TTE指令(1)R&TTE指令への流れ
平戸, 昌. (2000) · EMC - Médecine d urgence
Bettin, R. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/y94gu
Takahashi, K., & Yotsumoto, Y. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.767344
What’s the room got to do with it?
Hoogesteyn, K. (2020) · doi:10.26481/dis.20200706kh
(2020) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000745.supp
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v2/decision1
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v3/decision1
Author response for "That's a Lot to Process! Pitfalls of Popular Path Models"
Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v2/response1
Author response for "That's a Lot to Process! Pitfalls of Popular Path Models"
Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v3/response1
A Systematic Literature Review on Studying Energy Consumption Assessment in Heritage Buildings
Al-Sakkaf, A., Abdelkader, E. M., & El-Zahab, S. (2022) · International Journal of Strategic Decision Sciences · doi:10.4018/ijsds.301545
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/decision1
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review3
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review2
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review1
Interaction between color and attentional level in children’s conflict control
Sun, M., Liu, F., Jia, X., Jiang, S., Cui, L., & Zhang, Q. (2022) · Cognitive Processing · doi:10.1007/s10339-022-01107-z
ORMA: A strategy to reduce Psychology's replication problems
Howard, G. S., & Maxwell, S. E. (2022) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2022.100991
Self-citationThe 34th Cognitive Psychology Section Annual Conference
British Psychological Society (2018) · The Cognitive Psychology Bulletin · doi:10.53841/bpscog.2018.1.3.5
Castilla, C., García, F. E., & Vázquez, C. (2022) · Ansiedad y Estrés · doi:10.5093/anyes2022a17
Hunt, E. T., Armstrong, B., Beets, M. W., Turner‐McGrievy, G. M., & Weaver, R. G. (2023) · Journal of Primary Care & Community Health · doi:10.1177/21501319231182304
PTSD Symptoms Comparison EMDR and NFB with IPV Survivors: Ex-Post-Facto Study byPreprint
Shaikh, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3161799/v1
(2023) · The MIT Press eBooks · doi:10.7551/mitpress/14922.003.0016
Manresa, J. A. B. (2023) · eLife · doi:10.7554/elife.90013.1.sa3
Chen, K., Kim, J., Zhang, H., Clark, D. A., & Schlegel, R. J. (2023) · Motivation and Emotion · doi:10.1007/s11031-023-10042-1
A matter of genetic divergence: sizing up the sample for soybean canonical variablesPreprint
de Souza, R. R., Filho, A. C., Toebe, M. J., & Bittencourt, K. C. (2023) · Research Square · doi:10.21203/rs.3.rs-3342957/v1
Think positive! Resolving human motion ambiguity in the presence of disease threat
Magalhães, A. C., Silva, F., Lameirinha, I., Rodrigues, M., & Soares, S. C. (2023) · Cognition & Emotion · doi:10.1080/02699931.2023.2269831
Nakayama, M., & Ueno, T. (2023) · International Conference on Information Visualisation (IV) · doi:10.1109/iv60283.2023.00033
Buchanan, E. M., Elsherif, M. M., Geller, J., Aberson, C. L., Gurkan, N., Ambrosini, E., Heyman, T., Montefinese, M., Vanpaemel, W., Barzykowski, K., et al. (2023) · doi:10.31219/osf.io/e3afx
Kawachi, Y., Murata, A., Kitamura, M. S., & Mugitani, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-66964-4
The Ecology, Physiognomy and Ecosystem Services of Common Palm Species in Hururu, Guyana
Adrian, U., Ansari, A., & Jaikishun, S. (2024) · Current Advances in Agricultural Sciences(An International Journal) · doi:10.5958/2394-4471.2024.00019.4
Challenges of vaccines for aquaculture
Vaseeharan, B., & Jesudhasan, P. R. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-22167-5.00011-3
Experimental planning for assessing common bean lines regarding the severity of angular leaf spot
Mencalha, J., Dias, M. A., de Souza, E. A., Carneiro, V. Q., Carneiro, P. C. S., & Carneiro, J. E. S. (2024) · European Journal of Plant Pathology · doi:10.1007/s10658-024-02973-3
Tavakkoli, B., Abolmaali, K., & Aghaei, Z. S. P. S. (2024) · doi:10.61838/kman.aftj.5.5.8
Transparency and Open Science Practices in Research on Emerging Adulthood
Nguyen, P., & Syed, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197677797.003.0002
Warren, T., Masele, J., & Magova, G. (2024) · Business Management Review · doi:10.56279/bmrj.v27i2.6914
Integrating Governance Mechanisms for Food Security in Taita-Taveta County
Grace, W. M. (2024) · Sustainability in Food and Agriculture · doi:10.26480/sfna.01.2024.06.11
The fate of visual working memory items after their job is done
Hamblin-Frohman, Z., & Pratt, J. (2025) · Journal of Vision · doi:10.1167/jov.25.4.7
Alade, S. P., Okolo, A., Akinrefon, A. A., & John, D. I. (1970) · FUDMA Journal of Sciences · doi:10.33003/fjs-2024-0804-2669
Fostering transparency and reproducibility in psychological science.
Lindsay, D. S. (2025) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000381
Goodhew, S. C., Denniston, D., Dawel, A., & Edwards, M. (2025) · Cognition & Emotion · doi:10.1080/02699931.2025.2549318
Buchanan, E. M., Elsherif, M. M., Geller, J., Aberson, C. L., Gurkan, N., Ambrosini, E., Heyman, T., Montefinese, M., Vanpaemel, W., Barzykowski, K., et al. (2025) · doi:10.31219/osf.io/e3afx_v2
Empirical power of F and normality tests under different experimental conditions
Neto, H. R., Duarte, M. L., & Santos, N. T. (2025) · Brazilian Journal of Biometrics · doi:10.28951/bjb.v43i4.760
When seeing follows believing: The role of social likelihood in demographic estimation
Heo, Y., & Chong, S. C. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105664
Romeo, M., Genovese, F., Betta, M., Sebastiano, A. R., Teresi, L., Scanferlato, N., Sinigaglia, C., Ricciardi, E., & Garbarini, F. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121504
Through the Graphic Lens: The Effects of Graphic Images on News Consumers’ Reactions
Ibarra, G. R., Riet, J. V. ‘., Veling, H., & Fransen, M. L. (2025) · Journalism Practice · doi:10.1080/17512786.2025.2572976
Wang, C., Peng, Y., & Wan, X. I. (2025) · Multisensory Research · doi:10.1163/22134808-bja10163
Chen, M. Y., & Pullman, A. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-604-120251011
Harrall, K. K., Muller, K. E., Starling, A. P., Dabelea, D., Barton, K. E., Adgate, J. L., & Glueck, D. H. (2023) · Figshare · doi:10.6084/m9.figshare.22605865
Exposure to false cardiac feedback alters pain perception and anticipatory cardiac frequencyPreprint
Parrotta, E., Bach, P., Pezzulo, G., Zaccaro, A., Perrucci, M. G., Costantini, M., & Ferri, F. (2026) · eLife · doi:10.7554/elife.90013.2
Parrotta, E., Bach, P., Pezzulo, G., Zaccaro, A., Perrucci, M. G., Costantini, M., & Ferri, F. (2026) · eLife · doi:10.7554/elife.90013.2.sa0
Manresa, J. A. B. (2026) · eLife · doi:10.7554/elife.90013.2.sa3
Botlhoko, T., & Montshiwa, T. V. (2025) · F1000Research · doi:10.12688/f1000research.168092.1
Snow, N. J., Mohamed, B., Duraid, S., & Ploughman, M. (2026) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2026.107035
Pointing over gaze: how saliency, proximity, and context shape spatial attention to embodied cues
van Zoest, W., & Higgins, A. (2026) · Psychological Research · doi:10.1007/s00426-026-02250-4
The Psychological Costs of Tax Compliance: Insights From Indonesian SME Taxpayers
Ferry (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1058-749720260000032006
Quantifying individual recognition sensitivity to static and dynamic facial expressions
Stacchi, L., Poncet, F., Benedetti, V., Caldara, R., & Richoz, A.-R. (2026) · Methods in Psychology · doi:10.1016/j.metip.2026.100241
Botlhoko, T., & Montshiwa, T. V. (2026) · F1000Research · doi:10.12688/f1000research.168092.3
Yang, S., Jiang, M., & Cai, X. (2026) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2026.101335
Boyce, S., Coetzee, N., Guse, T., & Masenge, A. (2026) · Journal of Humanistic Psychology · doi:10.1177/00221678261428720
Tourism innovation on the road: explaining smart helmet adoption among motorcycle tourists
Rasheed, H. M. W., & Khurshid, R. (2026) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-11-2025-1356
Fini, C., Fischer, M., Moors, A., Brass, M., & Bardi, L. (2020) · OSF Preprints (OSF Preprints)
Brudek, P., Augustyn, K., & Steuden, S. (2026) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2026.2673298
Soret, R., Charras, P., & Peysakhovich, V. (2026) · Scientific Reports · doi:10.1038/s41598-026-39071-9
Yang, S. (2026) · Chinese Journal of Applied Linguistics · doi:10.1515/cjal-2026-0201
Metadata
- Authors
- Anderson, S. F., Kelley, K., & Maxwell, S. E.
- Affiliations
- University of Notre Dame (US)
- Corresponding author
- Anderson, Samantha F.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2017-09-13
- Volume
- 28
- Issue
- 11
- Pages
- 1547-1562
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2756450828
- Cited by
- 406
- References
- 63
- Citations by year
- 2026: 31 · 2025: 39 · 2024: 46 · 2023: 55 · 2022: 52 · 2021: 53 · 2020: 44 · 2019: 47 · 2018: 34 · 2017: 3
- FWCI
- 31.51
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- sample size determination, statistical power, effect size estimation, publication bias, underpowered studies
- MeSH terms
- Data Interpretation, Statistical, Humans, Publication Bias, Sample Size, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review