The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Current sample size conventions: Flaws, harms, and alternatives
Open accessAbstract
BACKGROUND: The belief remains widespread that medical research studies must have statistical power of at least 80% in order to be scientifically sound, and peer reviewers often question whether power is high enough. DISCUSSION: This requirement and the methods for meeting it have severe flaws. Notably, the true nature of how sample size influences a study's projected scientific or practical value precludes any meaningful blanket designation of <80% power as "inadequate". In addition, standard calculations are inherently unreliable, and focusing only on power neglects a completed study's most important results: estimates and confidence intervals. Current conventions harm the research process in many ways: promoting misinterpretation of completed studies, eroding scientific integrity, giving reviewers arbitrary power, inhibiting innovation, perverting ethical standards, wasting effort, and wasting money. Medical research would benefit from alternative approaches, including established value of information methods, simple choices based on cost or feasibility that have recently been justified, sensitivity analyses that examine a meaningful array of possible findings, and following previous analogous studies. To promote more rational approaches, research training should cover the issues presented here, peer reviewers should be extremely careful before raising issues of "inadequate" sample size, and reports of completed studies should not discuss power. SUMMARY: Common conventions and expectations concerning sample size are deeply flawed, cause serious harm to the research process, and should be replaced by more rational alternatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“05 as ensuring that an observed effect is real and accurate also seems to be widespread, despite being unreliable [17].”
BackgroundThe Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Prentice, R. L., Caan, B., Chlebowski, R. T., Patterson, R., Kuller, L. H., Ockene, J. K., Margolis, K. L., Limacher, M. C., Manson, J. E., Parker, L. M., et al. (2006) · JAMA · doi:10.1001/jama.295.6.629 · Cited by 828
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · cited 2×
“Investigators frequently use the difference suggested by preliminary data, but this is unreliable [6] and has greater risk of inconclusive results for differences that are smaller but still interesting.”
BackgroundSample size calculations in randomised trials: mandatory and mystical
Schulz, K. F., & Grimes, D. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)61034-3 · Cited by 549
Reporting of sample size calculation in randomised controlled trials: review
Charles, P., Giraudeau, B., Dechartres, A., Baron, G., & Ravaud, P. (2009) · BMJ · doi:10.1136/bmj.b1732 · Cited by 274
Underpowering in randomized trials reporting a sample size calculation
Vickers, A. J. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00141-0 · Cited by 102
Cited by
Sample Size in Qualitative Interview Studies: Guided by Information Power
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016) · Qualitative Health Research · doi:10.1177/1049732315617444 · Cited by 12,703
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Recommendations for Planning Pilot Studies in Clinical and Translational Research
Moore, C. G., Carter, R. E., Nietert, P. J., & Stewart, P. W. (2011) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00347.x · Cited by 661
Local Standards for Sample Size at CHI
Caine, K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858498 · Cited by 657
Murai, I. H., Fernandes, A. L., Sales, L. P., Pinto, A. J., Goessler, K. F., Duran, C. S. C., Silva, C. B. R., Franco, A. S., Macedo, M. B., Dalmolin, H. H. H., et al. (2021) · JAMA · doi:10.1001/jama.2020.26848 · Cited by 528
Metadata
- Authors
- Bacchetti, P.
- Venue
- BMC Medicine
- Published
- 2010-03-22
- Volume
- 8
- Issue
- 1
- Pages
- 17-17
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W2125462933
- Cited by
- 232
- References
- 8
- FWCI
- 9.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Current sample size conventions: Flaws, harms, and alternatives. https://app.cochat.ai/papers/10.1186/1741-7015-8-17
- The paper
- Bacchetti, P. (2010). Current sample size conventions: Flaws, harms, and alternatives. BMC Medicine. https://doi.org/10.1186/1741-7015-8-17
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.