Consultants' forum: should post hoc sample size calculations be done?
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Pre‐study sample size calculations for clinical trial research protocols are now mandatory. When an investigator is designing a study to compare the outcomes of an intervention, an essential step is the calculation of sample sizes that will allow a reasonable chance (power) of detecting a pre‐determined difference (effect size) in the outcome variable, at a given level of statistical significance. Frequently studies will recruit fewer patients than the initial pre‐study sample size calculation suggested. Investigators are faced with the fact that their study may be inadequately powered to detect the pre‐specified treatment effect and the statistical analysis of the collected outcome data may or may not report a statistically significant result. If the data produces a “non‐statistically significant result” then investigators are frequently tempted to ask the question “Given the actual final study size, what is the power of the study, now, to detect a treatment effect or difference?” The aim of this article is to debate whether or not it is desirable to answer this question and to undertake a power calculation, after the data have been collected and analysed. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702
Sample sizes for clinical trials with normal data.
Julious, S. A. (2004) · Statistics in Medicine · doi:10.1002/sim.1783 · Cited by 605
Costs and effectiveness of community postnatal support workers: randomised controlled trial
Morrell, C. J. (2000) · BMJ · doi:10.1136/bmj.321.7261.593 · Cited by 229 · cited 2×
“Nevertheless, the trial had over 80% power to detect a 5 point different in GH scores which is the smallest change in score that can be considered clinically and socially relevant’’ [6].”
BackgroundSample size calculations for clinical studies allowing for uncertainty about the variance
Julious, S. A., & Owen, R. J. (2006) · Pharmaceutical Statistics · doi:10.1002/pst.197 · Cited by 59 · cited 1×
“There may be considerable uncertainties in estimates of such quantities as the standard deviation [10] and the treatment effect [11].”
Background
Cited by
The statistical interpretation of pilot trials: should significance thresholds be reconsidered?
Lee, E. C., Whitehead, A. L., Jacques, R. M., & Julious, S. A. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-41 · Cited by 423
“The confidence interval should be interpreted with regards to the minimum clinically important difference (MCID) [12]; this is the difference between treatment groups that is considered to be clinically meaningful, specified a priori.”
BackgroundInfluentialDimauro, I., Sgura, A., Pittaluga, M., Magi, F., Fantini, C., Mancinelli, R., Sgadari, A., Fulle, S., & Caporossi, D. (2017) · Scientific Reports · doi:10.1038/s41598-017-04448-4 · Cited by 47
Tang, Y., Gierc, M., La, H., Liu, S., Lam, R. W., Puterman, E., & Faulkner, G. (2025) · PLOS One · doi:10.1371/journal.pone.0321958 · Cited by 2
“Results will be reported with 75%, 85%, and 95% confidence intervals, while considering clinically meaningful changes as suggested by Lee et al [76] and Walters [77].”
Doig, G. S. (2008) · JAMA · doi:10.1001/jama.2008.826 · Cited by 1
Metadata
- Authors
- Walters, S. J.
- Venue
- Pharmaceutical Statistics
- Publisher
- Wiley
- Published
- 2008-04-17
- Volume
- 8
- Issue
- 2
- Pages
- 163-169
- ISSN
- 1539-1604 (ISSN-L)
- 1539-1612
- OpenAlex
- W2142629810
- Cited by
- 68
- References
- 5
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Consultants' forum: should post hoc sample size calculations be done? https://app.cochat.ai/papers/10.1002/pst.334
- The paper
- Walters, S. J. (2009). Consultants' forum: should post hoc sample size calculations be done? Pharmaceutical Statistics. https://doi.org/10.1002/pst.334
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.