Methods for Specifying the Target Difference in a Randomised Controlled Trial: The Difference ELicitation in TriAls (DELTA) Systematic Review
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Randomised controlled trials (RCTs) are widely accepted as the preferred study design for evaluating healthcare interventions. When the sample size is determined, a (target) difference is typically specified that the RCT is designed to detect. This provides reassurance that the study will be informative, i.e., should such a difference exist, it is likely to be detected with the required statistical precision. The aim of this review was to identify potential methods for specifying the target difference in an RCT sample size calculation. METHODS AND FINDINGS: A comprehensive systematic review of medical and non-medical literature was carried out for methods that could be used to specify the target difference for an RCT sample size calculation. The databases searched were MEDLINE, MEDLINE In-Process, EMBASE, the Cochrane Central Register of Controlled Trials, the Cochrane Methodology Register, PsycINFO, Science Citation Index, EconLit, the Education Resources Information Center (ERIC), and Scopus (for in-press publications); the search period was from 1966 or the earliest date covered, to between November 2010 and January 2011. Additionally, textbooks addressing the methodology of clinical trials and International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) tripartite guidelines for clinical trials were also consulted. A narrative synthesis of methods was produced. Studies that described a method that could be used for specifying an important and/or realistic difference were included. The search identified 11,485 potentially relevant articles from the databases searched. Of these, 1,434 were selected for full-text assessment, and a further nine were identified from other sources. Fifteen clinical trial textbooks and the ICH tripartite guidelines were also reviewed. In total, 777 studies were included, and within them, seven methods were identified-anchor, distribution, health economic, opinion-seeking, pilot study, review of the evidence base, and standardised effect size. CONCLUSIONS: A variety of methods are available that researchers can use for specifying the target difference in an RCT sample size calculation. Appropriate methods may vary depending on the aim (e.g., specifying an important difference versus a realistic difference), context (e.g., research question and availability of data), and underlying framework adopted (e.g., Bayesian versus conventional statistical approach). Guidance on the use of each method is given. No single method provides a perfect solution for all contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Understanding the minimum clinically important difference: A review of concepts and methods
Copay, A. G., Subach, B. R., Glassman, S. D., Polly, D. W., & Schuler, T. C. (2007) · The Spine Journal · doi:10.1016/j.spinee.2007.01.008 · Cited by 1,662
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · cited 2×
“Standardised Effect Size Method This method is commonly used to determine the importance of a difference in an outcome when set in comparison to other possible effect sizes upon a standardised scale [88,104–116].”
MethodDetermining the minimum clinically important differences for outcomes in the DOMINO trial
Howard, R., Phillips, P., Johnson, T., O'Brien, J., Sheehan, B., Lindesay, J., Bentham, P., Burns, A., Ballard, C., Holmes, C., et al. (2011) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2607 · Cited by 185
Sun~er, I. J., Kokame, G. T., Yu, E., Ward, J., Dolan, C., & Bressler, N. M. (2009) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.08-3225 · Cited by 170
Samsa, G. P., & Matchar, D. B. (2001) · Stroke · doi:10.1161/01.str.32.3.669 · Cited by 51 · cited 1×
“Health Economic Method The approaches included under the health economic method typically involve defining a threshold value for the cost of a unit of health effect that a decision-maker is willing to pay and using this threshold to construct a ‘‘net benefit’’ that combines both resource cost and health outcomes [57–6…”
MethodSufficiently important difference for common cold: severity reduction
Barrett, B., Harahan, B., Brown, D., Zhang, Z., & Brown, R. (2007) · The Annals of Family Medicine · doi:10.1370/afm.698 · Cited by 48 · cited 1×
“Opinion-Seeking Method The opinion-seeking method determines a value (or a plausible range of values) for the target difference, by asking one or more individuals to state their view on what value or values for a particular difference should be important and/or realistic [66–86].”
Method
Cited by
Bell, M. L., Whitehead, A. L., & Julious, S. A. (2018) · Clinical Epidemiology · doi:10.2147/clep.s146397 · Cited by 280
“Expert opinion is also used to specify important differences.(15) Although some researchers use the pilot effect size to power the definitive trial, this is a practice that should be avoided in general, as estimation is poor due to the small sample size, and is likely to mislead.”
Hallingberg, B., Turley, R., Segrott, J., Wight, D., Craig, P., Moore, L., Murphy, S., Robling, M., Simpson, S. A., & Moore, G. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0290-8 · Cited by 248
“Several also recommended the need to consider a desired meaningful difference in the health outcomes from a future evaluation and the appropriate sample size needed to detect this, rather than conducting sample size calculations using estimates of likely effect size from pilot data [30, 35, 38, 43].”
BackgroundMethodCook, J. A., Julious, S. A., Sones, W., Hampson, L. V., Hewitt, C., Berlin, J. A., Ashby, D., Emsley, R., Fergusson, D. A., Walters, S. J., et al. (2018) · Trials · doi:10.1186/s13063-018-2884-0 · Cited by 197
Self-citationCook, J. A., Julious, S. A., Sones, W., Hampson, L. V., Hewitt, C., Berlin, J. A., Ashby, D., Emsley, R., Fergusson, D. A., Walters, S. J., et al. (2018) · BMJ · doi:10.1136/bmj.k3750 · Cited by 148
Self-citationShould treatment effects be estimated in pilot and feasibility studies?
Sim, J. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0493-7 · Cited by 123
Metadata
- Authors
- Hislop, J., Adewuyi, T. E., Vale, L. D., Harrild, K., Fraser, C., Gurung, T., Altman, D. G., Briggs, A. H., Fayers, P., Ramsay, C. R., Norrie, J. D., Harvey, I. M., Buckley, B., Cook, J. A., & for the DELTA group
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-05-13
- Volume
- 11
- Issue
- 5
- Pages
- e1001645
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W2143818021
- Cited by
- 36
- References
- 6
- FWCI
- 0.47
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methods for Specifying the Target Difference in a Randomised Controlled Trial: The Difference ELicitation in TriAls (DELTA) Systematic Review. https://app.cochat.ai/papers/10.1371/journal.pmed.1001645
- The paper
- Hislop, J., Adewuyi, T. E., Vale, L. D., Harrild, K., Fraser, C., Gurung, T., Altman, D. G., Briggs, A. H., Fayers, P., Ramsay, C. R., Norrie, J. D., Harvey, I. M., Buckley, B., Cook, J. A., & for the DELTA group. (2014). Methods for Specifying the Target Difference in a Randomised Controlled Trial: The Difference ELicitation in TriAls (DELTA) Systematic Review. PLoS Medicine. https://doi.org/10.1371/journal.pmed.1001645
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.