The DOI matches its Crossref record; 893 of the 893 references it cites were found in a registry or an index.
Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review
Open accessAbstract
BACKGROUND: The randomised controlled trial (RCT) is widely considered to be the gold standard study for comparing the effectiveness of health interventions. Central to the design and validity of a RCT is a calculation of the number of participants needed (the sample size). The value used to determine the sample size can be considered the 'target difference'. From both a scientific and an ethical standpoint, selecting an appropriate target difference is of crucial importance. Determination of the target difference, as opposed to statistical approaches to calculating the sample size, has been greatly neglected though a variety of approaches have been proposed the current state of the evidence is unclear. OBJECTIVES: The aim was to provide an overview of the current evidence regarding specifying the target difference in a RCT sample size calculation. The specific objectives were to conduct a systematic review of methods for specifying a target difference; to evaluate current practice by surveying triallists; to develop guidance on specifying the target difference in a RCT; and to identify future research needs. DESIGN: The biomedical and social science databases searched were MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Methodology Register, PsycINFO, Science Citation Index, EconLit, Education Resources Information Center (ERIC) and Scopus for in-press publications. All were searched from 1966 or the earliest date of the database coverage and searches were undertaken between November 2010 and January 2011. There were three interlinked components: (1) systematic review of methods for specifying a target difference for RCTs - a comprehensive search strategy involving an electronic literature search of biomedical and some non-biomedical databases and clinical trials textbooks was carried out; (2) identification of current trial practice using two surveys of triallists - members of the Society for Clinical Trials (SCT) were invited to complete an online survey and respondents were asked about their awareness and use of, and willingness to recommend, methods; one individual per triallist group [UK Clinical Research Collaboration (UKCRC)-registered Clinical Trials Units (CTUs), Medical Research Council (MRC) UK Hubs for Trials Methodology Research and National Institute for Health Research (NIHR) UK Research Design Services (RDS)] was invited to complete a survey; (3) production of a structured guidance document to aid the design of future trials - the draft guidance was developed utilising the results of the systematic review and surveys by the project steering and advisory groups. SETTING: Methodological review incorporating electronic searches, review of books and guidelines, two surveys of experts (membership of an international society and UK- and Ireland-based triallists) and development of guidance. PARTICIPANTS: The two surveys were sent out to membership of the SCT and UK- and Ireland-based triallists. INTERVENTIONS: The review focused on methods for specifying the target difference in a RCT. It was not restricted to any type of intervention or condition. MAIN OUTCOME MEASURES: Methods for specifying the target difference for a RCT were considered. RESULTS: The search identified 11,485 potentially relevant studies. In total, 1434 were selected for full-text assessment and 777 were included in the review. Seven methods to specify the target difference for a RCT were identified - anchor, distribution, health economic, opinion-seeking, pilot study, review of evidence base (RoEB) and standardised effect size (SES) - each having important variations in implementation. A total of 216 of the included studies used more than one method. A total of 180 (15%) responses to the SCT survey were received, representing 13 countries. Awareness of methods ranged from 38% (n =69) for the health economic method to 90% (n =162) for the pilot study. Of the 61 surveys sent out to UK triallist groups, 34 (56%) responses were received. Awareness ranged from 97% (n =33) for the RoEB and pilot study methods to only 41% (n =14) for the distribution method. Based on the most recent trial, all bar three groups (91%, n =30) used a formal method. Guidance was developed on the use of each method and the reporting of the sample size calculation in a trial protocol and results paper. CONCLUSIONS: There is a clear need for greater use of formal methods to determine the target difference and better reporting of its specification. Raising the standard of RCT sample size calculations and the corresponding reporting of them would aid health professionals, patients, researchers and funders in judging the strength of the evidence and ensuring better use of scarce resources. FUNDING: The Medical Research Council UK and the National Institute for Health Research Joint Methodology Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Internal pilot studies were primarily viewed as part of the full trial [8, 32, 35–38] and are therefore not depicted under nomenclature in Table 3.”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationGRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Farrar, J. T., Young, J. P., LaMoreaux, L., Werth, J. L., & Poole, M. R. (2001) · Pain · doi:10.1016/s0304-3959(01)00349-9 · Cited by 5,808
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J., Green, S. R., & Higgins, J. (2008) · Cited by 5,544
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
QUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
WEIR, J. P. (2005) · Journal of Strength and Conditioning Research · doi:10.1519/00124278-200502000-00038 · Cited by 4,842
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citation
Cited by
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Self-citationVitamin D supplementation for women during pregnancy
De-Regil, L. M., Palacios, C., Lombardo, L. K., & Peña-Rosas, J. P. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008873.pub3 · Cited by 744
Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21022 · Cited by 719
Monitoring Fatigue Status in Elite Team-Sport Athletes: Implications for Practice
Thorpe, R. T., Atkinson, G., Drust, B., & Gregson, W. (2017) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2016-0434 · Cited by 328
Metadata
- Authors
- Cook, J., Hislop, J., Adewuyi, T., Harrild, K., Altman, D., Ramsay, C., Fraser, C., Buckley, B., Fayers, P., Harvey, I., Briggs, A., Norrie, J., Fergusson, D., Ford, I., & Vale, L.
- Affiliations
- University of Aberdeen (GB)
- University of Oxford (GB)
- Ollscoil na Gaillimhe – University of Galway (IE)
- University of East Anglia (GB)
- University of Glasgow (GB)
- Ottawa Hospital Research Institute (CA)
- Newcastle University (GB)
- ORCID
- Venue
- Health Technology Assessment
- Published
- 2014-01
- Volume
- 18
- Issue
- 28
- Pages
- v-vi, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- PMC
- PMC4781097
- OpenAlex
- W2171723063
- Cited by
- 194
- References
- 871
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 6 · 2023: 3 · 2022: 8 · 2021: 19 · 2020: 18 · 2019: 14 · 2018: 24 · 2017: 25 · 2016: 27 · 2015: 33 · 2014: 3
- FWCI
- 3.74
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- ARAN (University of Galway Research Repository) (Ollscoil na Gaillimhe – University of Galway) (submittedVersion, cc-by-nc-nd)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Galway Research Repository (submittedVersion, cc-by-nc)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Research Repository UCD (University College Dublin) (cc-by-nc)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Institute for Health Research
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- sample size determination, randomized controlled trials, trial design, clinical trial design, DELTA project, health interventions, research capacity building
- MeSH terms
- Attitude of Health Personnel, Cost-Benefit Analysis, Data Collection, United Kingdom, Humans, Ireland, Research Personnel, Societies, Scientific, Statistics as Topic, Epidemiologic Research Design, Bias, Randomized Controlled Trials as Topic, Patient Satisfaction, Sample Size, Evidence-Based Medicine, Internationality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review. https://app.cochat.ai/papers/10.3310/hta18280
- The paper
- Cook, J., Hislop, J., Adewuyi, T., Harrild, K., Altman, D., Ramsay, C., Fraser, C., Buckley, B., Fayers, P., Harvey, I., Briggs, A., Norrie, J., Fergusson, D., Ford, I., & Vale, L. (2014). Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review. Health Technology Assessment. https://doi.org/10.3310/hta18280
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.