Cited by 42Statistical Methods in Clinical TrialsMeta-analysis and systematic reviewsPharmaceutical industry and healthcare

The use of interim data and Data Monitoring Committee recommendations in randomized controlled trial reports: frequency, implications and potential sources of bias

Open access
Tharmanathan, Puvan, Calvert, Melanie, Hampton, John, Freemantle, Nick·2008·BMC Medical Research Methodology

Abstract

BACKGROUND: Interim analysis of accumulating trial data is important to protect participant safety during randomized controlled trials (RCTs). Data Monitoring Committees (DMCs) often undertake such analyses, but their widening role may lead to extended use of interim analysis or recommendations that could potentially bias trial results. METHODS: Systematic search of eight major publications: Annals of Internal Medicine, BMJ, Circulation, CID, JAMA, JCO, Lancet and NEJM, including all randomised controlled trials (RCTs) between June 2000 and May 2005 to identify RCTs that reported use of interim analysis, with or without DMC involvement. Recommendations made by the DMC or based on interim analysis were identified and potential sources of bias assessed. Independent double data extraction was performed on all included trials. RESULTS: We identified 1772 RCTs, of which 470 (27%; 470/1772) reported the use of a DMC and a further 116 (7%; 116/1772) trials reported some form of interim analysis without explicit mention of a DMC. There were 28 trials (24 with a formal DMC), randomizing a total of 79396 participants, identified as recommending changes to the trial that may have lead to biased results. In most of these, some form of sample size re-estimation was recommended with four trials also reporting changes to trial endpoints. The review relied on information reported in the primary publications and methods papers relating to the trials, higher rates of use may have occurred but not been reported. CONCLUSION: The reported use of interim analysis and DMCs in clinical trials has been increasing in recent years. It is reassuring that in most cases recommendations were made in the interest of participant safety. However, in practice, recommendations that may lead to potentially biased trial results are being made.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-2288-8-12

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 39 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. International Conference on Harmonisation Of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) Steering Committee ICH Harmonised Tripartite Guidelines: Statistical Principles For Clinical Trials (E9). ICH 1998
  2. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) Steering Committee ICH Tripartite Guidelines: General Considerations for Clinical Trials (E8) 1997

Cited by

Sorted by citations

Authors
Tharmanathan, P., Calvert, M., Hampton, J., & Freemantle, N.
Affiliations
  • University of Birmingham (GB)
  • Queen's Medical Centre (GB)
Corresponding author
Freemantle, Nick
Venue
BMC Medical Research Methodology
Published
2008-03-20
Volume
8
Issue
1
Pages
12-12
ISSN
1471-2288 (ISSN-L)
OpenAlex
W1975476357
Cited by
42
References
39
Citations by year
2026: 2 · 2025: 1 · 2023: 6 · 2022: 1 · 2021: 4 · 2020: 1 · 2019: 2 · 2017: 1 · 2016: 1 · 2015: 3 · 2014: 4 · 2013: 5 · 2012: 2
FWCI
0.43
Type
journal article
Language
en
Open access
Locations
  • BMC Medical Research Methodology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
Keywords
interim analysis, data monitoring committees, randomized controlled trials, trial reporting, sample size re-estimation, participant safety
MeSH terms
Data Interpretation, Statistical, Research Design, Bias, Randomized Controlled Trials as Topic, Sample Size, Clinical Trials Data Monitoring Committees

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review