The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Why clinical trial outcomes fail to translate into benefits for patients
Open accessAbstract
Clinical research should ultimately improve patient care. For this to be possible, trials must evaluate outcomes that genuinely reflect real-world settings and concerns. However, many trials continue to measure and report outcomes that fall short of this clear requirement. We highlight problems with trial outcomes that make evidence difficult or impossible to interpret and that undermine the translation of research into practice and policy. These complex issues include the use of surrogate, composite and subjective endpoints; a failure to take account of patients' perspectives when designing research outcomes; publication and other outcome reporting biases, including the under-reporting of adverse events; the reporting of relative measures at the expense of more informative absolute outcomes; misleading reporting; multiplicity of outcomes; and a lack of core outcome sets. Trial outcomes can be developed with patients in mind, however, and can be reported completely, transparently and competently. Clinicians, patients, researchers and those who pay for health services are entitled to demand reliable evidence demonstrating whether interventions improve patient-relevant clinical outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, despite increasing attention to the quality of clinical trial reporting [19–21] and generics use in science [15,17,18], it remains unclear to what extent medical researchers produce hasty generalizations, how impactful articles with such generalizations are, and whether the generalizations in primary research articles differ in their scope (e.g., generics use) from those found in research”
From Hasty generalizations and generics in medical research: A systematic review (2024) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“An unfortunate consequence of group studies such as the Evans et al. (2017) trial is that mean outcome scores on nomothetic measures obscures both the responsivity (or not) of individuals and also whether the idiosyncratic problems brought by patients to therapy actually change (Heneghan et al., 2017).”
From Effectiveness of cognitive analytic therapy for bipolar affective disorder: A co‐produced single subject cumulative treatment design with extended follow‐up (A 1 /B/A 2 /C‐FU) (2022) · cites this paper as Heneghan et al., 2017
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Firstly, in the pursuit of optimal treatment outcomes, clinical exercise trials often invest a level of resources, such as staff time, facilities and other support, that can facilitate patient engagement and overcome key barriers to patient adherence.”
From Identifying the factors affecting ‘patient engagement’ in exercise rehabilitation (2022) · cites this paper as [11]
Experimental — accuracy not yet measuredIn the citing paper
“If medical researchers make claims that are broader than warranted by the evidence or that mask variations, and if articles with such claims are impactful and summarized for practitioners without adjustments in generalization scope, this may contribute to regulatory approval or clinical use of treatments that are ineffective or harmful for people [3,19].”
From Hasty generalizations and generics in medical research: A systematic review (2024) · cites this paper as [19]
In the citing paper
“Secondly, the volunteers for clinical trials are likely to have a vested interest in the exercise activity, a belief in its efficacy, and be positively motivated to engage, as well as the time and resources to commit to the programme/clinical trial—characteristics that are not universal in the wider patient population.”
From Identifying the factors affecting ‘patient engagement’ in exercise rehabilitation (2022) · cites this paper as [11]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 1×
“, when outcome assessors are not blinded) [17, 18].”
BackgroundThe prevention and handling of the missing data
Kang, H. (2013) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2013.64.5.402 · Cited by 1,728 · cited 1×
“Despite the development of a number of different ways of handling missing data, the only real solution is to prevent it from happening in the first place [36].”
BackgroundDeveloping core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133 · cited 1×
“Authors of a review of 283 Cochrane reviews found that more than half did not include data on the primary outcome [43].”
BackgroundDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 1×
“approved trials, half go unpublished [38], and trials with positive outcomes are twice as likely to be published, and published faster, compared with trials with negative outcomes [39, 40].”
BackgroundMarshall, M., Lockwood, A., Bradley, C., Adams, C., Joy, C., & Fenton, M. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.176.3.249 · Cited by 870
Cited by
Fogel, D. B. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.08.001 · Cited by 1,035
Long-term (10-year) dental implant survival: A systematic review and sensitivity meta-analysis
Howe, M.-S., Keys, W., & Richards, D. (2019) · Journal of Dentistry · doi:10.1016/j.jdent.2019.03.008 · Cited by 555
Pound, P., & Ritskes-Hoitinga, M. (2018) · Journal of Translational Medicine · doi:10.1186/s12967-018-1678-1 · Cited by 419
Brennan, N. A., Toubouti, Y. M., Cheng, X., & Bullimore, M. A. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100923 · Cited by 355
Recent clinical trends in Toll‐like receptor targeting therapeutics
Anwar, M. A., Shah, M., Kim, J., & Choi, S. (2019) · Medicinal Research Reviews · doi:10.1002/med.21553 · Cited by 275
Metadata
- Authors
- Heneghan, C., Goldacre, B., & Mahtani, K. R.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Heneghan, Carl
- Venue
- Trials
- Published
- 2017-03-14
- Volume
- 18
- Issue
- 1
- Pages
- 122-122
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC5348914
- OpenAlex
- W2597385103
- Cited by
- 404
- References
- 67
- Citations by year
- 2026: 34 · 2025: 27 · 2024: 59 · 2023: 51 · 2022: 54 · 2021: 50 · 2020: 50 · 2019: 38 · 2018: 27 · 2017: 13
- FWCI
- 24.34
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Trials (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute for Health and Care Research (CL-2011-13-006)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- clinical trial results, outcome measurement, clinical translation, surrogate endpoints, composite endpoints, patient perspectives, selective reporting, core outcome set, clinical trial transparency, patient-relevant outcomes
- MeSH terms
- Clinical Trials as Topic, Data Interpretation, Statistical, Humans, Patient Participation, Research Design, Bias, Treatment Outcome, Publication Bias, Endpoint Determination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Why clinical trial outcomes fail to translate into benefits for patients. https://app.cochat.ai/papers/10.1186/s13063-017-1870-2
- The paper
- Heneghan, C., Goldacre, B., & Mahtani, K. R. (2017). Why clinical trial outcomes fail to translate into benefits for patients. Trials. https://doi.org/10.1186/s13063-017-1870-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
