Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.

Claims of causality in health news: a randomised trial

Open access

Abstract

BACKGROUND: Misleading news claims can be detrimental to public health. We aimed to improve the alignment between causal claims and evidence, without losing news interest (counter to assumptions that news is not interested in communicating caution). METHODS: We tested two interventions in press releases, which are the main sources for science and health news: (a) aligning the headlines and main causal claims with the underlying evidence (strong for experimental, cautious for correlational) and (b) inserting explicit statements/caveats about inferring causality. The 'participants' were press releases on health-related topics (N = 312; control = 89, claim alignment = 64, causality statement = 79, both = 80) from nine press offices (journals, universities, funders). Outcomes were news content (headlines, causal claims, caveats) in English-language international and national media (newspapers, websites, broadcast; N = 2257), news uptake (% press releases gaining news coverage) and feasibility (% press releases implementing cautious statements). RESULTS: News headlines showed better alignment to evidence when press releases were aligned (intention-to-treat analysis (ITT) 56% vs 52%, OR = 1.2 to 1.9; as-treated analysis (AT) 60% vs 32%, OR = 1.3 to 4.4). News claims also followed press releases, significant only for AT (ITT 62% vs 60%, OR = 0.7 to 1.6; AT, 67% vs 39%, OR = 1.4 to 5.7). The same was true for causality statements/caveats (ITT 15% vs 10%, OR = 0.9 to 2.6; AT 20% vs 0%, OR 16 to 156). There was no evidence of lost news uptake for press releases with aligned headlines and claims (ITT 55% vs 55%, OR = 0.7 to 1.3, AT 58% vs 60%, OR = 0.7 to 1.7), or causality statements/caveats (ITT 53% vs 56%, OR = 0.8 to 1.0, AT 66% vs 52%, OR = 1.3 to 2.7). Feasibility was demonstrated by a spontaneous increase in cautious headlines, claims and caveats in press releases compared to the pre-trial period (OR = 1.01 to 2.6, 1.3 to 3.4, 1.1 to 26, respectively). CONCLUSIONS: News claims-even headlines-can become better aligned with evidence. Cautious claims and explicit caveats about correlational findings may penetrate into news without harming news interest. Findings from AT analysis are correlational and may not imply cause, although here the linking mechanism between press releases and news is known. ITT analysis was insensitive due to spontaneous adoption of interventions across conditions. TRIAL REGISTRATION: ISRCTN10492618 (20 August 2015).

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12916-019-1324-7

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 CONSORT diagram for the press releases (participants) in the trial. Inclusion criteria: participating press offices were asked to send each press release based on peer-reviewed research that was relevant to human health, broadly defined (all biomedical, psychological or lifestyle topics), where the press office was leading the press release (rather than collaborating on a release by another office outside the trial) and the academic authors consented (we used opt-out consent). Our focus was on observational and experimental studies. Observational studies included cross-sectional and longitudinal designs as well as meta-analyses and systematic reviews based solely on observational research. Experimental research included randomised controlled trials, other experiments and meta-analyses or systematic reviews based solely on experimental designs. Press releases on studies that could not be classified as experimental or observational (e.g. simulations and mixed methods reviews) were excluded
Fig. 1 CONSORT diagram for the press releases (participants) in the trial. Inclusion criteria: participating press offices were asked to send each press release based on peer-reviewed research that was relevant to human health, broadly defined (all biomedical, psychological or lifestyle topics), where the press office was leading the press release (rather than collaborating on a release by another office outside the trial) and the academic authors consented (we used opt-out consent). Our focus was on observational and experimental studies. Observational studies included cross-sectional and longitudinal designs as well as meta-analyses and systematic reviews based solely on observational research. Experimental research included randomised controlled trials, other experiments and meta-analyses or systematic reviews based solely on experimental designs. Press releases on studies that could not be classified as experimental or observational (e.g. simulations and mixed methods reviews) were excludedCC BY · PubMed Central
Fig. 2 a News follows the phrasing of the press release: In ITT and AT analysis, news headlines were more likely to align to evidence if the press release phrasing did so; and in the AT analysis, claims in the news text were also more likely to do so if the press release did so. The discrepancy between ITT and AT analyses was due to a high level of condition mixing (see text). b ITT and AT analyses both show no evidence of reduced news uptake for press releases whose headlines and main claims aligned to evidence (see also Additional file 1: Figure S4 for the average number of news per press release). Error bars are 95% CIs. For each bar, n reports total number of news (a) or press releases (b) in that analysis group (i.e. the denominator of the proportion that the bar displays; total n is lower for AT than ITT analysis, because AT was possible only for press releases with causal claims present in headlines or main claims)
Fig. 2 a News follows the phrasing of the press release: In ITT and AT analysis, news headlines were more likely to align to evidence if the press release phrasing did so; and in the AT analysis, claims in the news text were also more likely to do so if the press release did so. The discrepancy between ITT and AT analyses was due to a high level of condition mixing (see text). b ITT and AT analyses both show no evidence of reduced news uptake for press releases whose headlines and main claims aligned to evidence (see also Additional file 1: Figure S4 for the average number of news per press release). Error bars are 95% CIs. For each bar, n reports total number of news (a) or press releases (b) in that analysis group (i.e. the denominator of the proportion that the bar displays; total n is lower for AT than ITT analysis, because AT was possible only for press releases with causal claims present in headlines or main claims)CC BY · PubMed Central
Fig. 3 Feasibility and growing use of cautious headlines and main claims in observational research (error bars are 95% CIs). Feasibility is indicated by the increase in spontaneous use in pre-intervention (draft) press releases since the baseline period (2014/15). Final press releases showed small further increases in cautious wording following suggestions in the trial. For each bar, n reports the total number of press releases in that analysis group (i.e. the denominator of the proportion that the bar displays)
Fig. 3 Feasibility and growing use of cautious headlines and main claims in observational research (error bars are 95% CIs). Feasibility is indicated by the increase in spontaneous use in pre-intervention (draft) press releases since the baseline period (2014/15). Final press releases showed small further increases in cautious wording following suggestions in the trial. For each bar, n reports the total number of press releases in that analysis group (i.e. the denominator of the proportion that the bar displays)CC BY · PubMed Central
Fig. 4 Use of causality statements/caveats (error bars are 95%CIs). a ITT was insensitive to differences in news content; AT showed that 20% of news contained causality statements or caveats if the press release did, and almost never otherwise. b ITT shows no reduction of news uptake and AT shows an increase in news for press releases containing causality statements/caveats (see also Additional file 1: Figure S4 for average number of news per press release). c Feasibility is indicated by the increase in spontaneous caveats for observational research since the baseline period (2014/2015). Final press releases showed a further increase following suggestions in relevant trial conditions. For each bar, n reports total number of news (a) or press releases (b, c) in that analysis group (i.e. the denominator of the proportion that the bar displays)
Fig. 4 Use of causality statements/caveats (error bars are 95%CIs). a ITT was insensitive to differences in news content; AT showed that 20% of news contained causality statements or caveats if the press release did, and almost never otherwise. b ITT shows no reduction of news uptake and AT shows an increase in news for press releases containing causality statements/caveats (see also Additional file 1: Figure S4 for average number of news per press release). c Feasibility is indicated by the increase in spontaneous caveats for observational research since the baseline period (2014/2015). Final press releases showed a further increase following suggestions in relevant trial conditions. For each bar, n reports total number of news (a) or press releases (b, c) in that analysis group (i.e. the denominator of the proportion that the bar displays)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 34 references

Research works printed but not linked: 4

  1. Castell S, Charlton A, Clemence M, Pettigrew N, Pope S, Quigley A, et al. Public attitudes to science. Ipsos Mori report for Department for Business Innovation and Skills; 2015. p. 1–202.
  2. The Academy of Medical Sciences. Enhancing the use of scientific evidence to judge the potential benefits and harms of medicines; 2017. p. 1–116.
  3. Jackson D, Moloney K. Inside Churnalism. J Stud Routledge. 2015;17:763–80.
  4. Schat J, Bossema FG, Nederlands MN. Overdreven gezondheidsnieuws. Relatie tussen overdrijving in academische persberichten en in nieuwsmedia. openaccess.leidenuniv.nl; 2018.

Cited by

See all 69

Metadata

Authors
Adams, R. C., Challenger, A., Bratton, L., Boivin, J., Bott, L., Powell, G., Williams, A., Chambers, C. D., & Sumner, P.
Affiliations
Cardiff University (GB)
Corresponding author
Sumner, Petroc
Venue
BMC Medicine
Published
2019-05-16
Volume
17
Issue
1
Pages
91-91
ISSN
1741-7015 (ISSN-L)
OpenAlex
W2945644351
Cited by
69
References
34
Citations by year
2026: 3 · 2025: 3 · 2024: 1 · 2023: 4 · 2022: 6 · 2021: 25 · 2020: 21 · 2019: 6
FWCI
17.15
Type
journal article
Language
en
Open access
Licence
Locations
  • BMC Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, public-domain)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • H2020 European Research Council (647893-CCT)
  • Economic and Social Research Council (ES/M000664/1)
Topics
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Communication › Journalism and Media Studies
  • Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
Keywords
health news, press releases, science communication, headlines, causal inference, correlation versus causation, public health communication
MeSH terms
Communication, Double-Blind Method, United Kingdom, Health Promotion, Humans, Mass Media, Public Health, Health Behavior, Causality, Evidence-Based Medicine, Information Dissemination, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Claims of causality in health news: a randomised trial. https://app.cochat.ai/papers/10.1186/s12916-019-1324-7
The paper
Adams, R. C., Challenger, A., Bratton, L., Boivin, J., Bott, L., Powell, G., Williams, A., Chambers, C. D., & Sumner, P. (2019). Claims of causality in health news: a randomised trial. BMC Medicine. https://doi.org/10.1186/s12916-019-1324-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.