CoChat

Scientific research in news media: a case study of misrepresentation, sensationalism and harmful recommendations

Open access
Dempster, Georgia, Sutherland, Georgina, Keogh, Louise · 2022 · Journal of Science Communication

The DOI matches its Crossref record; 57 of the 60 references it cites were found in a registry or an index; 6 of the 10 sources its claims cite were checked for support.

Abstract

Accurate news media reporting of scientific research is important as most people receive their health information from the media and inaccuracies in media reporting can have adverse health outcomes.

Overview

CoChat Summary

TL;DR

This case study traces how a New England Journal of Medicine study on NAD deficiency, congenital malformations and niacin supplementation was translated into a press release and then into online news, finding that sensationalism, misrepresentation and harmful clinical recommendations in the press release were often carried into news reports. The authors argue that pressures on scientists, institutions and journalists create a mutually beneficial relationship that can prioritise newsworthiness over scientific integrity.

Key findings

  • The analysis identified 60 unique news reports from 48 separate news organisations and websites.
  • Sensationalism was introduced in the press release and appeared in many news reports: 68% included spin in the body, 87% used buzz words, and 71% were framed positively.
  • Misrepresentation was common: 87% of news reports described the study design, 62% described niacin supplementation in mice, 57% described the study population as including both mice and humans, and 56% described genetic sequencing in humans.
  • Clinical recommendations were widespread: 88% of articles included recommendations about vitamin supplementation, while 60% stated findings could not be translated to humans and only 7% advised readers to consult their doctor. Subjectivity measures included 47% with both independent and non-independent expert commentators, 45% with non-independent experts only, 17% with a patient narrative, 17% with funding information, and 25% with a link to the journal article.

Methods

  • Quantitative and qualitative content analysis of the journal article, its corresponding press release, and online news reports about the study.
  • News reports were sourced from Google News for August–December 2017 using keywords such as “niacin”, “vitamin B3”, “Vegemite”, “congenital malformations” and “birth defects”; the press release was issued on 10 August 2017 and most reports appeared 10–12 August 2017.
  • Documents were imported into NVivo 12; a coding framework with yes/no items was developed, the first author completed coding, 10% of articles were double coded by another author with agreement reaching 80%, and qualitative analysis explored themes in more depth.

Limitations

  • The paper states that using one case study provides rich data but means results may not be generalisable to understanding where and how misrepresentation occurs in all communication pathways.
  • The paper states that using Google News as a single source means some online news reports about the study may not have been captured.
  • The paper states that although the coding framework was developed collaboratively and 10% of reports were double coded with 80% agreement, there remains some subjectivity in interpreting the coded variables.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.22323/2.21010206

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 1 Not valid · 4 Not checked · 56 Own results and interpretations

33 more claims

Create a free account to see all 67 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 25
  • It may state two separate claims as one. 10

Create a free account to see these claims.

Citations

Cites

Research works printed but not linked: 3

  1. [2]2. Autzen, C. and Weitkamp, E. (2020). 'Science communication and public relations: beyond borders'. In: Science Communication. Ed. by A. Leßmöllmann, M. Dascal and T. Gloning. Vol. 17. Handbooks of Communication Science.
  2. [28]28. HealthNewsReview.org (2018). Our review criteria. URL: https://www.healthnewsreview.org/about-us/review-criteria/.
  3. [61]61. Vestergård, G. L. (2015). 'Where does science news come from?' Ph.D. thesis. Aarhus, Denmark: Aarhus University.

Cited by

See all 72

Metadata

Authors
Dempster, G., Sutherland, G., & Keogh, L.
Venue
Journal of Science Communication
Published
2022-03-07
Volume
21
Issue
01
Pages
A06
ISSN
1824-2049 (ISSN-L)
OpenAlex
W4220724178
Cited by
71
References
60
Citations by year
2026: 16 · 2025: 19 · 2024: 16 · 2023: 18 · 2022: 2
FWCI
11.53
Type
journal article
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • Journal of Science Communication (publishedVersion, cc-by-nc-nd)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Communication › Journalism and Media Studies
  • Social Sciences › Communication › News Media Framing and Political Communication
Keywords
science journalism, sensationalism, press releases, health information, clinical guidelines, scientific integrity, newsworthiness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.