CoChat

Misinformation in and about science

Open access
West, Jevin D., Bergstrom, Carl T. · 2021 · Proceedings of the National Academy of Sciences

The DOI matches its Crossref record; 142 of the 144 references it cites were found in a registry or an index; 19 of the 105 sources its claims cite were checked for support.

Abstract

Humans learn about the world by collectively acquiring information, filtering it, and sharing what we know. Misinformation undermines this process. The repercussions are extensive. Without reliable and accurate sources of information, we cannot hope to halt climate change, make reasoned democratic decisions, or control a global pandemic. Most analyses of misinformation focus on popular and social media, but the scientific enterprise faces a parallel set of problems—from hype and hyperbole to publication bias and citation misdirection, predatory publishing, and filter bubbles. In this perspective, we highlight these parallels and discuss future research directions and interventions.

Overview

CoChat Summary

TL;DR

This perspective argues that science faces misinformation problems parallel to those in public media—hype, publication bias, citation misdirection, predatory publishing, and filter bubbles—driven by attention and productivity incentives. It proposes incentive reform, better detection and evaluation, and data-reasoning education, while maintaining that science remains a highly trusted, self-correcting enterprise.

Key findings

  • Misinformation in science arises from misaligned incentives, out-of-date publishing norms, and sociotechnical systems that concentrate attention and credit on a small subset of the literature; the paper highlights hype/hyperbole, publication bias, citation misdirection, predatory publishing, filter bubbles/echo chambers, and data distortion.
  • Publication bias is substantial: only 15% of published results across the sciences are negative, and in antidepressant trials, 94% of published trials reported positive efficacy results versus 51% of FDA-registered trials yielding definitively positive results on original outcome measures.
  • Citation misdirection is common: most analyses find between 1 in 5 and 1 in 10 citations support claims incongruous with the cited paper; a five-sentence opioid letter was cited over 600 times, with fewer than 20% of citations acknowledging its hospital-setting restriction; and 92% of radiation oncology articles citing retracted articles after retraction cited them as if no retraction had occurred.
  • Predatory publishers produced nearly half a million articles in 2014, bringing in around $74 million in publication fees, compared with an estimated $250 million annual market for reputable open access journals and about 2.5 million Web of Science articles in 2014; predatory publishing likely comprises about 5 to 10% of the literature.

Methods

  • Perspective/synthesis article; the authors state “There are no new data associated with this article.”
  • The paper draws on published literature, news examples, and prior studies to build a conceptual argument about misinformation in and about science.
  • Main analysis is interpretive and agenda-setting rather than systematic review or original empirical analysis.

Limitations

  • The paper does not include a formal limitations section.
  • Evident from the text: as a perspective, it relies on illustrative examples and cited studies rather than a systematic review, and some claims are explicitly speculative (e.g., “we surmise that most fields are susceptible”).
  • The authors also state that the magnitude of publication bias is not fully known: “How bad is the problem? We do not really know.”

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.1912444117

Cites

142 of 142 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

10 Valid · 3 Not valid · 59 Not checked · 33 Own results and interpretations

56 more claims · 5 with their cited sources checked

Create a free account to see all 105 claims and to verify the 86 references still open.

See all claims — free account
  • Probably not a substantial claim. 27
  • It may state two separate claims as one. 24

Create a free account to see these claims.

Citations

Cites

3 retracted

Show all 142 references

Research works printed but not linked: 6

  1. T. C. Bergstrom, C. T. Bergstrom, Can ‘author pays’ journals compete with ‘reader pays?’ Nature (2004).
  2. A. Cairo, How Charts Lie. (WW Norton & Company, 2019).
  3. K. Parker, The growing partisan divide in views of higher education. Pew Research Center (19 August 2019). https://www.pewsocialtrends.org/essay/the-growing-partisan-divide-in-views-of-higher-education/. Accessed 7 December 2020.
  4. C. Funk, Mixed messages about public trust in science. Issues Sci. Technol. 34, 86–88 (2017).
  5. N. M. Krause, D. Brossard, D. A. Scheufele, M. A. Xenos, K. Franke, Trends—Americans’ Trust in Science and Scientists. Publ. Opin. Q. 83, 817–836 (2019).
  6. N. S. Board Science and Engineering Indicators (NSF 2018) vol. 1.

Cited by

See all 455

Metadata

Authors
West, J. D., & Bergstrom, C. T.
Affiliations
University of Washington (US)
Corresponding author
West, Jevin D.
Venue
Proceedings of the National Academy of Sciences
Published
2021-04-09
Volume
118
Issue
15
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W3148182339
Cited by
391
References
144
Citations by year
2026: 38 · 2025: 97 · 2024: 108 · 2023: 77 · 2022: 51 · 2021: 18
FWCI
12.18
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Science Foundation (1735194)
  • John S. and James L. Knight Foundation (G-2019-58788)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Education › Academic integrity and plagiarism
Keywords
misinformation, science communication, scholarly publishing, publication bias, predatory publishing, hype, filter bubbles, information filtering, misinformation interventions
MeSH terms
Humans, Mass Media, Periodicals as Topic, Biomedical Research, Health Communication

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Misinformation in and about science. https://app.cochat.ai/papers/10.1073/pnas.1912444117
The paper
West, J. D., & Bergstrom, C. T. (2021). Misinformation in and about science. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1912444117

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.