CoChat

Misrepresentation of Neuroscience Data Might Give Rise to Misleading Conclusions in the Media: The Case of Attention Deficit Hyperactivity Disorder

Open access
Gonon, Francois, Bezard, Erwan, Boraud, Thomas · 2011 · PLoS ONE

The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.

Abstract

BACKGROUND: There is often a huge gap between neurobiological facts and firm conclusions stated by the media. Data misrepresentation in the conclusions and summaries of neuroscience articles might contribute to this gap. METHODOLOGY/PRINCIPAL FINDINGS: Using the case of attention deficit hyperactivity disorder (ADHD), we identified three types of misrepresentation. The first relies on prominent inconsistencies between results and claimed conclusions and was observed in two scientific reports dealing with ADHD. Only one out of the 61 media articles echoing both scientific reports adequately described the results and, thus questioned the claimed conclusion. The second type of misrepresentation consists in putting a firm conclusion in the summary while raw data that strongly limit the claim are only given in the results section. To quantify this misrepresentation we analyzed the summaries of all articles asserting that polymorphisms of the gene coding for the D4 dopaminergic receptor are associated with ADHD. Only 25 summaries out of 159 also mentioned that this association confers a small risk. This misrepresentation is also observed in most media articles reporting on ADHD and the D4 gene. The third misrepresentation consists in extrapolating basic and pre-clinical findings to new therapeutic prospects in inappropriate ways. Indeed, analysis of all ADHD-related studies in mice showed that 23% of the conclusions were overstated. The frequency of this overstatement was positively related with the impact factor of the journal. CONCLUSION/SIGNIFICANCE: Data misrepresentations are frequent in the scientific literature dealing with ADHD and may contribute to the appearance of misleading conclusions in the media. In synergy with citation distortions and publication biases they influence social representations and bias the scientific evidence in favor of the view that ADHD is primarily caused by biological factors. We discuss the social consequences and the causes of data misrepresentations and suggest a few corrective actions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0014618

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Overstatement of the relevance of mouse studies towards ADHD neurobiology and treatment. Studies were selected with a systematic search via PubMed (see methods). We rated a study as overstated when the link between ADHD and the studied mice only relied on their behavioral similarities with ADHD symptoms and when the conclusion stated that the findings provide novel insights into the neurobiology of ADHD. When this overstatement was reinforced by a claim about the clinical relevance of the study, it was rated as of type 2. Among the 101 studies examined, 56 were classified as overstated (33 type 1 and 23 type 2). A. Relationship between these 3 classes and the impact factor of the corresponding journal. Horizontal bars indicate mean ± SEM for the 3 classes. This impact factor was significantly higher (ANOVA, F = 6.52, Fisher's test: *p = 0.0006) when comparing studies with the type 2 overstatement to studies without overstatement. B. The occurrence rate of extrapolating to new therapeutic prospects (type 2 overstatement) is positively related to the impact factor.
Figure 1 Overstatement of the relevance of mouse studies towards ADHD neurobiology and treatment. Studies were selected with a systematic search via PubMed (see methods). We rated a study as overstated when the link between ADHD and the studied mice only relied on their behavioral similarities with ADHD symptoms and when the conclusion stated that the findings provide novel insights into the neurobiology of ADHD. When this overstatement was reinforced by a claim about the clinical relevance of the study, it was rated as of type 2. Among the 101 studies examined, 56 were classified as overstated (33 type 1 and 23 type 2). A. Relationship between these 3 classes and the impact factor of the corresponding journal. Horizontal bars indicate mean ± SEM for the 3 classes. This impact factor was significantly higher (ANOVA, F = 6.52, Fisher's test: *p = 0.0006) when comparing studies with the type 2 overstatement to studies without overstatement. B. The occurrence rate of extrapolating to new therapeutic prospects (type 2 overstatement) is positively related to the impact factor.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 71

Metadata

Authors
Gonon, F., Bezard, E., & Boraud, T.
Affiliations
Centre National de la Recherche Scientifique (FR)
Venue
PLoS ONE
Published
2011-01-31
Volume
6
Issue
1
Pages
e14618
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2082124284
Cited by
71
References
37
Citations by year
2026: 1 · 2025: 1 · 2024: 4 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 6 · 2019: 6 · 2018: 8 · 2017: 5 · 2016: 8 · 2015: 3 · 2014: 6 · 2013: 3 · 2012: 2
FWCI
12.91
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • HAL (submittedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • Agence Nationale de la Recherche
  • Centre National de la Recherche Scientifique
  • Université de Bordeaux
Topics
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › Academic Writing and Publishing
Keywords
data misrepresentation, attention deficit hyperactivity disorder, science communication, genetic polymorphism, mouse model, publication bias, impact factor, biological determinism
MeSH terms
Attention Deficit Disorder with Hyperactivity, Communications Media, Humans, Medical Informatics, Neurosciences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.