Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of News
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mass media through the Internet is a powerful means of disseminating medical research. We aimed to determine whether and how the interpretation of research results is misrepresented by the use of "spin" in the health section of Google News. Spin was defined as specific way of reporting, from whatever motive (intentional or unintentional), to emphasize that the beneficial effect of the intervention is greater than that shown by the results. METHODS: We conducted a cross-sectional study of news highlighted in the health section of US, UK and Canada editions of Google News between July 2013 and January 2014. We searched for news items for 3 days a week (i.e., Monday, Wednesday, and Friday) during 6 months and selected a sample of 130 news items reporting a scientific article evaluating the effect of an intervention on human health. RESULTS: In total, 78% of the news did not provide a full reference or electronic link to the scientific article. We found at least one spin in 114 (88%) news items and 18 different types of spin in news. These spin were mainly related to misleading reporting (59%) such as not reporting adverse events that were reported in the scientific article (25%), misleading interpretation (69%) such as claiming a causal effect despite non-randomized study design (49%) and overgeneralization/misleading extrapolation (41%) of the results such as extrapolating a beneficial effect from an animal study to humans (21%). We also identified some new types of spin such as highlighting a single patient experience for the success of a new treatment instead of focusing on the group results. CONCLUSIONS: Interpretation of research results was frequently misrepresented in the health section of Google News. However, we do not know whether these spin were from the scientific articles themselves or added in the news.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Media outlets may spin [26–28] and encourage dissemination of eye-catching, potentially overstated, inaccurate [29], and/or misleading headlines in order to gain larger audience size [28, 30, 31].”
From Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review (2018) · cites this paper as [28]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“We restricted our search to Google News because it covers a vast range of news media sources [Filloux, 2013] and has been used previously in media analysis research as the single source of online news media coverage [Haneef et al., 2015;Young Lin and Rosenkrantz, 2017].”
From Scientific research in news media: a case study of misrepresentation, sensationalism and harmful recommendations (2022) · cites this paper as Haneef et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842
Self-citationTranslation of Research Evidence From Animals to Humans
Hackam, D. G., & Redelmeier, D. A. (2006) · JAMA · doi:10.1001/jama.296.14.1731 · Cited by 733 · cited 1×
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundComparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Chan, A.-W., & Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.38356.424606.8f · Cited by 613
When are observational studies as credible as randomised trials?
Vandenbroucke, J. P. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16261-2 · Cited by 538
Coverage by the news media of the benefits and risks of medications
Moynihan, R., Bero, L., Ross-Degnan, D., Henry, D., Lee, K., Watkins, J., Mah, C., & Soumerai, S. B. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006013422206 · Cited by 500 · cited 2×
“For example, in the United States [13] and in Canada [45], 53% and 68% of news stories, respectively, failed to mention the potential harms related to drug treatments for patients and failed to quantify the benefits.”
BackgroundSumner, P., Vivian-Griffiths, S., Boivin, J., Williams, A., Venetis, C. A., Davies, A., Ogden, J., Whelan, L., Hughes, B., Dalton, B., et al. (2014) · BMJ · doi:10.1136/bmj.g7015 · Cited by 489 · cited 3×
“Furthermore, spin in press releases and news items is related to the presence of spin in the abstract conclusions of published articles, and the findings of randomized controlled trials (RCTs) based on press releases and media coverage could be misinterpreted [7, 11].”
BackgroundImportance of the Lay Press in the Transmission of Medical Knowledge to the Scientific Community
Phillips, D. P., Kanter, E. J., Bednarczyk, B., & Tastad, P. L. (1991) · New England Journal of Medicine · doi:10.1056/nejm199110173251620 · Cited by 399
Boutron, I., Altman, D. G., Hopewell, S., Vera-Badillo, F., Tannock, I., & Ravaud, P. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.7503 · Cited by 368
Self-citationYavchitz, A., Boutron, I., Bafeta, A., Marroun, I., Charles, P., Mantz, J., & Ravaud, P. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001308 · Cited by 293 · cited 6×
“Previous studies have focused on spin in RCTs [5, 7, 39, 40], diagnostic test accuracy studies [6, 41], non-randomized studies [14, 16, 42] and epidemiologic studies [43] and demonstrated a high prevalence of spin in published articles.”
BackgroundInfluentialSelf-citation
Cited by
Haber, N., Smith, E. R., Moscoe, E., Andrews, K., Audy, R., Bell, W., Brennan, A. T., Breskin, A., Kane, J. C., Karra, M., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196346 · Cited by 97
“Media outlets may spin [26–28] and encourage dissemination of eye-catching, potentially overstated, inaccurate [29], and/or misleading headlines in order to gain larger audience size [28, 30, 31].”
BackgroundCausal and Associational Language in Observational Health Research: A Systematic Evaluation
Haber, N., Wieten, S. E., Rohrer, J. M., Arah, O. A., Tennant, P. W. G., Stuart, E. A., Murray, E. J., Pilleron, S., Lam, S. T., Riederer, E., et al. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac137 · Cited by 113
Magni, P., Bier, D. M., Pecorelli, S., Agostoni, C. V., Astrup, A. V., Brighenti, F., Cook, R., Folco, E., Fontana, L., Gibson, R. A., et al. (2017) · Advances in Nutrition · doi:10.3945/an.116.014738 · Cited by 97
“Recently, 18 kinds of media spin were identified, and $1 spin was found in 88% of media research reports: 25% failed to report adverse events mentioned in the scientific article, 49% claimed a causal effect despite a nonrandomized study design, and 21% extrapolated a beneficial effect from an animal study to humans (7…”
Dempster, G., Sutherland, G., & Keogh, L. (2022) · Journal of Science Communication · doi:10.22323/2.21010206 · Cited by 71
“In the context of scientific research, spin has been described as communicating findings so that the benefits of an intervention seem stronger or more positive than they actually are [Haneef et al., 2015].”
BackgroundMethodResultInfluentialClaims of causality in health news: a randomised trial
Adams, R. C., Challenger, A., Bratton, L., Boivin, J., Bott, L., Powell, G., Williams, A., Chambers, C. D., & Sumner, P. (2019) · BMC Medicine · doi:10.1186/s12916-019-1324-7 · Cited by 69
“For example, in a sample of 130 prominent health stories, 49% had causal claims based on non-randomised designs [6] (see also Additional file 1: Figure S1).”
Background
Metadata
- Authors
- Haneef, R., Lazarus, C., Ravaud, P., Yavchitz, A., & Boutron, I.
- Affiliations
- Inserm (FR)
- Corresponding author
- Boutron, Isabelle
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-16
- Volume
- 10
- Issue
- 10
- Pages
- e0140889
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4608738
- OpenAlex
- W2210216123
- Semantic Scholar
- 68d3fa11f0f6e773b5ca14fa0a87d1c5a549272d
- Cited by
- 70
- References
- 46
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 7 · 2023: 5 · 2022: 8 · 2021: 8 · 2020: 11 · 2019: 12 · 2018: 4 · 2017: 6 · 2016: 1
- FWCI
- 7.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Columbia Academic Commons (Columbia University)
- Funders
- École des Hautes Études en Santé Publique
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- health news, Google News, media spin, adverse event reporting, overgeneralization, animal-to-human extrapolation, science communication, online health information
- MeSH terms
- Animals, Cross-Sectional Studies, Humans, Models, Theoretical, Internet, Information Dissemination, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of News. https://app.cochat.ai/papers/10.1371/journal.pone.0140889
- The paper
- Haneef, R., Lazarus, C., Ravaud, P., Yavchitz, A., & Boutron, I. (2015). Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of News. PLOS ONE. https://doi.org/10.1371/journal.pone.0140889
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

