Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of News
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mass media through the Internet is a powerful means of disseminating medical research. We aimed to determine whether and how the interpretation of research results is misrepresented by the use of "spin" in the health section of Google News. Spin was defined as specific way of reporting, from whatever motive (intentional or unintentional), to emphasize that the beneficial effect of the intervention is greater than that shown by the results. METHODS: We conducted a cross-sectional study of news highlighted in the health section of US, UK and Canada editions of Google News between July 2013 and January 2014. We searched for news items for 3 days a week (i.e., Monday, Wednesday, and Friday) during 6 months and selected a sample of 130 news items reporting a scientific article evaluating the effect of an intervention on human health. RESULTS: In total, 78% of the news did not provide a full reference or electronic link to the scientific article. We found at least one spin in 114 (88%) news items and 18 different types of spin in news. These spin were mainly related to misleading reporting (59%) such as not reporting adverse events that were reported in the scientific article (25%), misleading interpretation (69%) such as claiming a causal effect despite non-randomized study design (49%) and overgeneralization/misleading extrapolation (41%) of the results such as extrapolating a beneficial effect from an animal study to humans (21%). We also identified some new types of spin such as highlighting a single patient experience for the success of a new treatment instead of focusing on the group results. CONCLUSIONS: Interpretation of research results was frequently misrepresented in the health section of Google News. However, we do not know whether these spin were from the scientific articles themselves or added in the news.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Media outlets may spin [26–28] and encourage dissemination of eye-catching, potentially overstated, inaccurate [29], and/or misleading headlines in order to gain larger audience size [28, 30, 31].”
From Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review (2018) · cites this paper as [28]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“We restricted our search to Google News because it covers a vast range of news media sources [Filloux, 2013] and has been used previously in media analysis research as the single source of online news media coverage [Haneef et al., 2015;Young Lin and Rosenkrantz, 2017].”
From Scientific research in news media: a case study of misrepresentation, sensationalism and harmful recommendations (2022) · cites this paper as Haneef et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842
Self-citationTranslation of Research Evidence From Animals to Humans
Hackam, D. G., & Redelmeier, D. A. (2006) · JAMA · doi:10.1001/jama.296.14.1731 · Cited by 733 · cited 1×
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundComparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Chan, A.-W., & Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.38356.424606.8f · Cited by 613
When are observational studies as credible as randomised trials?
Vandenbroucke, J. P. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16261-2 · Cited by 538
Coverage by the news media of the benefits and risks of medications
Moynihan, R., Bero, L., Ross-Degnan, D., Henry, D., Lee, K., Watkins, J., Mah, C., & Soumerai, S. B. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006013422206 · Cited by 500 · cited 2×
“For example, in the United States [13] and in Canada [45], 53% and 68% of news stories, respectively, failed to mention the potential harms related to drug treatments for patients and failed to quantify the benefits.”
BackgroundSumner, P., Vivian-Griffiths, S., Boivin, J., Williams, A., Venetis, C. A., Davies, A., Ogden, J., Whelan, L., Hughes, B., Dalton, B., et al. (2014) · BMJ · doi:10.1136/bmj.g7015 · Cited by 489 · cited 3×
“Furthermore, spin in press releases and news items is related to the presence of spin in the abstract conclusions of published articles, and the findings of randomized controlled trials (RCTs) based on press releases and media coverage could be misinterpreted [7, 11].”
BackgroundImportance of the Lay Press in the Transmission of Medical Knowledge to the Scientific Community
Phillips, D. P., Kanter, E. J., Bednarczyk, B., & Tastad, P. L. (1991) · New England Journal of Medicine · doi:10.1056/nejm199110173251620 · Cited by 399
Boutron, I., Altman, D. G., Hopewell, S., Vera-Badillo, F., Tannock, I., & Ravaud, P. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.7503 · Cited by 368
Self-citationYavchitz, A., Boutron, I., Bafeta, A., Marroun, I., Charles, P., Mantz, J., & Ravaud, P. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001308 · Cited by 293 · cited 6×
“Previous studies have focused on spin in RCTs [5, 7, 39, 40], diagnostic test accuracy studies [6, 41], non-randomized studies [14, 16, 42] and epidemiologic studies [43] and demonstrated a high prevalence of spin in published articles.”
BackgroundInfluentialSelf-citationAssessment of Claims of Improved Prediction Beyond the Framingham Risk Score
Tzoulaki, I. (2009) · JAMA · doi:10.1001/jama.2009.1757 · Cited by 276
Chen, X., & Siu, L. L. (2001) · Journal of Clinical Oncology · doi:10.1200/jco.2001.19.23.4291 · Cited by 262
Drugs in the news: an analysis of Canadian newspaper coverage of new prescription drugs.
Cassels, A., Hughes, M. A., Cole, C., Mintzes, B. J., Lexchin, J., & McCormack, J. P. (2003) · Europe PMC (PubMed Central) · Cited by 198
Schwartz, L. M., Woloshin, S., & Welch, H. G. (1999) · New England Journal of Medicine · doi:10.1056/nejm199907223410411 · Cited by 192
Press Releases: Translating Research Into News
Woloshin, S., & Schwartz, L. M. (2002) · JAMA · doi:10.1001/jama.287.21.2856 · Cited by 187
Schwitzer, G. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050095 · Cited by 174
Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013) · Radiology · doi:10.1148/radiol.12120527 · Cited by 158
Brown, A. W., Bohan Brown, M. M., & Allison, D. B. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.064410 · Cited by 155
Schwartz, L. M., Woloshin, S., Andrews, A., & Stukel, T. A. (2012) · BMJ · doi:10.1136/bmj.d8164 · Cited by 136
Policy: Twenty tips for interpreting scientific claims
Sutherland, W. J., Spiegelhalter, D., & Burgman, M. (2013) · Nature · doi:10.1038/503335a · Cited by 129 · cited 1×
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundVera-Badillo, F. E., Shapiro, R., Ocana, A., Amir, E., & Tannock, I. F. (2013) · Annals of Oncology · doi:10.1093/annonc/mds636 · Cited by 117 · cited 1×
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundPress Releases by Academic Medical Centers: Not So Academic?
Woloshin, S., Schwartz, L. M., Casella, S. L., Kennedy, A. T., & Larson, R. J. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-9-200905050-00007 · Cited by 108
Chan, K. B. Y., Man‐Son‐Hing, M., Molnar, F., & Laupacis, A. (2001) · Europe PMC (PubMed Central) · Cited by 102
Prasad, V., Jorgenson, J., Ioannidis, J. P. A., & Cifu, A. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.005 · Cited by 90
Monitoring the quality of medical news reporting: early experience with media doctor
Smith, D. E., Wilson, A. J., & Henry, D. A. (2005) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2005.tb06992.x · Cited by 80
Use of causal language in observational studies of obesity and nutrition
Cofield, S. S., Corona, R. V., & Allison, D. B. (2010) · Obesity Facts · doi:10.1159/000322940 · Cited by 74 · cited 2×
“, implies a cause and effect relationship between the intervention being assessed and the outcome of interest [12]) despite non-randomized study design; 6) concluding a beneficial effect despite lack of a comparator; 7) focus on p-value instead of clinical importance; 8) interpretation of relative risk as absolute ris…”
BackgroundPharmacotherapy and Behavioral Intervention for Alcohol Dependence
Kiefer, F., & Mann, K. F. (2006) · JAMA · doi:10.1001/jama.296.14.1727-b · Cited by 72
The effect of scientific misconduct on the results of clinical trials: A Delphi survey
Al-Marzouki, S., Roberts, I., Marshall, T., & Evans, S. (2005) · Contemporary Clinical Trials · doi:10.1016/j.cct.2005.01.011 · Cited by 70
Reporting of Limitations of Observational Research
Wang, M. T. M., Bolland, M. J., & Grey, A. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.2147 · Cited by 69
Why do the results of randomised and observational studies differ?
Vandenbroucke, J. P. (2011) · BMJ · doi:10.1136/bmj.d7020 · Cited by 65
Overinterpretation of Clinical Applicability in Molecular Diagnostic Research
Lumbreras, B., Parker, L. A., Porta, M., Pollán, M., Ioannidis, J. P. A., & Hernández-Aguado, I. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.121517 · Cited by 65 · cited 1×
“Previous studies have focused on spin in RCTs [5, 7, 39, 40], diagnostic test accuracy studies [6, 41], non-randomized studies [14, 16, 42] and epidemiologic studies [43] and demonstrated a high prevalence of spin in published articles.”
BackgroundInfluence of the News Media on Diagnostic Testing in the Emergency Department
Sharma, V., Dowd, M. D., Swanson, D. S., Slaughter, A. J., & Simon, S. D. (2003) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.157.3.257 · Cited by 61
Causality in complex interventions
Rickles, D. P. (2008) · Medicine Health Care and Philosophy · doi:10.1007/s11019-008-9140-4 · Cited by 59
Comparisons within randomised groups can be very misleading
Bland, M., & Altman, D. G. (2011) · BMJ · doi:10.1136/bmj.d561 · Cited by 58
Listen to the data when results are not significant
Hewitt, C. E., Mitchell, N., & Torgerson, D. J. (2008) · BMJ · doi:10.1136/bmj.39379.359560.ad · Cited by 57
Characteristics of Medical Research News Reported on Front Pages of Newspapers
Lai, W. Y. Y., & Lane, T. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006103 · Cited by 51
Latronico, N., Metelli, M., Turin, M., Piva, S., Rasulo, F. A., & Minelli, C. (2013) · Intensive Care Medicine · doi:10.1007/s00134-013-2947-3 · Cited by 48
Twenty tips for interpreting scientific claims
Sutherland, W. J., Spiegelhalter, D. J., & Burgman, M. A. (2013) · Nature · Cited by 45
Quality of Pharmaceutical Industry Press Releases Based on Original Research
Kuriya, B., Schneid, E. C., & Bell, C. M. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002828 · Cited by 30
Hernandez, A. V., Pasupuleti, V., Deshpande, A., Thota, P., Collins, J. A., & Vidal, J. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063272 · Cited by 29 · cited 1×
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundSpin and Boasting in Research Articles
Cummings, P., & Rivara, F. P. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2012.1461 · Cited by 19 · cited 2×
“, any word or expression emphasizing the beneficial effect of the treatment [10]); and 5) any other type of misleading reporting not classified under the above section.”
BackgroundRhetorical Strategies Used in the Reporting of Implantable Defibrillator Primary Prevention Trials
Wilson, J. R. (2011) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2011.02.320 · Cited by 16
Identifying spin in health management evaluations
Linden, A. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01611.x · Cited by 15
Incomplete reporting of research in academic press releases
Lancet, T. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61044-8 · Cited by 8
Green light signals caution for primate research
Lancet, T. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61043-6 · Cited by 6
The press release, relative risks, and the polypill
McCartney, M. (2011) · BMJ · doi:10.1136/bmj.d4720 · Cited by 5
Cited by
Haber, N., Smith, E. R., Moscoe, E., Andrews, K., Audy, R., Bell, W., Brennan, A. T., Breskin, A., Kane, J. C., Karra, M., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196346 · Cited by 97
“Media outlets may spin [26–28] and encourage dissemination of eye-catching, potentially overstated, inaccurate [29], and/or misleading headlines in order to gain larger audience size [28, 30, 31].”
BackgroundCausal and Associational Language in Observational Health Research: A Systematic Evaluation
Haber, N., Wieten, S. E., Rohrer, J. M., Arah, O. A., Tennant, P. W. G., Stuart, E. A., Murray, E. J., Pilleron, S., Lam, S. T., Riederer, E., et al. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac137 · Cited by 113
Magni, P., Bier, D. M., Pecorelli, S., Agostoni, C. V., Astrup, A. V., Brighenti, F., Cook, R., Folco, E., Fontana, L., Gibson, R. A., et al. (2017) · Advances in Nutrition · doi:10.3945/an.116.014738 · Cited by 97
“Recently, 18 kinds of media spin were identified, and $1 spin was found in 88% of media research reports: 25% failed to report adverse events mentioned in the scientific article, 49% claimed a causal effect despite a nonrandomized study design, and 21% extrapolated a beneficial effect from an animal study to humans (7…”
Dempster, G., Sutherland, G., & Keogh, L. (2022) · Journal of Science Communication · doi:10.22323/2.21010206 · Cited by 71
“In the context of scientific research, spin has been described as communicating findings so that the benefits of an intervention seem stronger or more positive than they actually are [Haneef et al., 2015].”
BackgroundMethodResultInfluentialClaims of causality in health news: a randomised trial
Adams, R. C., Challenger, A., Bratton, L., Boivin, J., Bott, L., Powell, G., Williams, A., Chambers, C. D., & Sumner, P. (2019) · BMC Medicine · doi:10.1186/s12916-019-1324-7 · Cited by 69
“For example, in a sample of 130 prominent health stories, 49% had causal claims based on non-randomised designs [6] (see also Additional file 1: Figure S1).”
Background
Metadata
- Authors
- Haneef, R., Lazarus, C., Ravaud, P., Yavchitz, A., & Boutron, I.
- Affiliations
- Inserm (FR)
- Corresponding author
- Boutron, Isabelle
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-16
- Volume
- 10
- Issue
- 10
- Pages
- e0140889
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4608738
- OpenAlex
- W2210216123
- Semantic Scholar
- 68d3fa11f0f6e773b5ca14fa0a87d1c5a549272d
- Cited by
- 70
- References
- 46
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 7 · 2023: 5 · 2022: 8 · 2021: 8 · 2020: 11 · 2019: 12 · 2018: 4 · 2017: 6 · 2016: 1
- FWCI
- 7.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Columbia Academic Commons (Columbia University)
- Funders
- École des Hautes Études en Santé Publique
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- health news, Google News, media spin, adverse event reporting, overgeneralization, animal-to-human extrapolation, science communication, online health information
- MeSH terms
- Animals, Cross-Sectional Studies, Humans, Models, Theoretical, Internet, Information Dissemination, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

