Defining and Measuring Scientific Misinformation
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
We define scientific misinformation as publicly available information that is misleading or deceptive relative to the best available scientific evidence and that runs contrary to statements by actors or institutions who adhere to scientific principles. Scientific misinformation violates the supposition that claims should be based on scientific evidence and relevant expertise. As such, misinformation is observable and measurable, but research on scientific misinformation to date has often missed opportunities to clearly articulate units of analysis, to consult with experts, and to look beyond convenient sources of misinformation such as social media content. We outline the ways in which scientific misinformation can be thought of as a disorder of public science, identify its specific types and the ways in which it can be measured, and argue that researchers and public actors should do more to connect measurements of misinformation with measurements of effect.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“…Kata 2010) or through other computational tools (e.g., tingley and wagner 2017), and others do a combination of the two to validate analysis (e.g., Vosoughi, roy, and Aral 2018). these studies are useful to understand the types of content to which people are exposed and whether some types are…”
BackgroundThe Structure of Scientific Revolutions
Kuhn, T. S. (1996) · doi:10.7208/chicago/9780226458106.001.0001 · Cited by 7,281
Beyond misinformation: Understanding and coping with the “post-truth” era.
Lewandowsky, S., Ecker, U. K. H., & Cook, J. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.07.008 · Cited by 1,985
Houts, P. S., Doak, C. C., Doak, L. G., & Loscalzo, M. J. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.05.004 · Cited by 1,624
A postmodern Pandora's box: anti-vaccination misinformation on the internet
Kata, A. (2010) · Vaccine · doi:10.1016/j.vaccine.2009.12.022 · Cited by 1,208 · cited 1×
“…some researchers defer to decisions made by factchecking organizations (e.g., Zeng and chan 2021), others code the information themselves (e.g., Kata 2010) or through other computational tools (e.g., tingley and wagner 2017), and others do a combination of the two to validate analysis (e.g.,…”
BackgroundVisual Persuasion: The Role of Images in Advertising
Messaris, P. (1997) · doi:10.4135/9781452233444 · Cited by 684 · cited 1×
“Messaris (1997) notes that judging consequential deception stemming from the visual dimension of advertising is difficult because, unlike written language, visual communication lacks explicit propositional syntax to guide interpretation of elements. researchers have attempted to demonstrate…”
BackgroundZika virus pandemic—analysis of Facebook as a social media health information platform
Sharma, M., Yadav, K., Yadav, N., & Ferdinand, K. C. (2017) · American Journal of Infection Control · doi:10.1016/j.ajic.2016.08.022 · Cited by 426
Beyond (Mis)Representation: Visuals in COVID-19 Misinformation
Brennen, J. S., Simon, F. M., & Nielsen, R. K. (2021) · The International Journal of Press/Politics · doi:10.1177/1940161220964780 · Cited by 179
Self-citationDixon, G. N., McKeever, B. W., Holton, A. E., Clarke, C., & Eosco, G. (2015) · Journal of Communication · doi:10.1111/jcom.12159 · Cited by 106
Cited by
Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment
Pareek, S., van Berkel, N., Velloso, E., & Goncalves, J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686922 · Cited by 42
A Vision for University Biology Education for Non-science Majors
Gormally, C., & Heil, A. (2022) · CBE—Life Sciences Education · doi:10.1187/cbe.21-12-0338 · Cited by 28
A Pandemic of Misinformation: Understanding Influences on Beliefs in Health and Conspiracy Myths
Carletto, E., Carson, K. A., Yeh, H.-C., Dietz, K., Showell, N., Marsteller, J. A., & Cooper, L. A. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-024-08867-8 · Cited by 15
Reconceptualizing Epistemic Dependence for Future Scientific Literacy: A Lesson from the LK-99 Case
Lee, G., & Zhai, X. (2025) · Research in Science Education · doi:10.1007/s11165-025-10247-z · Cited by 3
“…dissemination, and consumption of information have become global and multilateral in the twenty-first century, due to the development of information and communication technologies, social media, and even generative artificial intelligence (Southwell et al., 2022; West & Bergstrom, 2021).”
Metadata
- Authors
- Southwell, B. G., Brennen, J. S. B., Paquin, R., Boudewyns, V., & Zeng, J.
- Venue
- The ANNALS of the American Academy of Political and Social Science
- Publisher
- SAGE Publications
- Published
- 2022-03
- Volume
- 700
- Issue
- 1
- Pages
- 98-111
- ISSN
- 0002-7162 (ISSN-L)
- 1552-3349
- OpenAlex
- W4229067106
- Cited by
- 134
- References
- 10
- FWCI
- 41.94
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Defining and Measuring Scientific Misinformation. https://app.cochat.ai/papers/10.1177/00027162221084709
- The paper
- Southwell, B. G., Brennen, J. S. B., Paquin, R., Boudewyns, V., & Zeng, J. (2022). Defining and Measuring Scientific Misinformation. The ANNALS of the American Academy of Political and Social Science. https://doi.org/10.1177/00027162221084709
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.