The DOI matches its Crossref record; 88 of the 89 references it cites were found in a registry or an index.
Fact-Checking: A Meta-Analysis of What Works and for Whom
Abstract
Despite its growing prominence in news coverage and public discourse, there is still considerable ambiguity regarding when and how fact-checking affects beliefs. Informed by theories of motivated reasoning and message design, a meta-analytic review was undertaken to examine the effectiveness of fact-checking in correcting political misinformation (k = 30,N = 20,963). Fact-checking has a significantly positive overall influence on political beliefs (d = 0.29), but the effects gradually weaken when using “truth scales,” refuting only parts of a claim, and fact-checking campaign-related statements. Likewise, the ability to correct political misinformation with fact-checking is substantially attenuated by participants’ preexisting beliefs, ideology, and knowledge. The study concludes with a discussion of the fact-checking literature in light of current gaps and future opportunities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“studies that show that emotionalised online environments influence people’s real-world attitudes on polarization, politics, or belief in false information (Martel et al., 2020; Walter et al., 2020; Van Bavel et al., 2021)”
From On manipulation by emotional AI: UK adults’ views and governance implications (2024) · cites this paper as Walter et al., 2020
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
The Nature and Origins of Mass Opinion
Zaller, J. R. (1992) · doi:10.1017/cbo9780511818691 · Cited by 7,785 · cited 1×
“Despite this expectation of a strong effect of fact-checkers, Zaller (1992) argues that not all information is used to shape beliefs and that people combine portions of available information with preexisting opinions when forming their political beliefs.”
BackgroundMethods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Petty, R. E., & Cacioppo, J. T. (1986) · doi:10.1007/978-1-4612-4964-1 · Cited by 5,219
Research works printed but not linked: 9
- 10.1515/9781400888740 · doi:10.1515/9781400888740
- Borenstein M., 2005, Comprehensive meta-analysis version 3.0
- 10.1002/polq.v132.4 · doi:10.1002/polq.v132.4
- *Jarman J. W., 2014, Disturbing argument: Selected papers from the 18th biennial conference on argumentation (pp. 174-180)
- 10.1037/0033-2909.106.2.290 · doi:10.1037/0033-2909.106.2.290 · Paper page
- Nyhan B., 2012, Misinformation and fact-checking: Research findings from social science
- *Pennycook, G. & Rand, D. G. (2017). The implied truth effect: Attaching warnings to a subset of fake news stories increases perceived accuracy of stories without warnings (Unpublished manuscript). Retrieved from: https://www.researchgate.net/profile/Gordon_Pennycook/publication/321887941_The_Implied_Truth_Effect_Attaching_warnings_to_a_subset_of_fake_news_headlines_increases_perceived_accuracy_of_headlines_without_warnings/links/5a38347b0f7e9b7c486f7f19/The-Implied-Truth-Effect-Attaching-warnings-to-a-subset-of-fake-news-headlines-increases-perceived-accuracy-of-headlines-without-warnings.pdf
- Stencel M., 2015, “Fact check this”: How U.S. politics adapts to media scrutiny
- *Wintersieck, A. (2015). The rise and impact of fact-checking in U.S. campaigns (Doctoral dissertation). Arizona State University. Available from ProQuest database (UMI no. 3701377).
Cited by
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
“Another commonly used approach involves attaching warnings to content that professional fact-checkers have found to be false (reviewed in [80,81]).”
BackgroundOur future in the Anthropocene biosphere
Folke, C., Polasky, S., Rockström, J., Galaz, V., Westley, F., Lamont, M., Scheffer, M., Österblom, H., Carpenter, S. R., Chapin, F. S., et al. (2021) · Ambio · doi:10.1007/s13280-021-01544-8 · Cited by 696
Exposure to untrustworthy websites in the 2016 US election
Guess, A. M., Nyhan, B., & Reifler, J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0833-x · Cited by 587
Evaluating the Impact of Attempts to Correct Health Misinformation on Social Media: A Meta-Analysis
Walter, N., Brooks, J. J., Saucier, C. J., & Suresh, S. (2021) · Health Communication · doi:10.1080/10410236.2020.1794553 · Cited by 374
Self-citationTsfati, Y., Boomgaarden, H. G., Strömbäck, J., Vliegenthart, R., Damstra, A., & Lindgren, E. (2020) · Annals of the International Communication Association · doi:10.1080/23808985.2020.1759443 · Cited by 337
Metadata
- Authors
- Walter, N., Cohen, J., Holbert, R. L., & Morag, Y.
- Affiliations
- Northwestern University (US)
- University of Haifa (IL)
- Temple University (US)
- Corresponding author
- Walter, Nathan
- Venue
- Political Communication
- Publisher
- Informa UK Limited
- Published
- 2019-10-24
- Volume
- 37
- Issue
- 3
- Pages
- 350-375
- ISSN
- 1058-4609 (ISSN-L)
- 1091-7675
- OpenAlex
- W2982071752
- Cited by
- 690
- References
- 89
- Citations by year
- 2026: 97 · 2025: 147 · 2024: 122 · 2023: 125 · 2022: 102 · 2021: 74 · 2020: 23
- FWCI
- 12.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Communication (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Sociology and Political Science › Media Influence and Politics
- Social Sciences › Communication › Social Media and Politics
- Keywords
- fact-checking, political misinformation, political beliefs, motivated reasoning, message design, partisanship, political knowledge, belief correction, campaign statements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fact-Checking: A Meta-Analysis of What Works and for Whom. https://app.cochat.ai/papers/10.1080/10584609.2019.1668894
- The paper
- Walter, N., Cohen, J., Holbert, R. L., & Morag, Y. (2020). Fact-Checking: A Meta-Analysis of What Works and for Whom. Political Communication. https://doi.org/10.1080/10584609.2019.1668894
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.