Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 41

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements

Pfänder, Jan, Altay, Sacha · 2025 · Nature Human Behaviour

Abstract

How good are people at judging the veracity of news? We conducted a systematic literature review and pre-registered meta-analysis of 303 effect sizes from 67 experimental articles evaluating accuracy ratings of true and fact-checked false news ( N Participants = 194,438 from 40 countries across 6 continents). We found that people rated true news as more accurate than false news (Cohen’s d = 1.12 [1.01, 1.22]) and were better at rating false news as false than at rating true news as true (Cohen’s d = 0.32 [0.24, 0.39]). In other words, participants were able to discern true from false news and erred on the side of skepticism rather than credulity. We found no evidence that the political concordance of the news had an effect on discernment, but participants were more skeptical of politically discordant news (Cohen’s d = 0.78 [0.62, 0.94]). These findings lend support to crowdsourced fact-checking initiatives and suggest that, to improve discernment, there is more room to increase the acceptance of true news than to reduce the acceptance of fact-checked false news.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41562-024-02086-1

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 29 references

Research works printed but not linked: 91

  1. Egelhofer, J. L., Boyer, M., Lecheler, S. & Aaldering, L. Populist attitudes and politicians’ disinformation accusations: effects on perceptions of media and politicians. J. Commun. 72, 619–632 (2022). · DOI
  2. Brennen, T. & Magnussen, S. Lie detection: what works? Curr. Dir. Psychol. Sci. 32, 395–401 (2023). · DOI
  3. Mont’Alverne, C. et al. The trust gap: how and why news on digital platforms is viewed more sceptically versus news in general. Reuters Institute https://doi.org/10.60625/risj-skfk-h856 (2022). · doi:10.60625/risj-skfk-h856
  4. Metzger, M. J. Making sense of credibility on the Web: models for evaluating online information and recommendations for future research. J. Am. Soc. Inf. Sci. Technol. 58, 2078–2091 (2007). · DOI · Paper page
  5. Ross Arguedas, A. et al. Snap judgements: how audiences who lack trust in news navigate information on digital platforms. Reuters Institute https://doi.org/10.60625/risj-64ja-0s18 (2022). · doi:10.60625/risj-64ja-0s18
  6. Altay, S., Lyons, B. & Modirrousta-Galian, A. Exposure to higher rates of false news erodes media trust and fuels skepticism in news judgment. Mass Commun. Soc. https://doi.org/10.1080/15205436.2024.2382776 (2024). · DOI
  7. Pennycook, G. & Rand, D. G. Lazy, not biased: susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition 188, 39–50 (2019). · DOI · Paper page
  8. Schulz, A., Fletcher, R. & Popescu, M. Are news outlets viewed in the same way by experts and the public? A comparison across 23 European countries. Reuters Institute https://doi.org/10.60625/risj-nbg4-8b23 (2020). · doi:10.60625/risj-nbg4-8b23
  9. Mourão, R. R. & Robertson, C. T. Fake news as discursive integration: an analysis of sites that publish false, misleading, hyperpartisan and sensational information. Journal. Stud. 20, 2077–2095 (2019).
  10. Chen, X., Pennycook, G. & Rand, D. What makes news sharable on social media? J. Quant. Descr. Digit. Media https://doi.org/10.51685/jqd.2023.007 (2023). · DOI
  11. Altay, S., de Araujo, E. & Mercier, H. "If this account is true, it is most enormously wonderful": interestingness-if-true and the sharing of true and false news. Digit. Journal. 10, 373–394 (2022).
  12. Mercier, H. Not Born Yesterday: The Science of Who We Trust and What We Believe (Princeton Univ. Press, 2020). · DOI
  13. Brashier, N. M. & Marsh, E. J. Judging truth. Annu. Rev. Psychol. 71, 499–515 (2020). · DOI · Paper page
  14. Street, C. N. H. & Masip, J. The source of the truth bias: heuristic processing? Scand. J. Psychol. 56, 254–263 (2015). · DOI
  15. Newman, N., Fletcher, R., Robertson, C. T., Eddy, K. & Nielsen, R. K. Digital News Report 2022. Reuters Institute https://doi.org/10.60625/risj-x1gn-m549 (2022). · doi:10.60625/risj-x1gn-m549
  16. Mihailidis, P. & Foster, B. The cost of disbelief: fracturing news ecosystems in an age of rampant media cynicism. Am. Behav. Sci. 65, 616–631 (2021). · DOI
  17. Egelhofer, J. L. & Lecheler, S. Fake news as a two-dimensional phenomenon: a framework and research agenda. Ann. Int. Commun. Assoc. 43, 97–116 (2019).
  18. Van Duyn, E. & Collier, J. Priming and fake news: the effects of elite discourse on evaluations of news media. Mass Commun. Soc. 22, 29–48 (2019). · DOI · Paper page
  19. Ulusoy, E. et al. Flooding the zone: how exposure to implausible statements shapes subsequent belief judgments. Int. J. Public Opin. Res. 33, 856–872 (2021). · DOI
  20. Batailler, C., Brannon, S. M., Teas, P. E. & Gawronski, B. A signal detection approach to understanding the identification of fake news. Perspect. Psychol. Sci. 17, 78–98 (2022). · DOI · Paper page
  21. Modirrousta-Galian, A. & Higham, P. A. Gamified inoculation interventions do not improve discrimination between true and fake news: reanalyzing existing research with receiver operating characteristic analysis. J. Exp. Psychol. Gen. 152, 2411 (2023). · DOI
  22. Guay, B., Berinsky, A. J., Pennycook, G. & Rand, D. How to think about whether misinformation interventions work. Nat. Hum. Behav. 7, 1231–1233 (2023). · DOI
  23. Higgins, J. P. et al. Cochrane Handbook for Systematic Reviews of Interventions (John Wiley & Sons, 2019). · DOI · Paper page
  24. Rathje, S., Roozenbeek, J., Van Bavel, J. J. & van der Linden, S. Accuracy and social motivations shape judgements of (mis)information. Nat. Hum. Behav. 7, 892–903 (2023). · DOI
  25. Globig, L. K., Holtz, N. & Sharot, T. Changing the incentive structure of social media platforms to halt the spread of misinformation. eLife 12, e85767 (2023). · DOI
  26. Altay, S., Berriche, M. & Acerbi, A. Misinformation on misinformation: conceptual and methodological challenges. Soc. Media Soc. https://doi.org/10.1177/20563051221150412 (2023). · DOI · Paper page
  27. Altay, S., Fletcher, R. & Nielsen, R. K. News participation is declining: evidence from 46 countries between 2015 and 2022. New Media Soc. https://doi.org/10.1177/14614448241247822 (2024). · DOI
  28. Newman, N., Fletcher, R., Eddy, K., Robertson, C. T. & Nielsen, R. K. Digital news report 2023. Reuters Institute https://doi.org/10.60625/risj-p6es-hb13 (2023). · doi:10.60625/risj-p6es-hb13
  29. Altay, S., De Angelis, A. & Hoes, E. Media literacy tips promoting reliable news improve discernment and enhance trust in traditional media. Commun. Psychol. 2, 74 (2024). · DOI
  30. Guay, B., Berinsky, A., Pennycook, G. & Rand, D. How to think about whether misinformation interventions work. Nat. Hum. Behav. 7, 1231–1233 (2023). · DOI
  31. Higham, P. A., Modirrousta-Galian, A. & Seabrooke, T. Mean rating difference scores are poor measures of discernment: the role of response criteria. Curr. Opin. Psychol. 56, 101785 (2024). · DOI
  32. Bachmann, I. & Valenzuela, S. Studying the downstream effects of fact-checking on social media: experiments on correction formats, belief accuracy, and media trust. Soc. Media Soc. https://doi.org/10.1177/20563051231179694 (2023). · DOI
  33. Besalú, R. & Pont-Sorribes, C. Credibility of digital political news in Spain: comparison between traditional media and social media. Soc. Sci. 10, 170 (2021). · DOI
  34. Karlsen, R. & Aalberg, T. Social media and trust in news: an experimental study of the effect of Facebook on news story credibility. Digit. Journal. 11, 144–160 (2023).
  35. Agadjanian, A. et al. A platform penalty for news? How social media context can alter information credibility online. J. Inf. Technol. Politics 20, 338–348 (2023). · DOI
  36. Gawronski, B., Ng, N. L. & Luke, D. M. Truth sensitivity and partisan bias in responses to misinformation. J. Exp. Psychol. Gen. 152, 2205–2236 (2023). · DOI
  37. Trouche, E., Johansson, P., Hall, L. & Mercier, H. Vigilant conservatism in evaluating communicated information. PLoS ONE 13, e0188825 (2018). · DOI
  38. Altay, S., Hacquin, A.-S. & Mercier, H. Why do so few people share fake news? It hurts their reputation. New Media Soc. 24, 1303–1324 (2022). · DOI · Paper page
  39. Garrett, R. K. & Bond, R. M. Conservatives’ susceptibility to political misperceptions. Sci. Adv. 7, eabf1234 (2021). · DOI · Paper page
  40. Aslett, K. et al. Online searches to evaluate misinformation can increase its perceived veracity. Nature 625, 548–556 (2024). · DOI
  41. Pennycook, G., Binnendyk, J., Newton, C. & Rand, D. G. A practical guide to doing behavioral research on fake news and misinformation. Collabra Psychol. 7, 25293 (2021). · DOI · Paper page
  42. Calvillo, D. P. & Smelter, T. J. An initial accuracy focus reduces the effect of prior exposure on perceived accuracy of news headlines. Cogn. Res. Princ. Implic. 5, 55 (2020). · DOI
  43. Baptista, J. P., Correia, E., Gradim, A. & Piñeiro-Naval, V. The influence of political ideology on fake news belief: the Portuguese case. Publications 9, 23 (2021). · DOI
  44. Maertens, R. et al. The Misinformation Susceptibility Test (MIST): a psychometrically validated measure of news veracity discernment. Behav. Res. Methods 56, 1863–1899 (2024). · DOI
  45. Roozenbeek, J. et al. Susceptibility to misinformation about COVID-19 around the world. R. Soc. Open Sci. 7, 201199 (2020). · DOI · Paper page
  46. Bryanov, K. et al. What drives perceptions of foreign news coverage credibility? A cross-national experiment including Kazakhstan, Russia, and Ukraine. Polit. Commun. 40, 115–146 (2023). · DOI
  47. Ali, A. & Qazi, I. A. Digital literacy and vulnerability to misinformation: evidence from Facebook users in Pakistan. J. Quant. Descr. Digit. Media https://doi.org/10.51685/jqd.2022.025 (2022). · DOI
  48. Allen, J., Arechar, A. A., Pennycook, G. & Rand, D. G. Scaling up fact-checking using the wisdom of crowds. Sci. Adv. 7, eabf4393 (2021). (2021). · DOI · Paper page
  49. Altay, S. & Gilardi, F. People are skeptical of headlines labeled as ai-generated, even if true or human-made, because they assume full AI automation. OSF https://doi.org/10.31234/osf.io/83k9r (2023). · DOI
  50. Altay, S., Nielsen, R. K. & Fletcher, R. The impact of news media and digital platform use on awareness of and belief in COVID-19 misinformation. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/7tm3s (2022). · doi:10.31234/osf.io/7tm3s
  51. Badrinathan, S. Educative Interventions to combat misinformation: evidence from a field experiment in India. Am. Polit. Sci. Rev. 115, 1325–1341 (2021). · DOI · Paper page
  52. Bago, B., Rosenzweig, L. R., Berinsky, A. J. & Rand, D. G. Emotion may predict susceptibility to fake news but emotion regulation does not seem to help. Cogn. Emot. 36, 1166–1180 (2022). · DOI
  53. Basol, M. et al. Towards psychological herd immunity: cross-cultural evidence for two prebunking interventions against COVID-19 misinformation. Big Data Soc. 8, 205395172110138 (2021). · DOI · Paper page
  54. Clemm von Hohenberg, B. Truth and bias, left and right: testing ideological asymmetries with a realistic news supply. Public Opin. Q. 87, 267–292 (2023). · DOI
  55. Erlich, A. & Garner, C. Is pro-Kremlin disinformation effective? Evidence from Ukraine. Int. J. Press Polit. 28, 5–28 (2023). · DOI
  56. Espina Mairal, S., Bustos, F., Solovey, G. & Navajas, J. Interactive crowdsourcing to fact-check politicians. J. Exp. Psychol. Appl. 30, 3–15 (2024). · DOI
  57. Lee, E. J. & Jang, J. How political identity and misinformation priming affect truth judgments and sharing intention of partisan news. Digit. Journal. 11, 226–245 (2023).
  58. Faragó, L., Krekó, P. & Orosz, G. Hungarian, lazy, and biased: the role of analytic thinking and partisanship in fake news discernment on a Hungarian representative sample. Sci. Rep. 13, 178 (2023). · DOI
  59. Fazio, L. et al. Combating misinformation: a megastudy of nine interventions designed to reduce the sharing of and belief in false and misleading headlines. OSF https://doi.org/10.31234/osf.io/uyjha (2024). · DOI
  60. Gottlieb, J., Adida, C. & Moussa, R. Reducing misinformation in a polarized context: experimental evidence from Côte d’Ivoire. OSF Preprints https://doi.org/10.31219/osf.io/6x4wy (2022). · DOI
  61. Guess, A. M. et al. A digital media literacy intervention increases discernment between mainstream and false news in the United States and India. Proc. Natl. Acad. Sci. USA 117, 15536–15545 (2020). · DOI · Paper page
  62. Guess, A., McGregor, S., Pennycook, G. & Rand, D. Unbundling digital media literacy tips: results from two experiments. OSF https://doi.org/10.31234/osf.io/u34fp (2024). · doi:10.31234/osf.io/u34fp
  63. Hameleers, M. et al. Mistakenly misinformed or intentionally deceived? Mis- and disinformation perceptions on the Russian War in Ukraine among citizens in 19 countries. Eur. J. Polit. Res. https://doi.org/10.1111/1475-6765.12646 (2023). · DOI
  64. Hlatky, R. Unintended consequences? Russian disinformation and public opinion. OSF https://doi.org/10.31219/osf.io/85vmt (2024). · DOI
  65. Koetke, J., Schumann, K., Porter, T. & Smilo-Morgan, I. Fallibility salience increases intellectual humility: implications for people’s willingness to investigate political misinformation. Pers. Soc. Psychol. Bull. 49, 806–820 (2023). · DOI
  66. Kreps, S. E. & Kriner, D. L. Assessing misinformation recall and accuracy perceptions: evidence from the COVID-19 pandemic. Harv. Kennedy Sch. Misinformation Rev. https://doi.org/10.37016/mr-2020-123 (2023). · DOI
  67. Lutzke, L., Drummond, C., Slovic, P. & Árvai, J. Priming critical thinking: simple interventions limit the influence of fake news about climate change on Facebook. Glob. Environ. Change 58, 101964 (2019). · DOI · Paper page
  68. Lyons, B., King, A. J. & Kaphingst, K. A health media literacy intervention increases skepticism of both inaccurate and accurate cancer news among U.S. adults. OSF Preprints https://doi.org/10.31219/osf.io/hm9ty (2024). · doi:10.31219/osf.io/hm9ty
  69. Lyons, B., Modirrousta-Galian, A., Altay, S. & Salovich, N. A. Reduce blind spots to improve news discernment? Performance feedback reduces overconfidence but does not improve subsequent discernment. OSF Preprints https://doi.org/10.31219/osf.io/kgfrb (2024). · DOI
  70. Lyons, B., Montgomery, J. & Reifler, J. Partisanship and older Americans’ engagement with dubious political news. OSF https://doi.org/10.31219/osf.io/etb89 (2023). · DOI
  71. Lühring, J. et al. Emotions in misinformation studies: distinguishing affective state from emotional response and misinformation recognition from acceptance. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/udqms (2023). · DOI
  72. Martel, C., Pennycook, G. & Rand, D. G. Reliance on emotion promotes belief in fake news. Cogn Res Princ Implic 5, 47 (2020). · DOI · Paper page
  73. Modirrousta-Galian, A., Higham, P. A. & Seabrooke, T. Effects of inductive learning and gamification on news veracity discernment. J. Exp. Psychol. Appl. 29, 599–619 (2023). · DOI
  74. Modirrousta-Galian, A., Higham, P. A. & Seabrooke, T. Wordless wisdom: the dominant role of tacit knowledge in true and fake news discrimination. J. Appl. Res. Mem. Cogn. https://doi.org/10.1037/mac0000151 (2024). · DOI
  75. Muda, R., Pennycook, G., Hamerski, D. & Białek, M. People are worse at detecting fake news in their foreign language. J. Exp. Psychol. Appl. 29, 712–724 (2023). · DOI
  76. OECD. An international effort using behavioural science to tackle the spread of misinformation. OECD Public Governance Policy Papers 21; OECD Public Governance Policy Papers, Vol. 21 https://doi.org/10.1787/b7709d4f-en (2022). · DOI
  77. Orosz, G., Paskuj, B., Faragó, L. & Krekó, P. A prosocial fake news intervention with durable effects. Sci. Rep. 13, 3958 (2023). · DOI · Paper page
  78. Pehlivanoglu, D. et al. The role of analytical reasoning and source credibility on the evaluation of real and fake full-length news articles. Cogn. Res. Princ. Implic. 6, 24 (2021). · DOI
  79. Pereira, F. B., Bueno, N. S., Nunes, F. & Pavão, N. Inoculation reduces misinformation: experimental evidence from multidimensional interventions in Brazil. J. Exp. Polit. Sci. 11, 239–250 (2024). (2023). · DOI
  80. Peren Arin, K., Mazrekaj, D. & Thum, M. Ability of detecting and willingness to share fake news. Sci. Rep. 13, 7298 (2023). · DOI
  81. Roozenbeek, J. et al. Susceptibility to misinformation is consistent across question framings and response modes and better explained by myside bias and partisanship than analytical thinking. Judgm. Decis. Mak. 17, 27 (2022). · DOI
  82. Rosenzweig, L. R., Bago, B., Berinsky, A. J. & Rand, D. G. Happiness and surprise are associated with worse truth discernment of COVID-19 headlines among social media users in Nigeria. Harv. Kennedy Sch. Misinformation Rev. https://doi.org/10.37016/mr-2020-75 (2021). · DOI
  83. Ross, B., Heisel, J., Jung, A.-K. & Stieglitz, S. Fake news on social media: the (in)effectiveness of warning messages. In Proc. 39th International Conference on Information Systems Article 16 (Association for Information Systems, 2018).
  84. Ross, R. M., Rand, D. G. & Pennycook, G. Beyond “fake news”: analytic thinking and the detection of false and hyperpartisan news headlines. Judgm. Decis. Mak. 16, 22 (2021). · DOI
  85. Shirikov, A. Fake news for all: how citizens discern disinformation in autocracies. Polit. Commun. 41, 45–65 (2024). · DOI
  86. Stagnaro, M., Pink, S., Rand, D. G. & Willer, R. Increasing accuracy motivations using moral reframing does not reduce Republicans’ belief in false news. Harv. Kennedy Sch. Misinformation Rev. 10.37016/mr-2020–128 (2023). · DOI
  87. Sultan, M. et al. Time pressure reduces misinformation discrimination ability but does not alter response bias. Sci. Rep. 12, 22416 (2022). · DOI
  88. Winter, S. et al. (Don’t) stop believing: a signal detection approach to risk and protective factors for engagement with politicized (mis)information in social media. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/84c36 (2024). · DOI
  89. Viechtbauer, W. Conducting meta-analyses in R with the metafor package. J. Stat. Softw. 36, 1–48 (2010). · DOI · Paper page
  90. Gibbons, R. D., Hedeker, D. R. & Davis, J. M. Estimation of effect size from a series of experiments involving paired comparisons. J. Educ. Stat. 18, 271–279 (1993). · DOI · Paper page
  91. Pfänder, J. & Altay, S. News accuracy meta analysis. OSF https://doi.org/10.17605/OSF.IO/96ZBP (2025). · DOI

Cited by

See all 41

Metadata

Authors
Pfänder, J., & Altay, S.
Venue
Nature Human Behaviour
Published
2025-02-21
Volume
9
Issue
4
Pages
688-699
ISSN
2397-3374
Cited by
41
References
29
Language
en
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements. https://app.cochat.ai/papers/10.1038/s41562-024-02086-1
The paper
Pfänder, J., & Altay, S. (2025). Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements. Nature Human Behaviour. https://doi.org/10.1038/s41562-024-02086-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.