Beyond “fake news”: Analytic thinking and the detection of false and hyperpartisan news headlines
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Why is misleading partisan content believed and shared? An influential account posits that political partisanship pervasively biases reasoning, such that engaging in analytic thinking exacerbates motivated reasoning and, in turn, the acceptance of hyperpartisan content. Alternatively, it may be that susceptibility to hyperpartisan content is explained by a lack of reasoning. Across two studies using different participant pools (total N = 1,973 Americans), we had participants assess true, false, and hyperpartisan news headlines taken from social media. We found no evidence that analytic thinking was associated with judging politically consistent hyperpartisan or false headlines to be accurate and unbiased. Instead, analytic thinking was, in most cases, associated with an increased tendency to distinguish true headlines from both false and hyperpartisan headlines (and was never associated with decreased discernment). These results suggest that reasoning typically helps people differentiate between low and high quality political news, rather than facilitate belief in misleading content. Because social media play an important role in the dissemination of misinformation, we also investigated willingness to share headlines on social media. We found a similar pattern whereby analytic thinking was not generally associated with increased willingness to share hyperpartisan or false headlines. Together, these results suggest a positive role for reasoning in resisting misinformation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“Moreover, research suggests that false news stories may spread as much (Grinberg, Joseph, Friedland, Swire-Thompson & Lazer, 2019) or more (Vosoughi, Roy & Aral, 2018) on social media than news stories that have been fact-checked to be true.”
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Dual-Process Theories of Higher Cognition: Advancing the Debate
Evans, J. S. B. T., & Stanovich, K. E. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612460685 · Cited by 4,271 · cited 1×
“Past work has operated under the framework of dual-process theory, which distinguishes between two types of cognitive processes (Evans & Stanovich, 2013; Kahneman, 2011; Pennycook, Fugelsang & Koehler, 2015b): System 1 “intuitive” processes that do not require working memory, and are often fast and…”
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160 · cited 1×
“A particularly flagrant form of misinformation is fake news , which refers to blatantly fabricated information that mimics online news media in form but not in content and can be political or non-political (Lazer et al., 2018).”
Self-citationIndividual differences in need for cognitive closure.
Webster, D. M., & Kruglanski, A. W. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.67.6.1049 · Cited by 2,494
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022
Self-citationFake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715
Self-citationLess than you think: Prevalence and predictors of fake news dissemination on Facebook
Guess, A., Nagler, J., & Tucker, J. (2019) · Science Advances · doi:10.1126/sciadv.aau4586 · Cited by 1,652 · cited 4×
“23 participants (1.15% of the data) did not respond to this question and were removed from all analyses. political party affiliation (response options: Democrat, Republican, Independent, other), a political preference question (see materials section), a social liberal versus social conservative question, an economic lib…”
InfluentialPennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360 · cited 6×
“…2019; Guess, Nyhan & Reifler, 2020), false content is likely to have an impact on individual beliefs (Guess, Lockett, et al., 2020) — for example, the “Pizzagate” incident (Hsu, 2017, June 13) or false beliefs about Donald Trump winning the 2020 U.S. Presidential Election (Pennycook & Rand, 2021a).”
InfluentialSelf-citationIdeology, motivated reasoning, and cognitive reflection
Kahan, D. M. (2013) · Judgment and Decision Making · doi:10.1017/s1930297500005271 · Cited by 1,302 · cited 2×
“Here, we refer to the more specific “motivated system 2 reasoning” account that focuses on the impact of deliberation on political polarization (Kahan, 2013, 2017; Kahan, Peters, Dawson & Slovic, 2017). texts: Whereas MS2R argues that explicit reasoning typically facilitates politically biased…”
Prior exposure increases perceived accuracy of fake news
Pennycook, G., Cannon, T. D., & Rand, D. G. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000465 · Cited by 1,268 · cited 1×
“This may be problematic, because even a single prior exposure to a false political headline can increase later belief in the headline (Pennycook, Cannon & Rand, 2018).”
Shifting attention to accuracy can reduce misinformation online
Pennycook, G., Epstein, Z., Mosleh, M., Arechar, A. A., Eckles, D., & Rand, D. G. (2021) · Nature · doi:10.1038/s41586-021-03344-2 · Cited by 1,155
Self-citationMotivated numeracy and enlightened self-government
KAHAN, D. M., PETERS, E., DAWSON, E. C., & SLOVIC, P. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.2 · Cited by 990 · cited 4×
“…to the more specific “motivated system 2 reasoning” account that focuses on the impact of deliberation on political polarization (Kahan, 2013, 2017; Kahan, Peters, Dawson & Slovic, 2017). texts: Whereas MS2R argues that explicit reasoning typically facilitates politically biased information…”
InfluentialCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
Fighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · cited 29×
“In a pair of studies, Pennycook and Rand (2019c) tested the two accounts in the context of political fake news.”
InfluentialSelf-citationPennycook, G., & Rand, D. G. (2020) · Journal of Personality · doi:10.1111/jopy.12476 · Cited by 879
Self-citationUnderstanding the Determinants of Political Ideology: Implications of Structural Complexity
Feldman, S., & Johnston, C. (2014) · Political Psychology · doi:10.1111/pops.12055 · Cited by 731
Moral outrage in the digital age
Crockett, M. J. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0213-3 · Cited by 618 · cited 2×
“…intuitive appeal – content that is highly emotional (Martel, Pennycook & Rand, 2020), that provokes moral outrage (Brady, Gantmam & Van Bavel, 2020; Crockett, 2017), or that draws people’s attention; since our cognitive system prioritizes miserly processing (Fisk & Taylor, 1984; Stanovich,…”
Fake news, fast and slow: Deliberation reduces belief in false (but not true) news headlines.
Bago, B., Rand, D. G., & Pennycook, G. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000729 · Cited by 593
Self-citationFake news, fast and slow: Deliberation reduces belief in false (but not true) news headlines
Bago, B., Rand, D. G., & Pennycook, G. (2019) · doi:10.31234/osf.io/29b4j · Cited by 593
Self-citationExposure to untrustworthy websites in the 2016 US election
Guess, A. M., Nyhan, B., & Reifler, J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0833-x · Cited by 587
Divine intuition: Cognitive style influences belief in God.
Shenhav, A., Rand, D. G., & Greene, J. D. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0025391 · Cited by 557
Self-citationReliance on emotion promotes belief in fake news
Martel, C., Pennycook, G., & Rand, D. G. (2020) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-020-00252-3 · Cited by 470 · cited 2×
“…with the classical reasoning account, impeding deliberation with cognitive load and time pressure (Bago et al., 2020) or an instruction to rely on emotion (Martel et al., 2020) reduces discrimination by increasing belief in fake news headlines – regardless of the headlines’ political alignment.”
Self-citationMisconceptions, Misinformation, and the Logic of Identity-Protective Cognition
Kahan, D. M. (2017) · doi:10.2139/ssrn.2973067 · Cited by 423 · cited 4×
“Here, we refer to the more specific “motivated system 2 reasoning” account that focuses on the impact of deliberation on political polarization (Kahan, 2013, 2017; Kahan, Peters, Dawson & Slovic, 2017). texts: Whereas MS2R argues that explicit reasoning typically facilitates politically biased…”
InfluentialBronstein, M. V., Pennycook, G., Bear, A., Rand, D. G., & Cannon, T. D. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.09.005 · Cited by 324 · cited 1×
“Indeed, analytic thinking was associated with being better able to discriminate true and fake news headlines (see also Bronstein et al., 2019; Pehlivanoglu et al., 2020; Pennycook & Rand, 2020).”
Self-citationPausing to consider why a headline is true or false can help reduce the sharing of false news
Fazio, L. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-009 · Cited by 187 · cited 1×
“A limitation of that approach is that questioning participants about the truth of headlines may have influenced their responses about willingness to share headlines (Fazio, 2020; Pennycook, Epstein, al., 2021; Pennycook, McPhetres, et al., 2020).”
Cognitive reflection correlates with behavior on Twitter
Mosleh, M., Pennycook, G., Arechar, A. A., & Rand, D. G. (2021) · Nature Communications · doi:10.1038/s41467-020-20043-0 · Cited by 175 · cited 3×
“These results are also in line with a recent study of Twitter users which found that higher CRT users were more likely to share news on Twitter from outlets that were deemed to be more trustworthy by fact-checkers (Mosleh et al., 2021).”
Self-citationAttentional capture helps explain why moral and emotional content go viral.
Brady, W. J., Gantman, A. P., & Van Bavel, J. J. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000673 · Cited by 166
Rethinking the link between cognitive sophistication and politically motivated reasoning.
Tappin, B. M., Pennycook, G., & Rand, D. G. (2021) · Journal of Experimental Psychology: General · doi:10.1037/xge0000974 · Cited by 154
Self-citationEmphasizing publishers does not effectively reduce susceptibility to misinformation on social media
Dias, N., Pennycook, G., & Rand, D. G. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-001 · Cited by 145 · cited 1×
“…in order to examine responses independently of familiarity with different news sources (we note, however, that manipulating the salience of the source appears to have little influence on whether people judge headlines to be true or false; Dias, Pennycook & Rand, 2020; Pennycook & Rand, 2020).”
Self-citationGuess, A. M., Lockett, D., Lyons, B., Montgomery, J. M., Nyhan, B., & Reifler, J. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-004 · Cited by 69
Cited by
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
“Furthermore, analytic thinking is not only associated with more truth discernment, as described earlier, but is also associated with having more discerning sharing intentions in survey experiments (both in terms of false [35,44] and hyperpartisan content [35]) and with the actual sharing of more reliable news outlets…”
BackgroundMethodInfluentialSelf-citationRoe, J., & Perkins, M. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02282-w · Cited by 87
Epstein, Z., Pennycook, G., & Rand, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376232 · Cited by 67
Self-citation(2021) · doi:10.31234/osf.io/ar96c · Cited by 12
Self-citation
Metadata
- Authors
- Ross, R. M., Rand, D. G., & Pennycook, G.
- Venue
- Judgment and Decision Making
- Publisher
- Cambridge University Press (CUP)
- Published
- 2021-03
- Volume
- 16
- Issue
- 2
- Pages
- 484-504
- ISSN
- 1930-2975 (ISSN-L)
- OpenAlex
- W4313428942
- Cited by
- 124
- References
- 33
- FWCI
- 30.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.