Credibility Perceptions and Detection Accuracy of Fake News Headlines on Social Media: Effects of Truth-Bias and Endorsement Cues
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article focuses on message credibility and detection accuracy of fake and real news as represented on social media. We developed a deception detection paradigm for news headlines and conducted two online experiments to examine the extent to which people (1) perceive news headlines as credible, and (2) accurately distinguish fake and real news across three general topics (i.e., politics, science, and health). Both studies revealed that people often judged news headlines as fake, suggesting a deception-bias for news in social media. Across studies, we observed an average detection accuracy of approximately 51%, a level consistent with most research using this deception detection paradigm with equal lie-truth base-rates. Study 2 evaluated the effects of endorsement cues in social media (e.g., Facebook likes) on message credibility and detection accuracy. Results showed that headlines associated with a high number of Facebook likes increased credibility, thereby enhancing detection accuracy for real news but undermining accuracy for fake news. These studies introduce truth-default theory to the context of news credibility and advance our understanding of how biased processing of news information can impact detection accuracy with social media endorsement cues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Results showed that headlines associated with a high number of likes increased credibility, thereby enhancing detection accuracy for real news but undermining accuracy for fake news.”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Luo et al. 2022
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 4×
“We use truth-default theory (TDT; Levine, 2014) as our theoretical framework to ground predictions about how participants will detect fake and real news, and because fake news spans multiple topics (Vosoughi et al., 2018), we evaluate message credibility and detection accuracy across three topics: politics, health, an…”
BackgroundMethodInfluentialSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 2×
“If a total of 156 fake news stories were circulated on Facebook right before the election, as estimated by Allcott and Gentzkow (2017), then people would have detected approximately 9 fewer fake news stories (5.6% fewer, or 77 rather than 86 stories) because these news stories received a high…”
BackgroundInfluentialWhat Americans Know about Politics and Why It Matters
Brooks, C., Carpini, M. X. D., & Keeter, S. (1997) · Contemporary Sociology · doi:10.2307/2655098 · Cited by 4,437 · cited 1×
“As news media are the main source of political information (Carpini & Keeter, 1996), scant media attention to public issues may limit people’s exposure and constrain their knowledge of these issue domains.”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160 · cited 1×
“These data also suggest that detecting and removing follower bots, which manipulate endorsement cues to create the illusion of popularity (Lazer et al., 2018), should be a priority for improving detection accuracy.”
BackgroundWhen Corrections Fail: The Persistence of Political Misperceptions
Nyhan, B., & Reifler, J. (2010) · Political Behavior · doi:10.1007/s11109-010-9112-2 · Cited by 3,173 · cited 4×
“…reasoning can drive false beliefs about controversial political and health issues (e.g., the existence of Weapons of Mass Destruction in Iraq, Nyhan & Reifler, 2010; risks of Genetically Modified Organisms, Bode & Vraga, 2015); or how cues in the information environment affect perceptions of…”
BackgroundInfluentialPennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022 · cited 3×
“A second possible mechanism is the plausibility of the headlines—an important message feature of fake news (Pennycook & Rand, 2019).”
BackgroundAccuracy of Deception Judgments
Bond, C. F., & DePaulo, B. M. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1003_2 · Cited by 1,953 · cited 3×
“The results suggest poor news detection accuracy across topics, which is consistent with the 54% accuracy reported in the meta-analysis of interpersonal deception detection studies with equal truth-lie base-rates (Bond & DePaulo, 2006).”
BackgroundResultInfluentialFake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,716
Detecting Lies and Deceit: Pitfalls and Opportunities
Vrij, A. (2008) · Cited by 1,711
News use across social media platforms 2016
Gottfried, J. A., & Shearer, E. (2016) · Cited by 1,643
Gilbert, D. T. (1991) · American Psychologist · doi:10.1037//0003-066x.46.2.107 · Cited by 1,515 · cited 1×
“The truth-bias has been extensively studied in interpersonal communication and has been foundational for assessing how people process social information (Gilbert, 1991).”
BackgroundSocial and Heuristic Approaches to Credibility Evaluation Online
Metzger, M. J., Flanagin, A. J., & Medders, R. B. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2010.01488.x · Cited by 1,394 · cited 11×
“Aggregated social endorsement can be derived from either known or unknown others (Metzger et al., 2010).”
BackgroundInfluentialPrior exposure increases perceived accuracy of fake news
Pennycook, G., Cannon, T. D., & Rand, D. G. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000465 · Cited by 1,268 · cited 2×
“Prior exposure to news headlines may also affect message credibility due to dynamics associated with the illusory truth effect, a type of processing heuristic that suggests that false information is often believed when repeated (Pennycook et al., 2018).”
BackgroundPerception of Hazards: The Role of Social Trust and Knowledge
Siegrist, M., & Cvetkovich, G. (2000) · Risk Analysis · doi:10.1111/0272-4332.205064 · Cited by 1,111 · cited 1×
“Furthermore, perceptions of the benefits and risks of public issues are tied to social trust, especially among less knowledgeable lay people (Siegrist & Cvetkovich, 2000), and people exhibit different levels of trust in information sources across topics.”
BackgroundDigital Media, Youth, and Credibility
Metzger, M. J., & Flanagin, A. J. (2007) · Cited by 1,063
Messing, S., & Westwood, S. J. (2014) · Communication Research · doi:10.1177/0093650212466406 · Cited by 902 · cited 1×
“Prior work suggests that traces of social media (e.g., number of views and likes) are cues that people use to judge the validity or value of online information (Messing & Westwood, 2014; Spartz et al., 2017), suggesting that they will likely play a crucial role in veracity judgments as well.”
BackgroundPennycook, G., & Rand, D. G. (2020) · Journal of Personality · doi:10.1111/jopy.12476 · Cited by 879
Guess, A. M., Nyhan, B. J., & Reifler, J. (2018) · Cited by 873
Bode, L., & Vraga, E. K. (2015) · Journal of Communication · doi:10.1111/jcom.12166 · Cited by 663 · cited 2×
“From the perspective of information processing, a burgeoning literature has examined how individuals process fake news, such as how motivated reasoning can drive false beliefs about controversial political and health issues (e.g., the existence of Weapons of Mass Destruction in Iraq, Nyhan & Reifler, 2010; risks of Ge…”
BackgroundTrends in the diffusion of misinformation on social media
Allcott, H., Gentzkow, M., & Yu, C. (2019) · Research & Politics · doi:10.1177/2053168019848554 · Cited by 643 · cited 1×
“As Allcott et al. (2019) have shown, fake news exposure appears to be declining on Facebook, suggesting that people are less likely to be exposed to fake news than in the past several years.”
BackgroundTsfati, Y., & Cappella, J. N. (2003) · Communication Research · doi:10.1177/0093650203253371 · Cited by 638
Measuring Message Credibility: Construction and Validation of an Exclusive Scale
Appelman, A., & Sundar, S. S. (2016) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699015606057 · Cited by 625
Turcotte, J., York, C., Irving, J., Scholl, R. M., & Pingree, R. J. (2015) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12127 · Cited by 616 · cited 3×
“For example, emails with political rumors or news stories recommended by friends and family were perceived as more credible than those from individuals outside of one’s immediate social network (Garrett, 2011) or generated from news organizations (Turcotte et al., 2015).”
BackgroundTruth-Default Theory (TDT): A Theory of Human Deception and Deception Detection
Levine, T. R. (2014) · Journal of Language and Social Psychology · doi:10.1177/0261927x14535916 · Cited by 585
Can Students Evaluate Online Sources? Learning From Assessments of Civic Online Reasoning
McGrew, S., Breakstone, J., Ortega, T., Smith, M., & Wineburg, S. (2018) · Theory & Research in Social Education · doi:10.1080/00933104.2017.1416320 · Cited by 533 · cited 2×
“practitioners who should consider integrating the strategies about how to evaluate social endorsement cues into the curriculum of online credibility assessment, given its effectiveness on online reasoning among college students (McGrew et al., 2018).”
BackgroundTHE DEVELOPMENT OF A MEASURE OF PERCEIVED HOMOPHILY IN INTERPERSONAL COMMUNICATION
MCCROSKEY, J. C., RICHMOND, V. P., & DALY, J. A. (1975) · Human Communication Research · doi:10.1111/j.1468-2958.1975.tb00281.x · Cited by 496 · cited 1×
“We adapted the perceived homophily scale from McCroskey et al. (1975) to assess the extent to which participants felt that people who “liked” the news were “unlike/like me,” “different from/similar to me,” “do not think like me/think like me,” and “concern unlike/like me” on a bipolar scale ranging…”
MethodAccuracy in detecting truths and lies: Documenting the “veracity effect”
Levine, T. R., Park, H. S., & McCornack, S. A. (1999) · Communication Monographs · doi:10.1080/03637759909376468 · Cited by 413 · cited 1×
“Given its primary assumption about the default nature of the truth-bias, TDT posits that judgments for truths should be more accurate than lies (Levine et al., 1999)—a robust observation called the veracity effect.”
BackgroundNews cues: Information scent and cognitive heuristics
Sundar, S. S., Knobloch‐Westerwick, S., & Hastall, M. R. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20511 · Cited by 302 · cited 1×
“Research has shown that bandwagon effects appear to be so powerful that they can overshadow other heuristics such as the expertise heuristic (Sundar et al., 2007).”
BackgroundCommunication Processes in Participatory Websites
Walther, J. B., & Jang, J.-W. (2012) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2012.01592.x · Cited by 243 · cited 1×
“Social media provide aggregated user representations (AURs; Walther & Jang, 2012), which are algorithm-generated statistics representing the number of users’ evaluations (e.g., likes on Facebook, up or down votes on Reddit) and behaviors, such as watching and sharing (e.g., viewership on YouTube,…”
BackgroundShen, C., Kasra, M., Pan, W., Bassett, G. A., Malloch, Y., & O’Brien, J. F. (2019) · New Media & Society · doi:10.1177/1461444818799526 · Cited by 209 · cited 4×
“…paradigm, prevents assessments of perceived authenticity and believability (Appelman & Sundar, 2016), and (2) we did not collect data on several individual differences in Study 2, such as political orientation and social media engagement (Shen et al., 2019), which can affect information processing.”
BackgroundMethodInfluentialLevine, T. R., Serota, K. B., Shulman, H., Clare, D. D., Park, H. S., Shaw, A. S., Shim, J. C., & Lee, J. H. (2011) · Human Communication Research · doi:10.1111/j.1468-2958.2011.01407.x · Cited by 196 · cited 3×
“Second, our data support the prediction of TDT’s sender demeanor cue proposition in which cues may directly affect credibility perceptions but affect accuracy, depending on whether they are matched with news veracity (Levine et al., 2011).”
BackgroundResultInfluentialTroubling Consequences of Online Political Rumoring
Garrett, R. K. (2011) · Human Communication Research · doi:10.1111/j.1468-2958.2010.01401.x · Cited by 190 · cited 4×
“, many likes), especially from in-group contacts (e.g., likes from friends; Garrett, 2011; Xu, 2013).”
BackgroundInfluentialJargon as a barrier to effective science communication: Evidence from metacognition
Bullock, O. M., Colón Amill, D., Shulman, H. C., & Dixon, G. N. (2019) · Public Understanding of Science · doi:10.1177/0963662519865687 · Cited by 181 · cited 1×
“Other types of fluency heuristics in news headlines may be considered in future research, such as communication frames and the use of jargon (Bullock et al., 2019; Shulman & Sweitzer, 2018).”
BackgroundWhen lovers become leery: The relationship between suspicion and accuracy in detecting deception
McCornack, S. A., & Levine, T. R. (1990) · Communication Monographs · doi:10.1080/03637759009376197 · Cited by 168
Selective Use of Heunrstic and Systematic Processing Under Defense Motivation
Giner-Sorolila, R., & Chaiken, S. (1997) · Personality and Social Psychology Bulletin · doi:10.1177/0146167297231009 · Cited by 159 · cited 1×
“That may have occurred because perceptions of political news are closely tied to existing political beliefs (Giner-Sorolila & Chaiken, 1997) and may be less influenced by social heuristic cues than motivated reasoning (Nyhan & Reifler, 2010), compared with the other topics.”
BackgroundDeAndrea, D. C. (2014) · Communication Theory · doi:10.1111/comt.12033 · Cited by 134 · cited 2×
“Alternatively, warranting theory suggests that online credibility evaluations depend on the degree to which people perceive that the information is immune to source manipulation (see DeAndrea, 2014).”
BackgroundXu, Q. (2013) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699013503158 · Cited by 129 · cited 4×
“First, our data confirmed the bandwagon effect on credibility perceptions (e.g., Jucks & Thon, 2017; Xu, 2013).”
BackgroundResultInfluentialYouTube, Social Norms and Perceived Salience of Climate Change in the American Mind
Spartz, J. T., Su, L. Y.-F., Griffin, R. J., Brossard, D., & Dunwoody, S. (2015) · Environmental Communication · doi:10.1080/17524032.2015.1047887 · Cited by 129 · cited 2×
“Prior work suggests that traces of social media (e.g., number of views and likes) are cues that people use to judge the validity or value of online information (Messing & Westwood, 2014; Spartz et al., 2017), suggesting that they will likely play a crucial role in veracity judgments as well.”
BackgroundMisinformation and Mass Audiences
Southwell, B. G., Thorson, E. A., & Sheble, L. (2018) · University of Texas Press eBooks · doi:10.7560/314555 · Cited by 112
Message Elaboration versus Peripheral Cues
Petty, R. E., & Cacioppo, J. T. (1986) · Springer eBooks · doi:10.1007/978-1-4612-4964-1_6 · Cited by 108 · cited 1×
“When people fail to elaborate on a message, they tend to rely on simple cognitive shortcuts to process information (e.g., Petty & Cacioppo, 1986).”
BackgroundDixon, G., & Clarke, C. (2013) · Health Education Research · doi:10.1093/her/cys110 · Cited by 94 · cited 1×
“Misperception about health issues may adversely affect individuals’ health behaviors (Dixon & Clarke, 2013); exposure to fake science messages may prevent environmental protection and constrain policy making (see Maki et al., 2018, for a review).”
BackgroundJucks, R., & Thon, F. M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.019 · Cited by 84 · cited 2×
“First, our data confirmed the bandwagon effect on credibility perceptions (e.g., Jucks & Thon, 2017; Xu, 2013).”
BackgroundResultEcological Validity and Deception Detection Research Design
Levine, T. R. (2017) · Communication Methods and Measures · doi:10.1080/19312458.2017.1411471 · Cited by 80 · cited 3×
“We followed the tradition of interpersonal deception detection research to prompt participants to make explicit fake-real judgments about news veracity (Levine, 2018), with minimal contextual information that is often available in actual social media platforms (e.”
BackgroundInfluentialThe Effects of Cognitive Capacity and Suspicion on Truth Bias
Millar, M. G., & Millar, K. U. (1997) · Communication Research · doi:10.1177/009365097024005005 · Cited by 70 · cited 1×
“1990; Millar & Millar, 1997).”
A probability model of accuracy in deception detection experiments
Park, H. S., & Levine, T. R. (2001) · Communication Monographs · doi:10.1080/03637750128059 · Cited by 62 · cited 2×
“As the ParkLevine Probability Model predicts, if individuals continue to demonstrate a deceptionbias on social media, their overall accuracy will decline as fake news exposure declines.”
ResultClare, D. D., & Levine, T. R. (2019) · Human Communication Research · doi:10.1093/hcr/hqz001 · Cited by 57 · cited 2×
“…be less suspicious about text-based headlines in actual social media platforms because prompted judgments tend to be more biased toward deception (Clare & Levine, 2019), and (2) the realworld news detection may also be more accurate because people can rely on a wide range of context-level…”
BackgroundTruth Bias and Partisan Bias in Political Deception Detection
Clementson, D. E. (2017) · Journal of Language and Social Psychology · doi:10.1177/0261927x17744004 · Cited by 48 · cited 1×
“Clementson (2018), for example, had people judge whether politicians answered or deceptively evaded questions during TV interviews.”
BackgroundAdvancing Framing Theory: Designing an Equivalency Frame to Improve Political Information Processing
Shulman, H. C., & Sweitzer, M. D. (2018) · Human Communication Research · doi:10.1093/hcr/hqx006 · Cited by 47 · cited 1×
“Other types of fluency heuristics in news headlines may be considered in future research, such as communication frames and the use of jargon (Bullock et al., 2019; Shulman & Sweitzer, 2018).”
BackgroundLie‐biased Decision Making in Prison
Bond, G. D., Malloy, D. M., Arias, E. A., Nunn, S. N., & Thompson, L. A. (2005) · Communication Reports · doi:10.1080/08934210500084180 · Cited by 35 · cited 1×
“The deception-bias, in contrast, often occurs in settings that can trigger a default assessment that communicators are likely to lie (Bond et al., 2005).”
BackgroundLevine, T. R., Shaw, A. S., & Shulman, H. C. (2010) · Communication Research Reports · doi:10.1080/08824090903526638 · Cited by 19 · cited 2×
“We followed prior work for calculating detection accuracy from Likert-type scale responses (Levine et al., 2010): scores of 1 to 3 were rescored as fake and were coded as accurate if the news was actually fake and as inaccurate if the news was actually real, while scores of 5 to 7 were rescored as…”
MethodMaki, A., Carrico, A. R., & Vandenbergh, M. P. (2018) · University of Texas Press eBooks · doi:10.7560/314555-012 · Cited by 1 · cited 1×
“Misperception about health issues may adversely affect individuals’ health behaviors (Dixon & Clarke, 2013); exposure to fake science messages may prevent environmental protection and constrain policy making (see Maki et al., 2018, for a review).”
Background
Research works printed but not linked: 4
- Funk C., 2017, Mixed messages about public trust in science
- 10.1037/0003-066X.46.2.107 · doi:10.1037/0003-066x.46.2.107 · Paper page
- Kennedy B., 2015, Science and health interest linked to Americans’ gender, age and personality
- O’Keefe D. J., 2004, Readings in persuasion, social influence, and compliance gaining, 31
Cited by
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Sundar, S. S., Molina, M. D., & Cho, E. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab010 · Cited by 212
Bryanov, K., & Vziatysheva, V. (2021) · PLOS ONE · doi:10.1371/journal.pone.0253717 · Cited by 211
“[40] found that across two experiments where stimuli consisted of equal”
BackgroundInfluentialA digital media literacy intervention for older adults improves resilience to fake news
Moore, R. C., & Hancock, J. T. (2022) · Scientific Reports · doi:10.1038/s41598-022-08437-0 · Cited by 196
Self-citation(Why) Is Misinformation a Problem?
Adams, Z., Osman, M., Bechlivanidis, C., & Meder, B. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221141344 · Cited by 215
Metadata
- Authors
- Luo, M., Hancock, J. T., & Markowitz, D. M.
- Affiliations
- Stanford University (US)
- University of Oregon (US)
- Corresponding author
- Luo, Mufan
- Venue
- Communication Research
- Publisher
- SAGE Publications
- Published
- 2020-05-23
- Volume
- 49
- Issue
- 2
- Pages
- 171-195
- ISSN
- 0093-6502 (ISSN-L)
- 1552-3810
- OpenAlex
- W3027896044
- Cited by
- 245
- References
- 52
- Citations by year
- 2026: 36 · 2025: 52 · 2024: 57 · 2023: 54 · 2022: 31 · 2021: 13 · 2020: 2
- FWCI
- 33.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Communication Research (publishedVersion)
- Funders
- Stanford Democracy and the Internet Institute
- Stanford Cyber Policy Center
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Psychology › Social Psychology › Deception detection and forensic psychology
- Social Sciences › Communication › Communication and COVID-19 Impact
- Keywords
- fake news, news headlines, message credibility, deception detection, truth bias, Facebook likes, social media, truth-default theory, detection accuracy, politics, health news
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.