Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Media
Open accessThe DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Abstract
When users on social media share content without considering its veracity, they may unwittingly be spreading misinformation. In this work, we investigate the design of lightweight interventions that nudge users to assess the accuracy of information as they share it. Such assessment may deter users from posting misinformation in the first place, and their assessments may also provide useful guidance to friends aiming to assess those posts themselves. In support of lightweight assessment, we first develop a taxonomy of the reasons why people believe a news claim is or is not true; this taxonomy yields a checklist that can be used at posting time. We conduct evaluations to demonstrate that the checklist is an accurate and comprehensive encapsulation of people's free-response rationales. In a second experiment, we study the effects of three behavioral nudges---1) checkboxes indicating whether headings are accurate, 2) tagging reasons (from our taxonomy) that a post is accurate via a checklist and 3) providing free-text rationales for why a headline is or is not accurate---on people's intention of sharing the headline on social media. From an experiment with 1668 participants, we find that both providing accuracy assessment and rationale reduce the sharing of false content. They also reduce the sharing of true content, but to a lesser degree that yields an overall decrease in the fraction of shared content that is false. Our findings have implications for designing social media and news sharing platforms that draw from richer signals of content credibility contributed by users. In addition, our validated taxonomy can be used by platforms and researchers as a way to gather rationales in an easier fashion than free-response.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“The score exceeded the recommended threshold for accepting the results [36].”
BackgroundQualitative Analysis for Social Scientists
Strauss, A. L. (1987) · doi:10.1017/cbo9780511557842 · Cited by 12,277 · cited 1×
“We first divided the free-form responses that we collected into idea units, each being a coherent unit of thought [73].”
BackgroundThe spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 3×
“analyze the spread of rumor cascades on Twitter and find that, among fact-checked articles, false content diffuses farther, faster, deeper, and more broadly than the truth [75].”
BackgroundCognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundMcCambridge, J., Witton, J., & Elbourne, D. R. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.015 · Cited by 2,748 · cited 1×
“One concern around the generalizability of our results to online platforms is the possible existence of Hawthorne effect, under which participants change their behavior due to an awareness of being studied [34, 41, 58].”
BackgroundInformation credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves 1 [82], and providing fact-checked information related to…”
BackgroundThe spreading of misinformation online
Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., Stanley, H. E., & Quattrociocchi, W. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517441113 · Cited by 2,407 · cited 2×
“, in communities that relate to certain conspiracy theory narratives [16, 43, 59, 61].”
BackgroundQualitative Analysis for Social Scientists.
Denzin, N. K., & Strauss, A. L. (1988) · Contemporary Sociology · doi:10.2307/2069712 · Cited by 2,189
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022 · cited 2×
“These questions were drawn from research studying users’ judgements assessing claims [55].”
BackgroundResultSelf-citationFake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803 · cited 2×
“This observations aligns with prior work that among other demographic factors investigated the association between Facebook users’ party identification and the number of fake news stories they had shared [24].”
BackgroundResultPennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715 · cited 5×
“Our results corroborate prior findings that nudging people to be mindful of news accuracy increases sharing discernment [53], and enrich our understanding of how impactful different nudges will be.”
BackgroundResultInfluentialSelf-citationLess than you think: Prevalence and predictors of fake news dissemination on Facebook
Guess, A., Nagler, J., & Tucker, J. (2019) · Science Advances · doi:10.1126/sciadv.aau4586 · Cited by 1,652 · cited 1×
“While our analyses were not planned a priori, they are bolstered by prior studies that have reported similar findings [27].”
ResultPrior exposure increases perceived accuracy of fake news
Pennycook, G., Cannon, T. D., & Rand, D. G. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000465 · Cited by 1,268 · cited 2×
“This phenomenon has also been reported in [51], where Pennycook et al. found that even a single prior exposure to a headline increases subsequent perceptions of its accuracy.”
BackgroundSelf-citationProceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing
Cosley, D., Forte, A., Ciolfi, L., & McDonald, D. W. (2015) · Cited by 1,245
Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity
Kreuter, F., Presser, S., & Tourangeau, R. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn063 · Cited by 1,220 · cited 1×
“One concern around the generalizability of our results to online platforms is the possible existence of Hawthorne effect, under which participants change their behavior due to an awareness of being studied [34, 41, 58].”
BackgroundShifting attention to accuracy can reduce misinformation online
Pennycook, G., Epstein, Z., Mosleh, M., Arechar, A. A., Eckles, D., & Rand, D. G. (2021) · Nature · doi:10.1038/s41586-021-03344-2 · Cited by 1,155 · cited 6×
“This observation aligns with prior studies that have found people are more likely to consider sharing politically concordant headlines than discordant headlines [52, 65].”
BackgroundResultInfluentialSelf-citationThe spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · Nature Communications · doi:10.1038/s41467-018-06930-7 · Cited by 1,125 · cited 1×
“In addition, they identify common strategies used by such bots, e.g., mentioning influential users [63].”
BackgroundFighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundSelf-citationInfluence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · CUNY Academic Works (City University of New York) · Cited by 882
Measuring Risk Literacy: The Berlin Numeracy Test
Cokely, E. T., Galesic, M., Schulz, E., Ghazal, S., & Garcia-Retamero, R. (2012) · Judgment and Decision Making · doi:10.1017/s1930297500001819 · Cited by 745 · cited 1×
“Participants then answered another survey gauging their critical thinking [21], statistical numeracy and risk literacy [14], political knowledge, and attitudes towards science.”
BackgroundSee Something, Say Something: Correction of Global Health Misinformation on Social Media
Bode, L., & Vraga, E. K. (2018) · Health Communication · doi:10.1080/10410236.2017.1331312 · Cited by 745 · cited 2×
“For example, Bode and Vraga investigate the roles that authoritative and expert sources, peers of social media users, and platforms play in correcting misinformation [10, 76].”
BackgroundZubiaga, A., Liakata, M., Procter, R., Wong Sak Hoi, G., & Tolmie, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150989 · Cited by 722
Pennycook, G., Bear, A., Collins, E. T., & Rand, D. G. (2020) · Management Science · doi:10.1287/mnsc.2019.3478 · Cited by 714 · cited 3×
“Previous work [50, 52, 53] often assessed the performance of an intervention by comparing the change in the absolute difference between the rate at which true and false content was shared.”
BackgroundSelf-citationInfluence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701 · cited 1×
“Researchers have focused on defining the problem space of misinformation [77, 78] and determining how it has changed the societal and political arena [11, 62].”
BackgroundFake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A. L., Wang, S., Tang, J., & Liu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.01967 · Cited by 581 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundThe spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · RePEc: Research Papers in Economics · Cited by 574
Using Expert Sources to Correct Health Misinformation in Social Media
Vraga, E. K., & Bode, L. (2017) · Science Communication · doi:10.1177/1075547017731776 · Cited by 558 · cited 1×
“For example, Bode and Vraga investigate the roles that authoritative and expert sources, peers of social media users, and platforms play in correcting misinformation [10, 76].”
BackgroundShin, J., & Thorson, K. (2017) · Journal of Communication · doi:10.1111/jcom.12284 · Cited by 481 · cited 3×
“This observation aligns with prior studies that have found people are more likely to consider sharing politically concordant headlines than discordant headlines [52, 65].”
BackgroundResultVraga, E. K., & Bode, L. (2020) · Political Communication · doi:10.1080/10584609.2020.1716500 · Cited by 479 · cited 1×
“Researchers have focused on defining the problem space of misinformation [77, 78] and determining how it has changed the societal and political arena [11, 62].”
BackgroundWHY DO PEOPLE SHARE FAKE NEWS? A SOCIOTECHNICAL MODEL OF MEDIA EFFECTS
Marwick, A. E. (2018) · Cited by 428
(2014) · iConference 2014 Proceedings · doi:10.9776/14308 · Cited by 423 · cited 1×
“investigate rumors that emerge during crisis events and report on the diffusion patterns of both false content and its corrections [70, 71].”
BackgroundTweeting is believing?: understanding microblog credibility perceptions
Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145274 · Cited by 411 · cited 1×
“For instance, number of quoted sources [74], prior exposure to a claim [51], official-looking logos and domains names [79], and post topic and author username [42] have been found to impact perceptions of news credibility, whereas the news publisher has surprisingly little effect on news accuracy ratings [17].”
BackgroundDeciding What's True: The Rise of Political Fact-Checking in American Journalism
Graves, L. (2016) · Columbia University Press eBooks · doi:10.7312/grav17506 · Cited by 406
Polarization of the vaccination debate on Facebook
Schmidt, A. L., Zollo, F., Scala, A., Betsch, C., & Quattrociocchi, W. (2018) · Vaccine · doi:10.1016/j.vaccine.2018.05.040 · Cited by 403
Wineburg, S., & McGrew, S. (2019) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811912101102 · Cited by 394
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · doi:10.31234/osf.io/uhbk9 · Cited by 390
Self-citationQuattrociocchi, W., Scala, A., & Sunstein, C. R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2795110 · Cited by 389 · cited 1×
“Other work has examined echo chambers on social media and their selective exposure to information, e.g., in communities that relate to certain conspiracy theory narratives [16, 44, 59, 61].”
BackgroundPotthast, M., Köpsel, S., Stein, B., & Hagen, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-30671-1_72 · Cited by 309 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves 1 [82], and providing fact-checked information related to…”
Background(2014) · doi:10.9776/14010 · Cited by 303
Political Fact-Checking on Twitter: When Do Corrections Have an Effect?
Margolin, D. B., Hannak, A., & Weber, I. (2018) · Political Communication · doi:10.1080/10584609.2017.1334018 · Cited by 285 · cited 2×
“Other work has studied circumstances under which fact-checking is effective and find that social media users are more willing to accept corrections from friends than strangers [29, 38].”
BackgroundScaling up fact-checking using the wisdom of crowds
Allen, J., Arechar, A. A., Pennycook, G., & Rand, D. G. (2021) · Science Advances · doi:10.1126/sciadv.abf4393 · Cited by 234 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves 1 [82], and providing fact-checked information related to…”
BackgroundSelf-citationLeveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation
Kim, J., Tabibian, B., Oh, A., Schölkopf, B., & Gomez-Rodriguez, M. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159734 · Cited by 230 · cited 1×
“…of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves 1 [82], and providing fact-checked information related to circulated…”
BackgroundPrior Exposure Increases Perceived Accuracy of Fake NewsPreprint
Pennycook, G., Cannon, T. D., & Rand, D. G. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2958246 · Cited by 223
Self-citationEffect of Source Attribution on Perception of Online News Stories
Sundar, S. S. (1998) · Journalism & Mass Communication Quarterly · doi:10.1177/107769909807500108 · Cited by 214 · cited 1×
“For instance, number of quoted sources [74], prior exposure to a claim [51], official-looking logos and domains names [79], and post topic and author username [42] have been found to impact perceptions of news credibility, whereas the news publisher has surprisingly little effect on news accuracy ratings [17].”
BackgroundOh, O., Kwon, K. H., & Rao, H. R. (2010) · International Conference on Information Systems · Cited by 203
Shin, J., Jian, L., Driscoll, K., & Bar, F. (2017) · New Media & Society · doi:10.1177/1461444816634054 · Cited by 203 · cited 1×
“In another study on rumors, Shin et al. analyze rumors spread on Twitter during the 2012 election and find that they mostly continued to propagate even when information by professional fact-checking organizations had been made available [64].”
BackgroundLateral reading: Reading less and learning more when evaluating digital information
Wineburg, S., & McGrew, S. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3048994 · Cited by 198 · cited 1×
“For instance, number of quoted sources [74], prior exposure to a claim [51], official-looking logos and domains names [79], and post topic and author username [42] have been found to impact perceptions of news credibility, whereas the news publisher has surprisingly little effect on news accuracy ratings [17].”
BackgroundFalling for Fake News: Investigating the Consumption of News via Social Media
Flintham, M., Karner, C., Bachour, K., Creswick, H., Gupta, N., & Moran, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173950 · Cited by 194 · cited 1×
“However, because who the sharer of a post is can also impact perceived content credibility [20], such a study would be more informative if conducted as a field study on a social network, rather than a controlled experiment.”
BackgroundSocial Sharing of Emotions on Facebook: Channel Differences, Satisfaction, and Replies
Bazarova, N. N., Choi, Y. H., Schwanda Sosik, V., Cosley, D., & Whitlock, J. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675297 · Cited by 177 · cited 1×
“A related driver is an emphasis on low barriers to sharing that allows users to share content without much attention to its accuracy or potential negative consequences, simply to receive social feedback or elevated engagement [7, 25].”
BackgroundCognitive reflection correlates with behavior on Twitter
Mosleh, M., Pennycook, G., Arechar, A. A., & Rand, D. G. (2021) · Nature Communications · doi:10.1038/s41467-020-20043-0 · Cited by 175 · cited 7×
“Vosoughi et al. analyze the spread of rumor cascades on Twitter and find that, among fact-checked articles, false content diffuses farther, faster, deeper, and more broadly than the truth [75].”
ResultInfluentialSelf-citationEffects of Credibility Indicators on Social Media News Sharing Intent
Yaqub, W., Kakhidze, O., Brockman, M. L., Memon, N., & Patil, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376213 · Cited by 171 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundMosleh, M., Pennycook, G., & Rand, D. G. (2020) · PLOS ONE · doi:10.1371/journal.pone.0228882 · Cited by 170 · cited 1×
“In addition, other prior work has reported that there is a correlation between hypothetical sharing of news stories reported by survey respondents and actual sharing on social media [46].”
BackgroundSelf-citationDeciding What's True: The Rise of Political Fact-Checking in American Journalism: Book Review
Greenberg, D. (2017) · Journal of Communication · doi:10.1111/jcom.12329 · Cited by 161
Fake News on Facebook and Twitter: Investigating How People (Don't) Investigate
Geeng, C., Yee, S., & Roesner, F. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376784 · Cited by 151 · cited 1×
“By conducting interviews with participants whose newsfeeds were manipulated to contain false posts, Geeng et al. study why people do not investigate content credibility, e.g., because they have undergone political burnout [22].”
BackgroundEmphasizing publishers does not effectively reduce susceptibility to misinformation on social media
Dias, N., Pennycook, G., & Rand, D. G. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-001 · Cited by 145
Self-citationShared partisanship dramatically increases social tie formation in a Twitter field experiment
Mosleh, M., Martel, C., Eckles, D., & Rand, D. G. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022761118 · Cited by 123 · cited 1×
“, in communities that relate to certain conspiracy theory narratives [16, 43, 59, 61].”
BackgroundSelf-citationDeciding What's True: The Rise of Political Fact-Checking in American Journalism
Graves, L. (2016) · Cited by 121
Zhang, A. X., Robbins, M., Bice, E., Hawke, S., Karger, D., Mina, A. X., Ranganathan, A., Metz, S. E., Appling, S., Sehat, C. M., et al. (2018) · Companion of the The Web Conference 2018 on The Web Conference 2018 - WWW '18 · doi:10.1145/3184558.3188731 · Cited by 120 · cited 3×
“…detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves 1 [82], and providing fact-checked information related to circulated news claims [23, 35, 50, 81].”
BackgroundInfluentialSelf-citationShifting attention to accuracy can reduce misinformation onlinePreprint
Pennycook, G., Epstein, Z., Mosleh, M., et al. (2019) · doi:10.31234/osf.io/3n9u8 · Cited by 119
Self-citationMosleh, M., Martel, C., Eckles, D., & Rand, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445642 · Cited by 106 · cited 1×
“In addition, a Twitter field experiment found that being corrected by a stranger significantly reduced the quality of content users subsequently shared [44].”
BackgroundSelf-citationHannak, A., Margolin, D., Keegan, B., & Weber, I. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14555 · Cited by 90 · cited 2×
“Other work has studied circumstances under which fact-checking is effective and find that social media users are more willing to accept corrections from friends than strangers [29, 38].”
BackgroundGleaning Wisdom from the Past: Early Detection of Emerging Rumors in Social Media
Wu, L., Li, J., Hu, X., & Liu, H. (2017) · Proceedings of the 2017 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974973.12 · Cited by 88 · cited 1×
“Other such studies investigate the impact of the wording of corrections [10, 39], explore identifying misinformation in its early stages using previously known rumors [80], presenting linguistic and social network information about new social media accounts to help users differentiate between real and suspicious accou…”
BackgroundEcosystem or Echo-System? Exploring Content Sharing across Alternative Media Domains
Starbird, K., Arif, A., Wilson, T., Van Koevering, K., Yefimova, K., & Scarnecchia, D. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15009 · Cited by 85 · cited 2×
“Related work shows that alternative media sources borrow content from other sources including mainstream media [69].”
BackgroundEpstein, Z., Pennycook, G., & Rand, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376232 · Cited by 67 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundSelf-citationBhuiyan, M. M., Zhang, A. X., Sehat, C. M., & Mitra, T. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415164 · Cited by 67 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundSelf-citationMartel, C., Mosleh, M., & Rand, D. G. (2021) · Media and Communication · doi:10.17645/mac.v9i1.3519 · Cited by 66
Self-citationCompeting or aiming to be average?: normification as a means of engaging digital volunteers
Preist, C., Massung, E., & Coyle, D. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531615 · Cited by 65 · cited 1×
“One concern around the generalizability of our results to online platforms is the possible existence of Hawthorne effect, under which participants change their behavior due to an awareness of being studied [34, 41, 58].”
BackgroundIntegrating on-demand fact-checking with public dialogue
Kriplean, T., Bonnar, C., Borning, A., Kinney, B., & Gill, B. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531677 · Cited by 65 · cited 1×
“Some of these initiatives include detecting false or misleading information using machine learning algorithms [12, 57, 67] and crowdsourcing [5, 9, 19, 33, 54], identifying bad actors and helping good actors differentiate themselves1 [82], and providing fact-checked information related to circulated news claims [23, 3…”
BackgroundEmphasizing publishers does not effectively reduce susceptibility to misinformation on social mediaPreprint
Dias, N., Pennycook, G., & Rand, D. G. (2020) · doi:10.31234/osf.io/zv4dq · Cited by 60
Self-citationScaling Up Fact-Checking Using the Wisdom of CrowdsPreprint
Allen, J. N. L., Arechar, A. A., Pennycook, G., et al. (2020) · doi:10.31234/osf.io/9qdza · Cited by 60
Self-citationGrygiel, J., & Brown, N. (2018) · Telecommunications Policy · doi:10.1016/j.telpol.2018.12.003 · Cited by 46 · cited 1×
“In addition, although policy-driven platform moderation is necessary in some contexts, communities should be wary of relinquishing all the power of content filtering and highlighting to the platforms whose incentives as for-profit entities running on ads do not necessarily align with the users’ [26, 32].”
BackgroundEngage Early, Correct More: How Journalists Participate in False Rumors Online during Crisis Events
Starbird, K., Dailey, D., Mohamed, O., Lee, G., & Spiro, E. S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173679 · Cited by 44 · cited 1×
“investigate rumors that emerge during crisis events and report on the diffusion patterns of both false content and its corrections [70, 71].”
BackgroundFacebook and the Napalm Girl: Reframing the Iconic as Pornographic
Ibrahim, Y. (2017) · Social Media + Society · doi:10.1177/2056305117743140 · Cited by 35 · cited 1×
“The challenge of moderation is exacerbated as not all accounts of problematic behavior or posts can be provisioned a priori in platform policies, leading moderators to make ad-hoc decisions in grey areas that sometimes draw criticism [2, 30, 66, 68].”
BackgroundKarduni, A., Cho, I., Wesslen, R. S., Santhanam, S., Volkova, S., Arendt, D., Shaikh, S., & Dou, W. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3301275.3302320 · Cited by 34 · cited 1×
“Other such studies investigate the impact of the wording of corrections [10, 39], explore identifying misinformation in its early stages using previously known rumors [80], presenting linguistic and social network information about new social media accounts to help users differentiate between real and suspicious accou…”
BackgroundMosleh, M., Pennycook, G., & Rand, D. G. (2019) · doi:10.31234/osf.io/zebp9 · Cited by 34
Self-citationShared Partisanship Dramatically Increases Social Tie Formation in a Twitter Field ExperimentPreprint
Mosleh, M., Martel, C., Eckles, D., & Rand, D. G. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ykh5t · Cited by 29
Self-citationEpstein, Z., Pennycook, G., & Rand, D. G. (2019) · doi:10.31234/osf.io/z3s5k · Cited by 28
Self-citationInformation Literacy vs. Fake News: The Case of Ukraine
Haigh, M., Haigh, T., & Matychak, T. (2019) · Open Information Science · doi:10.1515/opis-2019-0011 · Cited by 21 · cited 1×
“Other such studies investigate the impact of the wording of corrections [10, 39], explore identifying misinformation in its early stages using previously known rumors [80], presenting linguistic and social network information about new social media accounts to help users differentiate between real and suspicious accou…”
BackgroundMurray, S. F., Stanley, M. L., McPhetres, J., Pennycook, G., & Seli, P. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9evzc · Cited by 21 · cited 1×
“, even if their ideological beliefs disagree with the statements [47].”
BackgroundSelf-citationDeciding what’s true: The rise of political fact-checking in American journalism
Kalsnes, B. (2018) · Digital Journalism · doi:10.1080/21670811.2018.1460211 · Cited by 19
Understanding Feedback Expectations on Facebook
Grinberg, N., Kalyanaraman, S., Adamic, L. A., & Naaman, M. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998320 · Cited by 18 · cited 1×
“A related driver is an emphasis on low barriers to sharing that allows users to share content without much attention to its accuracy or potential negative consequences, simply to receive social feedback or elevated engagement [7, 25].”
BackgroundCognitive reflection correlates with behavior on TwitterPreprint
Mosleh, M., Pennycook, G., Arechar, A. A., et al. (2019) · doi:10.31234/osf.io/qaswn · Cited by 17
Self-citationHepp, A. (2021) · De Gruyter eBooks · doi:10.1515/9783110627275-015 · Cited by 15
Vulnerable to Misinformation? Verifi!Preprint
Karduni, A., Cho, I., Wesslen, R. S., Santhanam, S., Volkova, S., Arendt, D. L., Shaikh, S., & Dou, W. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.36571.46888 · Cited by 11
O’Riordan, S., Kiely, G., Emerson, B., & Feller, J. (2019) · International Symposium on Open Collaboration · doi:10.1145/3306446.3340818 · Cited by 10 · cited 1×
“However, the usefulness of these nudges is not limited to these platforms as they can be leveraged in alternative platforms with different publishing models, such as WikiTribune where users curate content collectively [49].”
BackgroundVulnerable to Misinformation? Verifi!Preprint
Karduni, A., Cho, I., Wesslen, R. S., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.09739 · Cited by 8 · cited 1×
“Other such studies investigate the impact of the wording of corrections [10, 39], explore identifying misinformation in its early stages using previously known rumors [80], presenting linguistic and social network information about new social media accounts to help users differentiate between real and suspicious accou…”
BackgroundMartel, C., Mosleh, M., & Rand, D. G. (2020) · doi:10.31234/osf.io/w3tfb · Cited by 7 · cited 1×
“Other such studies investigate the impact of the wording of corrections [10, 39] and explore identifying misinformation in its early stages using previously known rumors [80], presenting linguistic and social network information about new social media accounts to help users differentiate between real and suspicious ac…”
BackgroundSelf-citation
Research works printed but not linked: 7
- Kathy Charmaz and Linda Liska Belgrave. 2007. Grounded theory. The Blackwell encyclopedia of sociology (2007).
- Pranav Dixit and Ryan Mac. 2018. How WhatsApp Destroyed A Village. Buzzfeed News (2018).
- Farhad Manjoo. 2013. You won't finish this article. Why people online don't read to the end: Slate (2013).
- Julie Posetti and Alice Matthews. 2018. A short guide to the history of ?fake news' and disinformation. International Center For Journalists (2018), 2018--07.
- John Reed. 2018. Hate speech, atrocities and fake news: The crisis of democracy in Myanmar. Financial Times. Retrieved from https://www. ft. com/content/2003d54e-169a-11e8-9376-4a6390addb44 (2018).
- Scott Shane. 2017. The fake Americans Russia created to influence the election. The New York Time, Vol. 7, 09 (2017).
- Claire Wardle and Hossein Derakhshan. 2017. Information disorder: Toward an interdisciplinary framework for research and policy making. Council of Europe report, Vol. 27 (2017).
Cited by
Zhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288
“Specifcally, type includes news reports and non-news posts, as previous work has demonstrated the impact of article genre and publisher on credibility assessments [7, 30, 33, 49].”
ResultA meta-analysis of correction effects in science-relevant misinformation
Chan, M. S., & Albarracín, D. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01623-8 · Cited by 174
Melchior, C., & Oliveira, M. F. D. A. (2023) · New Media & Society · doi:10.1177/14614448231174224 · Cited by 115
“For example, to see which of their social media friends would believe the story (Jahanbakhsh et al., 2021).”
BackgroundBlair, R., Gottlieb, J., Nyhan, B. J., Paler, L., Argote, P., & Stainfield, C. J. (2023) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2023.101732 · Cited by 99
“, 2021), which is concerning given that some studies find lower levels of baseline of sharing discernment among this group (Jahanbakhsh et al., 2021; Pennycook et al., 2020; Grinberg et al., 2019).”
BackgroundDeveloping an accuracy-prompt toolkit to reduce COVID-19 misinformation online
Epstein, Z., Berinsky, A. J., Cole, R., Gully, A., Pennycook, G., & Rand, D. G. (2021) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-71 · Cited by 93
“…towards accuracy can help people attend to their existing — but often latent — capacity and desire to discern truth from falsehood, for both political misinformation (Fazio, 2020; Jahanbakhsh et al., 2021; Pennycook et al., 2021) and COVID-19 misinformation (Pennycook, McPhetres et al., 2020).”
BackgroundSelf-citation
Metadata
- Authors
- Jahanbakhsh, F., Zhang, A. X., Berinsky, A. J., Pennycook, G., Rand, D. G., & Karger, D. R.
- Affiliations
- Massachusetts Institute of Technology (US)
- University of Washington (US)
- University of Regina (CA)
- ORCID
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-42
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3123744018
- Cited by
- 112
- References
- 77
- Citations by year
- 2026: 12 · 2025: 26 · 2024: 23 · 2023: 23 · 2022: 23 · 2021: 5
- FWCI
- 25.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- misinformation, social media sharing, nudging, accuracy assessment, content credibility, platform design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.