Exposure to social engagement metrics increases vulnerability to misinformation
Open accessThe DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
News feeds in virtually all social media platforms include engagement metrics, such as the number of times each post is liked and shared. We find that exposure to these signals increases the vulnerability of users to low-credibility information in a simulated social media feed. This finding has important implications for the design of social media
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For instance, users are more likely to like and share low-quality content that others have already liked (Avram et al., 2020).”
From Social Drivers and Algorithmic Mechanisms on Digital Media. (2024) · cites this paper as Avram et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Similarly, other researchers concurred that even the best AI for spotting fake news is still ineffective.18”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as [18]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“Although the simulated engagement in the game is not drawn from empirical data, the metric numbers shown have a heavy tail similar to those typically observed in social media (Vosoughi et al., 2018).”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
Self-citationExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016) · Communications of the ACM · doi:10.1145/2818717 · Cited by 1,973
Self-citationFake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715
Less than you think: Prevalence and predictors of fake news dissemination on Facebook
Guess, A., Nagler, J., & Tucker, J. (2019) · Science Advances · doi:10.1126/sciadv.aau4586 · Cited by 1,652
The spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · Nature Communications · doi:10.1038/s41467-018-06930-7 · Cited by 1,125
Self-citationRomero, D. M., Meeder, B., & Kleinberg, J. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963503 · Cited by 1,082
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981 · cited 2×
“…& Flammini, 2017; Yang et al., 2019; Yang, Varol, Hui, & Menczer, 2020; Hui et al., 2019), time series analysis to detect promoted campaigns (Varol, Ferrara, Menczer, & Flammini, 2017), and natural language processing for flagging factually incorrect content (Prez-Rosas, Kleinberg, Lefevre,…”
BackgroundSelf-citationFighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947
Pennycook, G., Bear, A., Collins, E. T., & Rand, D. G. (2020) · Management Science · doi:10.1287/mnsc.2019.3478 · Cited by 714
Fake news game confers psychological resistance against online misinformation
Roozenbeek, J., & van der Linden, S. (2019) · Palgrave Communications · doi:10.1057/s41599-019-0279-9 · Cited by 708
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701
Clayton, K., Blair, S., Busam, J. A., Forstner, S., Glance, J., Green, G., Kawata, A., Kovvuri, A., Martin, J., Morgan, E., et al. (2020) · Political Behavior · doi:10.1007/s11109-019-09533-0 · Cited by 658
Ratkiewicz (2011) · doi:10.1145/1963192.1963301 · Cited by 541
Measuring Emotional Contagion in Social Media
Ferrara, E., & Yang, Z. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142390 · Cited by 532
Shin, J., & Thorson, K. (2017) · Journal of Communication · doi:10.1111/jcom.12284 · Cited by 481
The fake news game: actively inoculating against the risk of misinformation
Roozenbeek, J., & van der Linden, S. (2019) · Journal of Risk Research · doi:10.1080/13669877.2018.1443491 · Cited by 479
Detecting Emotional Contagion in Massive Social Networks
Coviello, L., Sohn, Y., Kramer, A. D. I., Marlow, C., Franceschetti, M., Christakis, N. A., & Fowler, J. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090315 · Cited by 478
Nyhan, B., Porter, E., Reifler, J., & Wood, T. J. (2020) · Political Behavior · doi:10.1007/s11109-019-09528-x · Cited by 442
(2014) · iConference 2014 Proceedings · doi:10.9776/14308 · Cited by 423
Arming the public with artificial intelligence to counter social bots
Yang, K., Varol, O., Davis, C. A., Ferrara, E., Flammini, A., & Menczer, F. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.115 · Cited by 419 · cited 1×
“…2013), supervised models of automated behavior (Ferrara, Varol, Davis, Menczer, & Flammini, 2016; Varol, Ferrara, Davis, Menczer, & Flammini, 2017; Yang et al., 2019; Yang, Varol, Hui, & Menczer, 2020; Hui et al., 2019), time series analysis to detect promoted campaigns (Varol, Ferrara, Menczer,…”
Self-citationTweetCred: Real-Time Credibility Assessment of Content on Twitter
Gupta, A., Kumaraguru, P., Castillo, C., & Meier, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13734-6_16 · Cited by 371
Basol, M., Roozenbeek, J., & Van der Linden, S. (2020) · Journal of Cognition · doi:10.5334/joc.91 · Cited by 368
(2020) · doi:10.1609/aaai.v34i01.5460 · Cited by 361
Self-citationEpidemiological modeling of news and rumors on Twitter
Jin, F., Dougherty, E., Saraf, P., Cao, Y., & Ramakrishnan, N. (2013) · Proceedings of the 7th Workshop on Social Network Mining and Analysis · doi:10.1145/2501025.2501027 · Cited by 342
Evidence of complex contagion of information in social media: An experiment using Twitter bots
Mønsted, B., Sapieżyński, P., Ferrara, E., & Lehmann, S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184148 · Cited by 325
Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes
Kumar, S., West, R., & Leskovec, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883085 · Cited by 310
Anatomy of an online misinformation network
Shao, C., Hui, P.-M., Wang, L., Jiang, X., Flammini, A., Menczer, F., & Ciampaglia, G. L. (2018) · PLOS ONE · doi:10.1371/journal.pone.0196087 · Cited by 278
Self-citationHameleers, M., Powell, T. E., Van Der Meer, T. G. L. A., & Bos, L. (2020) · Political Communication · doi:10.1080/10584609.2019.1674979 · Cited by 273
Lutzke, L., Drummond, C., Slovic, P., & Árvai, J. (2019) · Global Environmental Change · doi:10.1016/j.gloenvcha.2019.101964 · Cited by 239
Shen, C., Kasra, M., Pan, W., Bassett, G. A., Malloch, Y., & O’Brien, J. F. (2019) · New Media & Society · doi:10.1177/1461444818799526 · Cited by 209
Pausing to consider why a headline is true or false can help reduce the sharing of false news
Fazio, L. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-009 · Cited by 187
Learning to evaluate: An intervention in civic online reasoning
McGrew, S. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103711 · Cited by 179
Effects of Credibility Indicators on Social Media News Sharing Intent
Yaqub, W., Kakhidze, O., Brockman, M. L., Memon, N., & Patil, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376213 · Cited by 171
Self-citationActing the Part: Examining Information Operations Within #BlackLivesMatter Discourse
Arif, A., Stewart, L. G., & Starbird, K. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274289 · Cited by 152
COVID-19 on Social Media: Analyzing Misinformation in Twitter Conversations
Sharma, K., Seo, S., Meng, C., Rambhatla, S., & Liu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12309 · Cited by 130
Early detection of promoted campaigns on social media
Varol, O., Ferrara, E., Menczer, F., & Flammini, A. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0111-y · Cited by 128
Self-citationConspiracies Online: User Discussions in a Conspiracy Community Following Dramatic Events
Samory, M., & Mitra, T. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15039 · Cited by 66
Growing Wikipedia Across Languages via Recommendation
Wulczyn, E., West, R., Zia, L., & Leskovec, J. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883077 · Cited by 62
Uncovering Coordinated Networks on Social Media.
Pacheco, D. F., Hui, P.-M., Torres-Lugo, C., Truong, B. T., Flammini, A., & Menczer, F. (2020) · Cited by 38
Self-citationBotSlayer: real-time detection of bot amplification on Twitter
Hui, P.-M., Yang, K.-C., Torres-Lugo, C., Monroe, Z., McCarty, M., Serrette, B., Pentchev, V., & Menczer, F. (2019) · The Journal of Open Source Software · doi:10.21105/joss.01706 · Cited by 23
Self-citationShen, C., Kasra, M., Pan, W., et al. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3234129 · Cited by 22
Social Informatics: Proceedings of the 6th International Conference (SocInfo 2014)
Aiello, L. M., & McFarland, D. A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13734-6 · Cited by 5
Research works printed but not linked: 12
- Arif, A., Stewart, L. G., & Starbird, K. (2018). Acng the part: Examining informaon operaons within #Black- LivesMaer discourse. Proc. ACM Hum.-Comput. Interact., 2(CSCW). https://doi.org/10.1145/327 4289 · doi:10.1145/327
- Nygren, T., Brounéus, F., & Svensson, G. (2019). Diversity and credibility in young people’s news feeds: A foundaon for teaching and learning cizenship in a digital era. Journal of Social Science Educaon, 18(2), 87–109.
- Pérez-Rosas, V., Kleinberg, B., Lefevre, A., & Mihalcea, R. (2018). Automac detecon of fake news, In Pro- ceedings of the 27th internaonal conference on computaonal linguiscs, Santa Fe, New Mexico, USA, Associaon for Computaonal Linguiscs. https://www.aclweb.org/anthology/C18-1287
- misinformaon. Journal of Risk Research, 22(5), 570–580. https://doi.org/10.1080/13669877.201 · doi:10.1080/13669877.201
- formaon Review, 1(2). https://doi.org/10.37016/mr-2020-00 · doi:10.37016/mr-2020-00
- dramac events, In Twelh internaonal AAAI conference on web and social media. https://www
- credibility content by social bots. Nature Communicaons, 9(1), 4787. https://doi.org/10.1038/s4 · doi:10.1038/s4
- online misinformaon network. PLOS ONE, 13(4), 1–23. https://doi.org/10.1371/journal.pone.01 · doi:10.1371/journal.pone.01
- Proceedings. https://doi.org/10.9776/14308 · DOI · Paper page
- Proc. ACM WSDM, Workshop on misinformaon and misbehavior mining on the web.
- media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM17/paper/view/15587/14817
- media. EPJ Data Science, 6(1), 13. https://doi.org/10.1140/epjds/s13688-017-0111-y · DOI · Paper page
Cited by
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Factuality challenges in the era of large language models and opportunities for fact-checking
Augenstein, I., Baldwin, T., Cha, M., Chakraborty, T., Ciampaglia, G. L., Corney, D., DiResta, R., Ferrara, E., Hale, S., Halevy, A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00881-z · Cited by 187
Self-citationSocial Drivers and Algorithmic Mechanisms on Digital Media.
Metzler, H., & Garcia, D. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231185057 · Cited by 204
“Other suggestions include toning down status incentives by hiding or reducing the visibility of engagement metrics for certain types of posts (Avram et al., 2020) or adding cues that spotlight passive user behaviors (e.g., how many scrolled over a post; Lorenz-Spreen et al., 2020).”
BackgroundResearch into practice: Virtual exchange in language teaching and learning
Dooly, M., & Vinagre, M. (2022) · Language Teaching · doi:10.1017/s0261444821000069 · Cited by 161
Metadata
- Authors
- Avram, M., Micallef, N., Patil, S., & Menczer, F.
- Affiliations
- New York University Abu Dhabi (AE)
- Indiana University Bloomington (US)
- Venue
- Harvard Kennedy School Misinformation Review
- Published
- 2020-07-25
- ISSN
- 2766-1652 (ISSN-L)
- OpenAlex
- W3022818210
- Cited by
- 83
- References
- 38
- Citations by year
- 2026: 16 · 2025: 15 · 2024: 12 · 2023: 14 · 2022: 12 · 2021: 12 · 2020: 2
- FWCI
- 13.35
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Harvard Kennedy School Misinformation Review (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- engagement metrics, social media, news feeds, social media design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

