Tackling misinformation: What researchers could do with social media data
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Written by Michelle A. Amazeen, Fabrício Benevenuto, Nadia M. Brashier, Robert M. Bond, Lia C. Bozarth, Ceren Budak, Ullrich K. H. Ecker, Lisa K. Fazio, Emilio Ferrara, Andrew J. Flanagin, Ales-sandro Flammini, Deen Freelon, Nir Grinberg, Ralph Hertwig, Kathleen Hall Jamieson, Kenneth Jo-seph, Jason J. Jones, R. Kelly Garrett, Daniel Kreiss, Shannon McGregor, Jasmine McNealy, Drew Margolin, Alice Marwick, FiIippo Menczer, Miriam J. Metzger, Seungahn Nah, Stephan Lewan-dowsky, Philipp Lorenz-Spreen, Pablo Ortellado, Irene Pasquetto, Gordon Pennycook, Ethan Porter, David G. Rand, Ronald Robertson, Briony Swire-Thompson, Francesca Tripodi, Soroush Vosoughi, Chris Vargo, Onur Varol, Brian E. Weeks, John Wihbey, Thomas J. Wood, & Kai-Cheng Yang
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“More often the decision reflects practical concerns, as when researchers use fact checkers’ archives to identify which claims to study (e.g., Vosoughi et al., 2018), despite the significant selection bias introduced by focusing on high-diffusion cases (Goel et al., 2012).”
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160 · cited 1×
“…Media, Indiana University, USA, (3) Information Sciences Institute, University of Southern California, USA Efforts to disseminate disinformation and manipulate public opinion show similarities with early propaganda and persuasion campaigns (Lazer et al. 2018; Starbird, 2019; Varol & Uluturk, 2018).”
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Self-citationPennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715
Less than you think: Prevalence and predictors of fake news dissemination on Facebook
Guess, A., Nagler, J., & Tucker, J. (2019) · Science Advances · doi:10.1126/sciadv.aau4586 · Cited by 1,652 · cited 2×
“Emphasizing “successful” misinformatio n also overlooks important variants, as most political falsehoods fail to find a large audience (Allen et al., 2020; Guess et al., 2019) and are shared primarily within small enclaves (Bail et al., 2019; Grinberg et al., 2019; Guess et al., 2020).”
Shifting attention to accuracy can reduce misinformation online
Pennycook, G., Epstein, Z., Mosleh, M., Arechar, A. A., Eckles, D., & Rand, D. G. (2021) · Nature · doi:10.1038/s41586-021-03344-2 · Cited by 1,155
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981 · cited 1×
“Inauthentic, coordinated, malicious accounts, whether human-controlled or automated (Ferrara et al., 2016; Shao et al., 2018; Varol et al., 2017; Yang et al., 2019), domestic or state-sponsored (Zannettou et al., 2019), or anywhere in between, have been weaponized to influence public conversations…”
Fighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · cited 1×
“Finally, we would also be interested in assessing the impact of incorporating layperson (user) accuracy ratings, either of news sources (Epstein et al, 2020; Pennycook & Rand, 2019) or individual pieces of content (Allen, Arechar, et al. 2020), into social media ranking algorithms.”
Guess, A. M., Lerner, M., Lyons, B., Montgomery, J. M., Nyhan, B., Reifler, J., & Sircar, N. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1920498117 · Cited by 773
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · cited 1×
“In the rare case data sharing is a possibility, negotiations have been slow for several reasons, including platforms’ concerns over protecting their brands and reputation, and ethical and legal issues of privacy and data security on a grand scale (Bechmann & Kim, 2020; Olteanu et al., 2019).”
BackgroundSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Clayton, K., Blair, S., Busam, J. A., Forstner, S., Glance, J., Green, G., Kawata, A., Kovvuri, A., Martin, J., Morgan, E., et al. (2020) · Political Behavior · doi:10.1007/s11109-019-09533-0 · Cited by 658
Knowledge does not protect against illusory truth.
Fazio, L. K., Brashier, N. M., Payne, B. K., & Marsh, E. J. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000098 · Cited by 598 · cited 1×
“Given that repetition makes claims seem more credible to both young (Fazio et al., 2015) and older (Brashier et al., 2018) adults, it is also essential to know not just what people see, but also how often they see it.”
Exposure to untrustworthy websites in the 2016 US election
Guess, A. M., Nyhan, B., & Reifler, J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0833-x · Cited by 587
Evaluating the fake news problem at the scale of the information ecosystem
Allen, J., Howland, B., Mobius, M., Rothschild, D., & Watts, D. J. (2020) · Science Advances · doi:10.1126/sciadv.aay3539 · Cited by 528
Computational social science: Obstacles and opportunities
Lazer, D. M. J., Pentland, A., Watts, D. J., Aral, S., Athey, S., Contractor, N., Freelon, D., Gonzalez-Bailon, S., King, G., Margetts, H., et al. (2020) · Science · doi:10.1126/science.aaz8170 · Cited by 453
Arming the public with artificial intelligence to counter social bots
Yang, K., Varol, O., Davis, C. A., Ferrara, E., Flammini, A., & Menczer, F. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.115 · Cited by 419 · cited 1×
“Inauthentic, coordinated, malicious accounts, whether human-controlled or automated (Ferrara et al., 2016; Shao et al., 2018; Varol et al., 2017; Yang et al., 2019), domestic or state-sponsored (Zannettou et al., 2019), or anywhere in between, have been weaponized to influence public conversations…”
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · doi:10.31234/osf.io/uhbk9 · Cited by 390
Scaling up fact-checking using the wisdom of crowds
Allen, J., Arechar, A. A., Pennycook, G., & Rand, D. G. (2021) · Science Advances · doi:10.1126/sciadv.abf4393 · Cited by 234 · cited 2×
“Finally, we would also be interested in assessing the impact of incorporating layperson (user) accuracy ratings, either of news sources (Epstein et al, 2020; Pennycook & Rand, 2019) or individual pieces of content (Allen, Arechar, et al. 2020), into social media ranking algorithms.”
Bail, C. A., Guay, B., Maloney, E., Combs, A., Hillygus, D. S., Merhout, F., Freelon, D., & Volfovsky, A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906420116 · Cited by 224 · cited 1×
“Emphasizing “successful” misinformatio n also overlooks important variants, as most political falsehoods fail to find a large audience (Allen et al., 2020; Guess et al., 2019) and are shared primarily within small enclaves (Bail et al., 2019; Grinberg et al., 2019; Guess et al., 2020).”
Protecting elections from social media manipulation
Aral, S., & Eckles, D. (2019) · Science · doi:10.1126/science.aaw8243 · Cited by 209 · cited 1×
“Emphasizing “successful” misinformatio n also overlooks important variants, as most political falsehoods fail to find a large audience (Allen et al., 2020; Guess et al., 2019) and are shared primarily within small enclaves (Bail et al., 2019; Grinberg et al., 2019; Guess et al., 2020).”
BackgroundDisinformation’s spread: bots, trolls and all of us
Starbird, K. (2019) · Nature · doi:10.1038/d41586-019-02235-x · Cited by 203
Pausing to consider why a headline is true or false can help reduce the sharing of false news
Fazio, L. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-009 · Cited by 187
How Politics Shape Views Toward Fact-Checking: Evidence from Six European Countries
Lyons, B., Mérola, V., Reifler, J., & Stoeckel, F. (2020) · The International Journal of Press/Politics · doi:10.1177/1940161220921732 · Cited by 82
Epstein, Z., Pennycook, G., & Rand, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376232 · Cited by 67 · cited 1×
“Finally, we would also be interested in assessing the impact of incorporating layperson (user) accuracy ratings, either of news sources (Epstein et al, 2020; Pennycook & Rand, 2019) or individual pieces of content (Allen, Arechar, et al. 2020), into social media ranking algorithms.”
Journalists on Twitter: self-branding, audiences, and involvement of bots
Varol, O., & Uluturk, I. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-019-00056-6 · Cited by 39 · cited 1×
“Temporal anomalies leave marks of coordinated activities and remain detectable years after an operation (Varol & Uluturk, 2019).”
Cited by
Shifting attention to accuracy can reduce misinformation online
Pennycook, G., Epstein, Z., Mosleh, M., Arechar, A. A., Eckles, D., & Rand, D. G. (2021) · Nature · doi:10.1038/s41586-021-03344-2 · Cited by 1,155
A systematic review of worldwide causal and correlational evidence on digital media and democracy
Lorenz-Spreen, P., Oswald, L., Lewandowsky, S., & Hertwig, R. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01460-1 · Cited by 348
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
“This could lead to censorship or the amplification of harmful content, perpetuating biases and misinformation [116, 117, 118].”
BackgroundShould ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · arXiv · doi:10.48550/arxiv.2304.03738 · Cited by 282
Kingdom of Trolls? Influence Operations in the Saudi Twittersphere
Barrie, C., & Siegel, A. (2021) · Journal of Quantitative Description: Digital Media · doi:10.51685/jqd.2021.012 · Cited by 12
“Third, much of the information shared online remains proprietary, inaccessible to the public, and subject to unpredictable changes in terms of use (Freelon, 2018; Pasquetto et al., 2020).”
Background
Metadata
- Authors
- Pasquetto, I., Swire-Thompson, B., & Amazeen, M. A.
- Venue
- Harvard Kennedy School Misinformation Review
- Published
- 2020-12-09
- ISSN
- 2766-1652 (ISSN-L)
- OpenAlex
- W3112646659
- Cited by
- 86
- References
- 26
- FWCI
- 20.16
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.