Emphasizing publishers does not effectively reduce susceptibility to misinformation on social media
Open accessPublished version of a preprint
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Survey experiments with nearly 7,000 Americans suggest that increasing the visibility of publishers is an ineffective, and perhaps even counterproductive, way to address misinformation on social media. Our findings underscore the importance of social media platforms and civil society organizations evaluating interventions experimentally rather than implementing them based on intuitive appeal. Research Question Platforms are making
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The crowdsourced accuracy ratings generated by this process may also be useful for identifying misinformation, as has been found for crowd ratings of source trustworthiness 138,139 .”
From Using social and behavioural science to support COVID-19 pandemic response (2020) · cites this paper as [138]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“the salience of source information does not appear to change how accurately people identify fabricated news stories55, manipulated images56, or false news headlines57,58”
From Human detection of political speech deepfakes across transcripts, audio, and video (2024) · cites this paper as [57]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2023) · doi:10.1126/science · Cited by 6,063
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160 · cited 1×
“Scholars are increasingly concerned about the impact of misinformation and hyperpartisan content on platforms such as Facebook and Twitter (Lazer et al., 2018).”
BackgroundSelf-citationThe Persuasiveness of Source Credibility: A Critical Review of Five Decades' Evidence
Pornpitakpan, C. (2004) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2004.tb02547.x · Cited by 2,205 · cited 1×
“Many studies have shown that readers are more likely to believe messages from high-credibility sources relative to identical messages from lowcredibility sources (Pornpitakpan, 2004).”
BackgroundPennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022 · cited 5×
“Yet, others (Austin & Dong, 1994, Pennycook & Rand, 2019b, Jakesch et al., 2018) have failed to demonstrate that assessments of news stories are changed by source information.”
BackgroundMethodResultInfluentialSelf-citationThe Online Laboratory: Conducting Experiments in a Real Labor Market∗Preprint
Zeckhauser, R. J. (2016) · Cited by 1,531
Judd, C. M., Westfall, J., & Kenny, D. A. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028347 · Cited by 1,236
The Generalizability of Survey Experiments
Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015) · Journal of Experimental Political Science · doi:10.1017/xps.2015.19 · Cited by 1,228
Coppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987 · cited 4×
“We then assigned participants from MTurk and the sampling company Lucid (Coppock & McClellan, 2019) to either rate the trustworthiness of a random subset of the 60 sources (N=251 from MTurk in Study 4, N=253 from Lucid in Study 5) or rate the accuracy of a random subset of the 600 headlines…”
MethodInfluentialFighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · cited 5×
“Yet, others (Austin & Dong, 1994, Pennycook & Rand, 2019b, Jakesch et al., 2018) have failed to demonstrate that assessments of news stories are changed by source information.”
BackgroundMethodResultInfluentialSelf-citationPennycook, G., & Rand, D. G. (2020) · Journal of Personality · doi:10.1111/jopy.12476 · Cited by 879
Self-citationRumors and Health Care Reform: Experiments in Political Misinformation
Berinsky, A. J. (2017) · British Journal of Political Science · doi:10.1017/s0007123415000186 · Cited by 703 · cited 1×
“Many studies have found that source credibility can affect judgments of accuracy or believability (Baum & Groeling, 2009; Landrum et al., 2017; Berinsky, 2017; Swire et al., 2017; Knight Foundation, 2018; Kim et al., 2019).”
BackgroundThe online laboratory: conducting experiments in a real labor market
Horton, J. J., Rand, D. G., & Zeckhauser, R. (2011) · Experimental Economics · doi:10.1007/s10683-011-9273-9 · Cited by 567 · cited 1×
“In Study 1, 562 Americans from the online labor market Amazon Mechanical Turk (MTurk; Horton et al., 2011) were shown 24 headlines in the format of the Facebook News Feed (Figure 1).”
BackgroundSelf-citationGeneralizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach
Coppock, A. (2019) · Political Science Research and Methods · doi:10.1017/psrm.2018.10 · Cited by 515 · cited 1×
“Although MTurk workers are not nationally representative, they are a reliable resource for research on political ideology (Coppock, 2018; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
BackgroundProcessing political misinformation: comprehending the Trump phenomenon
Swire, B., Berinsky, A. J., Lewandowsky, S., & Ecker, U. K. H. (2017) · Royal Society Open Science · doi:10.1098/rsos.160802 · Cited by 498
Bronstein, M. V., Pennycook, G., Bear, A., Rand, D. G., & Cannon, T. D. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.09.005 · Cited by 324 · cited 1×
“As in previous research on fake news (e.g. Bronstein et al., 2019; Pennycook et al., in press; Pennycook & Rand, 2019b,c), our primary dependent measures were an accuracy rating (4-point scale from “Not at all accurate” to “Very accurate”) and a sharing intention judgment (3-point scale of “no”,…”
MethodSelf-citationKim, A., Moravec, P. L., & Dennis, A. R. (2019) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1628921 · Cited by 316 · cited 1×
“Many studies have found that source credibility can affect judgments of accuracy or believability (Baum & Groeling, 2009; Landrum et al., 2017; Berinsky, 2017; Swire et al., 2017; Knight Foundation, 2018; Kim et al., 2019).”
BackgroundCross-Sample Comparisons and External Validity
Krupnikov, Y., & Levine, A. S. (2014) · Journal of Experimental Political Science · doi:10.1017/xps.2014.7 · Cited by 251 · cited 1×
“Although MTurk workers are not nationally representative, they are a reliable resource for research on political ideology (Coppock, 2018; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
BackgroundShot by the Messenger: Partisan Cues and Public Opinion Regarding National Security and War
Baum, M. A., & Groeling, T. (2009) · Political Behavior · doi:10.1007/s11109-008-9074-9 · Cited by 193
Source v. Content Effects on Judgments of News Believability
Austin, E. W., & Dong, Q. (1994) · Journalism Quarterly · doi:10.1177/107769909407100420 · Cited by 144 · cited 1×
“Yet, others (Austin & Dong, 1994, Pennycook & Rand, 2019b, Jakesch et al., 2018) have failed to demonstrate that assessments of news stories are changed by source information.”
BackgroundAssessing the Effect of 'Disputed' Warnings and Source Salience on Perceptions of Fake News AccuracyPreprint
Pennycook, G., & Rand, D. G. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3035384 · Cited by 85
Self-citationLandrum, A. R., Lull, R. B., Akin, H., Hasell, A., & Jamieson, K. H. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.015 · Cited by 77 · cited 1×
“Many studies have found that source credibility can affect judgments of accuracy or believability (Baum & Groeling, 2009; Landrum et al., 2017; Berinsky, 2017; Swire et al., 2017; Knight Foundation, 2018; Kim et al., 2019).”
BackgroundEpstein, Z., Pennycook, G., & Rand, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376232 · Cited by 67
Self-citationThe Role of Source, Headline and Expressive Responding in Political News Evaluation
Jakesch, M., Koren, M., Evtushenko, A., & Naaman, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3306403 · Cited by 30 · cited 1×
“Yet, others (Austin & Dong, 1994, Pennycook & Rand, 2019b, Jakesch et al., 2018) have failed to demonstrate that assessments of news stories are changed by source information.”
BackgroundEpstein, Z., Pennycook, G., & Rand, D. G. (2019) · doi:10.31234/osf.io/z3s5k · Cited by 28
Self-citation(2008) · Issue Lab (Candid)
Research works printed but not linked: 1
- Pennycook, G., Bear, A., Collins, E., & Rand, D. G. (In press). The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Stories Increases Perceived Accuracy of Stories Without Warnings. Management Science.
Cited by
Using social and behavioural science to support COVID-19 pandemic response
Bavel, J. J. V., Baicker, K., Boggio, P. S., Capraro, V., Cichocka, A., Cikara, M., Crockett, M. J., Crum, A. J., Douglas, K. M., Druckman, J. N., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0884-z · Cited by 4,964
Self-citationThe psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
“study 4 of [93] in which US participants (n = 1008) from Amazon Mechanical Turk (MTurk) provided accuracy ratings for the”
BackgroundSelf-citationFake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
“…studies , which investigate why and who falls for fake news (Altay et al. 2022; Batailler et al. 2022; Sterret et al. 2018; Badawy et al. 2019; Pennycook and Rand 2020; Weiss et al. 2020; Guadagno and Guttieri 2021), whom to trust and how perceptions of misinformation and disinformation…”
BackgroundCitizens Versus the Internet: Confronting Digital Challenges With Cognitive Tools
Kozyreva, A., Lewandowsky, S., & Hertwig, R. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620946707 · Cited by 479
Metadata
- Authors
- Dias, N., Pennycook, G., & Rand, D. G.
- Affiliations
- University of Regina (CA)
- Massachusetts Institute of Technology (US)
- Venue
- Harvard Kennedy School Misinformation Review
- Published
- 2020-01-14
- ISSN
- 2766-1652 (ISSN-L)
- OpenAlex
- W2998076808
- Cited by
- 145
- References
- 24
- Citations by year
- 2026: 8 · 2025: 18 · 2024: 20 · 2023: 32 · 2022: 24 · 2021: 33 · 2020: 10
- FWCI
- 33.44
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Harvard Kennedy School Misinformation Review (publishedVersion, cc-by)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- John Templeton Foundation
- William and Flora Hewlett Foundation
- Miami Foundation
- Social Sciences and Humanities Research Council of Canada
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- misinformation, social media, misinformation interventions, platform accountability, civil society organizations, survey experiment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.