Breaking Harmony Square: A game that “inoculates” against political misinformation
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
We present Harmony Square, a short, free-to-play online game in which players learn how political misinformation is produced and spread. We find that the game confers psychological resistance against manipulation techniques commonly used in political misinformation: players from around the world find social media content making use of these techniques significantly less reliable after playing, are more confident in their ability to spot such content, and less likely to report sharing it with others in their network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715
Emotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,580 · cited 2×
“Exploiting emotional language, i.e., trying to make people afraid or angry about a particular topic (Brady et al., 2017; Zollo et al., 2015).”
BackgroundSusceptibility to misinformation about COVID-19 around the world
Roozenbeek, J., Schneider, C. R., Dryhurst, S., Kerr, J., Freeman, A. L. J., Recchia, G., van der Bles, A. M., & van der Linden, S. (2020) · Royal Society Open Science · doi:10.1098/rsos.201199 · Cited by 1,447
Self-citationCook, J., Lewandowsky, S., & Ecker, U. K. H. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175799 · Cited by 971 · cited 3×
“…(which has been the standard in inoculation research), Harmony Square builds cognitive resistance against the techniques that underpin a whole range of political misinformation in an attempt to achieve broad-spectrum resistance against manipulation (Basol et al., 2020; Cook et al., 2017).”
BackgroundFake news game confers psychological resistance against online misinformation
Roozenbeek, J., & van der Linden, S. (2019) · Palgrave Communications · doi:10.1057/s41599-019-0279-9 · Cited by 708
Self-citationLewandowsky, S., Oberauer, K., & Gignac, G. E. (2013) · Psychological Science · doi:10.1177/0956797612457686 · Cited by 638 · cited 2×
“Creating and spreading conspiracy theories, i.e., blaming a small, secretive and nefarious organization for events going on in the world (Lewandowsky et al., 2013; van der Linden, 2015).”
BackgroundMcGuire, W. J., & Papageorgis, D. (1961) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0042026 · Cited by 476
van der Linden, S. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.07.045 · Cited by 391 · cited 7×
“Creating and spreading conspiracy theories, i.e., blaming a small, secretive and nefarious organization for events going on in the world (Lewandowsky et al., 2013; van der Linden, 2015).”
BackgroundInfluentialPennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · doi:10.31234/osf.io/uhbk9 · Cited by 390
Political Astroturfing on Twitter: How to Coordinate a Disinformation Campaign
Keller, F. B., Schoch, D., Stier, S., & Yang, J. (2020) · Political Communication · doi:10.1080/10584609.2019.1661888 · Cited by 378 · cited 1×
“, 2017), for example, by fueling outgroup hostility, a critical element of both organic misinformation and targeted disinformation campaigns, particularly during contentious political events such as the 2020 US Presidential elections (Groshek & Koc-Michalska, 2017; Hindman & Barash, 2018; Iyengar & Massey, 2018; Kelle…”
BackgroundScientific communication in a post-truth society
Iyengar, S., & Massey, D. S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1805868115 · Cited by 374
Basol, M., Roozenbeek, J., & Van der Linden, S. (2020) · Journal of Cognition · doi:10.5334/joc.91 · Cited by 368 · cited 12×
“…(which has been the standard in inoculation research), Harmony Square builds cognitive resistance against the techniques that underpin a whole range of political misinformation in an attempt to achieve broad-spectrum resistance against manipulation (Basol et al., 2020; Cook et al., 2017).”
BackgroundMethodInfluentialSelf-citationLong-term effectiveness of inoculation against misinformation: Three longitudinal experiments.
Maertens, R., Roozenbeek, J., Basol, M., & van der Linden, S. (2021) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000315 · Cited by 321 · cited 13×
“Following the methodology established in prior research on “fake news” games (Basol et al., 2020; Maertens et al., 2020; Roozenbeek, Maertens, et al., 2020; Roozenbeek & van der Linden, 2019), we measured reliability judgments of social media posts containing misinformation, both before and after the intervention on a…”
BackgroundMethodInfluentialSelf-citationUsers Polarization on Facebook and Youtube
Bessi, A., Zollo, F., Del Vicario, M., Puliga, M., Scala, A., Caldarelli, G., Uzzi, B., & Quattrociocchi, W. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159641 · Cited by 285 · cited 1×
“Unlike Bad News, Harmony Square is an election game that focuses specifically on how misinformation can be used to achieve political polarization (Bessi et al., 2016; Shao et al., 2017), for example, by fueling outgroup hostility, a critical element of both organic misinformation and targeted…”
BackgroundEmotional Dynamics in the Age of Misinformation
Zollo, F., Novak, P. K., Del Vicario, M., Bessi, A., Mozetič, I., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138740 · Cited by 273 · cited 2×
“Exploiting emotional language, i.e., trying to make people afraid or angry about a particular topic (Brady et al., 2017; Zollo et al., 2015).”
BackgroundYou are fake news: political bias in perceptions of fake news
van der Linden, S., Panagopoulos, C., & Roozenbeek, J. (2020) · Media, Culture & Society · doi:10.1177/0163443720906992 · Cited by 235
Self-citationVraga, E. K., Kim, S. C., & Cook, J. (2019) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2019.1653102 · Cited by 162 · cited 2×
“Aside from increasing the entertainment value of the game, the use of humor in inoculation interventions has the added benefit of potentially decreasing reactance, i.e., resistance to voluntarily engaging with the intervention (Compton, 2018; Vraga et al., 2019).”
BackgroundCompton, J. (2012) · The SAGE Handbook of Persuasion: Developments in Theory and Practice · doi:10.4135/9781452218410.n14 · Cited by 158
Roozenbeek, J., Maertens, R., McClanahan, W., & van der Linden, S. (2021) · Educational and Psychological Measurement · doi:10.1177/0013164420940378 · Cited by 80
Self-citationReliance on emotion promotes belief in fake news
Martel, C., Pennycook, G., & Rand, D. G. (2019) · doi:10.31234/osf.io/a2ydw · Cited by 49
Cited by
The psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Countering Misinformation and Fake News Through Inoculation and Prebunking
Lewandowsky, S., & van der Linden, S. (2021) · European Review of Social Psychology · doi:10.1080/10463283.2021.1876983 · Cited by 773
Self-citationMisinformation: susceptibility, spread, and interventions to immunize the public
van der Linden, S. (2022) · Nature Medicine · doi:10.1038/s41591-022-01713-6 · Cited by 570
Psychological Inoculation against Misinformation: Current Evidence and Future Directions
Traberg, C. S., Roozenbeek, J., & van der Linden, S. (2022) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/00027162221087936 · Cited by 224
Self-citationVisual Mis- and Disinformation, Social Media, and Democracy
Dan, V., Paris, B., Donovan, J., Hameleers, M., Roozenbeek, J., van der Linden, S., & von Sikorski, C. (2021) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990211035395 · Cited by 144
Self-citation
Metadata
- Authors
- Roozenbeek, J., & van der Linden, S.
- Venue
- Harvard Kennedy School Misinformation Review
- Published
- 2020-11-06
- ISSN
- 2766-1652 (ISSN-L)
- OpenAlex
- W3096296182
- Cited by
- 137
- References
- 20
- FWCI
- 22.14
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.