The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Developing Misinformation Immunity: How to Reason-Check Fallacious News in a Human–Computer Interaction Environment
Open accessAbstract
To counter the fake news phenomenon, the scholarly community has attempted to debunk and prebunk disinformation. However, misinformation still constitutes a major challenge due to the variety of misleading techniques and their continuous updates which call for the exercise of critical thinking to build resilience. In this study we present two open access chatbots, the Fake News Immunity Chatbot and the Vaccinating News Chatbot, which combine Fallacy Theory and Human–Computer Interaction to inoculate citizens and communication gatekeepers against misinformation. These chatbots differ from existing tools both in function and form. First, they target misinformation and enhance the identification of fallacious arguments; and second, they are multiagent and leverage discourse theories of persuasion in their conversational design. After having described both their backend and their frontend design, we report on the evaluation of the user interface and impact on users’ critical thinking skills through a questionnaire, a crowdsourced survey, and a pilot qualitative experiment. The results shed light on the best practices to design user-friendly active inoculation tools and reveal that the two chatbots are perceived as increasing critical thinking skills in the current misinformation ecosystem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the phenomenon of GenAI producing biassed or inaccurate information, commonly referred to as GenAI hallucination, has surprisingly been observed to contribute to the enhancement of students' critical analysis skills.”
From The Mediating Role of Generative AI Self-Regulation on Students’ Critical Thinking and Problem-Solving (2024) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McCright, A. M., & Dunlap, R. E. (2011) · The Sociological Quarterly · doi:10.1111/j.1533-8525.2011.01198.x · Cited by 2,340
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022 · cited 1×
“…trust values to mainstream media sources, hyperpartisan ones, and fake news websites, despite appearing quite well developed in experimental environments (Pennycook & Rand, 2019), are not well enough developed to identify misinformation across different media platforms and in everyday interactions.”
BackgroundWalton, D., Reed, C., & Macagno, F. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802034 · Cited by 1,372 · cited 2×
“The heuristics is, in fact, composed of a set of critical questions , which are conceived in Argumentation Theory (Walton et al., 2008) as those questions that scrutinize the soundness of the reasoning expressed by the arguments (e.g., “Is the reported evidence [if any] the only available?” to verify whether cherry pi…”
BackgroundSelf-citationCritical Thinking and Subject Specificity: Clarification and Needed Research
Ennis, R. H. (1989) · Educational Researcher · doi:10.2307/1174885 · Cited by 1,055
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027 · cited 1×
“…post-intervention surveys with the same population of workers, we have encountered issues such as fraudulent, nonsensical, and partial responding, which are common for complex tasks that require a willingness to engage (Chmielewski & Kucker, 2020), but they do not allow for a valid assessment.”
BackgroundCredibility and trust of information in online environments: The use of cognitive heuristics
Metzger, M. J., & Flanagin, A. J. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2013.07.012 · Cited by 1,000 · cited 1×
“Another possible explanation lies in the reputation cognitive heuristics according to which “people are likely to believe a source whose name they recognize as more credible compared to an unfamiliar source” (Metzger & Flanagin, 2013, p. 214).”
BackgroundCook, J., Lewandowsky, S., & Ecker, U. K. H. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175799 · Cited by 971 · cited 1×
“…has shown that instructing against misleading rhetorical strategies is a highly efficient way to boost people’s resilience against fake news (Cook et al., 2017) and that content features such as degree of novelty and emotional reactions of recipients are key factors in making fake news…”
BackgroundStrategies for Teaching Students to Think Critically: A Meta-Analysis
Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015) · Review of Educational Research · doi:10.3102/0034654314551063 · Cited by 932 · cited 1×
“This choice is reminiscent of the fact that authentic problems are a crucial factor when teaching critical thinking (Abrami et al., 2015).”
BackgroundMetzger, M. J. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20672 · Cited by 871
The media and the literacies: media literacy, information literacy, digital literacy
Koltay, T. (2011) · Media, Culture & Society · doi:10.1177/0163443710393382 · Cited by 796 · cited 1×
“Koltay (2011) lists, for example, “Having a critical approach to quality and accuracy of content” among the five stages to build media literacy” (p. 213).”
Background
Research works printed but not linked: 4
- Facione P. A. (1990). The California critical thinking skills test: College level. Technical report #1—Experimental validation and content validity. https://www.researchgate.net/profile/Peter-Facione/publication/268295703_The_California_Critical_Thinking_Skills_Test_College_Level_Experimental_Validation_and_Content_Validity/links/587677f908aebf17d3b9a162/The-California-Critical-Thinking-Skills-Test-Co
- Hatcher D. L., 2005, Reasoning and writing: From critical thinking to composition
- Johnson R. H., 2006, Logical self-defense
- Mercier H., 2017, The enigma of reason: A new theory of human undersanding
Cited by
Zhou, X., Teng, D., & Al-Samarraie, H. (2024) · Education Sciences · doi:10.3390/educsci14121302 · Cited by 119
“…might undermine advanced cognitive capabilities, the necessity making of GenAI hal-lucination students’ from the tool, which as a result in fl uences their ability to distinguish between accurate and inaccurate AI-generated content—a competency that is increasingly essential as they engage [16].”
Parsakia, K. (2023) · Health Nexus · doi:10.61838/hn.1.1.14 · Cited by 89
Shin, D., & Akhtar, F. (2024) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2024.2323712 · Cited by 40
“…of AI and given the volume of misinformation online, misinformation immunization initiatives have gained prominence for mitigating the spread of AI-generated misinformation (Musi et al., 2023) by alleviating susceptibility to both individual instances of misinformation (Compton et al., 2022).”
BackgroundCountering Misinformation in Private Messaging Groups: Insights From a Fact-checking Chatbot
Lee, T.-H., & Fussell, S. R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701189 · Cited by 21
“Instead of information providers, AI systems could stimulate reasoning, such as chatbot enhancing critical thinking skills via peer discussion [72].”
Johnston, S., McGrane, J. A., Morancho, M. V., & Hopfenbeck, T. N. (2023) · Review of Education · doi:10.1002/rev3.3442 · Cited by 17
Metadata
- Authors
- Musi, E., Carmi, E., Reed, C., Yates, S., & O’Halloran, K.
- Affiliations
- University of Liverpool (GB)
- City, University of London (GB)
- University of Dundee (GB)
- Corresponding author
- Musi, Elena
- Venue
- Social Media + Society
- Publisher
- SAGE Publications
- Published
- 2023-01
- Volume
- 9
- Issue
- 1
- ISSN
- 2056-3051 (ISSN-L)
- OpenAlex
- W4318313270
- Cited by
- 34
- References
- 55
- Citations by year
- 2026: 8 · 2025: 15 · 2024: 8 · 2023: 3
- FWCI
- 14.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Social Media + Society (publishedVersion, cc-by)
- Discovery Research Portal (University of Dundee) (publishedVersion, cc-by)
- City Research Online (City University London) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- misinformation, fake news, inoculation theory, prebunking, fallacy theory, chatbots, multi-agent systems, critical thinking, persuasion, discourse theory, user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing Misinformation Immunity: How to Reason-Check Fallacious News in a Human–Computer Interaction Environment. https://app.cochat.ai/papers/10.1177/20563051221150407
- The paper
- Musi, E., Carmi, E., Reed, C., Yates, S., & O’Halloran, K. (2023). Developing Misinformation Immunity: How to Reason-Check Fallacious News in a Human–Computer Interaction Environment. Social Media + Society. https://doi.org/10.1177/20563051221150407
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.