Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment
Open accessThe DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
As misinformation increasingly proliferates on social media platforms, it has become crucial to explore how to best convey automated news credibility assessments to end-users, and foster trust in fact-checking AIs. In this paper, we investigate how model-agnostic, natural language explanations influence trust and reliance on a fact-checking AI. We construct explanations from four Conceptualisation Validations (CVs) - namely consensual, expert, internal (logical), and empirical - which are foundational units of evidence that humans utilise to validate and accept new information. Our results show that providing explanations significantly enhances trust in AI, even in a fact-checking context where influencing pre-existing beliefs is often challenging, with different CVs causing varying degrees of reliance. We find consensual explanations to be the least influential, with expert, internal, and empirical explanations exerting twice as much influence. However, we also find that users could not discern whether the AI directed them towards the truth, highlighting the dual nature of explanations to both guide and potentially mislead. Further, we uncover the presence of automation bias and aversion during collaborative fact-checking, indicating how users' previously established trust in AI can moderate their reliance on AI judgements. We also observe the manifestation of a 'boomerang'/backfire effect often seen in traditional corrections to misinformation, with individuals who perceive AI as biased or untrustworthy doubling down and reinforcing their existing (in)correct beliefs when challenged by the AI. We conclude by presenting nuanced insights into the dynamics of user behaviour during AI-based fact-checking, offering important lessons for social media platforms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This method, known as 'cognitive forcing', has recently been adopted in AI systems, where it has shown promising signs of reducing overreliance at the cost of increased cognitive load [6,57].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [57]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910 · cited 1×
“We conducted a likelihood ratio test between our final model and the null model to ascertain the goodness of fit [8].”
MethodThe spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 2×
“Moreover, alerting individuals to the veracity of posts directly at reading time is more optimal than offering it afterwards, since corrective messages tend to propagate slower than misinformation [112] and may not reach all exposed to it.”
BackgroundSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“• Trust in Automation (TiA): A set of validated questionnaire scales to measure subjective trust [56], from which we adopted the Propensity to Trust (TiA-PtT) subscale to account for any effects of dispositional trust on user reliance, following similar studies [39, 59].”
BackgroundMethodA study of normative and informational social influences upon individual judgment.
Deutsch, M., & Gerard, H. B. (1955) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0046408 · Cited by 4,819 · cited 1×
“Social influence literature identifies two motivations for individuals to conform to a majority opinion: normative influences (conforming to gain approval and fit in) and informational influences (conforming to be more correct) [20].”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
A Theory of Psychological Reactance
Mishler, E. G. (1968) · Psychosomatic Medicine · doi:10.1097/00006842-196811000-00013 · Cited by 1,665
Research works printed but not linked: 13
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- Santanu Chakrabarti, Lucile Stengel, and Sapna Solanki. 2018. Duty, identity, credibility: Fake news and the ordinary citizen in India. BBC World Service Audiences Research (2018).
- 10.1007/s10869-011--9231--8 · doi:10.1007/s10869-011--9231--8
- 10.1111/j.1083--6101.2007.00388.x · doi:10.1111/j.1083--6101.2007.00388.x
- N.A. Karlova and K.E. Fisher. 2013. A social diffusion model of misinformation and disinformation for understanding human information behaviour. Information Research, Vol. 18 (Jan. 2013).
- 10.1111/j.1460--2466.2010.01488.x · doi:10.1111/j.1460--2466.2010.01488.x
- 10.1186/s41235-020-00251--4 · doi:10.1186/s41235-020-00251--4
- Harikumar Pallathadka, Malik Jawarneh, Domenic Sanchez, Guna Sajja, Sanjeev Gour, and Mohd Naved. 2021. The Impact of Machine Learning on Management, Healthcare, and Agriculture. (July 2021).
- 10.1111/j.1559--1816.2004.tb02547.x · doi:10.1111/j.1559--1816.2004.tb02547.x
- 10.37016/mr-2020--81 · doi:10.37016/mr-2020--81
- Ron Sellers. 2013. How Sliders Bias Survey Data. MRA's Alert, Vol. 53, 3 (2013), 56--57. https://greymatterresearch.com/wp-content/uploads/2019/09/Alert-Sliders-2013.pdf
- 10.1111/j.1540--5907.2006.00214.x · doi:10.1111/j.1540--5907.2006.00214.x
- 10.1007/978--3-030--85610--6_26 · doi:10.1007/978--3-030--85610--6_26
Cited by
Exploring people's perceptions of LLM-generated advice
Wester, J., de Jong, S., Pohl, H., & van Berkel, N. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100072 · Cited by 91
de Jong, S., Paananen, V., Tag, B., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710946 · Cited by 32
Pareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 27
Self-citationResponsibility Attribution in Human Interactions with Everyday AI Systems
Brailsford, J., Vetere, F., & Velloso, E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713126 · Cited by 25
Self-citationAssessing the accuracy and explainability of using ChatGPT to evaluate the quality of health news
Liu, X., He, L., Alanazi, E. M., Liu, E., Goss, A., & Gumireddy, L. (2025) · BMC Public Health · doi:10.1186/s12889-025-23206-0 · Cited by 15
Stakeholder-centric participation in large language models enhanced health systems
Wang, Z., Yan, R., Francis, S., Diaz, C., Flickinger, T., Lin, Y., Xiao, H., Barnes, L. E., & LeBaron, V. T. (2025) · npj Health Systems · doi:10.1038/s44401-025-00024-5 · Cited by 11
de Jong, S., Bos, M. W., van Berkel, N., & Lamers, M. H. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2535732 · Cited by 20
Mena, P. (2025) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990251347657 · Cited by 9
Catch me if you search: When contextual web search results affect the detection of hallucinations
Nahar, M., Lee, E.-J., Park, J. W., & Lee, D. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108763 · Cited by 7
Delaunay, J., Galárraga, L. A., Largouët, C., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711011 · Cited by 14
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791467 · Cited by 5
“Studies also showed that confirming decisions by expert or empirical validation can be useful, in the form of conceptual validations (CVs) [112].”
InfluentialCustomer Immersiveness and Customer Retention: A Metaverse-Driven Study for Brands
Srivastava, A., Singh, B. M., Singh, A., & Singh, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0340-6.ch023 · Cited by 5
AI Agency in Fact-Checking: Role-Based Machine Heuristics and Publics’ Conspiratorial Orientation
Lan, D., Zhu, Y., Liu, M., & He, C. (2025) · Media and Communication · doi:10.17645/mac.9516 · Cited by 7
From Trust to Appropriate Reliance: Measurement Constructs in Human-AI Decision-Making
Raees, M., & Papangelis, K. (2026) · arXiv · doi:10.48550/arxiv.2604.23896 · Cited by 5
Impact of Agent-Generated Rationales on Online Social Conformity
de Jong, S., Jacobsen, R. M., Wester, J., Wijenayake, S., Gonçalves, J., & van Berkel, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732217 · Cited by 13
Lin, M. P.-C., Huang, J.-Y., Chang, D., Tembrevilla, G., Bowen, G. M., Poitras, E., Janarthanan, V., & Ryoo, J. (2026) · AI in Education · doi:10.3390/aieduc2010004 · Cited by 6
Pal, O., Duddu, V., Goyal, A., Goel, D., & Saha, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799386 · Cited by 6
Ansari, S., & Alam, M. Z. (2025) · ACM International Workshop on Multimedia AI against Disinformation (MAD) · doi:10.1145/3733567.3735568 · Cited by 5
Navigating “Limerence”: Designing a Customized ChatGPT-Based Assistant System
Mei, K.-Q., Chen, Y.-J., & Liu, S.-T. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-94162-7_16 · Cited by 2
Tang, H. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715668.3735624 · Cited by 1
AIJIM: A Scalable Model for Real-Time AI in Environmental Journalism
Tiltack, T. O. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-07989-3_26 · Cited by 1
Balaskas, S., & Komis, K. (2026) · Sustainability · doi:10.3390/su18073185 · Cited by 4
To Disclose or Not to Disclose: How AI Use Transparency Increases Trust in Fact-Checking
Chung, M., Choi, J., & Jones-Jang, S. M. (2026) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2026.2656696 · Cited by 3
Catch Me If You Search: When Contextual Web Search Results Affect the Detection of HallucinationsPreprint
Nahar, M., Lee, E.-J., Park, J. W., & Lee, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5251555 · Cited by 1
A metacognitive approach to learning and performance in human-AI interaction
Fan, Y., Yan, L., Molenaar, I., Greiff, S., & Gašević, D. (2026) · Communications Psychology · doi:10.1038/s44271-026-00548-y · Cited by 1
Sharma, S. R., Kshetri, N., Paudel, S., & Pokharel, B. P. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6481-0.ch005
Credibility Assessment of Human–Generative AI Interaction
Zhao, Y., Song, S., & Jing, Y. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009587877.005
Between Privacy and Transparency: Exploring the Ways of Communicating Credibility Assessment
Tang, H., Rohles, B., Chuai, Y., Lenzini, G., & Sergeeva, A. (2025) · European Symposium on Usable Security (EuroUSEC) · doi:10.1109/eurousec69254.2025.00018 · Cited by 1
Bias Correction and Explainability Framework for Large Language Models: A Knowledge-Driven Approach
Yang, X., Li, Q., Qian, C., Wang, H., Wu, Y., & Wang, W. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10020058 · Cited by 1
Social Media and Artificial Intelligence: Information, Bias, and Trust
Santos, S., Santos, J. D., & Pires, P. B. (2026) · Springer eBooks · doi:10.1007/978-3-031-75316-9_96-1
Ling, T.-W., Peng, W., Meng, J., & Liu, J. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798608
Understanding, Mitigating, and Leveraging Cognitive Biases to Calibrate Trust in Evolving AI Systems
Pareek, S., Boonprakong, N., Kollerup, N. K., Chen, S., Hosio, S. J., Yatani, K., Lee, Y., Gadiraju, U., van Berkel, N., & Gonçalves, J. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778722 · Cited by 1
Self-citationSensemaking in Multi-Agent LLM Interfaces: How Users Interpret Transparency and Trustworthiness Cues
Pareek, S., Govers, J., Kollerup, N. K., Wong, E., Velloso, E., & Gonçalves, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791157 · Cited by 6
Self-citationCasás, J., Rodríguez, A. S., & Vázquez, A. I. R. (2026) · Social Sciences · doi:10.3390/socsci15040247 · Cited by 2
Face value: How avatar identity shapes epistemic trust in AI-mediated learning
Anthis, Z., & Kyriakidou-Zacharoudiou, A. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100610 · Cited by 1
The Role of Presentation Styles in Countering Misinformation on Short Video Platforms CSCW039
Gunasekara, S., Sew, C., Pareek, S., Kelly, R., Kostakos, V., & Gonçalves, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788075
Self-citationWhen Do Users (Not) Want Explanations? Understanding Explanation Demand in Human-AI Interaction
Ingesson, E., & Riveiro, M. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812974
Reliance-Aware Design of Interactive Explainable User Interfaces
Filho, J. C. D. S., Belloum, R., Monteiro, I. T., & de Oliveira, K. M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812231 · Cited by 2
Explainable AI, Academic Confidence, and Decision-Making Quality in Physics Learning
Hidayah, N., & Sodikin, S. (2026) · Digital Learning Social Science and Life-course Studies · doi:10.70211/disolife.v2i1.777 · Cited by 4
The Perceived Persuasiveness of Generative Artificial Intelligence Systems in Learning Task
Ekpezu, A. O., Wiafe, I., & B, H. O.-K. A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-27235-5_4
Fernández, R. C., & Solórzano, M. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2726917
Yamamoto, K., Tanikawa, T., & Kuzuoka, H. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02469-5
AI and Media and Communication
Wang, M., 赵蓝图, Liu, Z., & Shaw, R. (2026) · Springer eBooks · doi:10.1007/978-981-92-2544-6_13
Metadata
- Authors
- Pareek, S., van Berkel, N., Velloso, E., & Goncalves, J.
- Affiliations
- The University of Melbourne (AU)
- Aalborg University, Aalborg, Denmark
- The University of Melbourne, Melbourne, Victoria, Australia
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2024-11-07
- Volume
- 8
- Issue
- CSCW2
- Pages
- 1-31
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4404172855
- Cited by
- 42
- References
- 100
- Citations by year
- 2026: 21 · 2025: 20 · 2024: 1
- FWCI
- 30.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
- VBN Forskningsportal (Aalborg Universitet) (publishedVersion, cc-by)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- trust in AI, fact-checking, natural language explanations, misinformation, social media, automation bias, backfire effect
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.