Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment
Open accessThe DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
As misinformation increasingly proliferates on social media platforms, it has become crucial to explore how to best convey automated news credibility assessments to end-users, and foster trust in fact-checking AIs. In this paper, we investigate how model-agnostic, natural language explanations influence trust and reliance on a fact-checking AI. We construct explanations from four Conceptualisation Validations (CVs) - namely consensual, expert, internal (logical), and empirical - which are foundational units of evidence that humans utilise to validate and accept new information. Our results show that providing explanations significantly enhances trust in AI, even in a fact-checking context where influencing pre-existing beliefs is often challenging, with different CVs causing varying degrees of reliance. We find consensual explanations to be the least influential, with expert, internal, and empirical explanations exerting twice as much influence. However, we also find that users could not discern whether the AI directed them towards the truth, highlighting the dual nature of explanations to both guide and potentially mislead. Further, we uncover the presence of automation bias and aversion during collaborative fact-checking, indicating how users' previously established trust in AI can moderate their reliance on AI judgements. We also observe the manifestation of a 'boomerang'/backfire effect often seen in traditional corrections to misinformation, with individuals who perceive AI as biased or untrustworthy doubling down and reinforcing their existing (in)correct beliefs when challenged by the AI. We conclude by presenting nuanced insights into the dynamics of user behaviour during AI-based fact-checking, offering important lessons for social media platforms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This method, known as 'cognitive forcing', has recently been adopted in AI systems, where it has shown promising signs of reducing overreliance at the cost of increased cognitive load [6,57].”
From Cognitive Forcing for Better Decision-Making: Reducing Overreliance on AI Systems Through Partial Explanations (2025) · cites this paper as [57]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910 · cited 1×
“We conducted a likelihood ratio test between our final model and the null model to ascertain the goodness of fit [8].”
MethodThe spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 2×
“Moreover, alerting individuals to the veracity of posts directly at reading time is more optimal than offering it afterwards, since corrective messages tend to propagate slower than misinformation [112] and may not reach all exposed to it.”
BackgroundSocial Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“• Trust in Automation (TiA): A set of validated questionnaire scales to measure subjective trust [56], from which we adopted the Propensity to Trust (TiA-PtT) subscale to account for any effects of dispositional trust on user reliance, following similar studies [39, 59].”
BackgroundMethodA study of normative and informational social influences upon individual judgment.
Deutsch, M., & Gerard, H. B. (1955) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0046408 · Cited by 4,819 · cited 1×
“Social influence literature identifies two motivations for individuals to conform to a majority opinion: normative influences (conforming to gain approval and fit in) and informational influences (conforming to be more correct) [20].”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
A Theory of Psychological Reactance
Mishler, E. G. (1968) · Psychosomatic Medicine · doi:10.1097/00006842-196811000-00013 · Cited by 1,665
The psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
CSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132877 · Cited by 1,039
Hardwig, J. (1985) · The Journal of Philosophy · doi:10.2307/2026523 · Cited by 937
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Metzger, M. J. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20672 · Cited by 871
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Artificial intelligence in cancer diagnosis and prognosis: Opportunities and challenges
Huang, S., Yang, J., Fong, S., & Zhao, Q. (2020) · Cancer Letters · doi:10.1016/j.canlet.2019.12.007 · Cited by 672
Liu, Y., & Wu, Y.-F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11268 · Cited by 663
Clayton, K., Blair, S., Busam, J. A., Forstner, S., Glance, J., Green, G., Kawata, A., Kovvuri, A., Martin, J., Morgan, E., et al. (2020) · Political Behavior · doi:10.1007/s11109-019-09533-0 · Cited by 658
Belief Echoes: The Persistent Effects of Corrected Misinformation
Thorson, E. (2016) · Political Communication · doi:10.1080/10584609.2015.1102187 · Cited by 624
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527
Walter, N., & Tukachinsky, R. (2020) · Communication Research · doi:10.1177/0093650219854600 · Cited by 522
Processing political misinformation: comprehending the Trump phenomenon
Swire, B., Berinsky, A. J., Lewandowsky, S., & Ecker, U. K. H. (2017) · Royal Society Open Science · doi:10.1098/rsos.160802 · Cited by 498
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
Zika virus pandemic—analysis of Facebook as a social media health information platform
Sharma, M., Yadav, K., Yadav, N., & Ferdinand, K. C. (2017) · American Journal of Infection Control · doi:10.1016/j.ajic.2016.08.022 · Cited by 426
The Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392 · cited 2×
“A multitude of contextual and personal determinants, such as risk perception [35, 36], AI literacy [17], confidence [124], and level of anthropomorphism of the automated aid [54], have been found to influence trust.”
BackgroundToo much, too little, or just right? Ways explanations impact end users' mental models
Kulesza, T., Stumpf, S., Burnett, M., Yang, S., Kwan, I., & Wong, W.-K. (2013) · 2013 IEEE Symposium on Visual Languages and Human Centric Computing · doi:10.1109/vlhcc.2013.6645235 · Cited by 388 · cited 1×
“They should be able to trust it to incorporate its judgement during decision-making since users are more likely to accept the recommendations of automated aids when they have a sound and complete understanding of the reasoning behind them [26, 55].”
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · cited 3×
“…research, which found AI-based credibility indicators to exhibit limited effectiveness [100, 122], either due to the absence of explanations [14, 77], or the provision of explanations that were challenging to comprehend and could not improve users’ understanding of the AI’s rationale [3, 24, 89].”
BackgroundUnderstanding User Beliefs About Algorithmic Curation in the Facebook News Feed
Rader, E., & Gray, R. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702174 · Cited by 386 · cited 1×
“Further, centralised decisions to remove content may go against end-users’ needs, as some users may nevertheless wish to view unverified content to assess it independently, and stay informed of what their online peers share, irrespective of its veracity [49, 90].”
BackgroundLai, V., & Tan, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287590 · Cited by 377
The Boomerang Effect A Synthesis of Findings and a Preliminary Theoretical Framework
Byrne, S., & Hart, P. S. (2009) · Annals of the International Communication Association · doi:10.1080/23808985.2009.11679083 · Cited by 313
Understanding algorithm aversion: When is advice from automation discounted?
Prahl, A., & Van Swol, L. (2017) · Journal of Forecasting · doi:10.1002/for.2464 · Cited by 308 · cited 1×
“On the other hand, undue scepticism or distrust towards automated systems, known as algorithm aversion [52, 87], may lead users to solely rely on their own judgements, disregarding automated advice.”
BackgroundVraga, E. K., & Bode, L. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2017.1313883 · Cited by 302
Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments
Green, B., & Chen, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287563 · Cited by 275
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Understanding news sharing in social media: An explanation from the diffusion of innovations theory
Ma, L., Lee, C. S., & Goh, D. H. (2014) · Online Information Review · doi:10.1108/oir-10-2013-0239 · Cited by 223
Mena, P. (2020) · Policy & Internet · doi:10.1002/poi3.214 · Cited by 223
Can’t We Just Disregard Fake News? The Consequences of Exposure to Inaccurate Information
Rapp, D. N., & Salovich, N. A. (2018) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218785193 · Cited by 213
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
Schemmer, M., Kuehl, N., Benz, C., Bartos, A., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584066 · Cited by 208 · cited 1×
“This phenomenon where users are able to discern the accuracy of AI advice and rely on it only when warranted is termed appropriate reliance [98].”
BackgroundCorrection as a Solution for Health Misinformation on Social Media
Vraga, E. K., & Bode, L. (2020) · American Journal of Public Health · doi:10.2105/ajph.2020.305916 · Cited by 186
Garrett, R. K., Nisbet, E. C., & Lynch, E. K. (2013) · Journal of Communication · doi:10.1111/jcom.12038 · Cited by 184
User attitudes towards algorithmic opacity and transparency in online reviewing platforms
Eslami, M., Vaccaro, K., Lee, M. K., Elazari Bar On, A., Gilbert, E., & Karahalios, K. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300724 · Cited by 184 · cited 1×
“Explanations can enhance understanding of automated decisions, with increased model transparency heavily influencing users’ perceptions of automated systems [27].”
BackgroundConceptual Metaphors Impact Perceptions of Human-AI Collaboration
Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415234 · Cited by 183 · cited 1×
“A multitude of contextual and personal determinants, such as risk perception [35, 36], AI literacy [17], confidence [124], and level of anthropomorphism of the automated aid [54], have been found to influence trust.”
BackgroundDefining and Measuring Scientific Misinformation
Southwell, B. G., Brennen, J. S., Paquin, R. S., Boudewyns, V., & Zeng, J. (2022) · The Annals of the American Academy of Political and Social Science · doi:10.1177/00027162221084709 · Cited by 180
Jones-Jang, S. M., & Park, Y. J. (2022) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmac029 · Cited by 178
Effects of Credibility Indicators on Social Media News Sharing Intent
Yaqub, W., Kakhidze, O., Brockman, M. L., Memon, N., & Patil, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376213 · Cited by 171
Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists
Aducci, C. J., & Johnson, M. D. (2011) · Journal of Family Theory & Review · doi:10.1111/j.1756-2589.2010.00083.x · Cited by 170
Automation bias: Empirical results assessing influencing factors
Goddard, K., Roudsari, A., & Wyatt, J. C. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.001 · Cited by 163
The limits of human predictions of recidivism
Lin, Z. J., Jung, J., Goel, S., & Skeem, J. L. (2020) · Science Advances · doi:10.1126/sciadv.aaz0652 · Cited by 159
Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks
Lu, Z., & Yin, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445562 · Cited by 131
Molina, M. D., & Sundar, S. S. (2024) · New Media & Society · doi:10.1177/14614448221103534 · Cited by 124
Jahanbakhsh, F., Zhang, A. X., Berinsky, A. J., Pennycook, G., Rand, D. G., & Karger, D. R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449092 · Cited by 112
Liu, H., Lai, V., & Tan, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479552 · Cited by 111
Haque, M. M., Yousuf, M., Alam, A. S., Saha, P., Ahmed, S. I., & Hassan, N. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415201 · Cited by 111
The Ineffectiveness of Fact-Checking Labels on News Memes and Articles
Oeldorf-Hirsch, A., Schmierbach, M., Appelman, A., & Boyle, M. (2020) · Mass Communication & Society · doi:10.1080/15205436.2020.1733613 · Cited by 110
Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107
Dixon, G. N., McKeever, B. W., Holton, A. E., Clarke, C., & Eosco, G. (2015) · Journal of Communication · doi:10.1111/jcom.12159 · Cited by 106 · cited 1×
“For scientific headlines, we selected medical and health-related news, following other works examining scientific misinformation [21].”
BackgroundAnik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103
A Conceptual Model of Trust, Perceived Risk, and Reliance on AI Decision Aids
Solberg, E., Kaarstad, M., Eitrheim, M. H. R., Bisio, R., Reegård, K., & Bloch, M. (2022) · Group & Organization Management · doi:10.1177/10596011221081238 · Cited by 102
Explainability Pitfalls: Beyond Dark Patterns in Explainable AI
Ehsan, U., & Riedl, M. O. (2021) · arXiv · doi:10.48550/arxiv.2109.12480 · Cited by 99
Trust It or Not: Effects of Machine-Learning Warnings in Helping Individuals Mitigate Misinformation
Seo, H., Xiong, A., & Lee, D. (2019) · ACM Web Science Conference (WebSci) · doi:10.1145/3292522.3326012 · Cited by 96
“Believe it or not: Designing a human-ai partnership for mixed-initiative fact-checking,”
Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018) · Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3242587.3242666 · Cited by 95
Will You Accept the AI Recommendation? Predicting Human Behavior in AI-Assisted Decision Making
Wang, X., Lu, Z., & Yin, M. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512240 · Cited by 93
Do Explanations Increase the Effectiveness of AI-Crowd Generated Fake News Warnings?
Epstein, Z., Foppiani, N., Hilgard, S., Sharma, S., Glassman, E. L., & Rand, D. G. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19283 · Cited by 93
Your Understanding Is My Understanding: Evidence for a Community of Knowledge
Sloman, S. A., & Rabb, N. (2016) · Psychological Science · doi:10.1177/0956797616662271 · Cited by 88
Improving Human-AI Collaboration With Descriptions of AI Behavior
Cabrera, Á. A., Perer, A., & Hong, J. I. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579612 · Cited by 87
User Trust in Intelligent Systems
Holliday, D. D., Wilson, S., & Stumpf, S. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2856767.2856811 · Cited by 85
Bossen, C., & Pine, K. H. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569892 · Cited by 80
Saltz, E., Leibowicz, C., & Wardle, C. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451807 · Cited by 77
Explainability pitfalls: beyond dark patterns in explainable AI
Ehsan, U., & Riedl, M. O. (2024) · Patterns · doi:10.1016/j.patter.2024.100971 · Cited by 72
Theoretical considerations and development of a questionnaire to measure trust in automation
Körber, M. (2018) · doi:10.31234/osf.io/nfc45 · Cited by 71
Understanding User Reliance on AI in Assisted Decision-Making
Cao, S., & Huang, C.-M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555572 · Cited by 71
Automation use and automation bias
Mosier, K. L., & Skitka, L. J. (1999) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129904300346 · Cited by 69
Green, B., & Chen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479562 · Cited by 69 · cited 1×
“A multitude of contextual and personal determinants, such as risk perception [35, 36], AI literacy [17], confidence [124], and level of anthropomorphism of the automated aid [54], have been found to influence trust.”
BackgroundRating Reliability and Bias in News Articles: Does AI Assistance Help Everyone?
Horne, B. D., Nevo, D., O’Donovan, J., Cho, J.-H., & Adalı, S. (2019) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v13i01.3226 · Cited by 67
Epstein, Z., Pennycook, G., & Rand, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376232 · Cited by 67
Understanding the Role of Explanation Modality in AI-assisted Decision-making
Robbemond, V., Inel, O., & Gadiraju, U. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3503252.3531311 · Cited by 56
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3186967 · Cited by 55
Confidence, advice seeking and changes of mind in decision making
Pescetelli, N., Hauperich, A.-K., & Yeung, N. (2021) · Cognition · doi:10.1016/j.cognition.2021.104810 · Cited by 55 · cited 1×
“In studies examining changes in beliefs or opinions, including research on misinformation [47, 118] and conformity [120, 121], initial confidence commonly serves as a proxy for participants’ prior knowledgeoruncertaintyaboutthetask,andinfluencestheirinclinationtorelyontheAI[64,81,117].”
BackgroundLu, Z., Li, P., Wang, W., & Yin, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555562 · Cited by 54
Erlei, A., Das, R., Meub, L., Anand, A., & Gadiraju, U. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517734 · Cited by 49
Effect of Conformity on Perceived Trustworthiness of News in Social Media
Wijenayake, S., Hettiachchi, D., Hosio, S. J., Kostakos, V., & Gonçalves, J. (2020) · IEEE Internet Computing · doi:10.1109/mic.2020.3032410 · Cited by 48
Leveraging Structured Trusted-Peer Assessments to Combat Misinformation
Jahanbakhsh, F., Zhang, A. X., & Karger, D. R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555637 · Cited by 48
Sanz-Menéndez, L., & Cruz-Castro, L. (2019) · Public Understanding of Science · doi:10.1177/0963662519840946 · Cited by 47
Machine Learning Explanations to Prevent Overtrust in Fake News Detection
Mohseni, S., Yang, F., Pentyala, S., Du, M., Liu, Y., Lupfer, N., Hu, X., Ji, S., & Ragan, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18072 · Cited by 44
Vraga, E. K., Myers, T. A., Kotcher, J., Beall, L., & Maibach, E. W. (2018) · Royal Society Open Science · doi:10.1098/rsos.170505 · Cited by 43
Chiang, C.-W., & Yin, M. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511121 · Cited by 42
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42
Tailoring heuristics and timing AI interventions for supporting news veracity assessments
Horne, B. D., Nevo, D., Adalı, S., Manikonda, L., & Arrington, C. (2020) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2020.100043 · Cited by 40
Quantifying the Effect of Social Presence on Online Social Conformity
Wijenayake, S., van Berkel, N., Kostakos, V., & Gonçalves, J. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392863 · Cited by 38
Measuring the Effects of Gender on Online Social Conformity
Wijenayake, S., van Berkel, N., Kostakos, V., & Gonçalves, J. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359247 · Cited by 31
The Role of Source, Headline and Expressive Responding in Political News Evaluation
Jakesch, M., Koren, M., Evtushenko, A., & Naaman, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3306403 · Cited by 30
Park, S., Park, J. Y., Chin, H., Kang, J., & Cha, M. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450121 · Cited by 28
Detecting fake news by image analysis
Masciari, E., Moscato, V., Picariello, A., & Sperlí, G. (2020) · Proceedings of the 24th Symposium on International Database Engineering & Applications · doi:10.1145/3410566.3410599 · Cited by 19
Machine Learning Approach to Detect Fake News, Misinformation in COVID-19 Pandemic
Bojjireddy, S., Chun, S. A., & Geller, J. (2021) · doi:10.1145/3463677.3463762 · Cited by 17
Medicine of the Future: the Power of Artificial Intelligence (AI) and Big Data in HealthcarePreprint
Puaschunder, J. M., Mantl, J., & Plank, B. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3607616 · Cited by 16
Amazeen, M. A., & Krishna, A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3698102 · Cited by 11
An Empirical Investigation of Reliance on AI-Assistance in a Noisy-Image Classification Task
Tejeda, H., Kumar, A., & Steyvers, M. (2022) · Frontiers in artificial intelligence and applications · doi:10.3233/faia220201 · Cited by 7
Affinity for Technology Interaction Scale
Franke, T., Attig, C., & Wessel, D. (2019) · PsycTESTS Dataset · doi:10.1037/t76895-000 · Cited by 6
TExSS: Transparency and Explanations in Smart Systems
Smith, A., Kleanthous, S., Dodge, J. E., Dugan, C., Lee, M. K., Lim, B. Y., Kuflik, T., Sarkar, A., Tal, A. S., & Stumpf, S. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397482.3450705 · Cited by 2
Research works printed but not linked: 13
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- Santanu Chakrabarti, Lucile Stengel, and Sapna Solanki. 2018. Duty, identity, credibility: Fake news and the ordinary citizen in India. BBC World Service Audiences Research (2018).
- 10.1007/s10869-011--9231--8 · doi:10.1007/s10869-011--9231--8
- 10.1111/j.1083--6101.2007.00388.x · doi:10.1111/j.1083--6101.2007.00388.x
- N.A. Karlova and K.E. Fisher. 2013. A social diffusion model of misinformation and disinformation for understanding human information behaviour. Information Research, Vol. 18 (Jan. 2013).
- 10.1111/j.1460--2466.2010.01488.x · doi:10.1111/j.1460--2466.2010.01488.x
- 10.1186/s41235-020-00251--4 · doi:10.1186/s41235-020-00251--4
- Harikumar Pallathadka, Malik Jawarneh, Domenic Sanchez, Guna Sajja, Sanjeev Gour, and Mohd Naved. 2021. The Impact of Machine Learning on Management, Healthcare, and Agriculture. (July 2021).
- 10.1111/j.1559--1816.2004.tb02547.x · doi:10.1111/j.1559--1816.2004.tb02547.x
- 10.37016/mr-2020--81 · doi:10.37016/mr-2020--81
- Ron Sellers. 2013. How Sliders Bias Survey Data. MRA's Alert, Vol. 53, 3 (2013), 56--57. https://greymatterresearch.com/wp-content/uploads/2019/09/Alert-Sliders-2013.pdf
- 10.1111/j.1540--5907.2006.00214.x · doi:10.1111/j.1540--5907.2006.00214.x
- 10.1007/978--3-030--85610--6_26 · doi:10.1007/978--3-030--85610--6_26
Cited by
Exploring people's perceptions of LLM-generated advice
Wester, J., de Jong, S., Pohl, H., & van Berkel, N. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100072 · Cited by 91
de Jong, S., Paananen, V., Tag, B., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710946 · Cited by 32
Pareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 27
Self-citationResponsibility Attribution in Human Interactions with Everyday AI Systems
Brailsford, J., Vetere, F., & Velloso, E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713126 · Cited by 25
Self-citationAssessing the accuracy and explainability of using ChatGPT to evaluate the quality of health news
Liu, X., He, L., Alanazi, E. M., Liu, E., Goss, A., & Gumireddy, L. (2025) · BMC Public Health · doi:10.1186/s12889-025-23206-0 · Cited by 15
Metadata
- Authors
- Pareek, S., van Berkel, N., Velloso, E., & Goncalves, J.
- Affiliations
- The University of Melbourne (AU)
- Aalborg University, Aalborg, Denmark
- The University of Melbourne, Melbourne, Victoria, Australia
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2024-11-07
- Volume
- 8
- Issue
- CSCW2
- Pages
- 1-31
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4404172855
- Cited by
- 42
- References
- 100
- Citations by year
- 2026: 21 · 2025: 20 · 2024: 1
- FWCI
- 30.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
- VBN Forskningsportal (Aalborg Universitet) (publishedVersion, cc-by)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- trust in AI, fact-checking, natural language explanations, misinformation, social media, automation bias, backfire effect
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.