Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
The DOI matches its Crossref record; 74 of the 76 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, interpersonal trust (i.e., trust between people) as defined by sociologists. This model rests on two key properties: the vulnerability of the user; and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI model is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (that detaches from the notion of trustworthiness in sociology), and with it concepts of 'warranted' and 'unwarranted' trust. We present the possible causes of warranted trust as intrinsic reasoning and extrinsic behavior, and discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted. Finally, we elucidate the connection between trust and XAI using our formalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Uncertainty is a defining characteristic of trust (Mayer et al., 1995) and has been referred to as a necessary prerequisite of human trust in AI that has been lacking in current XAI studies (Jacovi et al., 2021).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Jacovi et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research found that people often ignore recommendations because they do not trust them”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The primary motivation for clinical XAI is fostering appropriate trust: enabling clinicians to calibrate their reliance on AI recommendations based on the quality of supporting reasoning [156,157].”
From Explainability of decoder-only clinical large language models: A scoping review (2026) · cites this paper as [157]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, people find it difficult to correctly calibrate their trust in a decision aid [10,13,21,37].”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“For example, [38] formalizes human-AI trust by considering and extending the concepts of interpersonal trust.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [38]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“on basic definition of trust regards it as a directional transaction between two parties: if A believes that B will act in A’s best interest, and accepts vulnerability to B’s actions, then A trusts B [49]. The goal of trust is to “make social life predictable [by anticipating the impact of behavior], and make it easie…”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“ay that the trust is warranted if it is the result of trustworthiness, and otherwise it is unwarranted [50]. Warranted trust is sometimes referred to as trust which is calibrated with trustworthiness [43]. In other words, trust is the cognitive mechanism to give the ‘illusion’ of anticipating intended behavior, which…”
BackgroundLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 2×
“s can reveal strong correlations between attributes for one of those classes, giving leads to research on causation between them, even if the model was not useful for the original classification task [42, 46]. 2Assume that the performance evaluation is representative of real usage for now, although this is an importan…”
BackgroundInfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“Transparency High-standard documentation All Technical explainability Factsheets (explainability) Saliency maps [61], self-attention patterns [40], influence functions [38], probing [16] Adaptable user-centered explainability Factsheets (explainability) Counterfactual [21], contrastive [51], natural language [27], by-…”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Self-citationHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“8We consider AI as an automation attributed with intent, and thus, Human-AI trust is a sub-case of human-machine trust [28, 55].”
BackgroundLewis, J. D., & Weigert, A. (1985) · Social Forces · doi:10.2307/2578601 · Cited by 4,163 · cited 1×
“the influence of the trustee’s incentives on Human-AI trust, should build on the existing research in sociology that investigates the influence of relationships and communities on interpersonal trust [44]. Consequently, the question of whether this trust is warranted or unwarranted is ill-defined.Our definition of war…”
BackgroundA large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · cited 1×
“We set the “effort boundary” around 774 tokens—a few of minutes of reading—and the “vulnerability boundary” right from natural language inference [7], commonsense QA [70], and multi-sentence”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Baier, A. (1986) · Ethics · doi:10.1086/292745 · Cited by 2,567 · cited 1×
“present two directions for extension of our formalization inspired by other factors of interpersonal trust. 9.1 Other Elements of Interpersonal Trust and Trust in Automation Trust vs Reliance. Baier [4] introduces the term reliance for trust in inanimate objects, such as trusting a stool to hold your weight. We may fe…”
BackgroundInfluential
Research works printed but not linked: 27
- [1] David Alvarez Melis and Tommi Jaakkola. 2018. Towards Robust Interpretability with Self-Explaining Neural Networks. In Advances in Neural Information Processing Systems 31 , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. CesaBianchi, and R. Garnett (Eds.). 7775-7784. http://papers.nips.cc/paper/8003towards-robust-interpretability-with-self-explaining-neural-networks.pdf -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [15] Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017). - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- [21] Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6572 - · arXiv
- [22] Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Counterfactual Visual Explanations (Proceedings of Machine Learning Research, Vol. 97) , Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, Long Beach, California, USA, 2376-2384. http://proceedings.mlr.press/v97/goyal19a.html -
- 10.18653/v1 · doi:10.18653/v1
- [25] Sven Ove Hansson. 2018. Risk. In The Stanford Encyclopedia of Philosophy (fall 2018 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- [29] Robert R Hoffman. 2017. A taxonomy of emergent trusting in the human-machine relationship. Cognitive systems engineering: The future for a changing world (2017), 137-163. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [40] Hana Kopecka and Jose M Such. 2020. Explainable AI for Cultural Minds. https://sites.google.com/view/dexahai-at-ecai2020/home Workshop on Dialogue, Explanation and Argumentation for Human-Agent Interaction , DEXAHAI ; Conference date: 07-09-2020. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [53] Carolyn McLeod. 2015. Trust. In The Stanford Encyclopedia of Philosophy (fall 2015 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [64] Philipp Schmidt and Felix Bießmann. 2019. Quantifying Interpretability and Trust in Machine Learning Systems. CoRR abs/1901.08558 (2019). arXiv:1901.08558 http://arxiv.org/abs/1901.08558 - · arXiv
- [67] Anders Søgaard, Sebastian Ebert, Jasmijn Bastings, and Katja Filippova. 2020. We Need to Talk About Random Splits. CoRR abs/2005.00636 (2020). arXiv:2005.00636 https://arxiv.org/abs/2005.00636 - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
Cited by
Items 301–400 of 747
AI practical wisdom and compassion
Graves, M. (2025) · AI and Ethics · doi:10.1007/s43681-025-00877-4 · Cited by 10
Lin, C., Fan, H.-Y., Chang, Y., Ou, L. S., Liu, J., Wang, Y., & Jung, T. (2022) · Technologies · doi:10.3390/technologies10060115 · Cited by 10
Does Self-Rationalization Improve Robustness to Spurious Correlations?
Ross, A., Peters, M. E., & Marasović, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.501 · Cited by 19
Self-citationTrust Junk and Evil Knobs: Calibrating Trust in AI Visualization
Wall, E., Matzen, L. E., El‐Assady, M., Masters, P., Hosseinpour, H., Endert, A., Borgo, R., Chau, P., Perer, A., Schupp, H. T., et al. (2024) · IEEE Pacific Visualization Conference (PacificVis) · doi:10.1109/pacificvis60374.2024.00012 · Cited by 19
“Many tools and techniques have been designed to increase or calibrate trust in AI [3,38,56,76,98], leading to the derivation of design spaces [24], formalized models [42] and frameworks [61].”
BackgroundTambwekar, P., & Gombolay, M. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1375490 · Cited by 10
Farbiz, F., Aggarwal, S., Maszczyk, T. K., Habibullah, M. S., & Hamadicharef, B. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02482-4 · Cited by 12
“The authors in Jacovi et al. (2021) and Xu and Saleh (2021) concluded that by assessing the reliability of ML predictions, the trust in the model can be increased.”
A POMDP-based Robot-Human Trust Model for Human-Robot Collaboration
Tilloo, P., Parron, J., Obidat, O., Zhu, M., & Wang, W. (2022) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber55403.2022.9907660 · Cited by 9
“The work in [17] investigated trust towards robots, while [18] delved into discussions on designing trustworthy AI and how trust is manifested and warranted.”
BackgroundWorkshop on Trust and Reliance in AI-Human Teams (TRAIT)
Bansal, G., Buçinca, Z., Holstein, K., Hullman, J., Smith-Renner, A. M., Stumpf, S., & Wu, S. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3573831 · Cited by 8
“Despite all this interest, the community still lacks a conceptual understanding of definitions of human-AI trust and reliance in the context of successful human-AI collaborations [5, 8, 10].”
BackgroundA Trustworthiness-based Metaphysics of Artificial Intelligence Systems
Ferrario, A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732091 · Cited by 15
“For instance, in their work, Ja-covi et al. explicitly mention “model correctness,” i.e., accuracy, and “transparency” as genuine examples of AI contracts [26].”
InfluentialTowards Uncertainty Aware Task Delegation and Human-AI Collaborative Decision-Making
Lee, M. H., & Tok, M. Z. Y. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732155 · Cited by 14
Chen, R., Wang, R., Sadeh, N., & Fang, F. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732050 · Cited by 13
Balancing Minds and Data: The Privacy Dilemma of LLMs and Anthropomorphism in LLMs
Meier, R. L. (2025) · Journal of Social Computing · doi:10.23919/jsc.2025.0014 · Cited by 8
Tricking into Trusting? The Influence of Social Cues of a Generative AI on Perceived Trust
Krämer, N. C., Lamia, I., Siegert, H., Wenda, F., & Suchmann, L. B. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3771844 · Cited by 11
“Whether and to what extent such an AI systems can be successfully integrated into society and will be used in the long term depends largely on users’ trust [Glikson and Woolley, 2020; Jacovi et al., 2021].”
Being Pragmatic About Reliance and Trust in Artificial Intelligence
Ferrario, A. (2025) · Minds and Machines · doi:10.1007/s11023-025-09754-9 · Cited by 14
“To the ‘Trustworthy AI’ framework belongs the ‘contractual trust’ approach to the trustwor-thiness of AI, which promotes the idea that an AI system is worthy of our trust if and only if it works as it is supposed to in its context of application (Jacovi et al., 2021).”
Trust Me, I’m Transparent: Describing AI Systems Using Global Explanations
Jantzen, L., Philipp, M., Tagalidou, N., Bui, M., & Kempen, R. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2606953 · Cited by 8
Alharbi, B. S., Aljabri, M. M., & Ali, E. A. (2026) · Healthcare · doi:10.3390/healthcare14040506 · Cited by 10
Albrecht, C., Archiwaranguprok, C., Poonsiriwong, R., Chen, A., Lertsutthiwong, M., Winson, K., Maes, P., Ersner-Hershfield, H., & Pataranutaporn, P. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789455 · Cited by 9
“Systems such as "Living Memories" create interactive digital me-mentos from journals, letters, and personal data, with evaluations showing that interactions with a living memory of Leonardo da Vinci increased learning effectiveness and motivation beyond text alone [67].”
Bi, N., Huang, Y., Han, C.-C., & Hsu, J. Y.-J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579593 · Cited by 10
Deconstructing controversies to design a trustworthy AI future
Trevisan, F., Troullinou, P., Kyriazanos, D. M., Fisher, E., Fratantoni, P., Sir, C. M., & Bertelli, V. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09771-9 · Cited by 9
“Trust in technology is a complex concept (Jacovi et al., 2021) and is a primary predictor of its usage (Bradford et al., 2020).”
Matzen, L. E., Gastelum, Z., Howell, B. C., Divis, K., & Stites, M. C. (2024) · Cognitive Research Principles and Implications · doi:10.1186/s41235-024-00586-2 · Cited by 11
“Although there are several definitions of trust in the context of human use of AI/ML tools, most definitions consider risk to be a key component of trust (Jacovi et al., 2021; Lee & See, 2004; Mayer et al., 1995).”
BackgroundNowroozi, E., Taheri, R., Hajizadeh, M., & Bauschert, T. (2024) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr61664.2024.10679401 · Cited by 8
“The absence of visibility in the logic and boundaries of decisions within a model hinders experts from employing dependable techniques to validate accuracy or define modes of failure [14], [15].”
BackgroundTrust and care robots: philosophical considerations, ethical challenges, and viable options
Kropf, M. (2025) · Intelligent Service Robotics · doi:10.1007/s11370-025-00589-y · Cited by 9
Toward Patient-Centered AI Fact Labels: Leveraging Extrinsic Trust Cues
Yoo, D. W., Stroud, A. M., Zhu, X., Miller, J. E., & Barry, B. A. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735758 · Cited by 9
“Moreover, a digital format enables updates with the latest healthcare AI information.”
InfluentialKennedy-Mayo, D., & Gord, J. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-84457-7_11 · Cited by 10
RelEYEance: Gaze-based Assessment of Users' AI-reliance at Run-time
Wu, Z., Wang, Y., Langer, M., & Feit, A. M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3725841 · Cited by 7
Ties of Trust: a bowtie model to uncover trustor-trustee relationships in LLMs
Paraschou, E., Michali, M., Yfantidou, S., Karamanidis, S., Kalogeros, S. R., & Vakali, A. I. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732115 · Cited by 9
“Jacovi et al.’s model [32], emphasizing trustor vulnerability and anticipation of AI decision impacts, was used to explore AI-trust-explainability relationships in clinical applications [19].”
InfluentialErlei, A., Cau, F. M., Georgiev, R., Kumar, S. C., Bizer, K., & Gadiraju, U. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791420 · Cited by 7
“Our controlled study follows a 3 (lemon density: Low Density vs Medium Density vs High Density ) × 2 (information disclosure: No Disclosure vs Partial Disclosure ) between-subjects design, with an additional benchmark condition of High Density with Full Disclosure .”
Almamy, A. S. M., Habib, S., Nasser, L. K., & Hamadneh, N. N. (2026) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer21040120 · Cited by 8
Brillowski, F., Vervier, L., Schemmer, T., Brauner, P., Ziefle, M., & Gries, T. (2022) · AHFE international · doi:10.54941/ahfe1001709 · Cited by 7
Longo, L. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44070-0 · Cited by 7
Evaluating Behaviors of General Purpose Language Models in a Pedagogical Context
Karumbaiah, S., Ganesh, A., Bharadwaj, A., & Anderson, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-64299-9_4 · Cited by 7
Attitudinal Tensions in the Joint Pursuit of Explainable and Trusted AI
Narayanan, D., & Tan, Z. M. (2023) · Minds and Machines · doi:10.1007/s11023-023-09628-y · Cited by 11
“…about how their system might behave, decision-makers can use explanations to identify the patterns that distinguish AI-DST’s correct and incorrect outputs, and in turn, come to better-formed judgments about how to integrate these tools into their decision-making (Simon, 2010; Jacovi et al., 2021).”
BackgroundLukashova-Sanz, O., Dechant, M., & Wahl, S. (2023) · Applied Sciences · doi:10.3390/app13063572 · Cited by 8
VisFIS: Visual Feature Importance Supervision with Right-For-The-Right-Reason Objectives
Ying, Z., Hase, P., & Bansal, M. (2022) · neural information processing systems · doi:10.52202/068431-1241 · Cited by 19
Understanding, Visualizing and Explaining XAI Through Case Studies
Karpagam, G. R., Varma, A. P., Samrddhi, M., & Shivathmika, S., V (2022) · International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs54159.2022.9785199 · Cited by 7
Argumentative explanations for pattern-based text classifiers
Lertvittayakumjorn, P., & Toni, F. (2023) · Argument & Computation · doi:10.3233/aac-220004 · Cited by 8
Schrills, T., Gruner, M., Peuscher, H., & Franke, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35748-0_23 · Cited by 7
Explainability Paths for Sustained Artistic Practice with AIPreprint
Tecks, A., Peschlow, T., & Vigliensoni, G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.15216 · Cited by 7
“If done effectively, this process can improve the reliability of a generative model, allowing us to better anticipate its behavior, an essential component for the foundation of trust and trans-parency [10].”
BackgroundChen, Y., Verbert, K., Gerling, K., Abeele, M.-E. V., & Abeele, V. V. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712139 · Cited by 7
The importance of justified patient trust in unlocking AI's potential in mental healthcare
Bach, T. A., & Männikkö, N. (2025) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2025.1519872 · Cited by 6
Mehrotra, S., Gadiraju, U., Bittner, E. A. C., van Delden, F., Jonker, C. M., & Tielman, M. L. (2025) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3699682.3728343 · Cited by 8
“…despite the crucial role of appropriate trust in ensuring the successful 1 The decision to exclude discussions on the ethical implications of predictive policing and the individuals affected by such systems is not one made lightly, but rather stems from the specific focus of our research.”
Daniilidou, A., & Antoniadou, N. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2560520 · Cited by 8
“Researchers have emphasized the need for additional exploration of personality traits and their connection to trust in artificial intelligence (AI) systems (e.g., Jacovi et al., 2021; Li et al., 2024; Matthews et al., 2021).”
In Generative AI We (Dis)Trust? Computational Analysis of Trust and Distrust in Reddit Discussions
Pessianzadeh, A., Sultana, N., den Bulck, H. V., Gefen, D., Jabbari, S., & Rezapour, R. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.744 · Cited by 8
Newen, C., Müller, E., & Newen, A. (2025) · Topoi · doi:10.1007/s11245-025-10287-0 · Cited by 7
A Multidimensional Psychometric Scale for Measuring AI Dependency in Academic Research
Sultana, A., Saleh, M. A. K., Sellami, A., & Ahmad, Z. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2629522 · Cited by 7
“Jacovi et al. (2021) warn that uncritical trust in AI outputs, particularly those generated through generative models may diminish users’ capacity to evaluate information critically.”
Apuri, H., Aurangabadkar, M., Goel, S., Chinthala, M. M. R., & Yepuri, C. (2026) · International Journal of Engineering and Advanced Technology · doi:10.35940/ijeat.d4756.15040326 · Cited by 6
Characterizing the role of reasoning tokens in large language models as state over tokens
Levy, M., Elyoseph, Z., Ravfogel, S., & Goldberg, Y. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01303-y · Cited by 6
Self-citationRubegni, E., Ayoub, O., Rizzo, S., Barbero, M., Bernegger, G., Faraci, F. D., Mangili, F., Soldini, E., Trimboli, P., & Facchini, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60606-9_16 · Cited by 9
Measurable Trust: The Key to Unlocking User Confidence in Black-Box AI
Palazzolo, P., Stahl, B. C., & Webb, H. (2024) · International Symposium on Trustworthy Autonomous Systems (TAS) · doi:10.1145/3686038.3686058 · Cited by 7
“Jacovi et al. (2021) [32] differentiate between the two, defining trust as an attitude held by the trustor (human) and trustworthiness as a characteristic of the trustee (AI system).”
Miles, O., Pinckard, S., Gungor, M., Ridge, D., & Nadarzynski, T. (2025) · AI & Society · doi:10.1007/s00146-025-02332-8 · Cited by 6
“Research into AI has shown that trust can be shaped by both the capability of the AI itself and the AI literacy of the user (Jacovi et al. 2021; Long & Magerko 2020).”
Loureiro, J., Petrella, L., Gil, P. S., Rocha, T., Paredes, S., & Henriques, J. M. O. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3577486 · Cited by 9
“This not only would add a layer of security and transparency but also would enhance trust in human-AI interaction and aids in model improvement [13].”
When Generative AI Meets Abuse: What Are You Anxious About?
Song, Y., & Tan, H. (2025) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer20030215 · Cited by 6
Correa, T., Luco, F., Humeres, M., Cotorás, D., Davidoff, A., Hernández-Estrada, Y., Oyarzún-Merino, I., & López, C. (2025) · Communication and Change · doi:10.1007/s44382-025-00012-1 · Cited by 8
“For decision-makers, transparency in AI technologies is crucial, as it enables a clearer understanding that informs the development of regulations and governance that address AI’s complexities (Brauneis & Goodman, 2018; Jacovi et al., 2021).”
A Software Ecosystem for Deploying Deep Learning in Gravitational Wave Physics
Gunny, A., Rankin, D. S., Harris, P. C., Katsavounidis, E., Marx, E., Saleem, M., Coughlin, M. W., & Benoit, W. (2022) · doi:10.1145/3526058.3535454 · Cited by 10
“This allows us to optimize the Model as a whole, rather than one of its components at some fixed point in time, and formalize contractual obligations to downstream users by creating confident estimates of performance on the true test distribution [12, 24].”
Background“Garbage In, Garbage Out”: Mitigating Human Biases in Data Entry by Means of Artificial Intelligence
Eckhardt, S., Knaeble, M., Bucher, A. M., Staehelin, D., Dolata, M., Agotai, D., & Schwabe, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42286-7_2 · Cited by 8
A Robust Framework for Distributional Shift Detection Under Sample-Bias
Torpmann-Hagen, B., Riegler, M. A., Halvorsen, P., & Johansen, D. (2024) · IEEE Access · doi:10.1109/access.2024.3393296 · Cited by 7
“It is difficult to ascertain whether the model is failing to generalize, and though implementing explanations can assist somewhat in this regard [17], many domains require a higher degree of transparency in the model’s performance than these methods can provide [18].”
BackgroundBridging the Integrity Gap: Towards AI-assisted Design Research
Oksanen, J. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3647962 · Cited by 7
“Building upon the ABI (Ability, Benevolence, Integrity) framework for interpersonal trust [17], Jacovi et al. [10] formalise the mechanisms that facilitate human-AI trust into notions of extrinsic 3 https://chat.openai.com/ and intrinsic trust.”
Working with AI Sound: Exploring the Future of Workplace AI Sound Technologies
Deacon, T., & Plumbley, M. D. (2024) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3663384.3663391 · Cited by 6
“What this aims to promote is the design of “trustworthy” AI systems [28, 32, 34].”
BackgroundAI Caramba! The Negative Effects of AI Agents in Customer Relationship Management
Shaalan, A., Tourky, M. E., & Ibrahim, K. (2024) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/979-8-3693-5340-0.ch011 · Cited by 6
The Role of Trust in AI-Augmented Business Process Management Systems
Acitelli, G., Agostinelli, S., Casciani, A., & Marrella, A. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-78666-2_1 · Cited by 7
Zhang, Y., Fang, J., Liao, M., Han, L., Wen, C., & Addo, P. C. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115315 · Cited by 8
Meta-learning and Data Augmentation for Stress Testing Forecasting Models
Inácio, R., Cerqueira, V., Barandas, M., & Soares, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91398-3_26 · Cited by 8
Visually Explaining Uncertain Price Predictions in Agrifood: A User-Centred Case-Study
Ooge, J., & Verbert, K. (2022) · Agriculture · doi:10.3390/agriculture12071024 · Cited by 6
Causal representation for few-shot text classification
Yang, M., Zhang, X., Wang, J., & Zhou, X. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04667-5 · Cited by 8
Which Shortcut Solution Do Question Answering Models Prefer to Learn?
Shinoda, K., Sugawara, S., & Aizawa, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26590 · Cited by 12
Wünn, T., Sent, D., Peute, L., & Leijnen, S. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-50485-3_6 · Cited by 11
Taming the AI Monster: Monitoring of Individual Fairness for Effective Human Oversight
Baum, K. L., Biewer, S., Hermanns, H., Hetmank, S., Langer, M., Lauber-Rönsberg, A., & Sterz, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-66149-5_1 · Cited by 6
Recki, L., Lawo, D., Krauß, V., Pins, D., & Boden, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686996 · Cited by 7
“This focus allows designers to proactively mitigate the actual risks that might occur and also user-perceived risks, and thus to foster trust in the system [44].”
LLMCode: Evaluating and Enhancing Researcher-AI Alignment in Qualitative AnalysisPreprint
Oksanen, J., Lucero, A., & Hämäläinen, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.16671 · Cited by 7
“In the context of human-AI trust, Jacovi et al. [20] define warranted trust as trust that arises from an AI system’s trustworthiness.”
Limitations on Accurate, Trusted, Human-Level Reasoning
Panigrahy, R., & Sharan, V. (2025) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.forc.2026.11 · Cited by 6
“In this work, we point out a fundamental tension between the requirements of an AI system being accurate and trusted, but also matching or exceeding human reasoning capabilities, i.e. being a human-level reasoning system.”
Uncertainty in Natural Language Generation: From Theory to Applications
Baan, J., Daheim, N., Ilia, E., Ulmer, D., Li, H.-S., Fernández, R., Plank, B., Sennrich, R., Zerva, C., & Aziz, W. (2023) · arXiv · doi:10.48550/arxiv.2307.15703 · Cited by 6
On the Need to Rethink Trust in AI Assistants for Software Development: A Critical Review
Baltes, S., Speith, T., Chiteri, B., Mohsenimofidi, S., Chakraborty, S., & Buschek, D. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3659804 · Cited by 5
“There are ongoing discussions whether trust can be meaningfully applied to AI.”
Neves, J. B. D. J., & Romão, A. L. D. S. (2025) · Reforma y democracia. · doi:10.69733/clad.ryd.n90.a378 · Cited by 8
When AI meets counterfactuals: the ethical implications of counterfactual world simulation models
Kirfel, L., MacCoun, R. J., Icard, T., & Gerstenberg, T. (2025) · AI and Ethics · doi:10.1007/s43681-025-00718-4 · Cited by 6
“For example, the scene simulation model could be provided with the first t steps of the video evidence, and then predict how the remainder of the episode will unfold.”
Lay Perceptions of Algorithmic Discrimination in the Context of Systemic Injustice
Lima, G., Grgić-Hlača, N., Langer, M., & Zou, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713536 · Cited by 7
“Prior work suggests that explanations affect people’s mental models of algorithms [85] and their judgments of algorithmic decisions with respect to fairness, trust, and other factors [11, 38, 46, 73, 97, 100, 132].”
eXING-IoT conceptual framework for explainability integration in next generation-IoT
Vultureanu‐Albişi, A., Bădică, C., & Ivanović, M. D. (2025) · Connection Science · doi:10.1080/09540091.2025.2507180 · Cited by 6
Karumbaiah, S., Yin, Y., & Bharadwaj, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98414-3_5 · Cited by 6
Tunes of trust: A framework for auditory nudges in human-ai manufacturing collaboration
Mozaffar, F., Smith, L., & Morkos, B. W. (2025) · Manufacturing Letters · doi:10.1016/j.mfglet.2025.06.024 · Cited by 7
Sagasta, A. A., Antón, E., Zuberogoitia, A., & Egaña, T. (2025) · Pixel-Bit Revista de Medios y Educación · doi:10.12795/pixelbit.116875 · Cited by 5
Development and validation of a scale assessing perceived trustworthiness in large language models
Yankouskaya, A., Barajeeh, B., Babiker, A., Alshakhsi, S. A. A., Ma, Y. T., Ho, C. S. M., & Ali, R. (2026) · Discover Artificial Intelligence · doi:10.21203/rs.3.rs-7738215/v1 · Cited by 5
The Enterprising and Elusive Prospects of Human-AI Collaboration
Gadiraju, U., & Balayn, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_7 · Cited by 5
Multidisciplinary perspectives on human‑AI team trust
Tielman, M. L., Bailey, M. E., Frattolillo, F., Jorge, C. C., Ulfert, A., & Meyer-Vitali, A. (2025) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.24048.tie · Cited by 5
Does Sycophancy Change Decisions? Effect of LLM Sycophancy on AI-Assisted Decision-Making
Li, Z., Pan, J., Liu, Q., Xi, Y., Zhou, Y., Jin, Y., Mao, R., & Chen, P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790934 · Cited by 13
Qian, B. (2024) · Journal of Electrical Systems · doi:10.52783/jes.2767 · Cited by 5
“Recent studies, such as Jacovi et al. (2021), have underscored the significant impact of trust and perceived risk on online purchase decisions, emphasizing factors like trustworthiness, privacy, security, and information quality.”
BackgroundChen, H., Zhou, C., Saddik, A. E., & Cai, W. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710956 · Cited by 5
Digitalization of mass media as a factor of influence on trust in artificial intelligence
Razov, P. V., & Garaganov, A. V. (2023) · Digital sociology · doi:10.26425/2658-347x-2022-5-4-90-97 · Cited by 5
Actionable Artificial Intelligence for the Future of Production
Behery, M., Brauner, P., Zhou, H. A., Uysal, M. S., Самсонов, В., Bellgardt, M., Brillowski, F., Brockhoff, T., Ghahfarokhi, A. F., Gleim, L., et al. (2023) · Interdisciplinary excellence accelerator series · doi:10.1007/978-3-030-98062-7_4-2 · Cited by 6
Venger, A., & Dozortsev, V. M. (2023) · Mathematics · doi:10.3390/math11244956 · Cited by 5
“A pragmatic view of AI in industrial automation suggests that the user attributes a human-like reasoning process to an AI [13]; therefore, it seems logical to apply theory of mind (ToM) approaches to the HO–AI interaction, making the mental state of inter-acting agents transparent, which is…”
BackgroundA Novel Metric for XAI Evaluation Incorporating Pixel Analysis and Distance Measurement
Stodt, J., Reich, C., & Clarke, N. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00009 · Cited by 8
“This lack of transparency impedes the adoption of AI systems, as users may be skeptical without understanding the underlying rationale [5].”
BackgroundDesigning User-Centered Artificial Intelligence to Assist in Recovery from Domestic Abuse
Talwalkar, S., & Crooks, C. L. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00066 · Cited by 5
Patra ModelCards: AI/ML Accountability in the Edge-Cloud Continuum
Withana, S., & Plale, B. (2024) · IEEE International Conference on eScience · doi:10.1109/e-science62913.2024.10678710 · Cited by 6
Saliency strikes back: How filtering out high frequencies improves white-box explanationsPreprint
Muzellec, S., Fel, T., Boutin, V., Andéol, L., VanRullen, R., & Serre, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.09591 · Cited by 7
“Given the ever-increasing range of machine learning applications, the need for robust and reliable explainability methods is pressing (Doshi-Velez & Kim, 2017a; Jacovi et al., 2021).”
BackgroundExplainable Artificial IntelligencePreprint
Peters, T. M., & Visser, R. W. (2021) · arXiv (Cornell University) · doi:10.24406/publica-fhg-267645 · Cited by 5
Statistical Challenges with Dataset Construction: Why You Will Never Have Enough ImagesPreprint
Goldman, J., & Tsotsos, J. K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.11160 · Cited by 7
“However, trust in a model is only warranted if the trust was caused by the model’s ability to perform a given functionality [42].”
BackgroundTjondronegoro, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.00011 · Cited by 7
“Trust in AI is crucial for effective collaboration and decision-making in autonomous systems, especially when AI's decisions have significant consequences for users (Jacovi et al., 2021).”
Trust Formation in Healthcare AI: An Exploration of Older Adults’ Perspectives
Çelik, Ö., Kulla, M., & Stypińska, J. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36566 · Cited by 4
Poonsiriwong, R., Archiwaranguprok, C., Albrecht, C., Yin, P., Powdthavee, N., Ersner-Hershfield, H., Lertsutthiwong, M., Winson, K., & Pataranutaporn, P. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3797152 · Cited by 5
“Studies reveal contradictory user preferences: algorithm aversion in some contexts [21] but algorithmic appreciation in others [50], especially when users feel that they can expect trustworthy responses from AI [39].”
Schirmer, M., Fußwinkel, S., Mütze‐Niewöhner, S., Nitsch, V., & von Nitzsch, R. (2026) · Group Decision and Negotiation · doi:10.1007/s10726-026-09966-z · Cited by 5
“In this context, trust is often considered as a prerequisite for the interaction of potential users with AI applications (Chowdhury et al. 2022; Jacovi et al. 2021 ; Kelly et al. 2023 ).”
Khalid, M. I., Hussain, A., Hussain, N., & Alkhalifah, T. (2026) · Scientific Reports · doi:10.1038/s41598-026-43578-6 · Cited by 7
Metadata
- Authors
- Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y.
- Affiliations
- Bar-Ilan University (IL)
- University of Washington (US)
- The University of Melbourne (AU)
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 624-635
- OpenAlex
- W3134111219
- Cited by
- 545
- References
- 74
- Citations by year
- 2026: 131 · 2025: 137 · 2024: 102 · 2023: 90 · 2022: 60 · 2021: 24
- FWCI
- 31.88
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- European Research Council (802774)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- trust in AI, interpersonal trust, contractual trust, trustworthiness, user vulnerability, explainable AI, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.