Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
The DOI matches its Crossref record; 74 of the 76 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, interpersonal trust (i.e., trust between people) as defined by sociologists. This model rests on two key properties: the vulnerability of the user; and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI model is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (that detaches from the notion of trustworthiness in sociology), and with it concepts of 'warranted' and 'unwarranted' trust. We present the possible causes of warranted trust as intrinsic reasoning and extrinsic behavior, and discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted. Finally, we elucidate the connection between trust and XAI using our formalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Uncertainty is a defining characteristic of trust (Mayer et al., 1995) and has been referred to as a necessary prerequisite of human trust in AI that has been lacking in current XAI studies (Jacovi et al., 2021).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Jacovi et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research found that people often ignore recommendations because they do not trust them”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The primary motivation for clinical XAI is fostering appropriate trust: enabling clinicians to calibrate their reliance on AI recommendations based on the quality of supporting reasoning [156,157].”
From Explainability of decoder-only clinical large language models: A scoping review (2026) · cites this paper as [157]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, people find it difficult to correctly calibrate their trust in a decision aid [10,13,21,37].”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“For example, [38] formalizes human-AI trust by considering and extending the concepts of interpersonal trust.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [38]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“on basic definition of trust regards it as a directional transaction between two parties: if A believes that B will act in A’s best interest, and accepts vulnerability to B’s actions, then A trusts B [49]. The goal of trust is to “make social life predictable [by anticipating the impact of behavior], and make it easie…”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“ay that the trust is warranted if it is the result of trustworthiness, and otherwise it is unwarranted [50]. Warranted trust is sometimes referred to as trust which is calibrated with trustworthiness [43]. In other words, trust is the cognitive mechanism to give the ‘illusion’ of anticipating intended behavior, which…”
BackgroundLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 2×
“s can reveal strong correlations between attributes for one of those classes, giving leads to research on causation between them, even if the model was not useful for the original classification task [42, 46]. 2Assume that the performance evaluation is representative of real usage for now, although this is an importan…”
BackgroundInfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“Transparency High-standard documentation All Technical explainability Factsheets (explainability) Saliency maps [61], self-attention patterns [40], influence functions [38], probing [16] Adaptable user-centered explainability Factsheets (explainability) Counterfactual [21], contrastive [51], natural language [27], by-…”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Self-citationHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“8We consider AI as an automation attributed with intent, and thus, Human-AI trust is a sub-case of human-machine trust [28, 55].”
BackgroundLewis, J. D., & Weigert, A. (1985) · Social Forces · doi:10.2307/2578601 · Cited by 4,163 · cited 1×
“the influence of the trustee’s incentives on Human-AI trust, should build on the existing research in sociology that investigates the influence of relationships and communities on interpersonal trust [44]. Consequently, the question of whether this trust is warranted or unwarranted is ill-defined.Our definition of war…”
BackgroundA large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · cited 1×
“We set the “effort boundary” around 774 tokens—a few of minutes of reading—and the “vulnerability boundary” right from natural language inference [7], commonsense QA [70], and multi-sentence”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Baier, A. (1986) · Ethics · doi:10.1086/292745 · Cited by 2,567 · cited 1×
“present two directions for extension of our formalization inspired by other factors of interpersonal trust. 9.1 Other Elements of Interpersonal Trust and Trust in Automation Trust vs Reliance. Baier [4] introduces the term reliance for trust in inanimate objects, such as trusting a stool to hold your weight. We may fe…”
BackgroundInfluential
Research works printed but not linked: 27
- [1] David Alvarez Melis and Tommi Jaakkola. 2018. Towards Robust Interpretability with Self-Explaining Neural Networks. In Advances in Neural Information Processing Systems 31 , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. CesaBianchi, and R. Garnett (Eds.). 7775-7784. http://papers.nips.cc/paper/8003towards-robust-interpretability-with-self-explaining-neural-networks.pdf -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [15] Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017). - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- [21] Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6572 - · arXiv
- [22] Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Counterfactual Visual Explanations (Proceedings of Machine Learning Research, Vol. 97) , Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, Long Beach, California, USA, 2376-2384. http://proceedings.mlr.press/v97/goyal19a.html -
- 10.18653/v1 · doi:10.18653/v1
- [25] Sven Ove Hansson. 2018. Risk. In The Stanford Encyclopedia of Philosophy (fall 2018 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- [29] Robert R Hoffman. 2017. A taxonomy of emergent trusting in the human-machine relationship. Cognitive systems engineering: The future for a changing world (2017), 137-163. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [40] Hana Kopecka and Jose M Such. 2020. Explainable AI for Cultural Minds. https://sites.google.com/view/dexahai-at-ecai2020/home Workshop on Dialogue, Explanation and Argumentation for Human-Agent Interaction , DEXAHAI ; Conference date: 07-09-2020. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [53] Carolyn McLeod. 2015. Trust. In The Stanford Encyclopedia of Philosophy (fall 2015 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [64] Philipp Schmidt and Felix Bießmann. 2019. Quantifying Interpretability and Trust in Machine Learning Systems. CoRR abs/1901.08558 (2019). arXiv:1901.08558 http://arxiv.org/abs/1901.08558 - · arXiv
- [67] Anders Søgaard, Sebastian Ebert, Jasmijn Bastings, and Katja Filippova. 2020. We Need to Talk About Random Splits. CoRR abs/2005.00636 (2020). arXiv:2005.00636 https://arxiv.org/abs/2005.00636 - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
Cited by
Items 401–500 of 747
Ragone, G., Buono, P., Good, J., & Lanzilotti, R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790765 · Cited by 5
Nguyen, T. H., Truong, L. T., & Nguyen, N. H. T. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100618 · Cited by 4
Rusdiana, R., & Cahyadi, A. (2026) · Al Ghazali. · doi:10.69900/ag.v6i3.608 · Cited by 6
ZeroGuard: A Multi-Agent Zero-Trust Framework for Autonomous IaC Security Remediation
Apuri, H., Goel, S., Chinthala, M. M. R., & Yepuri, C. (2026) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai69016.2026.11613725 · Cited by 4
Not All Trust Is the Same: Effects of Decision Workflow and Explanations in Human-AI Decision Making
Spillner, L., Ringe, R., Porzel, R., & Malaka, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-26717-7_15 · Cited by 5
Mohajeri, B., & Cheng, J. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526114.3558698 · Cited by 5
Albini, E., Rago, A., Baroni, P., & Toni, F. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1099407 · Cited by 4
“trust can exist in a model that is not trustworthy, and a trustworthy model does not necessarily gain trust” (Jacovi et al., 2021).”
BackgroundActionable Artificial Intelligence for the Future of Production
Behery, M., Brauner, P., Zhou, H. A., Uysal, M. S., Самсонов, В., Bellgardt, M., Brillowski, F., Brockhoff, T., Ghahfarokhi, A. F., Gleim, L., et al. (2023) · Interdisciplinary excellence accelerator series · doi:10.1007/978-3-030-98062-7_4-1 · Cited by 4
Social Transparency in Network Monitoring and Security Systems
Soroko, D., Savino, G.-L., Gray, N., & Schöning, J. (2023) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3626705.3627773 · Cited by 4
Labe, Z. M., Delworth, T. L., Johnson, N. C., & Cooke, W. F. (2024) · Journal of Geophysical Research Machine Learning and Computation · doi:10.1029/2024jh000327 · Cited by 4
Sporsem, T., Finserås, S. R., Adde, L., & Strümke, I. (2026) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3786583.3786889 · Cited by 6
Ji, D., Zhang, M., & Lou, Y. (2025) · Journal of Engineering Design · doi:10.1080/09544828.2025.2518656 · Cited by 7
Trust‐Affording Action: Citizens’ Everyday Relations With Algorithmized Public Services
Rannisto, A., & Vainionpää, F. (2025) · Social Inclusion · doi:10.17645/si.10001 · Cited by 4
“Researchers have theorized trust in technology (Gille et al., 2020) and the formation of trust (Gillath et al., 2021; Jacovi et al., 2021), along with searching for ways to analyze trust specifically in human–AI Social Inclusion • 2025 • Volume 13 • Article 10001 interactions (Ferrario et al.,…”
Ensuring Safety, Accountability, and Drift Resistance in LLM-Based Supply Chain Optimization
Jingar, N. K. (2023) · International Journal of Scientific Research in Science Engineering and Technology · doi:10.32628/ijsrset2310372 · Cited by 7
Spoof Trace Discovery for Deep Learning Based Explainable Face Anti-Spoofing
Zhang, H., Zhu, X., Gao, L., Pan, J., Pang, K., Zhao, G., & Lei, Z. (2025) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb65343.2025.11411397 · Cited by 4
“The field of eXplainable Artificial Intelligence (XAI) [6, 20, 46, 8] has emerged to demystify the inner workings of black-box models and offer insights into their decision-making processes.”
Building Appropriate Trust in Human-AI Interactions
Alizadeh, F., Stevens, G., Vereschak, O., Bailly, G., Caramiaux, B., & Pins, D. (2022) · HAL · doi:10.48340/ecscw2022_ws04 · Cited by 7
Trustworthy Artificial Intelligence in Medical Applications: A Mini Survey
Onari, M. A., Grau, I., Nobile, M. S., & Zhang, Y. (2023) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb56990.2023.10264883 · Cited by 6
“bility to M’s actions, then H trusts M contractually to C [9].”
He, T., & Jazizadeh, F. (2024) · ASCE International Conference on Computing in Civil Engineering (i3CE) · doi:10.1061/9780784485224.064 · Cited by 4
On the Definition of Appropriate Trust and the Tools that Come with it
Löfström, H. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00256 · Cited by 4
“In some papers [32], the metric is called simply trust, while others justified trust [7], calibrated trust [16], perceptual accuracy [35], or causability [11].”
BackgroundPaddy Disease Detection through Vision Transformers
Chin, W. F. L., & Suhaili, W. S. (2024) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1426/1/012003 · Cited by 4
“Intrinsic trustworthiness can be built from the user through model explainability, whereby an alignment of model interpretation with human reasoning takes place [11,12].”
Arifin, G. Y. (2024) · American Journal of Scholarly Research and Innovation · doi:10.63125/4m5fjb12 · Cited by 13
Towards Fluid Software Architectures: Bidirectional Human-AI Interaction
Yasser, A., & Abu-Elkheir, M. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678647 · Cited by 4
“AI could be outdated/wrong (which causes users to lose trust in the system [17], [18]) or straight out malicious and harmful.”
BackgroundParamonova, I., Sousa, S., & Lamas, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34411-4_25 · Cited by 4
What is the Minimum to Trust AI?—A Requirement Analysis for (Generative) AI-Based Texts
Tomitza, C., Schaschek, M., Straub, L., & Winkelmann, A. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80119-8_14 · Cited by 7
Applications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021.v1 · Cited by 4
The FIX Benchmark: Extracting Features Interpretable to eXpertsPreprint
Jin, H., Havaldar, S., Kim, C., Xue, A., You, W., Qu, H., Gatti, M., Hashimoto, D. A., Jain, B., Madani, A., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.13684 · Cited by 4
“Although such models have promising applications, their opaque nature is a liability in domains where transparency is crucial [Jac+21; HHB20].”
BackgroundPointwise Reliability Assessment: Density vs. Local Fit Methods
Trovão, J., Henriques, J. M. O., Petrella, L., Trindade, M., & Loureiro, J. (2024) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw65004.2024.00077 · Cited by 3
“These factors have motivated significant research aiming to develop reliability/confidence measures for individual model predictions [3].”
Amine, J. M., & Mourad, M. (2025) · Current Alzheimer Research · doi:10.2174/0115672050401817250721190509 · Cited by 6
Trusted Simulation: Considering Model Quality in the Context of User Trust
Naugle, A., Manickam, I., Steinmetz, S., Schutte, P., Sweitzer, M., & Washburne, A. (2025) · System Dynamics Review · doi:10.1002/sdr.70011 · Cited by 3
Yoon, J., Zajac, P., Pococke, L., Jicol, A., Clarke, C., O'Neill, E. J., Petrini, K., Lutteroth, C., & Jicol, C. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3616748 · Cited by 4
“Restrictions apply. ing that is not reflective of the actual capabilities or limitations of the AI system [23].”
MODELING OF AN ADAPTIVE EDUCATIONAL SYSTEM BASED ON MACHINE LEARNING ALGORITHMS
Iklassova, K., Shaikhanova, A. K., Базарова, М., Tashibayev, R. M., & Aitymova, A. (2025) · Bulletin of Shakarim University Technical Sciences · doi:10.53360/2788-7995-2025-3(19)-15 · Cited by 3
An Empirical Examination of the Evaluative AI Framework
Kornowicz, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2581260 · Cited by 3
“As a result, the lack of transparency and comprehensibility often leads to distrust and underreliance among potential users, despite the accuracy of these decision-support systems (Jacovi et al., 2021; Mahmud et al., 2022; Zhang et al., 2020).”
Merikko, J., & Räsänen, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13184-3_14 · Cited by 3
Kahr, P. K., & Bernstein, A. (2026) · doi:10.1145/3780045.3780056 · Cited by 3
Toward a Holistic Framework for Human-AI Collaboration in Safety-Critical Systems
Bessa, R. J. G. D. S. B., Leyli-Abadi, M., Yagoubi, M., Boos, D., Borst, C., Castagna, A., Chavarriaga, R., Dias, D., Egli, A., Eisenegger, A., et al. (2026) · Springer eBooks · doi:10.1007/978-3-032-10561-5_13 · Cited by 3
Pal, O., Duddu, V., Goyal, A., Goel, D., & Saha, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799386 · Cited by 6
A Conceptual Crosswalk Between Trustworthy Records and Trustworthy AI
Carrasco, L. B., Engvall, T. S., & Dobslaw, F. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01112-6 · Cited by 3
“One paper approached trustworthiness of AI as a capability of maintaining a contract (Jacovi et al., 2021).”
Using It but Not Trusting It: Technology Acceptance and Generative AI in European Fact-Checking
Dierickx, L., & van Dalen, A. (2026) · Emerging Media · doi:10.1177/27523543261449974 · Cited by 3
“This tension challenges the common assumption that trust is a prerequisite for using AI (Jacovi et al., 2021; Schmitt et al., 2024; Toreini et al., 2020).”
Zhou, W., Karaturhan, P., Weilenmann, A. H., & Zhu, J. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812954 · Cited by 4
“Research has shown that the complexity and black-box nature of AI make it difficult for non-technical users to understand its decision-making and to develop an appropriate level of trust and reliance [36].”
Beyond Black Boxes: AI Certification Labels Increase Adoption through Trust
de Almeida, F., Glaum, J., Hildred, K., & Scott, I. J. (2026) · Psychology and Marketing · doi:10.1002/mar.70185 · Cited by 3
“…demonstrating the effectiveness of certification labels in aiding trust‐ formation mechanisms by helping end‐users assess a system's trustworthiness (Jacovi et al. 2021; Lee and See 2004; Liao and Sundar 2022), which can be strengthened by making the label's connection to TAI requirements more…”
InfluentialThe Duet of Representations and How Explanations Exacerbate It
Wan, C., Belo, R., Zejnilović, L., & Lavado, S. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_10 · Cited by 3
“[17] formalizes the notions of trust and trustworthiness in human-AI interaction and examine the criteria under which trust is normatively warranted.”
BackgroundDesign and Development of a Provenance Capture Platform for Data Science
Gregori, L., Missier, P., Stidolph, M., Torlone, R., & Wood, A. (2024) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew61823.2024.00042 · Cited by 3
“The main component of DPDS is the Provenance-Tracker that automates the process of detecting and tracking the provenance of a user-defined pipeline of data preparation written in pandas/python, a largely used library for data manipulation and analysis 3 .”
MethodGröner, F., & Chiou, E. K. (2024) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813241260399 · Cited by 4
“Trust is an attitude (Lee & See, 2004) that can be characterized as an expectation that a system will help achieve a common goal as promised (Jacovi et al., 2021; Zahedi et al., 2023).”
Descriptive Accuracy in Explanations: The Case of Probabilistic Classifiers
Albini, E., Rago, A., Baroni, P., & Toni, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-18843-5_19 · Cited by 5
A Conceptual Model for Labeling in Reinforcement Learning Systems: A Value Co-creation Perspective
Reinhard, P., Li, M. M., Dickhaut, E., Reh, C., Peters, C., & Leimeister, J. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-32808-4_8 · Cited by 3
The Behavioural Impact of Artificial Intelligence: Theory of Consumption Value Perspective
Balasooriya, B. A. D. N., Sedera, D., & Sorwar, G. (2024) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/979-8-3693-4453-8.ch016 · Cited by 4
Glomsrud, J. A., Kemna, S., Vasanthan, C., Zhao, L., McGeorge, D., Pedersen, T. A., Torben, T. R., Rokseth, B., & Nguyen, D. T. (2024) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2867/1/012043 · Cited by 3
“Insight evidence: (1) System identi(cid:976)ication and risk analysis: to increase the transparency, knowledge, and con(cid:976)idence in its robustness, and (2) Modular assurance of the ferry subsystem, its key components and integration: to gather knowledge, justify con(cid:976)idence and provide…”
Langer, M., Hunsicker, T., Feldkamp, T., König, C. J., & Grgić-Hlača, N. (2021) · arXiv (Cornell University) · Cited by 4
Augmented Algorithms, Adaptive Humans? Evidence from a Natural ExperimentPreprint
Lu, T., Lu, X., Huang, Y., & Wang, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4298793 · Cited by 6
Applications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021 · Cited by 4
Krämer, N. C., Wischnewski, M., & Müller, E. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h32ze · Cited by 4
Anticipating the risks and benefits of counterfactual world simulation modelsPreprint
Kirfel, L., MacCoun, R. J., Icard, T., & Gerstenberg, T. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9x8rv · Cited by 4
Venkit, P. N., Prabhakar, A., Li, Y., Lee, D., & Wu, C.-S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28818 · Cited by 4
Reciprocal trust and distrust in artificial intelligence systems: the hard problem of regulation
Maggetti, M. (2026) · AI & SOCIETY · doi:10.1007/s00146-026-02966-2 · Cited by 2
“But scholars are increasingly recognizing the bidirectional nature of trust in socio-technical systems (Bareis 2024; Jacovi et al. 2021; Lee-Geiller 2024; Sagona et al. 2025; Wang et al. 2024).”
Enhancing Trust in Smart Charging Agents—The Role of Traceability for Human-Agent-Cooperation
Attig, C., Schrills, T., Gödker, M., Wollstadt, P., Wiebel-Herboth, C. B., Valdez, A. S. C., & Franke, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48057-7_19 · Cited by 3
Jahn, T., Hühn, P., & Förster, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61175-9_5 · Cited by 4
The value of real-time automated explanations in stochastic planning
Goldman, C. V., Bustin, R., Qi, W., Xing, Z., McPhearson-White, R., & Rogers, S. J. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2025.104323 · Cited by 4
Wee, A. K. J., Lin, M., Jenkins, M. A., & Lee, S. E. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-5837-5.ch004 · Cited by 3
Human-AI Teaming – Challenges from a Practitioner’s Perspective
Droogenbroeck, C. V., Rankova, E., Papenfuß, A., Bos, T., & Zon, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93718-7_22 · Cited by 2
IT Professionals Versus the Public: Who’s More Optimistic About AI’s Future Impacts?
Thaiduong, N. (2025) · SAGE Open · doi:10.1177/21582440251348802 · Cited by 2
“Theoretical frameworks for building trustworthy AI systems often lean on socio technical solutions like safety features, fairness algorithms, and transparency measures (Jacovi et al., 2021; Knowles & Richards, 2021).”
Hayh, J. D., Joseph, S., Dirks, S., & Namboodiri, V. (2025) · Technology and Disability · doi:10.1177/10554181251355426 · Cited by 2
Hannibal, G., & Bauer, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05002-1_33 · Cited by 2
PCBEAR: Pose Concept Bottleneck for Explainable Action Recognition
Lee, J., Lee, W., Park, G.-M., Kim, S., & Choi, J. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00253 · Cited by 5
“This lack of transparency raises concerns in safety-critical applications, where inter-pretability is essential for ensuring trust and accountability [13, 26].”
Onari, M. A., Baer, G. T., Zhang, C., Grau, I., Nobile, M. S., & Zhang, Y. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_15 · Cited by 4
Gille, F., Daniore, P., Maaß, L., & Zavattaro, F. (2025) · International Journal of Public Health · doi:10.3389/ijph.2025.1608708 · Cited by 2
Merikko, J., Leppänen, L., & Mannila, L. (2025) · AI & Society · doi:10.1007/s00146-025-02699-8 · Cited by 2
Семеновна, Р. А., & Воронин, А. Н. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2580550 · Cited by 2
“This trust hinges on two key factors: the user’s vulnerability (dependence on the AI) and their ability to anticipate the AI’s impact (Jacovi et al., 2021).”
Khalid, M. I., Jian-Xun, M., Komal, A., Sarwar, N., & Attique, D. (2025) · International Conference on Open Source Systems and Technologies (ICOSST) · doi:10.1109/icosst69113.2025.11315337 · Cited by 2
Wang, H., Lai, X., Huang, S., Dai, X., Zhao, X., & Wang, Y. (2026) · Behavioral Sciences · doi:10.3390/bs16010072 · Cited by 2
“It is the core of human–AI interaction (Jacovi et al., 2021).”
Adolescent Perceptions of an Online Safety Chatbot: Survey Study
Charles, M., Sauer, J. D., Roehrer, E., Prichard, J., Watters, P., & Scanlan, J. D. (2026) · JMIR Human Factors · doi:10.2196/71498 · Cited by 4
Newen, C., Bodemer, D., Glantz, S., Müller, E., Wischnewski, M., & Schnaubert, L. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00070 · Cited by 2
“There have been many attempts in the literature to formalize the prerequisites and goals of the cognitive mechanism of trust [15].”
Chen, Y.-Q., Liang, J., Errey, N., Zowghi, D., Bano, M., Chan, K., & Hogan, J. (2026) · Information Visualization · doi:10.1177/14738716261435103 · Cited by 4
“13 Much less attention has been paid to trust in the medium of disclosure itself: the communicative interface through which AI is explained to the public.”
Building Trustworthy AI Systems for Condition Monitoring
Hämäläinen, A., Karhinen, A., & Viitala, R. (2026) · IEEE Access · doi:10.1109/access.2026.3688909 · Cited by 4
“The performance of a model plays only a part in determining the amount of trust placed on it [74].”
The BEETS framework for responsible artificial intelligence
Tettegah, S. Y. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01597-2 · Cited by 2
“This model is grounded in the idea that AI systems, as complex artifacts rather than moral agents, must demonstrate trustwor-thiness in order to earn and sustain public confidence [26, 50].”
Liebherr, M., Yankouskaya, A., Alshakhsi, S. A. A., Montag, C., & Ali, R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01781-4 · Cited by 2
“In the LLM context, trust is influenced by output accuracy, transparency of reasoning, consistency across interactions, and alignment with user values [79–81].”
Arora, R. G., & Siradhana, N. K. (2026) · South Asian Journal of Human Resources Management · doi:10.1177/23220937261470890 · Cited by 2
Why we believe chatbots: trust calibration as a design problem
Jaidka, K., & Cai, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1935527 · Cited by 4
“Common tactics include prompting the chatbot for citations, cross-checking answers in a search engine, and reading surface features such as response length or emotional tone as signs of credibility (Basu and Dave, 2024; Jacovi et al., 2021; Zamfirescu-Pereira et al., 2023).”
InfluentialAn Executive for Autonomous Systems, Inspired by Fear Memory Extinction
Garcia, M., Goranson, H. T., & Cardier, B. (2021) · Springer eBooks · doi:10.1007/978-3-030-77283-3_13 · Cited by 2
The Cycle of Trust and Responsibility in Outsourced AI
Castelli, M., & Moreau, L. C. (2022) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2022.trustnlp-1.4 · Cited by 2
Sustained Enablement of AI Ethics in Industry
Flatscher, M., Fessler, A., & Janez, I. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-42307-9_1 · Cited by 2
Continuous automation approach for autonomous ethics-based audit of AI systems
Lupo, G., Vo, Q. B., & Locke, N. (2024) · Elsevier eBooks · doi:10.1016/b978-0-44-315991-6.00015-7 · Cited by 3
Mylrea, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15988-6.00005-4 · Cited by 4
Integrating Explainable AI: Breakthroughs in Medical Diagnosis and Surgery
Henriques, A., Parola, H., Gonçalves, R., & Rodrigues, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-60218-4_23 · Cited by 2
Factors Influencing Perceptions of Trust in Data Infrastructures
Flicker, K., Rauber, A., Kern, B., & Ekaputra, F. J. (2024) · International Journal of Digital Curation · doi:10.2218/ijdc.v18i1.921 · Cited by 2
On Explaining and Reasoning About Optical Fiber Link Problems
Theodorou, G., Καραγιώργου, Σ., Fulignoli, A., & Magri, R. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63797-1_14 · Cited by 2
“Jacovi et al. [8] address the critical role of trust in human-AI interactions, particularly within the XAI contexts, aiming to provide clarity and structure to the concept of trust.”
Building Trust in AI: Exploring the Impact of AI Competence Framing
Gonzalez, V., Amo, L., & Smith, S. D. (2025) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2025.063 · Cited by 2
Runtime Verification for Visual Deep Learning Systems With Loss Prediction
Torpmann-Hagen, B., Riegler, M. A., Halvorsen, P., & Johansen, D. (2025) · IEEE Access · doi:10.1109/access.2025.3552157 · Cited by 4
“In addition to the fact that this reduces the overall utility of the system, it can result in more cross-cutting system failures for instance with regards to insufficient trustworthiness [34], safety [35], and fairness [36].”
Estimating Belief Updates in AI-Driven Drone Controls for Urban Search and Rescue Operations
Sun, B., Wu, J., You, H., & Du, J. (2025) · Journal of Construction Engineering and Management · doi:10.1061/jcemd4.coeng-15747 · Cited by 2
Leveraging Complementary AI Explanations to Mitigate Misunderstanding in XAI
Xuan, Y., Sokol, K., Sanderson, M., & Chan, J. (2025) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds66131.2025.00034 · Cited by 3
“It can lead to flawed judgment, automation misuse [3] and miscalibrated trust, where users either over-rely on or unjustifiably dismiss AI advice [4], [5].”
AI Eyes on the Road: Cross-Cultural Perspectives on Traffic Surveillance
Wang, Z., Yang, S., Currano, R., Fjeld, M., & Sirkin, D. M. (2026) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3828157.3828769 · Cited by 2
“The online questionnaire was offered in both English and Chinese versions.”
Ferdinal, O., & Bakir, H. (2024) · Journal of Multidisciplinary Sustainability Asean. · doi:10.70177/ijmsa.v1i6.1822 · Cited by 5
“Meanwhile, the analytical approach is used to analyze and review the application of legal norms in practice and identify gaps or legal gaps that may exist, to provide more effective solutions in dealing with the problem (Jacovi et al., 2021).”
SVD-based Peephole and Clustering to Enhance Trustworthiness in DNN Classifiers
Manovi, L., Capelli, L., Marchioni, A., Martinini, F., Setti, G., Mangia, M., & Rovatti, R. (2024) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas59952.2024.10595919 · Cited by 2
Traceability and Accountability by Construction
Wenzel, J., Köhl, M. A., Sterz, S., Zhang, H., Schmidt, A., Fetzer, C. W., & Hermanns, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75387-9_16 · Cited by 4
Boosting Benefits, Offsetting Obstacles—The Impact of Explanations on AI Users’ Task Performance
Walter, M. C., Broder, H. R., & Förster, M. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80122-8_7 · Cited by 2
Human-Centered Artificial Intelligence, a reviewPreprint
Domfeh, E. A. (2022) · doi:10.36227/techrxiv.19174772 · Cited by 2
Trust Explanations to Do What They SayPreprint
Natarajan, N., Binns, R., Zhao, J., & Shadbolt, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.13526 · Cited by 2
“propose that trust in AI systems can be understood in terms of a contract between the system and the trustor [4].”
BackgroundInfluentialApplications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021.v2 · Cited by 2
Lin, S. (2024) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/181390 · Cited by 4
AI-Based Crypto Tokens: The Illusion of Decentralized AI?Preprint
Mafrur, R. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/yrzj5_v1 · Cited by 2
European Cybersecurity in Context: A Policy-Oriented Comparative Analysis
Luigi Martino, N. G., Martino, L., & Gamal, N. (2022) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) · doi:10.53121/elftps3 · Cited by 2
Metadata
- Authors
- Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y.
- Affiliations
- Bar-Ilan University (IL)
- University of Washington (US)
- The University of Melbourne (AU)
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 624-635
- OpenAlex
- W3134111219
- Cited by
- 545
- References
- 74
- Citations by year
- 2026: 131 · 2025: 137 · 2024: 102 · 2023: 90 · 2022: 60 · 2021: 24
- FWCI
- 31.88
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- European Research Council (802774)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- trust in AI, interpersonal trust, contractual trust, trustworthiness, user vulnerability, explainable AI, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.