Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
The DOI matches its Crossref record; 74 of the 76 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, interpersonal trust (i.e., trust between people) as defined by sociologists. This model rests on two key properties: the vulnerability of the user; and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI model is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (that detaches from the notion of trustworthiness in sociology), and with it concepts of 'warranted' and 'unwarranted' trust. We present the possible causes of warranted trust as intrinsic reasoning and extrinsic behavior, and discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted. Finally, we elucidate the connection between trust and XAI using our formalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Uncertainty is a defining characteristic of trust (Mayer et al., 1995) and has been referred to as a necessary prerequisite of human trust in AI that has been lacking in current XAI studies (Jacovi et al., 2021).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Jacovi et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research found that people often ignore recommendations because they do not trust them”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The primary motivation for clinical XAI is fostering appropriate trust: enabling clinicians to calibrate their reliance on AI recommendations based on the quality of supporting reasoning [156,157].”
From Explainability of decoder-only clinical large language models: A scoping review (2026) · cites this paper as [157]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, people find it difficult to correctly calibrate their trust in a decision aid [10,13,21,37].”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“For example, [38] formalizes human-AI trust by considering and extending the concepts of interpersonal trust.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [38]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“on basic definition of trust regards it as a directional transaction between two parties: if A believes that B will act in A’s best interest, and accepts vulnerability to B’s actions, then A trusts B [49]. The goal of trust is to “make social life predictable [by anticipating the impact of behavior], and make it easie…”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“ay that the trust is warranted if it is the result of trustworthiness, and otherwise it is unwarranted [50]. Warranted trust is sometimes referred to as trust which is calibrated with trustworthiness [43]. In other words, trust is the cognitive mechanism to give the ‘illusion’ of anticipating intended behavior, which…”
BackgroundLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 2×
“s can reveal strong correlations between attributes for one of those classes, giving leads to research on causation between them, even if the model was not useful for the original classification task [42, 46]. 2Assume that the performance evaluation is representative of real usage for now, although this is an importan…”
BackgroundInfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“Transparency High-standard documentation All Technical explainability Factsheets (explainability) Saliency maps [61], self-attention patterns [40], influence functions [38], probing [16] Adaptable user-centered explainability Factsheets (explainability) Counterfactual [21], contrastive [51], natural language [27], by-…”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Self-citationHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“8We consider AI as an automation attributed with intent, and thus, Human-AI trust is a sub-case of human-machine trust [28, 55].”
BackgroundLewis, J. D., & Weigert, A. (1985) · Social Forces · doi:10.2307/2578601 · Cited by 4,163 · cited 1×
“the influence of the trustee’s incentives on Human-AI trust, should build on the existing research in sociology that investigates the influence of relationships and communities on interpersonal trust [44]. Consequently, the question of whether this trust is warranted or unwarranted is ill-defined.Our definition of war…”
BackgroundA large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · cited 1×
“We set the “effort boundary” around 774 tokens—a few of minutes of reading—and the “vulnerability boundary” right from natural language inference [7], commonsense QA [70], and multi-sentence”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Baier, A. (1986) · Ethics · doi:10.1086/292745 · Cited by 2,567 · cited 1×
“present two directions for extension of our formalization inspired by other factors of interpersonal trust. 9.1 Other Elements of Interpersonal Trust and Trust in Automation Trust vs Reliance. Baier [4] introduces the term reliance for trust in inanimate objects, such as trusting a stool to hold your weight. We may fe…”
BackgroundInfluential
Research works printed but not linked: 27
- [1] David Alvarez Melis and Tommi Jaakkola. 2018. Towards Robust Interpretability with Self-Explaining Neural Networks. In Advances in Neural Information Processing Systems 31 , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. CesaBianchi, and R. Garnett (Eds.). 7775-7784. http://papers.nips.cc/paper/8003towards-robust-interpretability-with-self-explaining-neural-networks.pdf -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [15] Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017). - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- [21] Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6572 - · arXiv
- [22] Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Counterfactual Visual Explanations (Proceedings of Machine Learning Research, Vol. 97) , Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, Long Beach, California, USA, 2376-2384. http://proceedings.mlr.press/v97/goyal19a.html -
- 10.18653/v1 · doi:10.18653/v1
- [25] Sven Ove Hansson. 2018. Risk. In The Stanford Encyclopedia of Philosophy (fall 2018 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- [29] Robert R Hoffman. 2017. A taxonomy of emergent trusting in the human-machine relationship. Cognitive systems engineering: The future for a changing world (2017), 137-163. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [40] Hana Kopecka and Jose M Such. 2020. Explainable AI for Cultural Minds. https://sites.google.com/view/dexahai-at-ecai2020/home Workshop on Dialogue, Explanation and Argumentation for Human-Agent Interaction , DEXAHAI ; Conference date: 07-09-2020. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [53] Carolyn McLeod. 2015. Trust. In The Stanford Encyclopedia of Philosophy (fall 2015 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University. -
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
- [64] Philipp Schmidt and Felix Bießmann. 2019. Quantifying Interpretability and Trust in Machine Learning Systems. CoRR abs/1901.08558 (2019). arXiv:1901.08558 http://arxiv.org/abs/1901.08558 - · arXiv
- [67] Anders Søgaard, Sebastian Ebert, Jasmijn Bastings, and Katja Filippova. 2020. We Need to Talk About Random Splits. CoRR abs/2005.00636 (2020). arXiv:2005.00636 https://arxiv.org/abs/2005.00636 - · arXiv
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
Cited by
Items 601–700 of 747
Trustworthy enough? Evaluation of an AI decision support system for healthcare professionals
Kacafírková, K. S. (2023) · VUBIR (Vrije Universiteit Brussel) · Cited by 3
Kurusev, R., & Jagor, M. (2025) · Lund University Publications Student Papers (Lund University) · Cited by 1
The significance of interns trust in artificial intelligence adoption
(2024) · UpSpace Institutional Repository (University of Pretoria)
Andersson, O., & Bucei, G. S. (2023) · DiVA (Digitala Vetenskapliga Arkivet)
Vertical Selection for Heterogeneous Search Engine Result Pages
Vilčinskas, A. (. (2021) · Research Repository (Delft University of Technology)
Li, Y., Wang, Y., & Sun, Y. (2025) · AIS Electronic Library (AISeL)
Menschliche Reaktionen auf soziale Bewertungssysteme
Löfflad, C., Grossklags, J., & München, T. U. (2024)
Bailey, M. E. (2025) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.85469
Proceedings of the 2nd International Conference on Digital Skills and IT Professionalism
López-Baldominos, I., & Pospelova, V. (2025) · doi:10.65163/icodpr2025
Deepfake user personas for good - from maleficent to helping users
Kaate, I. (2025) · UTUPub (University of Turku) · Cited by 2
García, F. C., & Fernández, V. N. (2025) · Colloquia Academic Journal of Culture and Thought · doi:10.31207/colloquia.v12i1.186
Trusting the Machine: University Faculty Perspectives on AI in Information Technology Education
Abisado, M., Blancaflor, E., Sideno, J. E., Sun, J., Caluya, S. S., & Calfoforo, J. C. (2025) · Conference on Information Technology Education · doi:10.1145/3769694.3771110
Addressing Perceived Existential Risks of Agentic AI Through Agile Trustworthiness Engineering
Wills, K., & Crooks, C. L. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12313-8_1
AI Approaches to Diversity and Inclusion in Hospitality
Talukder, M. B., Kumar, S., & Singh, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1077-0.ch001
Rizvi, S. W. F., Yankouskaya, A., Alshakhsi, S. A. A., Al‐Thani, D., & Ali, R. (2025) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm67465.2025.11391019
SkinSplain : An XAI Framework for Trust Calibration in Skin Lesion Analysis
Katzke, T., Yalçıner, M., Corazza, J., Ventura, A., Bündert, T.-M., & Müller, E. (2025) · Universitätsbibliographie, Universität Duisburg-Essen · Cited by 2
Wijaya, A. S. (2025) · Tampere University Institutional Repository (Tampere University)
Müller, H., Steiger, D., Plass, M., & Holzinger, A. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2739758 · Cited by 1
“Third, trust is a distinct construct from correctness with its own determinants and its own measurement tradition (Lee and See 2004; Jacovi et al. 2021), and transparency research argues for human-centered measurement of how model behavior is understood in context (Liao and Vaughan 2024).”
Daily Encounters with AI: An Inquiry into Users’ Sensemaking
Alizadeh, F. (2025) · Recherche und Kataloge (Universitätsbibliothek Siegen) · doi:10.25819/ubsi/10803
Carli, R., Bhattacharya, S., Tchappi, I., Främling, K., & Najjar, A. (2026) · Springer eBooks · doi:10.1007/978-981-96-5290-7_24
A Systematic Literature Review of User’s Trust in Autonomous Military TechnologiesPreprint
Värno, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6450163
Stites, M. C., Matzen, L. E., Howell, B. C., & Dickson, D. S. (2026) · Cognitive Research Principles and Implications · doi:10.1186/s41235-026-00716-y
“We tested predictions made by Jacovi et al.’s (2021) paper that making model errors more predictable, and thus less surprising, would increase trust in the model.”
InfluentialAI Trustworthiness Index for Healthcare (AITI-H): conceptualization, structure, and development
Rahman, H. A., Noraidi, A. A., & Tun, H. M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01102-6
Impact of AI on Trust in the Media
Kolo, C., Mütterlein, J., & Schmid, S. A. (2026) · Future of business and finance · doi:10.1007/978-3-032-07605-2_8
Vereschak, O. (2022) · theses.fr (ABES) · doi:10.70675/7ecd53bfza7ccz4edfz8f1azdb8052ba1233 · Cited by 2
The L.I.F. Protocol: Love as Relational Coherence in Advanced Intelligence SystemsPreprint
Lif, J. M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6424639
Enhancing user trust in autonomous vehicles through augmented reality visualization
Tran, T. T. H. (2026) · theses.fr (ABES) · doi:10.70675/13d1dbfcz2490z4169z8c9bz163e81177485
XR for Challenging Environments - Enabling Human Performance and Agency under Stress
Schatz, R., Schrom-Feiertag, H., Papagni, G., Steinicke, F., Skorin‐Kapov, L., Billinghurst, M., Oppermann, L., & Aumayr, G. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778704
AI as the Phantom Limb: The Asymmetry of Attribution in Human vs. AI Delegation
Chen, R. Y.-S., Hou, Y. T.-Y., Lin, Y., Liu, J. M.-E., Chen, W., & Chen, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791075 · Cited by 1
“…best interest [57]; perceived risk represents the potential negative consequences users feel when relying on the AI, particularly under uncertainty [46] and reciprocity is defined as the user’s belief that the agent will provide commensurate benefits or return the favor in an exchange…”
Röber, T. E., Festor, P., Goedhart, R., Birbil, Ş. İ., & Faisal, A. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.09573
“However, self-report scales are increasingly criticized due to, for example, their unreliability, susceptibility to biases, and misinterpretation of Likert items, which has been repeatedly raised in recent work around trust in AI models ( e.g. , Miller, 2022; Jacovi et al., 2021).”
Matziou, G., & Gao, Y. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.056
Effective but untrustworthy: How artificial intelligence bias opposing human bias affects judgments
Cognitive Science Society 2025, Honda, H., Rina, K., & Shirasuna, M. (2025) · eScholarship (California Digital Library) · doi:10.48448/0vep-kf76 · Cited by 1
Ye, Z., Liang, X., & Cheng, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6604907
Leveraging AI-Enabled Social Capital for Sustainable Tourism
Rao, V., & Arshi, T. (2026) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-031-98211-8_30
Wei, Q., & Guo, X. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2656818
Koskinen, K., Mallat, N., Tuunainen, V. K., & Lyyra, A. (2026) · Information Systems Journal · doi:10.1111/isj.70046 · Cited by 1
“Definitions of trust in AI similarly include a tendency to take meaningful risks (Glikson and Woolley 2020), acceptance of AI's vulnerability to errors (Jacovi et al. 2021), and confidence in AI (Gillath et al. 2021).”
KEY DRIVERS OF HEALTH INSURANCE ADOPTION IN EGYPT
Abouelenein, M. F. (2026) · Advances and Applications in Statistics · doi:10.17654/0972361726033
Trust in Large Language Models: An Exploratory Validation Framework
Money, W. H., & Mew, L. (2026) · Journal of Information Systems Applied Research and Analytics · doi:10.62273/npbz2264
FICS: Foreground-Informed Concept Segmentation for Robust, Object-Centric Explainability
Khalid, M. I., Komal, A., Ayyob, F., & Attique, D. (2026) · International Conference on Data Science, Machine Learning, and Intelligence (DataSciMI) · doi:10.1109/datascimi67380.2026.11523745
“However, current factorization and foundation-model explanations [7,8,12,31,13,18] remain computationally expensive and prone to background noise or diffuse object boundaries.”
陆文远, Jiazhen, Z., Xie, F., Zhong, H., Li, N., & Wang, X. (2026) · International Conference on Big Data and Informatization Education (ICBDIE) · doi:10.1145/3806980.3807123
Zaidi, S. T. Z., Khan, M. Z. A., Khan, M. U., Asif, A., Muhammad, K. B., Karim, F., & Mallick, A. (2026) · Kashf Journal of Multidisciplinary Research · doi:10.71146/kjmr944
Bag, S. B., Kumari, P., Vashishtha, A., & Madhav, M. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2173-6.ch004
Natural Language Interface to Databases: Design for Fostering Trust in a Sports Context
Henriksson, T., & Olyaee, R. (2026) · DiVA (Luleå University of Technology)
Jansen, L. J. A., & Strang, T. (2026) · International Conference on Information and Network Technologies (ICINT) · doi:10.1109/icint69379.2026.11549922
“In recent years, much of the literature on trust has shifted away from establishing precise definitions of the concept and has instead concentrated on examining human trust in emerging technologies such as Machine Learning (ML) and Artificial Intelligence (AI) systems [2]–[4].”
Ethical Sensemaking in AI Mental Health Chatbots: An Analysis of User Reviews
Rahman, M. M., & Chaudry, B. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3813050
AI Ethics in Cybersecurity: Designing for Accountability, Trust, and Human Oversight
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-25874-8_4
Bacelar, A. (2026) · International Journal of Advanced Research · doi:10.21474/ijar01/23524
Селиванова, Е. С., & Вартановна, С. В. (2026) · Актуальные проблемы экономики и права · doi:10.21202/2782-2923.2026.2.341-360 · Cited by 1
AI-Augmented Leadership and Digital Decision-Making Models
Roos, G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2541-3.ch002
Lived, affective, and cultural dimensions of ethical AI: beyond procedural AI ethics
Tettegah, S. Y. (2026) · AI & Society · doi:10.1007/s00146-026-03165-9
“The ethical standing of a system cannot therefore be fully captured through procedural indicators if the lived human experience remains unexamined (Afroogh et al. 2024; Jacovi et al. 2021; Kaplan et al. 2023).”
Tariq, S., Singh, R., Chhetri, M. B., Nepal, S., & Paris, C. (2026) · Research Square · doi:10.2139/ssrn.7002953
Stakeholder-Driven Contextual Evaluation of Language Models in Education
Karumbaiah, S., Ganesh, A., & Maravi, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-29794-5_20
Yang, M., Kagawa, R., & Baba, Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812288
“From this perspective, user-adaptive explanations, which tailor content to the user’s knowledge and preferences, have been proposed and shown to facilitate comprehension and reduce cognitive load [27, 33, 59].”
Enhancing Digital Collaboration Through Human-Centered AI and Machine Learning
Kumar, K. G., Sangamithra, T., Balamurugan, K., Periyasamy, S., Keerthana, N. V., & Vijay, V. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8217-3.ch004
Heavin, C., Phillips-Wren, G. E., & Jefferson, T. I. (2026) · Journal of Decision System · doi:10.1080/12460125.2026.2688525
Ahmed, I., Arpita, F. O., Islam, A., Alam, S. B., Zaber, M. I., & Amin, M. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30549-7_19
demian, J. (2026) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Möhle, M. H., Zall, M., Thorwart-Gumpert, T., Elbert, N., Thiesse, F., & Flath, C. M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30860-3_30 · Cited by 1
Hardy, K. (2026) · Research Square · doi:10.21203/rs.3.rs-10151972/v1
Irons, J. L., Cooper, P. S., Bölücü, N., Duenser, A., Timmer, R. C., Yang, H., Lee, C., Jin, B., & Wan, S. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820430
Guo, M., Agarwal, V., Alghafes, R. A., Papa, G., & Piccolo, L. (2026) · Journal of Knowledge Management · doi:10.1108/jkm-12-2025-1752
Too Much, Too Little, Just Right? Towards Dimensions of Trust Calibration in Human–AI Interaction
Börsting, I., & Hesenius, M. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816283
“The fairness and morality of an AI system (e.g., potential biases in training datasets) are relevant factors in building trust [15, 31].”
Goel, S., & Apuri, H. (2026) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai69016.2026.11613679 · Cited by 10
“This caution is consistent with formal analyses of trust in AI, which distinguish verified properties from warranted reliance [24].”
Wang, X., Alves, R. R., Hu, Q., & Chen, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-63139-1
A Survey on Multimodal Human-Machine Interaction in Smart Cockpits
Wang, Y., Zhang, W., Wu, B., Liu, K., Yu, H. R., Wang, G., Li, X., Liu, Q. F., & Zhang, R. X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30228-1_19
Evaluating the Impact of Explainable AI on Trust in AI-Assisted Code Review
Gao, Z., Barón, M. M., Habiba, U.-E., Graziotin, D., & Wagner, S. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832184
“In general, we aim to achieve an interaction with calibrated trust [4, 18], in which a user neither mistrusts a system without good reason (undertrust) nor places too much trust in a system (overtrust).”
Advancing sustainable construction: A trust-enhanced model of AI adoption and realised use
Regona, M., Yiğitcanlar, T., Hon, C. K. H., & Teo, M. (2026) · Sustainable Cities and Society · doi:10.1016/j.scs.2026.107755 · Cited by 1
Kandala, K. C. (2026) · International Journal of Artificial Intelligence and Machine Learning · doi:10.51483/ijaiml.6.5s.2026.426-434
Vertrauen als Erfolgsfaktor für die Einführung von Technologien und Innovationen im Gesundheitswesen
Gille, F., & Starke, G. (2026) · Edition HMD · doi:10.1007/978-3-658-51795-3_29
Hou, M., Porter‐Steele, J., Balaam, S., Chiu, V., McCarthy, A. L., Dobbins, C., & Viller, S. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2706669
From Issues to Insights: RAG-based Explanation Generation from Software Engineering Artifacts
Pöttgen, D., Sadeghi, M., Unterbusch, M., & Vogelsang, A. (2026) · IEEE/ACM International Workshop on Natural Language-Based Software Engineering (NLBSE) · doi:10.1145/3786164.3788448
“Studies have shown that explanations can increase trust, confidence, and overall system usability [13, 19, 38].”
Wang, C., Kroon, A. C., Möller, J. E., de Vreese, C. H., & Boerman, S. C. (2026) · New Media & Society · doi:10.1177/14614448261467983
Chaudhari, R. S., Goodrum, P. M., Jones, M., Bhandari, S., Brady, N., Hallowell, M. R., & YEH, T. P. (2026) · Frontiers in Built Environment · doi:10.3389/fbuil.2026.1884560
Xu, T., 陈, 融., & Song, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7237142
Hankins, T. C. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-27585-1_13
Trust-by-Design of an Avatar Chatbot: Advising University Students on Their Majors
Sung, B. J., Lee, G.-S., Kim, J., & Park, D.-K. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.7.1923
Same trust, different paths: how older adults reach similar AI trust through use and non-use
Wang, Y., Hong, A., & Zhang, Y. (2026) · Interacting with Computers · doi:10.1093/iwc/iwag040
Gonzalez, V., Amo, L., & Smith, S. D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7288164
The invisible risk trust framework: a decentralized consensus protocol for validating medical AI
Shih, P. F. (2026) · Frontiers in Blockchain · doi:10.3389/fbloc.2026.1809318
Trust in artificial intelligence to extract geospatial features for topographic databases
Koski, C., Kettunen, P., Tenkanen, H., & Oksanen, J. (2026) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2026.2716279 · Cited by 1
Imperial, R. M. A., & Artiola, A. S. (2026) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.610409
Park, S., Song, Y., & Cho, S. (2026) · IEEE Access · doi:10.1109/access.2026.3724790
“As AI systems have become more autonomous and complex, this discussion has expanded to human–AI trust, where users must evaluate systems that operate with limited transparency and probabilistic behavior [25], [26], [27], [28], [29].”
Mitigation of the coordination crisis in wildfire management using a multi-agent AI system
Debnath, R., Shafran, A. P., & Waichman, I. (2026) · Communications Earth & Environment · doi:10.1038/s43247-026-03962-6
“Onthe fl ip sideofinterpretability, trust in AI depends on two factors: transparency about how the system works, and evidence that it performs well 53 .”
How Does University Students' Perception of GenAI Affect Their Learning Engagement?
Pu, B., Zhuang, P., & Zhuang, K.-J. (2026) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste69562.2026.11649657
Lee, C. (2026) · Research Square · doi:10.21203/rs.3.rs-10314772/v1
Toward More Effective Automated Writing Evaluation Through Relational Trust
Goldshtein, M., Chiou, E. K., & Roscoe, R. D. (2026) · Technology Knowledge and Learning · doi:10.1007/s10758-026-09999-y
Jurmu, M., Naumanen, M., Westerstrand, S., Lämsä, A., Myllymaa, K., & Ailisto, H. J. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2721301
Measuring the User Experience of Human-Centered Machine Learning: Trust, Intelligibility, and More
Stumpf, S., & Smith-Renner, A. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.007
Doing Human-Centered Machine Learning
Fiebrink, R., Gillies, M. F. P., & Ramos, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.006
Operationalizing Trust in AI Outputs: A Multi-signal, Task-Aware, Trust Scoring Framework
Rajaram, K., Manohar, K., Hosein, P., & Addison, L. M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-35078-7_17
Signs of Intelligence: Trust in Generative Artificial Intelligence for Conservation Messaging
Snow, J. C., Zajchowski, C. A. B., Karl, J. W., & Baumgartner, B. (2026) · Parks Stewardship Forum · doi:10.5070/p5.69182
Trust and interaction design in AI-enabled systems: a systematic literature review
Abramson, S. L., Sora-Cardenas, J., Nandakumar, P., Bruce, J. E., Gopinath, N., Zangari, L. G., & Feijóo-García, P. G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1932655 · Cited by 1
Koski, C. (2026) · Helda - University of Helsinki Institutional Repository
Balakrishnan, M. S., Khan, Z. R., Mayumu, N., Krásničan, V., Rosenthal, L., Willis, M., & Reed, R. H. (2026) · doi:10.2196/preprints.111731
Hossain, M. J., Jahan, U. N., & Shammo, S. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.19151
“While other automated processes followed a defined algorithm, generative AI systems generate output flexibly and creatively, making it impossible to check the results or recognize mistakes [5, 6].”
Schaffernak, I., Cecil, J., Mahmuti, A., Angerer, S., Blaschta, T., & Lermer, E. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000185
“Comparative cross-specialty research is needed to identify which requirements are specific to ophthal-mology and which are broadly applicable.”
Metadata
- Authors
- Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y.
- Affiliations
- Bar-Ilan University (IL)
- University of Washington (US)
- The University of Melbourne (AU)
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 624-635
- OpenAlex
- W3134111219
- Cited by
- 545
- References
- 74
- Citations by year
- 2026: 131 · 2025: 137 · 2024: 102 · 2023: 90 · 2022: 60 · 2021: 24
- FWCI
- 31.88
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- European Research Council (802774)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- trust in AI, interpersonal trust, contractual trust, trustworthiness, user vulnerability, explainable AI, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.