The relationship between trust in AI and trustworthy machine learning technologies
Open accessThe DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Abstract
To design and develop AI-based systems that users and the larger public can justifiably trust, one needs to understand how machine learning technologies impact trust. To guide the design and implementation of trusted AI-based systems, this paper provides a systematic approach to relate considerations about trust from the social sciences to trustworthiness technologies proposed for AI-based services and products. We start from the ABI+ (Ability, Benevolence, Integrity, Predictability) framework augmented with a recently proposed mapping of ABI+ on qualities of technologies that support trust. We consider four categories of trustworthiness technologies for machine learning, namely these for Fairness, Explainability, Auditability and Safety (FEAS) and discuss if and how these support the required qualities. Moreover, trust can be impacted throughout the life cycle of AI-based systems, and we therefore introduce the concept of Chain of Trust to discuss trustworthiness technologies in all stages of the life cycle. In so doing we establish the ways in which machine learning technologies support trusted AI-based systems. Finally, FEAS has obvious relations with known frameworks and therefore we relate FEAS to a variety of international 'principled AI' policy and technology frameworks that have emerged in recent years.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Current academic and public discourses are predominantly structured around the guiding principles towards trustworthy AI [62, 64]”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [62]
In the citing paper
“These earlier models have later been adapted to the context of human-technology, human-automation, and human-AI relations (Toreini et al., 2020;Siau & Wang, 2018;Hoff & Bashir, 2015;Schaefer et al., 2016;Riegelsberger et al., 2005;Kaplan et al., 2023;R. Yang & Wibowo, 2022).”
From Trust, distrust, and appropriate reliance in (X)AI: A conceptual clarification of user trust and survey of its empirical evaluation (2025) · cites this paper as Toreini et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 1×
“, [75, 80] and the unified framework for local explainers which generalises these and other existing methods [64]), global explainers (e.”
BackgroundLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“Supervised Learning algorithms are mainly used in object recognition [54], machine translation [83], filtering spams [32], etc.”
Method"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Jain, A. K., Murty, M. N., & Flynn, P. J. (1999) · ACM Computing Surveys · doi:10.1145/331499.331504 · Cited by 13,199 · cited 1×
“that takes xas input and detects a hidden pattern representation as output, y. The problems that unsupervised learning tackles include grouped a dataset based on a similarity metric (a.k.a clustering [48]), projecting data to a reduced dimension space (e.g. PCA methods [53]) and pre{training algorithms for the other t…”
MethodGauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 5×
“While each of the attributes are related and may reinforce one another they are also separable [67].”
BackgroundMethodInfluentialIntriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · cited 1×
“These meth-ods deal only with data, but it is also relevant to consider integrity during the execution of the algorithm, e.g., in the training stage [26, 13, 11, 61, 85].”
BackgroundDeep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · cited 1×
“Careless preparation of the stored data would leak information to an attacker [61] but confidentiality can be enhanced in many ways, for instance through approaches for differential privacy [1, 34], homomorphic encryption [47] or cryptography integrated in machine learning algorithms [79].”
Background
Research works printed but not linked: 11
- [6] Susan Athey and Guido W Imbens. Machine learning methods for estimating heterogeneous causal effects. stat , 1050(5):1-26, 2015. -
- [9] Robert Bartlett, Adair Morse, Richard Stanton, and Nancy Wallace. Consumer-Lending Discrimination in the Era of FinTech. Unpublished working paper. University of California, Berkeley , 2018. -
- [34] Cynthia Dwork. Differential privacy. Encyclopedia of Cryptography and Security , pages 338-340, 2011. -
- [36] Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-Antoine Manzagol, Pascal Vincent, and Samy Bengio. Why does unsupervised pretraining help deep learning? Journal of Machine Learning Research , 11(Feb):625-660, 2010. -
- [38] Jessica Fjeld, Hannah Hilligoss, Nele Achten, Maia Levy Daniel, Sally Kagay, and Joshua Feldman. Principled Artificial Intelligence: Mapping Consensus and Divergence in Ethical and Rights-Based Approaches. 2019. -
- [41] Carlos Adriano Gon¸ calves, Celia Talma Gon¸ calves, Rui Camacho, and Eugenio C Oliveira. The impact of Pre-Processing on the Classification of MEDLINE Documents. Pattern Recognition in Information Systems, Proceedings of the 10th International Workshop on Pattern Recognition in Information Systems, PRIS 2010, In conjunction with ICEIS 2010 , page 10, 2010. -
- [54] Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems , pages 1097-1105, 2012. -
- [60] Zachary C Lipton. The mythos of model interpretability. arXiv preprint arXiv:1606.03490 , 2016. - · arXiv
- [68] Donald Michie, David J Spiegelhalter, C C Taylor, and others. Machine learning. Neural and Statistical Classification , 13, 1994. -
- [70] Arvind Narayanan. Translation tutorial: 21 fairness definitions and their politics. In Proc. Conf. Fairness Accountability Transp., New York, USA , 2018. -
- [92] Brian Wynne. A reflexive view of the expert-lay knowledge divide. Risk, environment and modernity: Towards a new ecology , 40:44, 1996. -
Cited by
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445923 · Cited by 545
“on between any user and the AI [8, 11, 71, 76]. The recent rapid growth in the field ofexplainable AI (XAI) is also, in part, motivated by the need to maintain trust between the human user and the AI [31, 35, 46, 52, 59, 72]. By designing AI that users can and will trust to interact with, the AI can be safely implemen…”
BackgroundNazar, M., Alam, M. M., Yafi, E., & Su'ud, M. M. (2021) · IEEE Access · doi:10.1109/access.2021.3127881 · Cited by 312
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.07213 · Cited by 306
Four principles of explainable artificial intelligence
Phillips, P. J., Hahn, C. A., Fontana, P. C., Yates, A. N., Greene, K., Broniatowski, D. A., & Przybocki, M. A. (2021) · doi:10.6028/nist.ir.8312 · Cited by 262
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
AI-augmented Business Process Management Systems: A Research Manifesto
Dumas, M., Fournier, F., Limonad, L., Marrella, A., Montali, M., Rehse, J.-R., Accorsi, R., Calvanese, D., Giacomo, G. D., Fahland, D., et al. (2023) · ACM Transactions on Management Information Systems · doi:10.1145/3576047 · Cited by 277
“[89] identify four aspects of trustworthiness: Fairness, Explainability, Auditability, and Safety (FEAS).”
Elliott, K., Price, R., Shaw, P., Spiliotopoulos, T., Ng, M., Coopamootoo, K., & van Moorsel, A. (2021) · Society · doi:10.1007/s12115-021-00594-8 · Cited by 184
Self-citationThe State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
Chatzimparmpas, A., Martins, R. M., Jusufi, I., Kucher, K., Rossi, F., & Kerren, A. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14034 · Cited by 182
“Trust in machine learning (ML) models is one of the greatest challenges in real-life applications of ML [TAC ∗ 20].”
BackgroundA Survey on Trustworthy Recommender Systems
Ge, Y., Liu, S., Fu, Z., Tan, J., Li, Z., Xu, S., Li, Y., Xian, Y., & Zhang, Y. (2024) · ACM Transactions on Recommender Systems · doi:10.1145/3652891 · Cited by 233
Sindermann, C., Yang, H., Elhai, J. D., Yang, S., Quan, L., Li, M., & Montag, C. (2022) · Discover Psychology · doi:10.1007/s44202-022-00020-y · Cited by 175
“…and system performance factors [40]; for another model about factors of trustworthy AI (or machine learning, specifically), please see, for example, Toreini et al. [63] or the review by Glikson and Woolley [64], which additionally takes into account different kinds of AI (robotic, embedded, etc.).”
BackgroundDesigning for Responsible Trust in AI Systems: A Communication Perspective
Liao, Q. V., & Sundar, S. S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533182 · Cited by 165
“Despite outlining the complexity of trust [55, 62], these works are detached from the cognitive mechanism of how people make trust judgments.”
BackgroundInfluentialTariq, A., Serhani, M. A., Sallabi, F., Barka, E. S., Qayyum, T., Khater, H. M., & Shuaib, K. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3438264 · Cited by 155
Four Principles of Explainable Artificial Intelligence
Phillips, P. J., Hahn, C. A., Fontana, P. C., Broniatowski, D. A., & Przybocki, M. A. (2020) · doi:10.6028/nist.ir.8312-draft · Cited by 136
“Explainable AI is one of several properties that characterize trust in AI systems [121, 127, 134].”
BackgroundA survey on artificial intelligence assurance
Batarseh, F. A., Freeman, L., & Huang, C. (2021) · Journal Of Big Data · doi:10.1186/s40537-021-00445-7 · Cited by 156
Perspectives on Digital Humanism
Werthner, H., Prem, E., Lee, E. A., & Ghezzi, C. (2021) · Springer eBooks · doi:10.1007/978-3-030-86144-5 · Cited by 146
Explainable Artificial Intelligence (XAI) in Insurance
Owens, E., Sheehan, B., Mullins, M., Cunneen, M., Ressel, J., & Castignani, G. (2022) · Risks · doi:10.3390/risks10120230 · Cited by 182
“Toreini et al. (2020) propose a Chain of Trust framework to further enhance users’ trust in AI and ML technologies, while research on explanations in AI’s use in medical diagnostic settings proves advantageous for clinician’s trust and understanding in these technologies (Diprose et al. 2020;…”
BackgroundTrust in and Acceptance of Artificial Intelligence Applications in Medicine: Mixed Methods Study
Shevtsova, D., Ahmed, A., Boot, I. W. A., Sanges, C., Hudecek, M., Jacobs, J. J. L., Hort, S., & Vrijhoef, H. J. M. (2024) · JMIR Human Factors · doi:10.2196/47031 · Cited by 124
How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)
Schlicker, N., Baum, K., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108671 · Cited by 76
Trust in AI chatbots: A systematic review
Ng, S. W. T., & Zhang, R. (2025) · Telematics and Informatics · doi:10.1016/j.tele.2025.102240 · Cited by 143
Knop, M., Weber, S., Mueller, M., & Niehaves, B. (2022) · JMIR Human Factors · doi:10.2196/28639 · Cited by 103
“Specific factors regarding AI-enabled technology and human actors such as dermatologists, radiologists, and other medical professionals are emphasized to influence the relationship among them, including the explainability or understandability of the system [38], its purpose [39], and the resulting trust a human actor…”
BackgroundAitken, J. M., Evans, M. H., Worley, R., Edwards, S., Zhang, R., Dodd, T. J., Mihaylova, L. S., & Anderson, S. (2021) · IEEE Access · doi:10.1109/access.2021.3115981 · Cited by 116
Benk, M., Kerstan, S., von Wangenheim, F., & Ferrario, A. (2024) · AI & Society · doi:10.1007/s00146-024-02059-y · Cited by 124
“It is now a relevant research topic in human–machine interactions (Lee and See 2004; Mcknight et al. 2011), prominently in the case of AI systems (Jacovi et al. 2021; Chiou and Lee 2021; Toreini et al. 2020).”
A Review on Human–Machine Trust Evaluation: Human-Centric and Machine-Centric Perspectives
Gebru, B., Zeleke, L., Blankson, D., Nabil, M., Nateghi, S., Homaifar, A., & Tunstel, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3144956 · Cited by 101
“People’s perceptions of trustworthiness can be affected by the environment, inclination toward technology, complexity of system (uncorroborated with explanations) and different interactions [70].”
BackgroundThe art and practice of data science pipelines
Biswas, S., Wardat, M., & Rajan, H. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510057 · Cited by 128
Addressing Algorithmic Bias in AI-Driven Customer Management
Akter, S., Dwivedi, Y. K., Biswas, K., Michael, K., Bandara, R. J., & Sajib, S. (2021) · Journal of Global Information Management · doi:10.4018/jgim.20211101.oa3 · Cited by 112
“Toreini et al. (2019) Understand ways to balance between achieving organizational benefits of using AI and addressing dark sides of AI for gaining sustainable benefits.”
BackgroundRechkemmer, A., & Yin, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501967 · Cited by 97
Ng, M., Coopamootoo, K. P. L., Toreini, E., Aitken, M., Elliot, K., & van Moorsel, A. (2020) · 2020 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW) · doi:10.1109/eurospw51379.2020.00034 · Cited by 68
“Trust is an important consideration for Artificial Intelligence based systems [74], such as chatbots, and in particular, in the context of finance [75].”
BackgroundSelf-citationEnhancing portfolio management using artificial intelligence: literature review
Šutienė, K., Schwendner, P., Șipoș, C., Lorenzo, L., Mirchev, M., Lameski, P., Kabašinskas, A., Tidjani, C., Öztürkkal, B., & Černevičienė, J. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1371502 · Cited by 115
Li, Y., & Goel, S. (2025) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100739 · Cited by 122
Shaping a multidisciplinary understanding of team trust in human-AI teams: a theoretical framework
Ulfert, A., Georganta, E., Jorge, C. C., Mehrotra, S., & Tielman, M. L. (2023) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2023.2200172 · Cited by 123
“Yet, the conceptualization of trustworthiness as described by Mayer’s ABI Model (Mayer et al., 1995) has been equally utilized in both disciplines for humans and AI agents (see, e.g., Calhoun et al., 2019; Solberg et al., 2022; Toreini et al., 2020; Ulfert & Georganta, 2020).”
Method”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90
“We emphasize the need to calibrate authority towards an appropriate level aligned with the actual trustworthiness of AI [51, 124], instead of a trust built through the proxy, confounding sources that we document in our findings.”
ResultA Review on Machine Unlearning
Zhang, H., Nakamura, T., Isohara, T., & Sakurai, K. (2023) · SN Computer Science · doi:10.1007/s42979-023-01767-4 · Cited by 141
“Toreini et al. [12] provide a systematic approach to relate considerations about trust from the social sciences to trust-worthiness technologies proposed for AI-based services and products.”
BackgroundThe Sanction of Authority: Promoting Public Trust in AI
Knowles, B., & Richards, J. T. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445890 · Cited by 86
Interpretable Machine Learning for Discovery: Statistical Challenges and Opportunities
Allen, G. I., Gan, L., & Zheng, L. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-040120-030919 · Cited by 115
Making It Possible for the Auditing of AI: A Systematic Review of AI Audits and AI Auditability
Li, Y., & Goel, S. (2024) · Information Systems Frontiers · doi:10.1007/s10796-024-10508-8 · Cited by 105
“One reason that has contributed to the complexity of models is believed to be the lack of explain-ability (Cobbe et al., 2021; European Group on Ethics in Science & New Technologies, 2018; Knowles & Richards, 2021; Toreini et al., 2020).”
How Do We Assess the Trustworthiness of AI? Introducing the Trustworthiness Assessment Model (TrAM)
Schlicker, N., Baum, K., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2022) · doi:10.31234/osf.io/qhwvx · Cited by 79
Bureaucrat or artificial intelligence: people’s preferences and perceptions of government service
Gaozhao, D., Wright, J. E., & Gainey, M. K. (2023) · Public Management Review · doi:10.1080/14719037.2022.2160488 · Cited by 85
“This principle requires AI agents to uphold fundamental human rights and promote the welfare of people and the environment (Barth and Arnold 1999; Toreini et al. 2020).”
BackgroundInfluentialAlzubaidi, L., Al-Dulaimi, K., Salhi, A., Alammar, Z., Fadhel, M. A., Albahri, A. S., Alamoodi, A. H., Albahri, O. S., Hasan, A. F., Bai, J., et al. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102935 · Cited by 84
Huynh, M.-T., & Aichner, T. (2025) · AI & Society · doi:10.1007/s00146-025-02378-8 · Cited by 91
The Intriguing Relation Between Counterfactual Explanations and Adversarial Examples
Freiesleben, T. (2021) · Minds and Machines · doi:10.1007/s11023-021-09580-9 · Cited by 118
“The trust we have in AI systems is and will be closely linked to the extent to which adversarial attacks are possible (Toreini et al., 2020).”
BackgroundFairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations
Dai, J. C., Upadhyay, S., Aïvodji, U., Bach, S. H., & Lakkaraju, H. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534159 · Cited by 129
Toward Trustworthy Metaverse: Advancements and Challenges
Jim, J. R., Hosain, M. T., Mridha, M. F., Kabir, M. M., & Shin, J. (2023) · IEEE Access · doi:10.1109/access.2023.3326258 · Cited by 87
“With this rapid growth and interest in Metaverse, it is also essential to build and maintain the trustworthiness of Metaverse and its application to ensure the user’s acceptance and trust [6].”
BackgroundExploring the Intersection of Machine Learning and Big Data: A Survey
Dritsas, E., & Τρίγκα, Μ. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7010013 · Cited by 96
“[219–229] Addresses the difficulty in interpreting complex ML models, especially in high-stakes applications where transparency is crucial.”
Aitken, M., Toreini, E., Carmichael, P., Coopamootoo, K., Elliott, K., & van Moorsel, A. (2020) · Big Data & Society · doi:10.1177/2053951720908892 · Cited by 82
“While developing trustworthy data practices remains an emerging field of interest, increasingly technical approaches are being developed with this aim (Toreini et al., 2019).”
BackgroundSelf-citationCan Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIPreprint
Alikhademi, K., Richardson, B., Drobina, E., & Gilbert, J. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07483 · Cited by 79
“Mitigating the bias and unfairness within the training data is a necessity, both out of ethical duty and because of the impact that perceived inaccuracies have on user trust [30, 34].”
Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
Scharowski, N., Benk, M., Kühne, S. J., Wettstein, L., & Brühlmann, F. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593994 · Cited by 75
“Motivated by these challenges, this work builds on research highlighting the pivotal role of auditability as an enabler of trust in AI [7, 65] and its crucial role in creating an "AI trustworthiness ecosystem" [2] by ensuring that the principles of trustworthy AI are met.”
BackgroundResultInfluentialSandeep, S., Ahamad, S., Saxena, D., Srivastava, K., Jaiswal, S., & Bora, A. (2021) · Materials Today Proceedings · doi:10.1016/j.matpr.2021.11.409 · Cited by 62
Agbabiaka, O., Ojo, A., & Connolly, N. (2025) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2025.124076 · Cited by 70
Explanation-Based Human Debugging of NLP Models: A Survey
Lertvittayakumjorn, P., & Toni, F. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00440 · Cited by 92
What kind of trust does AI deserve, if any?
Alvarado, R. (2023) · AI and Ethics · doi:10.1007/s43681-022-00224-x · Cited by 60
“…suggested that rather than using simplistic sentences such as “A trusts B”, when talking about human trust in AI, we should use more complex and parametrized assertions such as “A trusts B to do X (or not do Y), when Z pertains…” (Dietz and Den Hartog [19] as cited by Toreini et al. [86], p. 274).”
BackgroundMethodInfluentialPinto, A., Sousa, S., Simões, A. C., & Santos, J. (2022) · Human Behavior and Emerging Technologies · doi:10.1155/2022/6437441 · Cited by 64
“[64] consider that benevolence or integrity assessments can only be carried out indirectly by the entity that develops or applies the AITable 2: Intercorrelations between the four factors from 1st-order CFA.”
BackgroundVisser, R., Peters, T. M., Scharlau, I., & Hammer, B. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101357 · Cited by 58
El–Sappagh, S., Alonso, J. M., Abuhmed, T., Ali, F., & Bugarín, A. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10415-5 · Cited by 70
Harnessing human and machine intelligence for planetary-level climate action
Debnath, R., Creutzig, F., Sovacool, B. K., & Shuckburgh, E. F. (2023) · npj Climate Action · doi:10.1038/s44168-023-00056-3 · Cited by 76
“FAccT scholars have proposed various solutions to establish a subset of fairness notions 41,42,47 .”
BackgroundHaywood-Alexander, M., Liu, W., Bacsa, K., Lai, Z., & Chatzi, E. (2024) · Data-Centric Engineering · doi:10.1017/dce.2024.33 · Cited by 70
How Validation Methodology Influences Human Activity Recognition Mobile Systems
Bragança, H. L. D. S., Colonna, J. G., Oliveira, H. A. B. F., & Souto, E. (2022) · Sensors · doi:10.3390/s22062360 · Cited by 65
Kharchenko, V. S., Fesenko, H. V., & Illiashenko, O. A. (2022) · Sensors · doi:10.3390/s22134865 · Cited by 58
“For example, for [2], Expression (1) is as follows: TST = {HMA, HMO, RBS, SFT, PRV, DGV, TRP {TRC, EXP}, DVS, NDS, FRN, SWB, ACN {ADT, RDR}} where HMA, HMO, RBS, SFT, PRV, DGV, TRP, DVS, NDS, FRN, SWB, ACN—sub-characteristics of TST; TRC, EXP—sub-characteristics of TRP; ADT, RDR—sub-characteristics of ACN.”
InfluentialA Systematic Literature Review of Human-Centered, Ethical, and Responsible AI
Tahaei, M., Constantinides, M., Quercia, D., & Muller, M. J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.05284 · Cited by 72
“AI security aims to ensure safety and reduce harm to individuals [229, 246].”
A data-centric approach for ethical and trustworthy AI in journalism
Dierickx, L., Opdahl, A. L., Khan, S. A., Lindén, C., & Rojas, D. C. G. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09801-6 · Cited by 58
“Trust in AI and machine learning for journalism ensures that these technologies are designed and implemented in a way that promotes user and public acceptance (Toreini et al., 2020).”
Integrity-based Explanations for Fostering Appropriate Trust in AI Agents
Mehrotra, S., Jorge, C. C., Jonker, C. M., & Tielman, M. L. (2024) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3610578 · Cited by 51
“In both the studies mentioned above and in [90, 102], integrity in human-AI interaction is strongly related to honesty and being transparent about the process of decision making.”
BackgroundThe Robustness of Counterfactual Explanations Over Time
Ferrario, A., & Loi, M. (2022) · IEEE Access · doi:10.1109/access.2022.3196917 · Cited by 64
Kassar, M., & Jizi, M. I. (2025) · Journal of Applied Accounting Research · doi:10.1108/jaar-05-2024-0175 · Cited by 58
Martínez-Agüero, S., Soguero-Ruiz, C., Alonso-Moral, J. M., Mora-Jiménez, I., Álvarez-Rodríguez, J., & Marques, A. G. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.02.021 · Cited by 48
“…feature engineering, inter-pretable modeling, validation, etc.) ready to be understood by humans while respecting the “chain of trust” [23]. u XAI is an endeavor to develop human-centric AI sensitive not only to technical but also legal and ethical issues. r The so-called Responsible…”
BackgroundFarayola, M. M., Tal, I., Connolly, R., Saber, T., & Bendechache, M. (2023) · Information · doi:10.3390/info14080426 · Cited by 63
How Good Is ChatGPT in Giving Advice on Your Visualization Design?
Kim, N. W., Ahn, Y., Myers, G., & Bach, B. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3745768 · Cited by 55
“Our participants often found themselves in this latter scenario, where they did not know what kind of follow-up questions to ask.”
Agarwal, A., & Agarwal, H. (2023) · AI and Ethics · doi:10.1007/s43681-023-00266-9 · Cited by 49
An ensemble face recognition mechanism based on three-way decisions
Shah, A., Ali, B., Habib, M., Frnda, J., Ullah, I., & Anwar, M. S. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.03.016 · Cited by 49
“A trustworthy model offers users security, allowing them to utilize the system without fear (Toreini et al., 2020).”
Human trust in otherware – a systematic literature review bringing all antecedents together
Saßmannshausen, T. M., Burggräf, P., Hassenzahl, M., & Wagner, J. (2022) · Ergonomics · doi:10.1080/00140139.2022.2120634 · Cited by 47
“Yet, trust remains challenging to define and to study (Toreini et al. 2019).”
BackgroundIntegration of Artificial Intelligence Technology in Distance Learning in Higher Education
Mahmudi, A. A., Fionasari, R., Mardikawati, B., & Judijanto, L. (2023) · Journal of Social Science Utilizing Technology · doi:10.55849/jssut.v1i4.661 · Cited by 61
Ethical Considerations in AI Development
Singh, B. P., & Joshi, A. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-2964-1.ch010 · Cited by 47
Federated Generalized Bayesian Learning via Distributed Stein Variational Gradient Descent
Kassab, R., & Simeone, O. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3168490 · Cited by 59
Learning to run a power network with trust
Marot, A., Donnot, B., Chaouache, K., Kelly, A., Huang, Q., Hossain, R. R., & Cremer, J. L. (2022) · Electric Power Systems Research · doi:10.1016/j.epsr.2022.108487 · Cited by 55
Trust or mistrust in algorithmic grading? An embedded agency perspective
Jackson, S., & Panteli, N. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102555 · Cited by 51
LiteVR: Interpretable and Lightweight Cybersickness Detection using Explainable AI
Kundu, R. K., Islam, R., Quarles, J. P., & Hoque, K. A. (2023) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr55154.2023.00076 · Cited by 50
“In our context, the term trustworthy refers to using XAI for cybersickness explanation through a set of mechanisms, such as global and local explanations and explainable layers, to make the model transparent, understandable, and therefore, trusted by users [73].”
MethodTo Trust or Distrust Trust Measures: Validating Questionnaires for Trust in AIPreprint
Scharowski, N., Perrig, S. A. C., Aeschbach, L. F., von Felten, N., Opwis, K., Wintersberger, P., & Brühlmann, F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.00582 · Cited by 45
“More recent research has focused on trustworthiness factors specific to AI systems (Kaplan et al., 2023; Liao & Sundar, 2022; Thornton et al., 2021; Toreini et al., 2020).”
BackgroundMethodRiedel, A. S., Mulcahy, R. F., & Northey, G. (2022) · International Journal of Bank Marketing · doi:10.1108/ijbm-09-2021-0438 · Cited by 46
How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study
Gu, K., Grunde-McLaughlin, M., McNutt, A., Heer, J., & Althoff, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641891 · Cited by 40
“In general, designing AI-based user-facing systems is challenging since designs must face issues that include explainability [65, 75], trust [69, 76, 112], user control [50, 107], and user expectations [68, 82].”
Behl, A., Sampat, B. H., Pereira, V. E., & Jabbour, C. J. C. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05624-8 · Cited by 50
“When using AI, fairness refers to the technology’s ability to prevent bias-based discrimination, enabling the algorithms to be held accountable in regard to the decisions they make (Toreini et al., 2020).”
Gatzioufa, P., Saprikis, V., & Avlogiaris, G. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/8859989 · Cited by 45
“Trust is a key factor a ff ecting the intention to use AI technologies, such as chatbots [126].”
BackgroundPublic Perception on Artificial Intelligence–Driven Mental Health Interventions: Survey Research
Varghese, M. A., Sharma, P., & Patwardhan, M. (2024) · JMIR Formative Research · doi:10.2196/64380 · Cited by 43
“However, cultural variables must be considered when comparing acceptance studies conducted with different demographic groups [42,47-49].”
Ghasemaghaei, M., & Kordzadeh, N. (2024) · Information Systems Journal · doi:10.1111/isj.12572 · Cited by 46
“Additionally, recent literature emphasises the importance of managers' trust in the source of recommendations (in this case, trust in DA competency) for the successful adoption and acceptance of the provided recommendations (Toreini et al. 2020).”
Balayn, A., Yurrita, M., Rancourt, F., Casati, F., & Gadiraju, U. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713787 · Cited by 50
“Furthermore, to the best of our knowledge, Toreini et al. [125] are among the only ones that present AI as a pipeline with various stages involving various activities and technical components, and that discuss trust along these different dimensions.”
Human-AI governance (HAIG): A trust-utility approach
Engin, Z. (2026) · Journal of Responsible Technology · doi:10.1016/j.jrt.2026.100167 · Cited by 46
“These frameworks, including work by Winfield and Jirotka (2018) and Toreini et al. (2020), address the social and psychological dimensions of how humans develop appropriate confidence in AI systems, though they sometimes lack the regulatory specificity of risk-based approaches.”
Humans, AI, and Context: Understanding End-Users’ Trust in a Real-World Computer Vision Application
Kim, S. S. Y., Watkins, E. A., Russakovsky, O., Fong, R., & Monroy-Hernández, A. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3593978 · Cited by 37
“However, papers on trust recently published at FAccT remain largely theory-focused [10, 15, 24, 29, 45, 46].”
BackgroundShen, M. W. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.05302 · Cited by 43
Zhu, Y., Wang, T., Wang, C., Quan, W., & Tang, M. (2023) · Applied Sciences · doi:10.3390/app132412989 · Cited by 47
Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Kemmerzell, N., Schreiner, A., Khalid, H., Schalk, M., & Bordoli, L. (2025) · ACM Computing Surveys · doi:10.1145/3721976 · Cited by 45
“…trust, which represents the users’ perception that the AI system acts in their best interest and takes their values and preferences into account; and integrity trust, which measures the users’ confidence in the AI system’s adherence to ethical principles, confidentiality, and privacy [23, 240].”
Fairness in Agreement With European Values: An Interdisciplinary Perspective on AI Regulation
Colmenarejo, A. B., Nannini, L., Rieger, A., Scott, K. M., Zhao, X., Patro, G. K., Kasneci, G., & Kinder-Kurlanda, K. E. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534158 · Cited by 42
“However, this approach has received a lot of critique within the AI domain, and a range of issues have been pointed out; for example concerning causality [17, 34], fairness [29, 66], explainability [13], including the comparability and robustness of explanations [88, 89], and trustworthiness [107].”
BackgroundFirst impressions of a financial AI assistant: differences between high trust and low trust users
Schreibelmayr, S., Moradbakhti, L., & Mara, M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1241290 · Cited by 40
The Importance of Distrust in AI
Peters, T. M., & Visser, R. W. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44070-0_15 · Cited by 44
Enhancing user experience and trust in advanced LLM-based conversational agents
Xu, Y., Gao, W., Wang, Y., Shan, X., & Lin, Y. (2024) · Computing and artificial intelligence. · doi:10.59400/cai.v2i2.1467 · Cited by 38
“Understanding data processing and clear explanations for decisions are crucial, especially in sensitive areas like healthcare and finance [37 – 39].”
BackgroundTrust, artificial intelligence and software practitioners: an interdisciplinary agenda
Pink, S., Quilty, E., Grundy, J., & Hoda, R. (2024) · AI & Society · doi:10.1007/s00146-024-01882-7 · Cited by 39
The Value of Measuring Trust in AI - A Socio-Technical System PerspectivePreprint
Benk, M., Tolmeijer, S., von Wangenheim, F., & Ferrario, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.13480 · Cited by 34
“Nevertheless, different accounts of trust in AI are currently under investigation in the XAI and HCI domains, fueling the design of many empirical studies (e.g., [27, 29, 32, 36, 80]).”
BackgroundA Survey on Trusted Distributed Artificial Intelligence
Ağca, M. A., Faye, S., & Khadraoui, D. (2022) · IEEE Access · doi:10.1109/access.2022.3176385 · Cited by 33
“Trust features and indicators can be guaranteed for machine-learning systems [18] and distributed AI techniques [8].”
BackgroundHow Learners’ Trust Changes in Generative AI over a Semester of Undergraduate Courses
Song, D. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00446-6 · Cited by 32
“The present focus on this domain underscores the acknowledgment that preserving trust in AI could be pivotal in guaranteeing the acceptance and effective integration of AI-driven services and products (Toreini et al., 2020).”
Should Users Trust Advanced AI Assistants? Justified Trust As a Function of Competence and Alignment
Manzini, A., Keeling, G., Marchal, N., McKee, K. R., Rieser, V., & Gabriel, I. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658964 · Cited by 28
“…of trust in technology adopt a ‘dualistic perspective on trust’ [133] which includes both trust in the technology itself (including its functionality and capabilities) and trust in the individuals and organisations developing the technology (encompassing their competence and integrity) [135].”
BackgroundAI Loyalty: A New Paradigm for Aligning Stakeholder Interests
Aguirre, A. N., Dempsey, G., Surden, H., & Reiner, P. B. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.3013490 · Cited by 39
TruVR: Trustworthy Cybersickness Detection using Explainable Machine Learning
Kundu, R. K., Islam, R., Calyam, P. P., & Hoque, K. A. (2022) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar55827.2022.00096 · Cited by 33
“The trustworthiness in our proposed method is obtained via using a set of mechanisms, such as global and local explanation, and ex-plainable layers to make the model transparent, understandable, and therefore, trusted by users [34,69].”
Method
Metadata
- Authors
- Toreini, E., Aitken, M., Coopamootoo, K., Elliott, K., Zelaya, C. G., & van Moorsel, A.
- Affiliations
- Newcastle University (GB)
- Newcastle University, United Kingdom
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 272-283
- OpenAlex
- W2990399168
- Cited by
- 296
- References
- 89
- Citations by year
- 2026: 24 · 2025: 56 · 2024: 57 · 2023: 63 · 2022: 53 · 2021: 30 · 2020: 13
- FWCI
- 41.23
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Durham Research Online (Durham University) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Engineering and Physical Sciences Research Council (EP/R033595/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- trust in AI, trustworthy machine learning, fairness, explainability, auditability, safety, trust chain, AI lifecycle
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.