Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
The rapid advancement of artificial intelligence (AI) has impacted society in many aspects. Alongside this progress, concerns such as privacy violation, discriminatory bias, and safety risks have also surfaced, highlighting the need for the development of ethical, responsible, and socially beneficial AI. In response, the concept of trustworthy AI has gained prominence, and several guidelines for developing trustworthy AI have been proposed. Against this background, we demonstrate the significance of psychological research in identifying factors that contribute to the formation of trust in AI. Specifically, we review research findings on interpersonal, human-automation, and human-AI trust from the perspective of a three-dimension framework (i.e., the trustor, the trustee, and their interactive context). The framework synthesizes common factors related to trust formation and maintenance across different trust types. These factors point out the foundational requirements for building trustworthy AI and provide pivotal guidance for its development that also involves communication, education, and training for users. We conclude by discussing how the insights in trust research can help enhance AI’s trustworthiness and foster its adoption and application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 1×
“McAllister (1995) identified two dimensions of interpersonal trust: cognitive and affective, while Dirks and Ferrin (2002) expanded this to include vulnerability and overall trust.”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 4×
“Furthermore, the degrees of familiarity and understanding of automated systems contribute to a more accurate evaluation of these systems’ competence, promoting a well-calibrated trust (Lee and See, 2004).”
BackgroundInfluentialDeveloping and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 1×
“Example items include, “I am willing to let my partner make decisions for me” (Rempel et al., 1985), and “I usually trust people until they give me a reason not to trust them” (McKnight et al., 2002).”
BackgroundTrust, Reciprocity, and Social History
Berg, J., Dickhaut, J., & McCabe, K. (1995) · Games and Economic Behavior · doi:10.1006/game.1995.1027 · Cited by 5,548
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“Automation differs significantly from machines that operate specific functions entirely and indefinitely without human intervention (Parasuraman and Riley, 1997).”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Kim, D. J., Ferrin, D. L., & Rao, H. R. (2008) · Decision Support Systems · doi:10.1016/j.dss.2007.07.001 · Cited by 3,613 · cited 1×
“Perceived benefits, such as time savings, cost reductions, and increased convenience, highlight the recognized advantages of using AI (Kim et al., 2008).”
BackgroundTrust in leadership: Meta-analytic findings and implications for research and practice.
Dirks, K. T., & Ferrin, D. L. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.4.611 · Cited by 3,550
E-commerce: the role of familiarity and trust.
Gefen, D. (2000) · Omega · doi:10.1016/s0305-0483(00)00021-9 · Cited by 3,529 · cited 3×
“Such familiarity not only reduces cognitive complexity by supplying essential background information and a cognitive framework, but also enables the formation of concrete expectations regarding the AI’s future behavior (Gefen, 2000).”
BackgroundA new scale for the measurement of interpersonal trust1
Rotter, J. B. (1967) · Journal of Personality · doi:10.1111/j.1467-6494.1967.tb01454.x · Cited by 3,503
Bartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193
Rempel, J. K., Holmes, J. G., & Zanna, M. P. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.95 · Cited by 3,146 · cited 2×
“Rempel et al. (1985) identified three components of trust from a dynamic perspective, including predictability (the consistency of actions over time), dependability (reliability based on past experience), and faith (belief in future behavior).”
BackgroundHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“Notably, anthropomorphism, the attribution of human-like qualities to AI, significantly influences users’ emotional trust, potentially enhancing AI’s acceptance and trustworthiness (Glikson and Woolley, 2020).”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817 · cited 3×
“This tripartite framework has been validated across various studies, affirming its applicability in understanding trust dynamics (Hancock et al., 2011; Hoff and Bashir, 2015; Drnec et al., 2016).”
BackgroundMethodA Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799 · cited 2×
“Additionally, automation systems are also known to be particularly vulnerable to unexpected bugs (Sheridan, 1988), making the effectiveness of such systems heavily reliant on users’ trust in their performance (Jian et al., 2000).”
BackgroundComplacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Consumers acceptance of artificially intelligent (AI) device use in service delivery
Gursoy, D., Chi, O. H., Lu, L., & Nunkoo, R. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.03.008 · Cited by 1,437 · cited 3×
“This form of motivation is instrumental in increasing user satisfaction and enjoyment derived from AI, thereby positively influencing their attitudes toward technology and enhancing their intention to use it (Gursoy et al., 2019).”
BackgroundInfluentialLee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 1×
“Moreover, trust in AI is generally lower in domains traditionally dominated by human expertise, potentially due to concerns about the intentions of AI (Lee, 2018).”
BackgroundInitial trust formation in new organizational relationships
McKnight, D. H., Cummings, L. L., & Chervany, N. L. (1998) · The Academy of Management Review · doi:10.2307/259290 · Cited by 1,296
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Developing and validating a service robot integration willingness scale
Lu, L., Cai, R., & Gursoy, D. (2019) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2019.01.005 · Cited by 1,013
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
People are averse to machines making moral decisions.
Bigman, Y. E., & Gray, K. (2018) · Cognition · doi:10.1016/j.cognition.2018.08.003 · Cited by 738 · cited 2×
“People are reluctant to allow AI to make moral decisions because AI is perceived to lack mind perception (Bigman and Gray, 2018).”
BackgroundAre Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices
Nass, C., Moon, Y., & Green, N. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00275.x · Cited by 670 · cited 2×
“Nass et al. (1997) demonstrated that assigning male or female voices to computers elicits stereotypical perceptions.”
BackgroundRole of fairness, accountability, and transparency in algorithmic affordance
Shin, D., & Park, Y. J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.019 · Cited by 643
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
In AI We Trust: Ethics, Artificial Intelligence, and Reliability
Ryan, M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00228-y · Cited by 600 · cited 1×
“Although AI lacks emotions and cannot be held accountable for its actions, it is usually perceived through the lens of social cognition, making it difficult to regard AI as merely a machine or software; instead, AI is often viewed as an entity worthy of trust (Ryan, 2020).”
BackgroundTowards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548 · cited 1×
“The key to evaluating trustworthy AI is whether AI does what it claims to do (Schwartz et al., 2022).”
BackgroundTay, B., Jung, Y., & Park, T. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.014 · Cited by 490 · cited 1×
“In a similar vein, Tay et al. (2014) reported that robots performing tasks aligned with gender or personality stereotypes— such as medical robots perceived as female or extroverted, and security robots as male or introverted—received higher approval ratings.”
BackgroundAnthropomorphism of computers: Is it mindful or mindless?
Kim, Y., & Sundar, S. S. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.09.006 · Cited by 462 · cited 1×
“Such anthropomorphization usually happens subconsciously, leading to automated agents being perceived with human-like qualities (Kim and Sundar, 2012).”
BackgroundAttachment and trust in artificial intelligence
Gillath, O., Ai, T., Branicky, M. S., Keshmiri, S., Davison, R. B., & Spaulding, R. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106607 · Cited by 448 · cited 1×
“AI typically refers to the simulation of human intelligence by computers (Gillath et al., 2021).”
BackgroundTransparency and trust in artificial intelligence systems
Schmidt, P., Biessmann, F., & Teubner, T. (2020) · Journal of Decision Systems · doi:10.1080/12460125.2020.1819094 · Cited by 440 · cited 1×
“Furthermore, in a task of using AI assistance to rate movies, Schmidt et al. (2020) observed that increased transparency in AI-assisted movie rating tasks paradoxically reduced user trust.”
BackgroundVimalkumar, M., Sharma, S. K., Singh, J. B., & Dwivedi, Y. K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106763 · Cited by 402 · cited 1×
“Research has found that providing adequate privacy protection measures directly influences people’s trust in AI and their willingness to use it (Vimalkumar et al., 2021; Liu and Tao, 2022).”
BackgroundTrust in Artificial Intelligence: Meta-Analytic Findings
Kaplan, A. D., Kessler, T. T., Brill, J. C., & Hancock, P. A. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211013988 · Cited by 397
Systematic Review: Trust-Building Factors and Implications for Conversational Agent Design
Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1807710 · Cited by 360
Survey and behavioral measurements of interpersonal trust
Evans, A. M., & Revelle, W. (2008) · Journal of Research in Personality · doi:10.1016/j.jrp.2008.07.011 · Cited by 336
Urban artificial intelligence: from automation to autonomy in the smart city
Cugurullo, F. (2020) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2020.00038 · Cited by 290 · cited 1×
“The distinction lies in automation being systems that perform repetitive tasks based on static rules or human commands, while AI involves systems skilled in dealing with uncertainties and making decisions in novel situations (Cugurullo, 2020; Kaplan et al., 2021).”
BackgroundAutomation failures on tasks easily performed by operators undermine trust in automated aids
Madhavan, P., Wiegmann, D. A., & Lacson, F. C. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724408 · Cited by 268 · cited 1×
“Furthermore, the simpler the task in which the error occurs, the greater the loss of trust (Madhavan et al., 2006).”
BackgroundCooperative AI: machines must learn to find common ground
Dafoe, A., Bachrach, Y., Hadfield, G., Horvitz, E., Larson, K., & Graepel, T. (2021) · Nature · doi:10.1038/d41586-021-01170-0 · Cited by 232
Do We Trust in AI? Role of Anthropomorphism and Intelligence
Troshani, I., Rao Hill, S., Sherman, C., & Arthur, D. (2021) · Journal of Computer Information Systems · doi:10.1080/08874417.2020.1788473 · Cited by 228
Understanding User Trust in Artificial Intelligence-Based Educational Systems: Evidence from China
Qin, F., Li, K., & Yan, J. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12994 · Cited by 204
Leichtmann, B., Humer, C., Hinterreiter, A., Streit, M., & Mara, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107539 · Cited by 200
Self-efficacy and acceptance of robots
Latikka, R., Turja, T., & Oksanen, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.017 · Cited by 200
Algorithmic discrimination causes less moral outrage than human discrimination
Bigman, Y. E., Wilson, D., Arnestad, M. N., Waytz, A., & Gray, K. (2023) · Journal of Experimental Psychology: General · doi:10.1037/xge0001250 · Cited by 198
Artificial Intelligence in Skin Cancer Diagnostics: The Patients' Perspective
Jutzi, T. B., Krieghoff-Henning, E. I., Holland-Letz, T., Utikal, J. S., Hauschild, A., Schadendorf, D., Sondermann, W., Fröhling, S., Hekler, A., Schmitt, M., et al. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.00233 · Cited by 196
It Isn’t Always Mutual: A Critical Review of Dyadic Trust
Korsgaard, M. A., Brower, H. H., & Lester, S. W. (2015) · Journal of Management · doi:10.1177/0149206314547521 · Cited by 175 · cited 1×
“…can be categorized into three types: reciprocal trust, highlighting the dynamic interactions between parties; mutual trust, reflecting a shared and consistent level of trust; and asymmetric trust, indicating imbalances in trust levels within interpersonal relationships (Korsgaard et al., 2015).”
Background"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters
Wan, Y., Pu, G., Sun, J., Garimella, A., Chang, K.-W., & Peng, N. (2023) · arXiv · doi:10.48550/arxiv.2310.09219 · Cited by 175
Warmth and competence: stereotype content issues for clinicians and researchers
Fiske, S. T. (2012) · Canadian Psychology/Psychologie canadienne · doi:10.1037/a0026054 · Cited by 156 · cited 1×
“The significance of these two dimensions is evident in their substantial influence on individuals’ evaluations and behaviors toward others (Mayer et al., 1995; Fiske, 2012).”
BackgroundLee, M. K., & Rich, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445570 · Cited by 145
Trust in Human-AI Interaction: Scoping Out Models, Measures, and Methods
Ueno, T., Sawa, Y., Kim, Y., Urakami, J., Oura, H., & Seaborn, K. (2022) · Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491101.3519772 · Cited by 91
WorldGPT: A Sora-Inspired Video AI Agent as Rich World Models from Text and Image Inputs
Yang, D., Hu, L., Tian, Y., Li, Z., Kelly, C., Yang, B., Yang, C., & Zou, Y. (2024) · arXiv · doi:10.48550/arxiv.2403.07944 · Cited by 5
Cited by
Tun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
“Fostering trust in AI-CDSSs among health care workers involves enhancing the transparency of AI algorithms and providing clear, practical, and actionable recommendations for clinical decision-making [39-41].”
On the Need to Rethink Trust in AI Assistants for Software Development: A Critical Review
Baltes, S., Speith, T., Chiteri, B., Mohsenimofidi, S., Chakraborty, S., & Buschek, D. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3659804 · Cited by 5
“There are ongoing discussions whether trust can be meaningfully applied to AI.”
Metadata
- Authors
- Li, Y., Wu, B., Huang, Y., & Luan, S.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2024-04-17
- Volume
- 15
- Pages
- 1382693-1382693
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W4394890386
- Cited by
- 159
- References
- 56
- FWCI
- 75.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.