How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Open accessThe DOI matches its Crossref record; 212 of the 215 references it cites were found in a registry or an index.
Abstract
The spread of AI-embedded systems involved in human decision making makes studying human trust in these systems critical. However, empirically investigating trust is challenging. One reason is the lack of standard protocols to design trust experiments. In this paper, we present a survey of existing methods to empirically investigate trust in AI-assisted decision making and analyse the corpus along the constitutive elements of an experimental protocol. We find that the definition of trust is not commonly integrated in experimental protocols, which can lead to findings that are overclaimed or are hard to interpret and compare across studies. Drawing from empirical practices in social and cognitive studies on human-human trust, we provide practical guidelines to improve the methodology of studying Human-AI trust in decision-making contexts. In addition, we bring forward research opportunities of two types: one focusing on further investigation regarding trust methodologies and the other on factors that impact Human-AI trust.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Not So Different After All: A Cross-Discipline View Of Trust
Rousseau, D. M., Sitkin, S. B., Burt, R. S., & Camerer, C. (1998) · Academy of Management Review · doi:10.5465/amr.1998.926617 · Cited by 10,274
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191 · cited 1×
“Critical incident technique [57] is a set of procedures used to collect data from narrated past experiences (or observations) to identify and brainstorm about important events related to a pre-defined problem [7].”
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 2×
“Madsen [130] (adapted from McAllister [139]) HCI, adapted from Human-Human Trust ✗ ✓ ✓ [48, 109, 237]”
An overview of heart rate variability metrics and norms
Shaffer, F., & Ginsberg, J. P. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00258 · Cited by 7,185
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 11×
“In the rest of our paper, we rely on the Lee and See [116] definition when referring to trust: “An”
InfluentialDeveloping and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 4×
“The examples of such questionnaires are [11, 39, 68, 137, 142].”
Influential(2007) · Encyclopedia of Industrial and Organizational Psychology · doi:10.4135/9781412952651.n55 · Cited by 5,287
Boys will be Boys: Gender, Overconfidence, and Common Stock Investment
Barber, B. M., & Odean, T. (2001) · The Quarterly Journal of Economics · doi:10.1162/003355301556400 · Cited by 5,276 · cited 1×
“It is believed that its magnitude depends on gender [13], age or culture [93].”
Lewis, J. D., & Weigert, A. (1985) · Social Forces · doi:10.2307/2578601 · Cited by 4,163 · cited 1×
“Trust has grounds to form only when one thinks that negative outcomes associated with trusting do not exist or are very unlikely [121].”
Research works printed but not linked: 48
- 10.1037/0022--3514.46.3.610 · doi:10.1037/0022--3514.46.3.610
- S. Boon and J. Holmes. 1991. The dynamics of interpersonal trust: resolving uncertainty in the ace of risk. In Cooperation and Prosocial Behaviour R. Hinde and J. Gorebel (Eds.). Cambridge University Press Cambridge 190--211.
- Raja Chatila Virginia Dignum Michael Fisher Fosca Giannotti Katharina Morik Stuart Russell and Karen Yeung. 2021. Trustworthy AI. Springer International Publishing Cham 13--39. https://doi.org/10.1007/978--3-030--69128--8_2 · doi:10.1007/978--3-030--69128--8_2
- 10.1037//0021--9010.87.4.611 · doi:10.1037//0021--9010.87.4.611
- 10.1111/j.1751--9004.2009.00232.x · doi:10.1111/j.1751--9004.2009.00232.x
- 10.1162/JEEA.2009.7.2--3.235 · doi:10.1162/jeea.2009.7.2--3.235
- AXA Research Fund. 2019. Artificial Intelligence: Fostering Trust. Technical Report. AXA. 45 pages. https://www.axa-research.org/en/news/AI-research-guide
- Diego Gambetta. [n.d.]. Can We Trust Trust? Department of Sociology,University of Oxford, Oxford, United Kingdom.
- Nicole Gillespie. 2003. Measuring trust in working relationships: The behavioral trust inventory. Melbourne Business School, Melbourne, Australia.
- 10.1108/00483480610682299 · DOI · Paper page
- 10.1007/978-0--387--73655--6_19 · doi:10.1007/978-0--387--73655--6_19
- 10.1037//0022--3514.49.1.95 · doi:10.1037//0022--3514.49.1.95
- 10.1038/s42256-019-0088--2 · doi:10.1038/s42256-019-0088--2
- 10.1016/j.joep.2011.05.00 · doi:10.1016/j.joep.2011.05.00
- 10.1002/j.2333--8504.1967.tb00991.x · doi:10.1002/j.2333--8504.1967.tb00991.x
- 10.1016/j.obhdp.2012.08.0 · doi:10.1016/j.obhdp.2012.08.0
- KPMG. 2019. Controlling AI: The imperative for transparency and explainability. Technical Report. KPMG. 28 pages. https://advisory.kpmg.us/articles/2019/controlling-ai.html
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- 10.2307/259288 · DOI · Paper page
- 10.1007/978--94-010--1276--8_19 · doi:10.1007/978--94-010--1276--8_19
- Niklas Luhmann. 1979. Trust and Power (1 ed.). Wiley, Chichester, Toronto.
- Nikolas Luhmann. 2000. Familiarity, Confidence, Trust: Problems and Alternatives. In Trust: Making and Breaking Cooperative Relations, Diego Gambetta (Ed.). Basil Blackwell, Oxford, United Kingdom, 94--107.
- Maria A. Madsen and Shirley Gregor. 2000. Measuring Human-Computer Trust. In Proceedings of the 11 th Australasian Conference on Information Systems. Australasian Conference on Information Systems (ACIS), Brisbane, Australia, 6--8.
- C. Mantzavinos. 2020. Hermeneutics. In The Stanford Encyclopedia of Philosophy (spring 2020 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University, Stanford, CA, USA.
- 10.1016/S0969--5931(03)00037--4 · doi:10.1016/s0969--5931(03)00037--4
- 10.1037/0021--9010.84.1.123 · doi:10.1037/0021--9010.84.1.123
- 10.1007/3--540--45547--7_3 · doi:10.1007/3--540--45547--7_3
- 10.5465/amr.1998.926622 · DOI · Paper page
- Joachim Meyer and John D. Lee. 2013. Trust, Reliance, and Compliance. In The Oxford Handbook of Cognitive Engineering, John D. Lee and Alex Kirlik (Eds.). Oxford University Press, Oxford, UK, 1--29. https://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199757183.001.0001/oxfordhb-9780199757183-e-6 · doi:10.1093/oxfordhb/9780199757183.001.0001/oxfordhb-9780199757183-e-6
- B.M. Muir. 1989. Operators' Trust in and Use of Automatic Controllers in a Supervisory Process Control Task. University of Toronto, Toronto, Canada. https://books.google.fr/books?id=T94NSwAACAAJ
- Domen Novak. 2014. Engineering Issues in Physiological Computing. 17--38. https://doi.org/10.1007/978--1--4471--6392--3_2 · doi:10.1007/978--1--4471--6392--3_2
- Claus Offe. [n.d.]. How can we trust our fellow citizens? Cambridge UP, Cambridge, United Kingdom.
- 10.1111/2041--210X.12860 · doi:10.1111/2041--210x.12860
- 10.5214/ans.0972--7531.1017309 · doi:10.5214/ans.0972--7531.1017309
- 10.1111/j.1744--6198.2011.00230.x · doi:10.1111/j.1744--6198.2011.00230.x
- Gjalt-Jorn Peters. 2014. The alpha and the omega of scale reliability and validity: Why and how to abandon Conbach's alpha and the route towards more comprehensive assessment od scale quality. Euro Health Psychologist 16 (01 2014), 56--69.
- J. Potter and D. Edwards. 1996. Discourse Analysis. Macmillan Education UK London 419--425. https://doi.org/10.1007/978--1--349--24483--6_63 · doi:10.1007/978--1--349--24483--6_63
- 10.1016/B978-0--12--800985--7.00007--7 · doi:10.1016/b978-0--12--800985--7.00007--7
- Accenture Federal Services. 2019. Responsible AI: A Framework for Building Trust in your AI Solutions. Technical Report. Accenture. 13 pages. https://www.accenture.com/us-en/insights/us-federal-government/ai-is-ready-are-we
- 10.1007/s11336-008--9101-0 · doi:10.1007/s11336-008--9101-0
- Richard S. Sutton and Andrew G. Barto. 1998. Introduction to Reinforcement Learning (1st ed.). MIT Press, Cambridge, MA, USA.
- 10.1111/j.1758--6623.2005.tb00554.x · doi:10.1111/j.1758--6623.2005.tb00554.x
- M. Wang, A. Hussein, R. F. Rojas, K. Shafi, and H. A. Abbass. 2018. EEG-Based Neural Correlates of Trust in Human-Autonomy Interaction. In 2018 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, Bangalore, India, 350--357.
- Ning Wang, David V. Pynadath, and Susan G. Hill. 2016. Trust Calibration within a Human-Robot Team: Comparing Automatically Generated Explanations. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction (HRI '16). IEEE Press, New York, NY, USA, 109--116.
- 10.1111/j.1468--2958.1977.tb00523.x · doi:10.1111/j.1468--2958.1977.tb00523.x
- T. Whelan. 2008. Social Presence in Multi-User Virtual Environments : A Review and Measurement Framework for Organizational Research.
- 10.5555/3378680.3378689 · doi:10.5555/3378680.3378689
- Louise C. Young and Gerald S. Albaum. 2002. Developing a measure of trust in retail relationships : a direct selling application. School of Marketing, University of Technology of Sydney, Sydney Broadway, N.S.W, Australia.
Cited by
Items 201–235 of 235
Explainability for machine learning models : from data adaptability to user perception
Delaunay, J. (2023) · theses.fr (ABES) · doi:10.70675/933366c4z576ez464cz9fcfz24627f86dd2f · Cited by 1
Bertrand, A. (2024) · theses.fr (ABES) · doi:10.70675/216d3647z78bcz4c68z9ba9z2d0a029cf1b4 · Cited by 8
Trustable machine learning for intrusion detection systems
Duraz, R. (2024) · theses.fr (ABES) · doi:10.70675/e2fe5f32z19e5z41caz9b55z7b33b874c3c0 · Cited by 2
Trust of Artificial Intelligence in the Workplace: A Mixed-Methods Approach
Darnell, E. M. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799220 · Cited by 1
Kirmayr, J., Wennmacher, R., Huynh, K., Stappen, L., André, E., & Alt, F. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790997 · Cited by 3
Gómez, C., Jia, M. Y., Cho, S. M., Huang, C., & Unberath, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791660
EvaluAId: Human-AI Collaborative Evaluation of Open-Ended Student Essays
Zhang, C., Ju, K. P., Lu, X., Yen, Y.-C. G., & Rzeszotarski, J. M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790814 · Cited by 3
Advancing sustainable construction: a trust-enhanced model of AI adoption and actual usePreprint
Regona, M., Yiğitcanlar, T., Hon, C. K. H., & Teo, M. M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6614001
Helping doctors’ AI-assisted health care decision-making: The role of social norms
He, H., & Xia, J. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107597 · Cited by 1
Co-Designing Trust: The AI4Gov evaluation methodology for AI Tools in Public Governance
Goga, E., Kyrkou, D., Kovacic, M., Guček, A., Draksler, T. Z., Apostolopoulos, D., Cano, C. P., Iosif, E., Τσακοπούλου, Κ., Diamantara, V., et al. (2026) · Journal of artificial intelligence for sustainable development. · doi:10.69828/4d4ksh
Sun, X., Wei, S., Pan, T., Wang, Y., Bosch, J. A., Echizen, I., Ali, A. E., & Sugawara, S. (2026) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3774935.3806190 · Cited by 1
Bilal, F., Öörni, A., & Mezei, J. (2026) · Bled eConference · doi:10.18690/um.fov.4.2026.25
Alzahrani, A., Thota, S. K., Alarood, A. A., & Polat, K. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111332
Betancourt-Barrita, C., Berumen-Glinz, L. A., Peña, F. C. Y. M., & Escobar-Castillejos, D. (2026) · Frontiers of Computer Science · doi:10.3389/fcomp.2026.1832107
From Verdicts to Maps: Reimagining AI Assessment for ADHD Through a Strength-Based Lens
Yang, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29773-0_2
Hu, Y., Indurkhya, B., & Fujinami, K. (2026) · Applied Sciences · doi:10.3390/app16136396
Singh, N., Sovrano, F., Hellendoorn, V. J., & Bacchelli, A. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808165 · Cited by 1
Democratisation of AI with Understandable and Easily Accessible Machine Learning Operations
Obermeier, L., Khir, D., Küchen, N., Galindo, T. H., Stocker, J., Buchberger, M., Pesch, R., Frechen, H., Meier, J., Schatzl, M., et al. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-30805-4_13
Trust by design: Human factors and trust calibration in ML-based educational systems
Anthis, Z., & Kyriakidou-Zacharoudiou, A. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103893
Too Much, Too Little, Just Right? Towards Dimensions of Trust Calibration in Human–AI Interaction
Börsting, I., & Hesenius, M. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816283
Advancing sustainable construction: A trust-enhanced model of AI adoption and realised use
Regona, M., Yiğitcanlar, T., Hon, C. K. H., & Teo, M. (2026) · Sustainable Cities and Society · doi:10.1016/j.scs.2026.107755 · Cited by 1
Diaz-Papkovich, A., Kuntzleman, A., Davis, S. C., & Ramachandran, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.27.741055
A Systematic Validation of the Jian et al. (2000) “Trust in Automated Systems Scale”
Pithayarungsarit, P., Newberry, A., Lee, J. R., Roesler, E., & Gutzwiller, R. S. (2026) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813261475227
Psychias, S., Kierysch, J., Kandul, S., Hazan, D., & Christen, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7372011
Why we believe chatbots: trust calibration as a design problem
Jaidka, K., & Cai, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1935527 · Cited by 4
Schlicker, N., & Langer, M. (2026) · Springer eBooks · doi:10.1007/978-3-031-52643-5_264-1
Detherage, R., & Connelly, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1841079
Rasheed, M. (2026) · Kybernetes · doi:10.1108/k-05-2026-1124
Hou, Y., Yang, J., Wong, R. Y., & Howell, N. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816945
Frey, N., Agha-Mir-Salim, L., Renner, L., Haufe, S., Voge, L., & Balzer, F. (2026) · Research Square · doi:10.21203/rs.3.rs-10892043/v1 · Cited by 2
Çavuş, M. N., Çavuş, B., & Bozkurt, H. G. (2026) · ANASAY · doi:10.33404/anasay.1997259
Liu, J., Zhong, C., Meng, F., Shank, D. B., & Wunsch, D. C. (2026) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2026.103140
Bhatia, N., Pradhan, I., Ganguly, C., & Shrivastava, N. K. (2026) · IEEE World Conference on Applied Intelligence and Computing (AIC) · doi:10.1109/aic70896.2026.11716901
Machain, J. D. J. R., Lizárraga, D. M., García, V. M. M., Romero, Y. D., Ramírez, M. I. T., & Lizarraga, P. A. V. (2026) · SAP Engineering and Industry · doi:10.62486/ei202670
Yamamoto, K., Tanikawa, T., & Kuzuoka, H. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02469-5
Metadata
- Authors
- Vereschak, O., Bailly, G., & Caramiaux, B.
- Affiliations
- Sorbonne Université (FR)
- Centre National de la Recherche Scientifique (FR)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-10-13
- Volume
- 5
- Issue
- CSCW2
- Pages
- 1-39
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3207598588
- Cited by
- 229
- References
- 215
- Citations by year
- 2026: 58 · 2025: 61 · 2024: 64 · 2023: 31 · 2022: 15
- FWCI
- 26.95
- Type
- journal article
- Language
- en
- Open access
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- HAL (submittedVersion, other-oa)
- Funders
- ANR-11-LABX-65 (ANR-11-IDEX-0004-02)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- trust in AI, AI-assisted decision-making, experimental protocol, trust measurement, trust definition, research methodology guidelines, trust factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.