Do Humans Trust Advice More if it Comes from AI?: An Analysis of Human-AI Interactions
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
In decision support applications of AI, the AI algorithm's output is framed as a suggestion to a human user. The user may ignore this advice or take it into consideration to modify their decision. With the increasing prevalence of such human-AI interactions, it is important to understand how users react to AI advice. In this paper, we recruited over 1100 crowdworkers to characterize how humans use AI suggestions relative to equivalent suggestions from a group of peer humans across several experimental settings. We find that participants' beliefs about how human versus AI performance on a given task affects whether they heed the advice. When participants do heed the advice, they use it similarly for human and AI suggestions. Based on these results, we propose a two-stage, "activation-integration" model for human behavior and use it to characterize the factors that affect human-AI interactions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Maintaining proper self-confdence is critical for humans to establish appropriate trust in AI.”
From Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making (2023) · cites this paper as [96]
In the citing paper
“Evidence shows that people's confdence in themselves signifcantly afects whether they will take AI's advice [19,62,96].”
From Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making (2023) · cites this paper as [96]
In the citing paper
“Supporting this notion, studies have shown that individuals with more medical experience are often less susceptible to automation advice [ 58 ], whereas those with less experience are more prone to automation bias, leading to overreliance on AI [ 23 ].”
From Psychological Factors Influencing Appropriate Reliance on AI-enabled Clinical Decision Support Systems: Experimental Web-Based Study Among Dermatologists (2025) · cites this paper as [58]
In the citing paper
“Our research identified medical experience as a significant factor influencing self-reported trust and reliance behavior, which is consistent with previous research [ 58 - 60 ].”
From Psychological Factors Influencing Appropriate Reliance on AI-enabled Clinical Decision Support Systems: Experimental Web-Based Study Among Dermatologists (2025) · cites this paper as [58]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Explanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 1×
“In particular, how perception of an AI can affect trust and utilization of its advice [17] and advice utilization of an AI relative to peer or expert humans [9, 19, 28].”
BackgroundRandom effects structure for testing interactions in linear mixed-effects models
Barr, D. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00328 · Cited by 782
Mann, L., Burnett, P., Radford, M., & Ford, S. (1997) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199703)10:1<1::aid-bdm242>3.0.co;2-x · Cited by 449
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386
The relative influence of advice from human experts and statistical methods on forecast adjustments
Önkal, D., Goodwin, P., Thomson, M., Gönül, S., & Pollock, A. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.637 · Cited by 341
Understanding algorithm aversion: When is advice from automation discounted?
Prahl, A., & Van Swol, L. (2017) · Journal of Forecasting · doi:10.1002/for.2464 · Cited by 308 · cited 4×
“Previous work has attempted to understand the effects of peer vs. expert advice [18], human vs. algorithmic advice [6, 18, 21, 22], task difficulty [10], and advice confidence [26, 27] on human utilization of advice.”
BackgroundMethodInfluential
Research works printed but not linked: 10
- Douglas Bates , Martin Mächler , Ben Bolker , and Steve Walker . 2014. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 ( 2014 ). Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2014. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 (2014). · arXiv
- Susanne Gaube , Harini Suresh , Martina Raue , Alexander Merritt , Seth J Berkowitz , Eva Lermer , Joseph F Coughlin , John V Guttag , Errol Colak , and Marzyeh Ghassemi . 2021. Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ digital medicine , Vol. 4 , 1 ( 2021 ), 1--8. Susanne Gaube, Harini Suresh, Martina Raue, Alexander Merritt, Seth J Berkowitz, Eva Lermer, Joseph F Coughlin, John V Guttag, Errol Colak, and Marzyeh Ghassemi. 2021. Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ digital medicine, Vol. 4, 1 (2021), 1--8.
- Alexa Hagerty and Igor Rubinov . 2019. Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence. arXiv preprint arXiv:1907.07892 ( 2019 ). Alexa Hagerty and Igor Rubinov. 2019. Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence. arXiv preprint arXiv:1907.07892 (2019). · arXiv
- Nigel Harvey and Ilan Fischer . 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes , Vol. 70 , 2 ( 1997 ), 117--133. Nigel Harvey and Ilan Fischer. 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes, Vol. 70, 2 (1997), 117--133.
- Nigel Harvey , Clare Harries , and Ilan Fischer . 2000. Using advice and assessing its quality. Organizational behavior and human decision processes , Vol. 81 , 2 ( 2000 ), 252--273. Nigel Harvey, Clare Harries, and Ilan Fischer. 2000. Using advice and assessing its quality. Organizational behavior and human decision processes, Vol. 81, 2 (2000), 252--273.
- Ekaterina Jussupow Izak Benbasat and Armin Heinzl. 2020. Why are we averse towards Algorithms? A comprehensive literature Review on Algorithm aversion.. In ECIS. Ekaterina Jussupow Izak Benbasat and Armin Heinzl. 2020. Why are we averse towards Algorithms? A comprehensive literature Review on Algorithm aversion.. In ECIS.
- Mikhail Khodak , Nikunj Saunshi , and Kiran Vodrahalli . 2017. A large self-annotated corpus for sarcasm. arXiv preprint arXiv:1704.05579 ( 2017 ). Mikhail Khodak, Nikunj Saunshi, and Kiran Vodrahalli. 2017. A large self-annotated corpus for sarcasm. arXiv preprint arXiv:1704.05579 (2017). · arXiv
- Veronica Rotemberg , Nicholas Kurtansky , Brigid Betz-Stablein , Liam Caffery , Emmanouil Chousakos , Noel Codella , Marc Combalia , Stephen Dusza , Pascale Guitera , David Gutman , et almbox . 2021 . A patient-centric dataset of images and metadata for identifying melanomas using clinical context. Scientific data, Vol. 8 , 1 (2021), 1--8. Veronica Rotemberg, Nicholas Kurtansky, Brigid Betz-Stablein, Liam Caffery, Emmanouil Chousakos, Noel Codella, Marc Combalia, Stephen Dusza, Pascale Guitera, David Gutman, et almbox. 2021. A patient-centric dataset of images and metadata for identifying melanomas using clinical context. Scientific data, Vol. 8, 1 (2021), 1--8.
- Christoph Tauchert , Neda Mesbah , et almbox . 2019 . Following the Robot? Investigating Users' Utilization of Advice from Robo-Advisors.. In ICIS. AIS. Christoph Tauchert, Neda Mesbah, et almbox. 2019. Following the Robot? Investigating Users' Utilization of Advice from Robo-Advisors.. In ICIS. AIS.
- Lyn M Van Swol , Jihyun Esther Paik, and Andrew Prahl . 2018 . Advice recipients: The psychology of advice utilization. (2018). Lyn M Van Swol, Jihyun Esther Paik, and Andrew Prahl. 2018. Advice recipients: The psychology of advice utilization. (2018).
Cited by
Items 101–132 of 132
Designing human-AI alignment to improve collaborative decision-making
Ma, S. (2024) · doi:10.14711/thesis-991013340344203412 · Cited by 1
Students Choose Human Counselors Over Algorithms in College Applications, but Not AlwaysPreprint
Das, H., Goulas, S., & Monachou, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5282793 · Cited by 1
Learning to Decide with AI Assistance under Human-AlignmentPreprint
Benz, N. C., Straitouri, E., & Gomez-Rodriguez, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.12646 · Cited by 1
AI Persuasion and Financial-Decision Making: Experimental Evidence on Dominated Investment Choices
Greubel, J., Guhling, H., & Herweg, F. (2026) · CESifo · doi:10.65864/8vamyh3cl8 · Cited by 1
Shank, D. B. (2025) · Springer eBooks · doi:10.1007/978-3-031-86061-4_7
Palmer-Cooper, E. C., Gentry, E., Nichele, E., Naiseh, M., Dowthwaite, L., Azim, T., Armouch, M., Greenway, F. T., Weal, M. J., & Hughes, A. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/n6rvx_v1
Toward A Trustworthy And Responsible Artificial Intelligence
Afroogh, S. (2023) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/87mn-dwne
Wu, Y.-L., Ma, R., Feng, J.-J., Liao, J., Jiang, Q., Mo, L., & Guo, Y.-L. (2025) · Journal of Forest Research · doi:10.1080/13416979.2025.2574130
Chong, T. (2022) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/24370
Confirmation bias: A challenge for scalable oversight
Recchia, G., Mangat, C. S., Nyachhyon, J., Sharma, M., Canavan, C., Epstein-Gross, D., & Abdulbari, M. (2025) · arXiv · doi:10.48550/arxiv.2507.19486
AI as a resource: strategy, uncertainty, and societal welfare
Donahue, K. (2024) · eCommons (Cornell University) · doi:10.7298/3tfg-jj61
Correia, I. M. S. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Bengtsson, A., & Lindqvist, M. (2023) · DiVA (Linkoping University)
Palmer-Cooper, E. C., Gentry, E., Nichele, E., Azim, T., Naiseh, M., Dowthwaite, L., Armouch, M. S., Greenway, F. T., Weal, M. J., & Hughes, A. M. (2026) · ePrints Soton (University of Southampton) · doi:10.31219/osf.io/n6rvx_v4
Question-Driven Reasoning in AI-Assisted Decision-Making: A Content-Based Approach
Peng, C. (2024) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Human in the loop: Integration of experts in MR data processing
Carneiro, G. (2025) · Advances in magnetic resonance technology and applications · doi:10.1016/b978-0-443-14109-6.00018-3
Khan, M. T., Ee, J., & Tripathi, S. (2026) · Open Journal of Social Sciences · doi:10.4236/jss.2026.143015
Hartwig, K., Biselli, T., Schneider, F. B., Lamp, I., & Reuter, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790630
Trust in Chatbots for Collaboration.
Amiot, C. (2025) · theses.fr (ABES) · doi:10.70675/e00bc63czc556z4d21zb5c6z75dafba70f32
Salgueiro, R. G. W. (2026) · IEEE Access · doi:10.1109/access.2026.3695013
Yang, M., Kagawa, R., & Baba, Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812288
What Should (A)I Do? The Heuristic Role of Artificial Advice in Moral Decision-Making
Wolff, J. (2026) · University of Regensburg Publication Server (University of Regensburg) · doi:10.5283/epub.79660
Harvesting Trust Indicators: A Method for Evaluating Trustworthiness of RAG-Driven Advice
Scala, D., & de Boer, M. (2026) · Frontiers in artificial intelligence and applications · doi:10.3233/faia260518
Human-Centric Reflective Architecture for Human-AI Collaborative Decision-MakingPreprint
Kouridakis, A., Spyropoulos, D. P., & Vouros, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.03025
Mahasuar, K. (2026) · International journal of high school research · doi:10.36838/ijhsr816.87
Learning to Decide with {AI} Assistance under Human-alignment
Benz, N. C., Straitouri, E., & Rodriguez, M. G. (2026) · MPG.PuRe (Max Planck Society)
Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is JudgedPreprint
Kapadia, A. R., Chandrasekharan, E., & Saha, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.20989
Logic or Emotion? The Impact of Persuasion Strategies on Human-AI Trust
Li, T., & Yue, Q. I. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2740322
Yamamoto, K., Tanikawa, T., & Kuzuoka, H. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02469-5
Palmer-Cooper, E. C., Gentry, E., Nichele, E., Azim, T., Naiseh, M., Dowthwaite, L., Armouch, M. S., Greenway, F. T., Weal, M. J., & Hughes, A. (2026) · Behavioral Sciences · doi:10.3390/bs16111969
"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2023) · arXiv
Metadata
- Authors
- Vodrahalli, K., Daneshjou, R., Gerstenberg, T., & Zou, J.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2022-07-26
- Pages
- 763-777
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4288058227
- Cited by
- 63
- References
- 16
- Citations by year
- 2026: 14 · 2025: 19 · 2024: 21 · 2023: 8 · 2022: 1
- FWCI
- 23.59
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- human-AI interaction, decision support, advice taking, peer advice, crowdsourced experiments
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.