CoChat

Do Humans Trust Advice More if it Comes from AI?: An Analysis of Human-AI Interactions

Vodrahalli, Kailas, Daneshjou, Roxana, Gerstenberg, Tobias, Zou, James · 2022 · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

In decision support applications of AI, the AI algorithm's output is framed as a suggestion to a human user. The user may ignore this advice or take it into consideration to modify their decision. With the increasing prevalence of such human-AI interactions, it is important to understand how users react to AI advice. In this paper, we recruited over 1100 crowdworkers to characterize how humans use AI suggestions relative to equivalent suggestions from a group of peer humans across several experimental settings. We find that participants' beliefs about how human versus AI performance on a given task affects whether they heed the advice. When participants do heed the advice, they use it similarly for human and AI suggestions. Based on these results, we propose a two-stage, "activation-integration" model for human behavior and use it to characterize the factors that affect human-AI interactions.

Overview

Integrity signals

Registry

Crossref · 10.1145/3514094.3534150

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 18 references

Research works printed but not linked: 11

  1. Douglas Bates , Martin Mächler , Ben Bolker , and Steve Walker . 2014. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 ( 2014 ). Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2014. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 (2014). · arXiv
  2. Susanne Gaube , Harini Suresh , Martina Raue , Alexander Merritt , Seth J Berkowitz , Eva Lermer , Joseph F Coughlin , John V Guttag , Errol Colak , and Marzyeh Ghassemi . 2021. Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ digital medicine , Vol. 4 , 1 ( 2021 ), 1--8. Susanne Gaube, Harini Suresh, Martina Raue, Alexander Merritt, Seth J Berkowitz, Eva Lermer, Joseph F Coughlin, John V Guttag, Errol Colak, and Marzyeh Ghassemi. 2021. Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ digital medicine, Vol. 4, 1 (2021), 1--8.
  3. Alexa Hagerty and Igor Rubinov . 2019. Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence. arXiv preprint arXiv:1907.07892 ( 2019 ). Alexa Hagerty and Igor Rubinov. 2019. Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence. arXiv preprint arXiv:1907.07892 (2019). · arXiv
  4. Nigel Harvey and Ilan Fischer . 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes , Vol. 70 , 2 ( 1997 ), 117--133. Nigel Harvey and Ilan Fischer. 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes, Vol. 70, 2 (1997), 117--133.
  5. Nigel Harvey , Clare Harries , and Ilan Fischer . 2000. Using advice and assessing its quality. Organizational behavior and human decision processes , Vol. 81 , 2 ( 2000 ), 252--273. Nigel Harvey, Clare Harries, and Ilan Fischer. 2000. Using advice and assessing its quality. Organizational behavior and human decision processes, Vol. 81, 2 (2000), 252--273.
  6. Ekaterina Jussupow Izak Benbasat and Armin Heinzl. 2020. Why are we averse towards Algorithms? A comprehensive literature Review on Algorithm aversion.. In ECIS. Ekaterina Jussupow Izak Benbasat and Armin Heinzl. 2020. Why are we averse towards Algorithms? A comprehensive literature Review on Algorithm aversion.. In ECIS.
  7. Mikhail Khodak , Nikunj Saunshi , and Kiran Vodrahalli . 2017. A large self-annotated corpus for sarcasm. arXiv preprint arXiv:1704.05579 ( 2017 ). Mikhail Khodak, Nikunj Saunshi, and Kiran Vodrahalli. 2017. A large self-annotated corpus for sarcasm. arXiv preprint arXiv:1704.05579 (2017). · arXiv
  8. Tim Miller . 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence , Vol. 267 ( 2019 ), 1--38. Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence, Vol. 267 (2019), 1--38.
  9. Veronica Rotemberg , Nicholas Kurtansky , Brigid Betz-Stablein , Liam Caffery , Emmanouil Chousakos , Noel Codella , Marc Combalia , Stephen Dusza , Pascale Guitera , David Gutman , et almbox . 2021 . A patient-centric dataset of images and metadata for identifying melanomas using clinical context. Scientific data, Vol. 8 , 1 (2021), 1--8. Veronica Rotemberg, Nicholas Kurtansky, Brigid Betz-Stablein, Liam Caffery, Emmanouil Chousakos, Noel Codella, Marc Combalia, Stephen Dusza, Pascale Guitera, David Gutman, et almbox. 2021. A patient-centric dataset of images and metadata for identifying melanomas using clinical context. Scientific data, Vol. 8, 1 (2021), 1--8.
  10. Christoph Tauchert , Neda Mesbah , et almbox . 2019 . Following the Robot? Investigating Users' Utilization of Advice from Robo-Advisors.. In ICIS. AIS. Christoph Tauchert, Neda Mesbah, et almbox. 2019. Following the Robot? Investigating Users' Utilization of Advice from Robo-Advisors.. In ICIS. AIS.
  11. Lyn M Van Swol , Jihyun Esther Paik, and Andrew Prahl . 2018 . Advice recipients: The psychology of advice utilization. (2018). Lyn M Van Swol, Jihyun Esther Paik, and Andrew Prahl. 2018. Advice recipients: The psychology of advice utilization. (2018).

Cited by

See all 132

Metadata

Authors
Vodrahalli, K., Daneshjou, R., Gerstenberg, T., & Zou, J.
Affiliations
Stanford University (US)
Venue
Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society
Publisher
ACM
Published
2022-07-26
Pages
763-777
ISSN
3065-8365 (ISSN-L)
OpenAlex
W4288058227
Cited by
63
References
16
Citations by year
2026: 14 · 2025: 19 · 2024: 21 · 2023: 8 · 2022: 1
FWCI
23.59
Type
conference paper
Language
en
Open access
closed
Locations
Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
human-AI interaction, decision support, advice taking, peer advice, crowdsourced experiments

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.