The DOI matches its Crossref record.
Are We Trusting AI Too Much?: Examining Human-Robot Interactions in the Real World
Abstract
Intelligent systems, especially those with an embodied construct, are becoming pervasive in our society. From chatbots to rehabilitation robotics, from shopping agents to robot tutors, people are adopting these systems into their daily life activities. Alas, associated with this increased acceptance is a concern with the ethical ramifications as we start becoming more dependent on these devices [1]. Studies, including our own, suggest that people tend to trust, in some cases overtrusting, the decision-making capabilities of these systems [2]. For high-risk activities, such as in healthcare, when human judgment should still have priority at times, this propensity to overtrust becomes troubling [3]. Methods should thus be designed to examine when overtrust can occur, modelling the behavior for future scenarios and, if possible, introduce system behaviors in order to mitigate. In this talk, we will discuss a number of human-robot interaction studies conducted where we examined this phenomenon of overtrust, including healthcare-related scenarios with vulnerable populations, specifically children with disabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is a great deal of evidence that humans tend to over-trust computer systems.
“There is a great deal of evidence that humans tend to over-trust computer systems”
From The false hope of current approaches to explainable artificial intelligence in health care (2021) · cites this paper as [39]
Over-reliance on advice can be dangerous in high-risk settings like diagnostic decision-making, especially when the advice is inaccurate.
“However, for high-risk settings like diagnostic decision-making, over-reliance on advice can be dangerous and steps should be taken to minimize it, especially when the advice is inaccurate33,34.”
From Do as AI say: susceptibility in deployment of clinical decision-aids (2021) · cites this paper as [33]
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 3
- 10.1007/s11948-017-9975-2 · DOI · Paper page
- A. R. Wagner , J. Borenstein , A. Howard , "Overtrust in the Robotic Age : A Contemporary Ethical Challenge," Communications of the ACM, 61(9) , Sept. 2018 . A. R. Wagner, J. Borenstein, A. Howard, "Overtrust in the Robotic Age: A Contemporary Ethical Challenge," Communications of the ACM, 61(9), Sept. 2018.
- 10.1109/MRA.2017.2778743 · DOI · Paper page
Cited by
Sorted by citations
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543
“However, for high-risk settings like diagnostic decision-making, over-reliance on advice can be dangerous and steps should be taken to minimize it, especially when the advice is inaccurate 33,34 .”
Background
Metadata
- Authors
- Howard, A.
- Affiliations
- Georgia Institute of Technology (US)
- Corresponding author
- Howard, Ayanna
- ORCID
- Howard, Ayanna
- Venue
- Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
- Publisher
- ACM
- Published
- 2020-03-09
- Pages
- 1-1
- OpenAlex
- W3010238753
- Cited by
- 13
- References
- 0
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2023: 1 · 2022: 1 · 2021: 3
- FWCI
- 1.76
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- overtrust, trust in AI, human-robot interaction, healthcare robots, vulnerable populations, children with disabilities, ethical implications of AI, human-AI decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
