Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 158 of the 158 references it cites were found in a registry or an index.

Do people appropriately rely on AI-advice? An analytical review of HCI research on human-AI decision-making.

Open access
Raees, Muhammad, Khan, Vassilis-Javed, Lykourentzou, Ioanna, Papangelis, Konstantinos · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems

Abstract

AI systems are increasingly being positioned to assist people in decision-making. However, recent empirical studies show critical concerns that people over-rely on AI advice without analytically engaging with it. While HCI research explores how people rely on AI advice, we argue that it largely overlooks an important aspect: replicating realistic decision-making scenarios. Human-AI interaction factors influence people’s reliance on AI advice. To understand human-AI interaction factors and their interplay, we conducted an analytical review of recent studies in human-AI reliance literature. We analyzed the decision-making tasks in research and their validity in application-grounded contexts. Our findings show that user engagement is a precious commodity for relying on AI advice; however, it comes at a cost. We also discuss factors contributing to “appropriate reliance”, existing research gaps, and recommendations for intervention design for human-AI reliance. Our work contributes to the critical body of research on building appropriate reliance on AI advice.

Overview

Integrity signals

Registry

Crossref · 10.1145/3772318.3791467

Cites

158 of 158 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 157 references

Research works printed but not linked: 10

  1. Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:https://arXiv.org/abs/1702.08608 (2017). · arXiv
  2. Christoph Engel, Andreas Glöckner, and Sinika Timme. 2017. Defendant should have the last word: Experimentally manipulating order and provisional assessment of the facts in criminal procedure. Technical Report. Preprints of the Max Planck Institute for Research on Collective Goods.
  3. Robert R Hoffman Shane T Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:https://arXiv.org/abs/1812.04608 (2018). · arXiv
  4. Daniel Kahneman. 2011. Thinking, fast and slow. macmillan.
  5. Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
  6. Lee Ross and Andrew Ward. 2013. Naive realism in everyday life: Implications for social conflict and misunderstanding. In Values and knowledge. Psychology Press, 103–135.
  7. Max Schemmer, Andrea Bartos, Philipp Spitzer, Patrick Hemmer, Niklas Kühl, Jonas Liebschner, and Gerhard Satzger. 2023. Towards effective human-AI decision-making: The role of human learning in appropriate reliance on AI advice. In Forty-Fourth International Conference on Information Systems (Hyderabad, India) (ICIS 2023 Proceedings). AISEL, 1–17. https://aisel.aisnet.org/icis2023/hti/hti/14
  8. Keng Siau and Weiyu Wang. 2018. Building trust in artificial intelligence machine learning and robotics. Cutter business technology journal 31 2 (2018) 47–53.
  9. Steve G Sutton Vicky Arnold and Matthew Holt. 2022. An extension of the theory of technology dominance: understanding the underlying nature causes and effects. Causes and effects (2022). · DOI
  10. Earl L Wiener. 1981. Complacency: Is the term useful for air safety. In Proceedings of the 26th corporate aviation safety seminar , Vol. 117. 116–125.

Cited by

See all 8

Metadata

Authors
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K.
Affiliations
  • Rochester Institute of Technology (US)
  • Independent Researcher, Brussels, Belgium
  • Utrecht University (NL)
  • Rochester Institute of Technology, Rochester, New York, USA
Venue
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2026-04-13
Pages
1-24
OpenAlex
W7153972336
Cited by
5
References
157
Citations by year
2026: 5
FWCI
67.17
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
  • Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
AI advice, AI reliance, human-AI decision-making, human-AI interaction, user engagement, decision-making tasks, intervention design, trust in AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Do people appropriately rely on AI-advice? An analytical review of HCI research on human-AI decision-making. https://app.cochat.ai/papers/10.1145/3772318.3791467
The paper
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026). Do people appropriately rely on AI-advice? An analytical review of HCI research on human-AI decision-making. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3772318.3791467

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.