The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Three Challenges for AI-Assisted Decision-Making
Open accessAbstract
Artificial intelligence (AI) has the potential to improve human decision-making by providing decision recommendations and problem-relevant information to assist human decision-makers. However, the full realization of the potential of human–AI collaboration continues to face several challenges. First, the conditions that support complementarity (i.e., situations in which the performance of a human with AI assistance exceeds the performance of an unassisted human or the AI in isolation) must be understood. This task requires humans to be able to recognize situations in which the AI should be leveraged and to develop new AI systems that can learn to complement the human decision-maker. Second, human mental models of the AI, which contain both expectations of the AI and reliance strategies, must be accurately assessed. Third, the effects of different design choices for human-AI interaction must be understood, including both the timing of AI assistance and the amount of model information that should be presented to the human decision-maker to avoid cognitive overload and ineffective reliance strategies. In response to each of these three challenges, we present an interdisciplinary perspective based on recent empirical and theoretical findings and discuss new research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Self-evaluation is particularly promising for augmenting GenAI explainability, where it can help increase users' receptiveness to explanations that seek to update their mental models of GenAI systems [4,171] (see §4.2.1 for more on explainability).”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [171]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Human-AI collaboration models emphasize the importance of users' mental models of AI in decision-making processes (Bao etal. 2023; Steyvers and Kumar 2024).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Steyvers and Kumar 2024
The cited source says what the claim attributes to it.
In the citing paper
“Confidence and its adjustment are central to decision-making and reasoning, especially in many aspects of human-AI interaction [4, 171] ( §3.1, §3.2, and §3.3).”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [171]
The cited source says what the claim attributes to it.
In the citing paper
“Apart from facilitating engagement at opportune moments, the sequential paradigm is presumed to encourage independent reflection by the user.”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [171]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Likewise, end-user programmers have been reported to”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [169]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Nudge: improving decisions about health, wealth, and happiness
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0977 · Cited by 11,572
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“As Lee and See (2004) noted, the objective of this process is not to design systems to increase reliance or trust but to design them to produce appropriate levels of reliance and trust.”
(1999) · Cited by 6,104
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“…can also draw insights from an extensive body of research on human reliance on simple algorithmic decision aids (Arkes et al., 1986) and automation (Parasuraman & Riley, 1997), we argue that several distinct factors come into play when AI serves as an assistant rather than a decision aid grounded…”
Moral Identity and Developmental Theory
Lapsley, D. (2015) · Human Development · doi:10.1159/000435926 · Cited by 3,819
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 2×
“For example, Dietvorst et al. (2015) showed that participants prefer to rely on human decision-making than on algorithms after witnessing the performance of an algorithm, which includes cases in which the algorithms make mistakes, despite the fact that the algorithm actually outperforms the human…”
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Research works printed but not linked: 9
- Abraham H., 2017, Proceedings of the Transportation Research Board 96th Annual Meeting, 8
- Aggarwal I., 2015, Proceedings of Collective Intelligence, 1, 3
- 10.1145/3449287 · doi:10.1145/3449287 · Paper page
- Craik K. J. W., 1952, The nature of explanation, 445
- 10.1037/0003-066X.55.1.68 · doi:10.1037/0003-066x.55.1.68 · Paper page
- Smyth M. M., 1994, Cognition in action
- Taesiri M. R., 2022, Advances in Neural Information Processing Systems, 35, 34287
- Vodrahalli K., 2022, Advances in Neural Information Processing Systems, 35, 4004
- Wilder B., 2021, Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, 1526
Cited by
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Artificial intelligence and consumer behavior: From predictive to generative AI
Hermann, E., & Puntoni, S. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2024.114720 · Cited by 230
What large language models know and what people think they know
Steyvers, M., Tejeda, H., Kumar, A., Belem, C., Karny, S., Hu, X., Mayer, L. W., & Smyth, P. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00976-7 · Cited by 209
Self-citationA generalist medical language model for disease diagnosis assistance
Liu, X., Liu, H., Yang, G., Jiang, Z., Cui, S., Zhang, Z., Wang, H., Tao, L., Sun, Y., Song, Z., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03416-6 · Cited by 183
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
“These proposals seek to solve the three main challenges in hybrid decision-making (cf. 1.1.1; Steyvers and Kumar 2024).”
Influential
Metadata
- Authors
- Steyvers, M., & Kumar, A.
- Affiliations
- University of California, Irvine (US)
- Corresponding author
- Steyvers, Mark
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2023-07-13
- Volume
- 19
- Issue
- 5
- Pages
- 722-734
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- PMC
- PMC11373149
- OpenAlex
- W4384120246
- Cited by
- 217
- References
- 85
- Citations by year
- 2026: 100 · 2025: 86 · 2024: 28 · 2023: 3
- FWCI
- 64.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Perspectives on Psychological Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- AI-assisted decision-making, human-AI collaboration, complementarity, cognitive overload, decision recommendation
- MeSH terms
- Artificial Intelligence, Decision Making, Humans, Models, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Three Challenges for AI-Assisted Decision-Making. https://app.cochat.ai/papers/10.1177/17456916231181102
- The paper
- Steyvers, M., & Kumar, A. (2024). Three Challenges for AI-Assisted Decision-Making. Perspectives on Psychological Science. https://doi.org/10.1177/17456916231181102
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.