A Literature Review of Human–AI Synergy in Decision Making: From the Perspective of Affordance Actualization Theory
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
The emergence of artificial-intelligence (AI)-powered information technology, such as deep learning and natural language processing, enables human to shift their behaving or working diagram from human-only to human–AI synergy, especially in the decision-making process. Since AI is multidisciplinary by nature and our understanding of human–AI synergy in decision-making is fragmented, we conducted a literature review to systematically characterize the phenomenon. Adopting the affordance actualization theory, we developed a framework to organize and understand the relationship between AI affordances, the human–AI synergy process, and the outcomes of human–AI synergy. Three themes emerged from the review: the identification of AI affordances in decision-making, human–AI synergy patterns regarding different decision tasks, and outcomes of human–AI synergy in decision-making. For each theme, we provided evidence on the existing research gaps and proposed future research directions. Our findings provide a holistic framework for understanding human–AI synergy phenomenon in decision-making. This work also offers theoretical contributions and research directions for researchers studying human–AI synergy in decision-making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“To address more complex tasks, algorithms are more sophisticated, which may lead to a lack of understanding and “black box” issues [80,81].”
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
How artificial intelligence will change the future of marketing
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00696-0 · Cited by 2,875 · cited 1×
“Davenport proposed that the prerequisite for AI to be recognized in enterprises and society is complete information disclosure of AI technology and endorsement by external organizations or institutions [97].”
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772
Brave new world: service robots in the frontline
Wirtz, J., Patterson, P. G., Kunz, W. H., Gruber, T., Lu, V. N., Paluch, S., & Martins, A. (2018) · Journal of Service Management · doi:10.1108/josm-04-2018-0119 · Cited by 2,315 · cited 2×
“Other studies also investigated humans’ cognitive perception from the perspective of relationship building [18,57], social presence [96,99], perceived usefulness, and ease of use of AI/robots/decisions [100].”
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061 · cited 1×
“…trust [42] cooking-related tasks in a kitchen explainable artificial intelligence (XAI) mental model, task performance, and reliance on the system [43] visual estimation task, song forecasting task, romantic attraction forecasting task algorithm-based AI system algorithm appreciation (preference…”
Mikalef, P., & Gupta, M. (2021) · Information & Management · doi:10.1016/j.im.2021.103434 · Cited by 1,700
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 2×
“Castelo et al. explored the impact of objectivity and other factors on users’ trust and usage of algorithms [53].”
van Doorn, J., Mende, M., Noble, S. M., Hulland, J., Ostrom, A. L., Grewal, D., & Petersen, J. A. (2017) · Journal of Service Research · doi:10.1177/1094670516679272 · Cited by 1,344
Mende, M., Scott, M. L., van Doorn, J., Grewal, D., & Shanks, I. (2019) · Journal of Marketing Research · doi:10.1177/0022243718822827 · Cited by 1,197 · cited 1×
“Despite the positive perception of AI, negative perceptions of the automation have also been discussed, such as individuals’ perceived interactive discomfort [53,55], over-trust or -reliance on AI [66], and humans’ resistance to unethical instructions from their AI supervisors [15].”
Vrontis, D., Christofi, M., Pereira, V., Tarba, S., Makrides, A., & Trichina, E. (2022) · The International Journal of Human Resource Management · doi:10.1080/09585192.2020.1871398 · Cited by 1,134
Automation, Algorithms, and Beyond: Why Work Design Matters More Than Ever in a Digital World
Parker, S. K., & Grote, G. (2022) · Applied Psychology · doi:10.1111/apps.12241 · Cited by 960 · cited 1×
“Studies on human–AI synergy in decision-making span a wide range of fields, including human–AI team collaboration [16,76], human–AI relationships, task allocation between humans and AI [77,78], human trust in AI [21,50], shared mental models [79], and practice in the human–AI decision-making process.”
Machines as teammates: A research agenda on AI in team collaboration
Seeber, I., Bittner, E., Briggs, R. O., de Vreede, T., de Vreede, G.-J., Elkins, A., Maier, R., Merz, A. B., Oeste-Reiß, S., Randrup, N., et al. (2020) · Information & Management · doi:10.1016/j.im.2019.103174 · Cited by 835 · cited 3×
“…assume different roles, such as a facilitator, reviewer, expert advisor, or guide [5,15 With the improvement of AI automation, agents’ roles have evolved from being auxiliary tools to active participants in team decision-making processes [16], leading to a wider array of team collaboration formats.”
Understanding the Role of Artificial Intelligence in Personalized Engagement Marketing
Kumar, V., Rajan, B., Venkatesan, R., & Lecinski, J. (2019) · California Management Review · doi:10.1177/0008125619859317 · Cited by 797 · cited 3×
“Thus, affordance actualization is defined as “actions taken by actors as they take advantage of one or more affordances through their use of the technology to achieve immediate concrete outcomes in support of organizational goals” [6] (p. 70).”
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“Lim et al. also tested users’ understanding of the AI systems and decisions based on different types of explanations, including What, Why, Why Not, What If, and How To [74].”
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466
Lehrer, C., Wieneke, A., vom Brocke, J., Jung, R., & Seidel, S. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2018.1451953 · Cited by 404
Intelligent agent transparency in human–agent teaming for multi-UxV management
Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815621206 · Cited by 403 · cited 1×
“…control in a drinking-glass-making factory automated decision-support-systems human trust, system performance, human perception and decisions [46] multi-UxV (unmanned vehicle) planning task intelligent agent performance, trust, and perceived usability [47] student admission algorithm-based…”
Lai, V., & Tan, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287590 · Cited by 377 · cited 4×
“Based on the prevailing state of technology, the relationship between humans and AI also differs during the human–AI synergy process, in which humans and AI can act as different roles in a multi-agent organization [34].”
InfluentialSystematic Review: Trust-Building Factors and Implications for Conversational Agent Design
Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1807710 · Cited by 360
Human and artificial intelligence collaboration for socially shared regulation in learning
Järvelä, S., Nguyen, A., & Hadwin, A. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13325 · Cited by 342 · cited 3×
“…in other Other scholars also focused on studying users’ perceptions and acceptance of AI technologies in other fi elds, including service marketing, learning design, and clinical decision-making [7,18–20]. fields, including service marketing, learning design, and clinical decision-making [7,18–20].”
Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems
Buçinca, Z., Lin, P., Gajos, K. Z., & Glassman, E. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377498 · Cited by 307 · cited 2×
“Regarding the types of explanations, studies have proposed that both inductive and deductive reasoning can provide humans with general rules or conclusions for the decision [33].”
Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292 · cited 3×
“…human perception and decisions [46] multi-UxV (unmanned vehicle) planning task intelligent agent performance, trust, and perceived usability [47] student admission algorithm-based AI system trust in algorithmic decisions [48] collaborative game humanoid robot intention reading and trusting…”
InfluentialUpdates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284 · cited 3×
“Further considering tasks with a high uncertainty, studies are mostly human–AI synergy-centered and put more emphasis on the collaboration between the two agents [37].”
InfluentialHuman-machine collaboration in managerial decision making
Haesevoets, T., De Cremer, D., Dierckx, K., & Van Hiel, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106730 · Cited by 280 · cited 1×
“…[38] recruitment and staffing, e-commerce, banking AI-based platform/assistant degree of fairness, transparent feedback, less-biased decisions [39] managerial decision-making such as hiring and firing employees algorithm-based AI system acceptance of the decisions [40] open medicine bottles…”
Zhang (2021) · doi:10.1145/3432945 · Cited by 225
Planning with Trust for Human-Robot Collaboration
Chen, M., Nikolaidis, S., Soh, H., Hsu, D., & Srinivasa, S. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171264 · Cited by 221
Responsible AI for Digital Health: a Synthesis and a Research Agenda
Trocin, C., Mikalef, P., Papamitsiou, Z., & Conboy, K. (2023) · Information Systems Frontiers · doi:10.1007/s10796-021-10146-4 · Cited by 205 · cited 1×
“By eliminating human biases, AI-driven decisions tend to be more objective and impartial, leading to fairer outcomes [90].”
How do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200 · cited 2×
“…employees algorithm-based AI system acceptance of the decisions [40] open medicine bottles autonomous-system-based robot human trust in the robot [41] naming and distinguishing species machine learning classifier end users’ appropriate trust [42] cooking-related tasks in a kitchen explainable…”
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163
Human–AI collaborative decision-making as an organization design problem
Puranam, P. (2021) · Journal of Organization Design · doi:10.1007/s41469-021-00095-2 · Cited by 162
A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445472 · Cited by 137
Z-Inspection ® : A Process to Assess Trustworthy AI
Zicari, R. V., Brodersen, J., Brusseau, J., Dudder, B., Eichhorn, T., Ivanov, T., Kararigas, G., Kringen, P., McCullough, M., Moslein, F., et al. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3066209 · Cited by 134
"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
Lai, V., Liu, H., & Tan, C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376873 · Cited by 123
Bayati, M., Braverman, M., Gillam, M., Mack, K. M., Ruiz, G., Smith, M. S., & Horvitz, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109264 · Cited by 122 · cited 1×
“Embracing AI as a collaborative partner empowers humans to tackle complex challenges more effectively and paves the way for a promising future with human–AI synergy [87].”
Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems
Nourani, M., Roy, C., Block, J. E., Honeycutt, D. R., Rahman, T., Ragan, E., & Gogate, V. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450639 · Cited by 107 · cited 2×
“Explanations have also been identified to be able to address users’ bias during human–AI synergy [42].”
Challenges of human—machine collaboration in risky decision-making
Xiong, W., Fan, H., Ma, L., & Wang, C. (2022) · Frontiers of Engineering Management · doi:10.1007/s42524-021-0182-0 · Cited by 95
Exploring and Promoting Diagnostic Transparency and Explainability in Online Symptom Checkers
Tsai, C.-H., You, Y., Gui, X., Kou, Y., & Carroll, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445101 · Cited by 86 · cited 2×
“…in the e-commerce context, AI systems automatically capture commodity information or customer information and make classi fi cations of the products or customers, facilitating accurate commodity display and promotion. checkers collect the patient’s information and perform diagnosis accordingly [65].”
Levy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445522 · Cited by 73 · cited 1×
“Despite the positive perception of AI, negative perceptions of the automation have also been discussed, such as individuals’ perceived interactive discomfort [53,55], over-trust or -reliance on AI [66], and humans’ resistance to unethical instructions from their AI supervisors [15].”
Do I trust my machine teammate?: an investigation from perception to decision
Yu, K., Berkovsky, S., Taib, R., Zhou, J., & Chen, F. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302277 · Cited by 71 · cited 2×
“Among the many key factors perceived by individuals in the above human–AI synergy background, some scholars mainly focused on the issue of perceived trust [28,45].”
Seo, S. H., Griffin, K., Young, J. E., Bunt, A., Prentice, S., & Loureiro-Rodríguez, V. (2018) · International Journal of Social Robotics · doi:10.1007/s12369-017-0441-8 · Cited by 64
Practical engineering of knowledge-based systems
Bader, J., Edwards, J., Harris-Jones, C., & Hannaford, D. (1988) · Information and Software Technology · doi:10.1016/0950-5849(88)90019-5 · Cited by 45 · cited 3×
“…decision-making between humans and machines, AI can assume di ff erent roles, such as a facilitator, reviewer, expert advisor, or guide [5,15]. collaborative decision-making between humans and machines, AI can assume different roles, such as a facilitator, reviewer, expert advisor, or…”
Investigating User Confidence for Uncertainty Presentation in Predictive Decision Making
Arshad, S. Z., Zhou, J., Bridon, C., Chen, F., & Wang, Y. (2015) · Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction · doi:10.1145/2838739.2838753 · Cited by 30
Cited by
AI agents under threat: A survey of key security challenges and future pathways
Deng, Z., Guo, Y., Han, C., Ma, W., Xiong, J., Wen, S., & Xiang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3716628 · Cited by 210
“To address these challenges, concurrent solutions are divided into two categories, extending LLM context window [32] and compressing historical in-context contents [47, 65, 95, 118].”
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
“Human–AI collaboration models emphasize the importance of users’ mental models of AI in decision-making processes (Bao et al. 2023; Steyvers and Kumar 2024).”
InfluentialSensemaking with AI: how trust influences human–AI collaboration in health and creative industries
Daly, S. J., Hearn, G., & Papageorgiou, K. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101346 · Cited by 27
A metacognitive approach to learning and performance in human-AI interaction
Fan, Y., Yan, L., Molenaar, I., Greiff, S., & Gašević, D. (2026) · Communications Psychology · doi:10.1038/s44271-026-00548-y · Cited by 1
Metadata
- Authors
- Bao, Y., Gong, W., & Yang, K.
- Venue
- Systems
- Publisher
- MDPI AG
- Published
- 2023-08-25
- Volume
- 11
- Issue
- 9
- Pages
- 442
- ISSN
- 2079-8954 (ISSN-L)
- OpenAlex
- W4386168844
- Cited by
- 80
- References
- 46
- FWCI
- 23.13
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.