Team Dynamics in Human-AI Collaboration: Effects on Confidence, Satisfaction, and Accountability
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
The integration of multimodal AI agents into human teams raises critical questions about collaboration in ad hoc environments without pre-coordination. We examine how team composition affects psychological dimensions in Human-AI Teaming by investigating self-confidence, satisfaction, and accountability across configurations. Using a factorial design, we compared four conditions (Human-Only, Human-Human, Human-Agent, Human-Human-Agent) across resource management, healthcare, and finance domains. Fifty-four participants completed decision tasks using a tree-of-thought framework, with performance assessment and psychological measures. Results revealed domain-specific patterns: participants preferred human-led teams for health decisions but AI-assisted teams for data-driven tasks. Satisfaction did not increase when incorporating agents into human-expert teams, suggesting cognitive load constraints. Accountability attribution varied with perceived performance, with users taking more responsibility for failures while distributing credit for successes. These findings, grounded in cognitive load theory, advance our understanding of psychological dimensions in ad hoc teaming and provide a framework for designing domain-appropriate HAT systems that balance performance with ethical considerations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“(3) increased clinician dependence and automation bias, leading to potential deskilling and overreliance;”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [35]
In the citing paper
“A high level of functional autonomy can create an illusion of infallibility”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [35]
In the citing paper
“when a network of specialized agents collaborates to produce a diagnosis or treatment plan, the output carries a veneer of consensus that is psychologically difficult for a human clinician to challenge (35, 41).”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [35]
In the citing paper
“This asymmetric accountability, paired with automation bias, accelerates dependency and erodes critical engagement with AI-assisted decisions.”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [35]
In the citing paper
“The deployment of multi-agent AI systems in healthcare environments has altered the cognitive and professional dynamics of clinical decision-making, producing a marked increase in clinician dependence on AI outputs.”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [35]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · cited 1×
“Before recruiting participants, we conducted a power analysis to determine the required sample size for our study using G*Power [18].”
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 1×
“Additionally, our indirect measure of cognitive load should be supplemented with direct measures such as the NASA-TLX [22] or physiological indicators in subsequent research.”
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 3×
“Our investigation is grounded in cognitive load theory [27, 53], providing a framework for understanding how processing information from multiple sources affects users’ psychological experiences.”
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041 · cited 2×
“While these teams offer diverse perspectives, they require processing information from multiple sources, potentially increasing cognitive load [41] and creating domain-specific confidence patterns.”
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854 · cited 2×
“As a result, we employed the Aligned Rank Transform (ART) ANOVA, a non-parametric method [58], for a 2 × 2 × 3 factorial design to account for the non-normal data distribution (all 𝑝 0 .”
Cognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“While these agents can enhance outcomes [28], their integration introduces complex psychological challenges beyond performance metrics, raising critical questions about self-confidence, satisfaction, and accountability in team-agent collaboration effectiveness.”
Self-esteem and clarity of the self-concept.
Campbell, J. D. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.59.3.538 · Cited by 1,381 · cited 1×
“Accountability patterns aligned with self-serving bias theory [11], where users protect self-image by assuming more personal responsibility when performance is perceived as low, but distributing accountability when perceived as high.”
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Omission and commission in judgment and choice
Spranca, M., Minsk, E., & Baron, J. (1991) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(91)90011-t · Cited by 1,041 · cited 1×
“Research suggests attributing greater responsibility to agents in collaborative settings [52] may reduce users’ sense of responsibility in triadic teams.”
Designing for Motivation, Engagement and Wellbeing in Digital Experience
Peters, D., Calvo, R. A., & Ryan, R. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00797 · Cited by 888 · cited 2×
“…completing all three tasks under their assigned conditions, participants filled out two questionnaires: (1) Perceived Accountability of the System [49] and (2) Technology-based Experience of Need Satisfaction [42], both measured on a 5-point Likert scale (1 = ’Not at all true’, 5 = ’Very true’).”
Machines as teammates: A research agenda on AI in team collaboration
Seeber, I., Bittner, E., Briggs, R. O., de Vreede, T., de Vreede, G.-J., Elkins, A., Maier, R., Merz, A. B., Oeste-Reiß, S., Randrup, N., et al. (2020) · Information & Management · doi:10.1016/j.im.2019.103174 · Cited by 835
Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N., Barron, A., & Schelble, B. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 695
From Cognitive Load Theory to Collaborative Cognitive Load Theory
Kirschner, P. A., Sweller, J., Kirschner, F., & Zambrano R., J. (2018) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-018-9277-y · Cited by 590 · cited 3×
“Our investigation is grounded in cognitive load theory [27, 53], providing a framework for understanding how processing information from multiple sources affects users’ psychological experiences.”
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
(2025) · doi:10.1145/3706598 · Cited by 534
Direct manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518
Kim, S., Kang, H., Choi, S., Kim, D., Yang, M.-C., & Park, C. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671931 · Cited by 313
Large Language Models in Finance: A Survey
Li, Y., Wang, S., Ding, H., & Chen, H. (2023) · 4th ACM International Conference on AI in Finance · doi:10.1145/3604237.3626869 · Cited by 274
Zhang (2021) · doi:10.1145/3432945 · Cited by 225
Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224
Designing transparency for effective Human-AI collaboration
Vössing, M., Kühl, N., Lind, M., & Satzger, G. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10284-3 · Cited by 223
Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making
Rastogi, C., Zhang, Y., Wei, D., Varshney, K. R., Dhurandhar, A., & Tomsett, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512930 · Cited by 216
Beyond user experience: What constitutes algorithmic experiences?
Shin, D., Zhong, B., & Biocca, F. A. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.102061 · Cited by 174
Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams
Schelble, B. G., Flathmann, C., McNeese, N. J., Freeman, G., & Mallick, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492832 · Cited by 151
Ma, S., Lei, Y., Wang, X., Zheng, C., Shi, C., Yin, M., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581058 · Cited by 143
Jain, H., Padmanabhan, B., Pavlou, P. A., & Raghu, T. S. (2021) · Information Systems Research · doi:10.1287/isre.2021.1046 · Cited by 127
Cheong, I., Xia, K., Feng, K. J. K., Chen, Q. Z., & Zhang, A. X. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3659048 · Cited by 91
Caldwell, S., Sweetser, P., O’Donnell, N., Knight, M. J., Aitchison, M., Gedeon, T., Johnson, D., Brereton, M., Gallagher, M., & Conroy, D. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514257 · Cited by 76
Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making
Tolmeijer, S., Christen, M., Kandul, S., Kneer, M., & Bernstein, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517732 · Cited by 70
Designing Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65
Conversational Agents in Therapeutic Interventions for Neurodevelopmental Disorders: A Survey
Catania, F., Spitale, M., & Garzotto, F. (2022) · ACM Computing Surveys · doi:10.1145/3564269 · Cited by 65
The influence of agent reliability on trust in human-agent collaboration
Fan, X., Oh, S., McNeese, M., Yen, J., Cuevas, H., Strater, L., & Endsley, M. R. (2008) · Proceedings of the 15th European conference on Cognitive ergonomics: the ergonomics of cool interaction · doi:10.1145/1473018.1473028 · Cited by 59
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581015 · Cited by 56
Cai, Z., Park, S., Nixon, N., & Doroudi, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650868 · Cited by 56
Ma, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2403.09552 · Cited by 56
An Evaluation of Situational Autonomy for Human-AI Collaboration in a Shared Workspace Setting
Salikutluk, V., Schöpper, J., Herbert, F., Scheuermann, K., Frodl, E., Balfanz, D., Jäkel, F., & Koert, D. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642564 · Cited by 55
The Effects of Warmth and Competence Perceptions on Users' Choice of an AI System
Gilad, Z., Amir, O., & Levontin, L. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3446863 · Cited by 53
Conversational health agents: a personalized large language model-powered agent framework
Abbasian, M., Azimi, I., Rahmani, A. M., & Jain, R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf067 · Cited by 52
Rebensky, S., Carmody, K., Ficke, C., Carroll, M. B., & Bennett, W. R. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.782134 · Cited by 45
Coordinating Human-Robot Teams with Dynamic and Stochastic Task Proficiencies
Liu, R., Natarajan, M., & Gombolay, M. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3477391 · Cited by 40 · cited 1×
“This research concentrates on agents in supportive roles within controlled environments [30, 61], and extends this by investigating spontaneous collaboration between humans and agents.”
Towards Meaningfully Integrating Human-Autonomy Teaming in Applied Settings
Schelble, B. G., Flathmann, C., & McNeese, N. J. (2020) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3406499.3415077 · Cited by 39
Human-Agent Collaboration: Can an Agent be a Partner?
Bellamy, R., Andrist, S., Bickmore, T., Churchill, E. F., & Erickson, T. D. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3051138 · Cited by 35
Metrics for Human-Robot Team Design: A Teamwork Perspective on Evaluation of Human-Robot Teams
Ma, L. M., IJtsma, M., Feigh, K. M., & Pritchett, A. R. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3522581 · Cited by 34
Attig, C., Wollstadt, P., Schrills, T., Franke, T., & Wiebel-Herboth, C. B. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650853 · Cited by 33 · cited 1×
“Some researchers view agents as teammates capable of contributing to joint tasks [15], emphasising their design as dynamic entities that adapt to human needs [7, 45].”
Genter, K., Agmon, N., & Stone, P. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8057 · Cited by 32 · cited 1×
“This gap is particularly significant in ad hoc team settings, where participants collaborate without pre-coordination [20] across diverse configurations.”
Eloy, L., Spencer, C. A., Doherty, E. J., & Hirshfield, L. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579598 · Cited by 22
Developing teamwork: transitioning between stages in human-agent collaboration
Kaelin, V., Tewari, M., Benouar, S., & Lindgren, H. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1455903 · Cited by 20
The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task
Torre, I., Carrigan, E., Domijan, K., McDonnell, R., & Harte, N. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3469232 · Cited by 16 · cited 1×
“Concepts related to HAT include human-autonomy teaming [40], human-AI teams [10], human-AI collaboration [57], human-agent collaboration [8, 15], cooperative human-agent interaction [56], augmented intelligence [23], and human-AI hybrid teams [19].”
Exploring user experience and performance of a tedious task through human–agent relationship
Zhou, C., Bian, Y., Zhang, S., Zhang, Z., Wang, Y., & Liu, Y. (2023) · Scientific Reports · doi:10.1038/s41598-023-29874-5 · Cited by 13
Assessing artificial trust in human-agent teams: a conceptual model
Jorge, C. C., Tielman, M. L., & Jonker, C. M. (2022) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3514197.3549696 · Cited by 11
BABot: A Framework for the LLM-Based Chatbot Supporting Business Analytics in e-Commerce
Tran, G. T. N., Dinh, T. L., & Pham-Nguyen, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70816-9_15 · Cited by 6 · cited 1×
“Researchers have explored their application across diverse domains, including business analytics in e-commerce [38], collaborative recommender systems [26], legal advice [13], customer service [6], and collaborative problem-solving tasks [9].”
Human Satisfaction in Ad Hoc Human-Agent Teams
Abuhaimed, S., & Sen, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35894-4_15 · Cited by 2 · cited 2×
“Human-agent studies commonly investigate human perception of team and agent teammates, which includes satisfaction [2], trust [24, 47], competence [21], and performance [62].”
Research works printed but not linked: 6
- Mahyar Abbasian Iman Azimi Amir M Rahmani and Ramesh Jain. 2023. Conversational health agents: A personalized llm-powered agent framework. arXiv preprint arXiv:https://arXiv.org/abs/2310.02374 (2023). · arXiv
- 10.5555/3635637.3662846 · doi:10.5555/3635637.3662846
- Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:https://arXiv.org/abs/2303.08774 (2023). · arXiv
- Andrew Fuchs Andrea Passarella and Marco Conti. 2024. Optimizing Delegation in Collaborative Human-AI Hybrid Teams. arXiv preprint arXiv:https://arXiv.org/abs/2402.05605 (2024). · arXiv
- Shunyu Yao Dian Yu Jeffrey Zhao Izhak Shafran Tom Griffiths Yuan Cao and Karthik Narasimhan. 2024. Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems 36 (2024).
- Chong Zhang Xinyi Liu Mingyu Jin Zhongmou Zhang Lingyao Li Zhengting Wang Wenyue Hua Dong Shu Suiyuan Zhu Xiaobo Jin et al. 2024. When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environments. arXiv preprint arXiv:https://arXiv.org/abs/2407.18957 (2024). · arXiv
Cited by
Ethical issues in multi-agent AI systems for healthcare: a narrative review
Xie, Z., Wang, H., Dai, L., Wang, Z., Song, H., & Qian, J. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1792627 · Cited by 11
From Reactive AI to Agentic Systems: A Review of Autonomous medical AI Agents in Healthcare
Alhazba, S. A. S., Ali, M. H., Alawi, D. A., Al‐Betar, M. A., & Elaziz, M. A. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10655-y · Cited by 6
Alignment–Process–Outcome: Rethinking How AIs and Humans Collaborate
Li, H., Zhu, A., & Narechania, A. A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799032 · Cited by 3
“Collab-oration is often discussed separately across different participant configurations [16, 39, 44, 47].”
Friend, Foe, or Bot? Exploring Intergroup Dynamics in Hybrid Human-Bot Teams
Zhunis, A., Pan, Z., Zhang, Y., & Ma, X. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791939
“Such evaluation is inevitable, as integrating AI redis-tributes accountability within the team [120], complicating how errors are attributed [100].”
Theories of Team Formation for Human-Artificial Intelligence Collaboration
AbuAlfateh, M., Messaadia, M., & Ali, M. (2025) · International Conference on Decision Aid Sciences and Applications (DASA) · doi:10.1109/dasa68193.2025.11499103
“The study AM1 [19] is based on cognitive load theory, which offers a framework for comprehending how users' psychological experiences are impacted by processing information from various sources.”
Metadata
- Authors
- Yousefi, M., Shahi, A., Sharifi, M., J Jorge Romera, A., Hoermann, S., & Piumsomboon, T.
- Affiliations
- University of Canterbury (NZ)
- Unitec Institute of Technology (NZ)
- New Zealand Institute for Bioeconomy Science Limited, Lincoln, Canterbury, New Zealand
- New Zealand Institute for Bioeconomy Science Limited, Christchurch, Canterbury, New Zealand
- ORCID
- Venue
- Proceedings of the 27th International Conference on Multimodal Interaction
- Publisher
- ACM
- Published
- 2025-10-12
- Pages
- 395-404
- OpenAlex
- W4415065172
- Cited by
- 7
- References
- 50
- Citations by year
- 2026: 6 · 2025: 1
- FWCI
- 11.03
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion, cc-by)
- Funders
- This work was supported by the New Zealand Institute for Bioeconomy Science Limited through the Strategic Science Investment Fund (FY24 SSIF DIGI: Integral Design of Farm Digital Systems)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Team Dynamics and Performance
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- human-AI collaboration, team dynamics, confidence, satisfaction, accountability, human-AI teaming
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.