Human-AI teaming: leveraging transactive memory and speaking up for enhanced team effectiveness
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In this prospective observational study, we investigate the role of transactive memory and speaking up in human-AI teams comprising 180 intensive care (ICU) physicians and nurses working with AI in a simulated clinical environment. Our findings indicate that interactions with AI agents differ significantly from human interactions, as accessing information from AI agents is positively linked to a team’s ability to generate novel hypotheses and demonstrate speaking-up behavior, but only in higher-performing teams. Conversely, accessing information from human team members is negatively associated with these aspects, regardless of team performance. This study is a valuable contribution to the expanding field of research on human-AI teams and team science in general, as it emphasizes the necessity of incorporating AI agents as knowledge sources in a team’s transactive memory system, as well as highlighting their role as catalysts for speaking up. Practical implications include suggestions for the design of future AI systems and human-AI team training in healthcare and beyond.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · cited 1×
“Clinical performance assessment In a Delphi-like consensus-building process (Hasson et al., 2000), three authors (BPK, HD, CG) all specialized in intensive care medicine with more than 10 years of clinical experience developed a casespecific clinical performance measure including 29–34 items per scenario.”
MethodHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“, finding the right balance between trusting AI too much or too little, with the former posing more serious safety concerns due to the risk of overreliance (Parasuraman and Riley, 1997).”
BackgroundKaplan, A., & Haenlein, M. (2019) · Business Horizons · doi:10.1016/j.bushor.2018.08.004 · Cited by 3,140 · cited 2×
“AI agents are different from other technologies insofar as they can learn from vast amounts of data and possess the agency to perform tasks that were previously performed by human team members (Kaplan and Haenlein, 2019).”
BackgroundHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“Research on trust in AI has thus far focused mainly on the human-AI dyad (Glikson and Woolley, 2020).”
BackgroundEnhancing the Effectiveness of Work Groups and Teams
Kozlowski, S. W. J., & Ilgen, D. R. (2006) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2006.00030.x · Cited by 2,623
Teams in Organizations: From Input-Process-Output Models to IMOI Models
Ilgen, D. R., Hollenbeck, J. R., Johnson, M., & Jundt, D. (2005) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070250 · Cited by 2,273
Foundation models for generalist medical artificial intelligence
Moor, M., Banerjee, O., Abad, Z. S. H., Krumholz, H. M., Leskovec, J., Topol, E. J., & Rajpurkar, P. (2023) · Nature · doi:10.1038/s41586-023-05881-4 · Cited by 2,028 · cited 3×
“Accessing knowledge from AI agents might provide a way out of this vicious circle because AI agents are not affected by social group dynamics and—based on their immense data storage and analytical capabilities (Moor et al., 2023)—are likely to hold unique knowledge other team members do not possess.”
BackgroundInfluentialStasser, G., & Titus, W. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.48.6.1467 · Cited by 1,850 · cited 1×
“, known only to individual group members) knowledge, which gets further strengthened via confirmation by others in some kind of a vicious circle (Stasser and Titus, 1985; Lewis and Herndon, 2011; Boos et al., 2013).”
BackgroundBenefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Edmondson, A. C. (2003) · Journal of Management Studies · doi:10.1111/1467-6486.00386 · Cited by 1,635
Observing Interaction: An Introduction to Sequential Analysis
Bakeman, R., & Gottman, J. M. (1997) · doi:10.1017/cbo9780511527685 · Cited by 1,439
Information sharing and team performance: A meta-analysis
Mesmer-Magnus, J. R., & DeChurch, L. A. (2009) · Journal of Applied Psychology · doi:10.1037/a0013773 · Cited by 1,273 · cited 1×
“, finding the correct diagnosis, depend on a team’s ability to choose the most viable option amongst a diverse range of hypotheses (Mesmer-Magnus and DeChurch, 2009; Kämmer et al., 2017).”
BackgroundDo no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266
Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N., Barron, A., & Schelble, B. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 695
Durán, J. M., & Jongsma, K. R. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106820 · Cited by 446
AI in medicine must be explainable
Kundu, S. (2021) · Nature Medicine · doi:10.1038/s41591-021-01461-z · Cited by 318
Solving the Explainable AI Conundrum by Bridging Clinicians’ Needs and Developers’ Goals
Bienefeld, N., Boss, J. M., Lüthy, R., Brodbeck, D., Azzati, J., Blaser, M., Willms, J., & Keller, E. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00837-4 · Cited by 159
Self-citationSpeaking up to prevent harm: A systematic review of the safety voice literature
Noort, M. C., Reader, T. W., & Gillespie, A. (2019) · Safety Science · doi:10.1016/j.ssci.2019.04.039 · Cited by 141
Knop, M., Weber, S., Mueller, M., & Niehaves, B. (2022) · JMIR Human Factors · doi:10.2196/28639 · Cited by 103
Cross-Disciplinary Care: A Systematic Review on Teamwork Processes in Health Care
Dinh, J. V., Traylor, A. M., Kilcullen, M. P., Perez, J. A., Schweissing, E. J., Venkatesh, A., & Salas, E. (2020) · Small Group Research · doi:10.1177/1046496419872002 · Cited by 73
Cited by
Lovett, N. (2026) · Human Resource Development Review · doi:10.1177/15344843261470602 · Cited by 9
From testbeds to high-stakes work: a review of human-AI teaming domains and teaming factors
Kargarnovin, S., Hernandez, C. I., Reiners, D., Cruz-Neira, C., Bochenek, G., & Karwowski, W. (2026) · Frontiers in Robotics and AI · doi:10.3389/frobt.2026.1733942 · Cited by 2
“In contrast, in a simulated intensive care setting, adding an AI agent changed interaction patterns and performance, highlighting that even a useful AI can reshape coordination in ways that matter for outcomes (Bienefeld et al., 2023).”
Akgun, M., & Toker, S. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790980 · Cited by 2
Metadata
- Authors
- Bienefeld, N., Kolbe, M., Camen, G., Huser, D., & Buehler, P. K.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-08-04
- Volume
- 14
- Pages
- 1208019-1208019
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W4385580499
- Cited by
- 39
- References
- 21
- FWCI
- 11.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.