Investigating the Effects of Perceived Teammate Artificiality on Human Performance and Cognition
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Teammates powered by artificial intelligence (AI) are becoming more prevalent and capable in their abilities as a teammate. While these teammates have great potential in improving team performance, empirical work that explores the impacts of these teammates on the humans they work with is still in its infancy. Thus, this study explores how the inclusion of AI teammates impacts both the performative abilities of human-AI teams in addition to the perceptions those humans form. The current study found that participants perceiving their third teammate as artificial performed worse than those perceiving them as human. Furthermore, these performance differences were significantly moderated by the task’s difficulty, with participants in the AI teammate condition significantly outperforming participants perceiving a human teammate in the highest difficulty task, which diverges from previous human-AI teaming literature. Alternatively, no significant effect of perceived teammate artificiality was found on shared mental model similarity. However, it did significantly affect participants’ levels of perceived team cognition. Individual performance on medium difficulty maps also mediated the effect of perceived teammate artificiality on perceived team cognition. These results further build on the current understanding of how AI teammates impact perceptions of individual human teammates and how those perceptions subsequently impact their objective performance, which is critical in building more effective AI teammates to incorporate alongside humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Temporally Based Framework and Taxonomy of Team Processes
Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001) · The Academy of Management Review · doi:10.2307/259182 · Cited by 3,659
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons
Bradley, R. A., & Terry, M. E. (1952) · Biometrika · doi:10.2307/2334029 · Cited by 2,412 · cited 1×
“Mental models were elicited from participants using paired sentence comparison (Bradley & Terry, 1952; Mathieu et al., 2000).”
MethodDeterminants of Coordination Modes within Organizations
Ven, A. H. V. D., Delbecq, A. L., & Koenig, R. (1976) · American Sociological Review · doi:10.2307/2094477 · Cited by 1,979 · cited 1×
“…developed to ensure high levels of teammate interdependence by presenting a shared goal to each team member to accomplish using the implicit non-verbal communication necessary to carry out a coordinated strategy and develop effective shared mental models (Saavedra et al., 1993; Ven et al., 1976).”
BackgroundHuman-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 1×
“This research has highlighted that successfully joining humans and AI together in teams is not holistically dependent on AIs technical ability but also on a myriad of human factors that impact human-AI collaboration in human-AI teams (O ’ Neill et al., 2020; Shneiderman, 2020).”
BackgroundRANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434
On big data, artificial intelligence and smart cities
Allam, Z., & Dhunny, Z. A. (2019) · Cities · doi:10.1016/j.cities.2019.01.032 · Cited by 1,178
Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N., Barron, A., & Schelble, B. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 695
Self-citationChaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572 · cited 1×
“…attention as a major developmental challenge for AI (Kaminka, 2013; Van Riemsdijk et al., 2015) as the advancements in AI technology are beginning to place them in social situations (like teaming) more than ever before, especially as virtual agents (Chaves & Gerosa, 2021; Kepuska & Bohouta, 2018).”
BackgroundStephanidis, C., Salvendy, G., Antona, M., Chen, J. Y. C., Dong, J., Duffy, V. G., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., et al. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1619259 · Cited by 524 · cited 3×
“The potential for taking advantage of these strengths has made human-AI teaming and collaboration a significant emerging research requirement in HCI (Stephanidis et al., 2019).”
BackgroundInfluential
Cited by
Zhang, R., Duan, W., Flathmann, C., McNeese, N., Freeman, G., & Williams, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610072 · Cited by 134
Self-citationCyber-Creativity: A Decalogue of Research Challenges
Corazza, G. E., Agnoli, S., Jorge Artigau, A., Beghetto, R. A., Bonnardel, N., Coletto, I., Faiella, A., Gerardini, K., Gilhooly, K., Glăveanu, V. P., et al. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13080103 · Cited by 14
From testbeds to high-stakes work: a review of human-AI teaming domains and teaming factors
Kargarnovin, S., Hernandez, C. I., Reiners, D., Cruz-Neira, C., Bochenek, G., & Karwowski, W. (2026) · Frontiers in Robotics and AI · doi:10.3389/frobt.2026.1733942 · Cited by 2
“…while leaving trust in the human teammate unaffected, and may even shift emotions and skepticism toward the human in unexpected ways, further confirming that ethical behavior influences the social fabric of hybrid teams rather than only judgments about the AI itself (Schelble et al., 2023a).”
Metadata
- Authors
- Schelble, B. G., Flathmann, C., McNeese, N. J., O’Neill, T., Pak, R., & Namara, M.
- Venue
- International Journal of Human–Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2022-07-01
- Volume
- 39
- Issue
- 13
- Pages
- 2686-2701
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W4283765282
- Cited by
- 42
- References
- 18
- FWCI
- 5.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating the Effects of Perceived Teammate Artificiality on Human Performance and Cognition. https://app.cochat.ai/papers/10.1080/10447318.2022.2085191
- The paper
- Schelble, B. G., Flathmann, C., McNeese, N. J., O’Neill, T., Pak, R., & Namara, M. (2023). Investigating the Effects of Perceived Teammate Artificiality on Human Performance and Cognition. International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2022.2085191
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.