Fostering Collective Intelligence in Human–AI Collaboration: Laying the Groundwork for COHUMAIN
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) powered machines are increasingly mediating our work and many of our managerial, economic, and cultural interactions. While technology enhances individual capability in many ways, how do we know that the sociotechnical system as a whole, consisting of a complex web of hundreds of human–machine interactions, is exhibiting collective intelligence? Research on human–machine interactions has been conducted within different disciplinary silos, resulting in social science models that underestimate technology and vice versa. Bringing together these different perspectives and methods at this juncture is critical. To truly advance our understanding of this important and quickly evolving area, we need vehicles to help research connect across disciplinary boundaries. This paper advocates for establishing an interdisciplinary research domain—Collective Human‐Machine Intelligence (COHUMAIN). It outlines a research agenda for a holistic approach to designing and developing the dynamics of sociotechnical systems. In illustrating the kind of approach, we envision in this domain, we describe recent work on a sociocognitive architecture, the transactive systems model of collective intelligence, that articulates the critical processes underlying the emergence and maintenance of collective intelligence and extend it to human–AI systems. We connect this with synergistic work on a compatible cognitive architecture, instance‐based learning theory and apply it to the design of AI agents that collaborate with humans. We present this work as a call to researchers working on related questions to not only engage with our proposal but also develop their own sociocognitive architectures and unlock the real potential of human–machine intelligence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Does the chimpanzee have a theory of mind?
Premack, D., & Woodruff, G. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00076512 · Cited by 8,743
Does the autistic child have a “theory of mind” ?
Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985) · Cognition · doi:10.1016/0010-0277(85)90022-8 · Cited by 8,599
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 3×
“…of processes through which collaborator’s knowledge and skills (i.e., cognitive resources) and their beliefs about who knows what (i.e., metamemory) are dynamically updated to facilitate the allocation and retrieval of knowledge to and from the most appropriate collaborator (Wegner, 1987, 1995).”
Social cognitive theory of self-regulation
Bandura, A. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90022-l · Cited by 6,875 · cited 1×
“Goals are typically associated with motivational needs, and continuously fulfilling them sustains progress toward valued distal goals (Bandura, 1991).”
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 9×
“…only influence initial impressions; even users who begin with a strong positive impression of agents typically exhibit a loss of trust, particularly when an agent’s capabilities were not clearly presented, and the subsequent performance falls below users’ expectations (Glikson & Woolley, 2020).”
InfluentialSelf-citationTransactive Memory: A Contemporary Analysis of the Group Mind
Wegner, D. M. (1987) · Theories of Group Behavior · doi:10.1007/978-1-4612-4634-3_9 · Cited by 2,700 · cited 2×
“…of processes through which collaborator’s knowledge and skills (i.e., cognitive resources) and their beliefs about who knows what (i.e., metamemory) are dynamically updated to facilitate the allocation and retrieval of knowledge to and from the most appropriate collaborator (Wegner, 1987, 1995).”
van Knippenberg, D., & Schippers, M. C. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085546 · Cited by 2,200
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“…users’ reactions, at least initially, very little is known about how human perceptions of AI benev-olence develop or the degree to which human users perceive that their motives are aligned, and the agent is acting in their best interests and, possibly, even cares about them (Hancock et al., 2011).”
Measurement of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049499 · Cited by 2,039 · cited 1×
“…has focused primarily on individual cognition and cognitive models of situation awareness to understand and emulate human behavior by representing the cognitive steps by which a task is performed (Adams, Tenney, & Pew, 1995; Bolstad et al., 2010; Endsley, 1995a, 1995b, 2015; Wickens, 2008, 2015).”
Load Theory of Selective Attention and Cognitive Control
Lavie, N., Hirst, A., de Fockert, J. W., & Viding, E. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.3.339 · Cited by 1,812 · cited 1×
“A person’s meta-attention provides globalized cognitive control to help them expertly navigate situations involving choice among multiple tasks (Lavie, Hirst, de Fockert, & Viding, 2004; P. H. Miller & Bigi, 1979) for minimizing switching costs.”
Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips
Sparrow, B., Liu, J., & Wegner, D. M. (2011) · Science · doi:10.1126/science.1207745 · Cited by 1,762 · cited 1×
“Research demonstrates that when individuals expect to have future access to information they found online, they have lower recall rates for the information itself and enhanced recall instead of where on the internet to access it (Sparrow, Liu, & Wegner, 2011).”
YOU CAN'T PLAY 20 QUESTIONS WITH NATURE AND WIN: PROJECTIVE COMMENTS ON THE PAPERS OF THIS SYMPOSIUM
Newell, A. (1973) · Visual Information Processing · doi:10.1016/b978-0-12-170150-5.50012-3 · Cited by 820 · cited 1×
“Advocacy for a systems-level approach dates back to Newell (1973), who argued for the value of systems-level research as a vehicle for integration in cognitive science and AI, claiming “You can’t play 20 questions with nature and win.””
Universal intelligence: a definition of machine intelligence
Legg, S., & Hutter, M. (2007) · Minds and Machines · doi:10.1007/s11023-007-9079-x · Cited by 803
Cognitive architectures: Research issues and challenges
Langley, P., Laird, J. E., & Rogers, S. (2009) · Cognitive Systems Research · doi:10.1016/j.cogsys.2006.07.004 · Cited by 728
Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N., Barron, A., & Schelble, B. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 695
Meta-Reasoning: Monitoring and Control of Thinking and Reasoning
Ackerman, R., & Thompson, V. A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.004 · Cited by 400
Teaming With a Synthetic Teammate: Insights into Human-Autonomy Teaming
McNeese, N. J., Demir, M., Cooke, N. J., & Myers, C. (2018) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720817743223 · Cited by 380
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (2017) · Situational Awareness · doi:10.4324/9781315087924-3 · Cited by 348
Adaptive trust calibration for human-AI collaboration
Okamura, K., & Yamada, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229132 · Cited by 239 · cited 1×
“The value of adaptively calibrating and managing human–AI’s dyadic trust dynamics has been explored to some degree in autonomous car driving and drone flying (Akash et al., 2020; Okamura & Yamada, 2020).”
On the Utility of Learning about Humans for Human-AI Coordination
Carroll, M., Shah, R., Ho, M. K., Griffiths, T. L., Seshia, S. A., Abbeel, P., & Dragan, A. (2019) · arXiv · doi:10.48550/arxiv.1910.05789 · Cited by 168 · cited 1×
“…degree to which they need to oversee the autonomous agents (Boardman & Butcher, 2019), and autonomous agents also need to maintain a model of the state of their human teammates to perform their tasks (Barnes & Van Dyne, 2009; Carroll et al., 2019; Chakraborti, Kambhampati, Scheutz, & Zhang, 2017).”
Four Principles of Explainable Artificial Intelligence
Phillips, P. J., Hahn, C. A., Fontana, P. C., Broniatowski, D. A., & Przybocki, M. A. (2020) · doi:10.6028/nist.ir.8312-draft · Cited by 136
The science of teams in the military: Contributions from over 60 years of research.
Goodwin, G. F., Blacksmith, N., & Coats, M. R. (2018) · American Psychologist · doi:10.1037/amp0000259 · Cited by 115 · cited 1×
“Extant research on teamwork shows that members can anticipate and predict the needs of others when they have shared mental models, which is important for supporting mutual coordination (Goodwin, Blacksmith, & Coats, 2018) and underscores the need for this capability development in HATs.”
An Active Inference Model of Collective Intelligence
Kaufmann, R., Gupta, P., & Taylor, J. (2021) · Entropy · doi:10.3390/e23070830 · Cited by 35 · cited 1×
“A recent information-theoretic approach that models CI from first principles finds that agent features consistent with ToM and goal alignment are necessary conditions for multiple agents to optimize their joint outcomes (Kaufmann, Gupta, & Taylor, 2021).”
Self-citation
Cited by
Rawas, S. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00118-3 · Cited by 119
“The future of AI lies in collaborative intelligence, where humans and AI systems work together synergistically to achieve outcomes that neither could achieve alone [34].”
Toward a science of human–AI teaming for decision making: a complementarity framework
Gonzalez, C., Donahue, K., Goldstein, D. G., Heidari, H., Jalali, M. S., Schelble, B., Singh, A., & Woolley, A. W. (2026) · PNAS Nexus · doi:10.1093/pnasnexus/pgag030 · Cited by 33
“The key is not simply combining human and machine outputs, but also creating systems and workflows that support adaptive, transparent, and trust-calibrated human – AI teamwork (11, 12).”
Akgun, M., & Toker, S. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790980 · Cited by 2
Metadata
- Authors
- Gupta, P., Nguyen, T. N., Gonzalez, C., & Woolley, A. W.
- Venue
- Topics in Cognitive Science
- Publisher
- Wiley
- Published
- 2023-06-29
- Volume
- 17
- Issue
- 2
- Pages
- 189-216
- ISSN
- 1756-8757 (ISSN-L)
- 1756-8765
- OpenAlex
- W4382600585
- Cited by
- 78
- References
- 26
- FWCI
- 22.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.