CoChat

A Multifaceted Vision of the Human-AI Collaboration: A Comprehensive Review

Open access
Puerta-Beldarrain, Maite, Gómez-Carmona, Oihane, Sánchez-Corcuera, Rubén, Casado-Mansilla, Diego, López-de-Ipiña, Diego, Chen, Liming · 2025 · IEEE Access

The DOI matches its Crossref record; 338 of the 338 references it cites were found in a registry or an index.

Abstract

Human-AI collaboration has evolved into a complex, multidimensional paradigm shaped by research in various domains. Key areas such as human-in-the-loop systems, Interactive Machine Learning (IML), Hybrid Intelligence, and Human-Agent Interaction have significantly contributed to this development. However, these fields often lack cohesion, underscoring the need for a cohesive perspective to advance. This work addresses this gap by integrating insights from diverse aspects of collaboration to present a holistic approach to fostering effective and adaptive interactions between humans and artificial agents. It emphasizes empowering end-users with greater control and involvement in decision-making processes, thereby enhancing both the levels of interactivity and adaptability within intelligent systems. Moving beyond a focus on AI training techniques, this paper presents a broader perspective on incorporating human input into AI decision-making and learning processes, highlighting the importance of flexibility in systems and user engagement. The manuscript proposes a framework encompassing five levels of human integration and examines their relationship with core collaboration aspects, including the system purpose, participant expertise, and system proactivity. By synthesizing current knowledge on human-AI collaboration and outlining essential design principles, this work aims to advance the field and foster interdisciplinary collaboration among researchers, practitioners, and designers.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2025.3536095

Cites

338 of 338 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 338 references

Research works printed but not linked: 24

  1. [35] T. Miletić, ''Human-artificial intelligence symbiosis: The possibility of moral augmentation,'' Ph.D. dissertation, Dept. Philosophy, Univ. Rijeka. Fac. Humanities Social Sci., Rijeka, Croatia, 2021. -
  2. [75] A. Holzinger, ''On knowledge discovery and interactive intelligent visualization of biomedical data,'' in Proc. Int. Conf. Data Technol. Appl. DATA , 2012, pp. 5-16. -
  3. [80] L. McCallum and R. Fiebrink, ''Supporting feature engineering in enduser machine learning,'' in Proc. CHI Workshop Emerg. Perspect. Hum.Centered Mach. Learn. Glasgow, U.K., May 2019. -
  4. [88] A. Tegen, P. Davidsson, and J. A. Persson, The Effects of Reluctant and Fallible Users in Interactive Online Machine Learning . Malmö, Sweden: Malmö Universitet, 2022, p. 209. -
  5. [111] K. Konyushkova, R. Sznitman, and P. Fua, ''Learning active learning from data,'' in Proc. Adv. Neural Inf. Process. Syst. , vol. 30, Jan. 2017, pp. 4225-4235. -
  6. [112] O. Saadallah and Z. Rouissi, ''Interpretable meta-active learning for regression ensemble learning,'' in Proc. IAL@ PKDD/ECML , 2023, pp. 1-15. -
  7. [124] D. Ernst and A. Louette, Introduction to Reinforcement Learning , S. Feuerriegel, J. Hartmann, C. Janiesch, and P. Zschech, Eds., 2024, pp. 111-126. -
  8. [125] P. Winder, Reinforcement Learning . Sebastopol, CA, USA: O'Reilly Media, 2020. -
  9. [142] S. J. Russell, Artificial Intelligence a Modern Approach . London, U.K.: Pearson, 2010. -
  10. [143] A. Y. Ng and M. I. Jordan, ''PEGASUS: A policy search method for large MDPs and POMDPs,'' in Proc. 16th Conf. Uncertainty Artif. Intell. , Jun. 2000, pp. 406-415. -
  11. [151] J. Schulman, B. Zoph, C. Kim, J. Hilton, J. Menick, J. Weng, J. F. C. Uribe, L. Fedus, L. Metz, and M. Pokorny, ''ChatGPT: Optimizing language models for dialogue,'' OpenAI blog , vol. 2, no. 4, 2022. -
  12. [167] J. Lehtinen, J. Munkberg, J. Hasselgren, S. Laine, T. Karras, M. Aittala, and T. Aila, ''Noise2Noise: Learning image restoration without clean data,'' in Proc. Int. Conf. Mach. Learn. , Jan. 2018, pp. 4620-4631. -
  13. [188] Q. Zhang, Y. Kang, and R. Roth, ''The ethics of AI-generated maps: DALL-E 2 and AI's implications for cartography (short paper),'' in Proc. 12th Int. Conf. Geographic Inf. Sci. (GISci.) , 2023, pp. 93:1-93:6. -
  14. [210] M. Zakershahrak, ''Towards human-machine symbiosis: Design for effective AI facilitation,'' Ph.D. dissertation, Arizona State Univ., Tempe, AZ, USA, 2021. -
  15. [232] D. Yang, Y. Zhou, Z. Zhang, T. J.-J. Li, and R. LC, ''AI as an active writer: Interaction strategies with generated text in human-AI collaborative fiction writing,'' in Proc. Joint ACM IUI Workshops , vol. 10, 2022, pp. 1-11. -
  16. [254] C. Cao, Y. Fu, S. Xu, R. Zhang, and S. Li, ''Enhancing human-AI collaboration through logic-guided reasoning,'' in Proc. 12th Int. Conf. Learn. Represent. , 2024. -
  17. [255] O. Gómez-Carmona, J. García-Zubia, and D. Diego Casado-Mansilla, ''Promoting the perception of emerging technologies in work environments through edge computing and hybrid intelligence,'' Ph.D. dissertation, Univ. Deusto, Bilbao, Spain, 2021. -
  18. [275] J. Heinrich, M. Lanctot, and D. Silver, ''Fictitious self-play in extensiveform games,'' in Proc. Int. Conf. Mach. Learn. , Jul. 2015, pp. 805-813. -
  19. [284] H. Song, A. Abdolmaleki, J. T. Springenberg, A. Clark, H. Soyer, J. W. Rae, S. Noury, A. Ahuja, S. Liu, D. Tirumala, N. Heess, D. Belov, M. Riedmiller, and M. Botvinick, ''V-MPO: On-policy maximum a posteriori policy optimization for discrete and continuous control,'' in Proc. Int. Conf. Learn. Represent. , Jan. 2019. -
  20. [287] C. Wiethof and E. A. Bittner, ''Toward a hybrid intelligence system in customer service: Collaborative learning of human and AI,'' ECIS, Research Papers 66, 2022. [Online]. Available: https://aisel.aisnet.org/ecis2022\_rp/66 -
  21. [293] S. Nikolaidis, ''Mathematical models of adaptation in human-robot collaboration,'' Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, USA, 2017. -
  22. [299] L. Paripati, V . R. Hajari, N. Narukulla, N. Prasad, J. Shah, and A. Agarwal, ''AI algorithms for personalization: Recommender systems, predictive analytics, and beyond,'' Darpan Int. Res. Anal. , vol. 12, no. 2, pp. 51-63, 2024. -
  23. [317] N. D. Scharowski, ''Trust in artificial intelligence: Understanding and calibrating trust and distrust in the human-AI interaction,'' Ph.D. dissertation, Univ. Basel, Basel, Switzerland, 2024. -
  24. [344] K. Van Den Bosch and A. Bronkhorst, Human-AI Cooperation to Benefit Military Decision Making . Brussels, Belgium: NATO, 2018. -

Cited by

See all 86

Metadata

Authors
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L.
Affiliations
  • Universidad de Deusto (ES)
  • Deustotech, University of Deusto, Bilbao, Spain
  • Faculty of Engineering, University of Deusto, Bilbao, Spain
  • Dalian University of Technology (CN)
Venue
IEEE Access
Published
2025
Volume
13
Pages
29375-29405
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4406947263
Cited by
73
References
329
Citations by year
2026: 50 · 2025: 23
FWCI
80.27
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DeustoTeka (submittedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Basque Government, which recognizes Human-centric Computing for Smart Sustainable Communities and Environments (IT1582-22)
  • excellent research group under the Basque university system. Besides, we acknowledge the Ministerio de Ciencia e Innovación for Internet of People (PID2020-119682RB-I00)
  • European Commission through the Wearables and drones for City Socio-Environmental Observations and Behavioral Change (101037648)
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
human-AI collaboration, human-in-the-loop systems, interactive machine learning, hybrid intelligence, human-agent interaction, end-user control, user engagement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.