A Multifaceted Vision of the Human-AI Collaboration: A Comprehensive Review
Open accessThe DOI matches its Crossref record; 338 of the 338 references it cites were found in a registry or an index.
Abstract
Human-AI collaboration has evolved into a complex, multidimensional paradigm shaped by research in various domains. Key areas such as human-in-the-loop systems, Interactive Machine Learning (IML), Hybrid Intelligence, and Human-Agent Interaction have significantly contributed to this development. However, these fields often lack cohesion, underscoring the need for a cohesive perspective to advance. This work addresses this gap by integrating insights from diverse aspects of collaboration to present a holistic approach to fostering effective and adaptive interactions between humans and artificial agents. It emphasizes empowering end-users with greater control and involvement in decision-making processes, thereby enhancing both the levels of interactivity and adaptability within intelligent systems. Moving beyond a focus on AI training techniques, this paper presents a broader perspective on incorporating human input into AI decision-making and learning processes, highlighting the importance of flexibility in systems and user engagement. The manuscript proposes a framework encompassing five levels of human integration and examines their relationship with core collaboration aspects, including the system purpose, participant expertise, and system proactivity. By synthesizing current knowledge on human-AI collaboration and outlining essential design principles, this work aims to advance the field and foster interdisciplinary collaboration among researchers, practitioners, and designers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The Human-AI framework offers a comprehensive view of this evolution by emphasizing five collaborative principles: bidirectional learning, explainability, co-validation, shared goals, and mutual augmentation [15].”
From Redefining the Programmer: Human-AI Collaboration, LLMs, and Security in Modern Software Engineering (2025) · cites this paper as [15]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Items 201–338 of 338
Yeh, C., Ramos, G., Ng, R., Huntington, A., & Banks, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.08855 · Cited by 57 · cited 1×
“Another example is the work created by Yeh et al. [203], which developed an AI-enhanced writing tool that allows users to exercise greater agency and personalization in the writing process.”
Wyrwoll, C. (2014) · Springer eBooks · doi:10.1007/978-3-658-06984-1_2 · Cited by 56
Where is the Human?: Bridging the Gap Between AI and HCI
Inkpen, K., Chancellor, S., De Choudhury, M., Veale, M., & Baumer, E. P. S. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3299002 · Cited by 54 · cited 1×
“To do so, Inkpen et al. [87] examined how to integrate artificial and human intelligence in decision-making better, addressing the different human roles and relationships in human-AI systems.”
Learning Zero-Shot Cooperation with Humans, Assuming Humans Are BiasedPreprint
Yu, C., Gao, J., Liu, W., Xu, B., Tang, H., Yang, J., Wang, Y., & Wu, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.01605 · Cited by 53 · cited 1×
“Moreover, Yu et al. employed self-play strategies to mitigate human biases in decision-making [270].”
Visual Analytics for Human-Centered Machine Learning
Andrienko, N. V., Andrienko, G., Adilova, L., Wrobel, S., & Rhyne, T.-M. (2022) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2021.3130314 · Cited by 52 · cited 1×
“For that, visual exploratory tools [55], [57], [58], [59], data analysis and interactive exploration approaches have been used to improve ML models [60], [61].”
Are AI language models such as ChatGPT ready to improve the care of individuals with epilepsy?
Boßelmann, C. M., Leu, C., & Lal, D. (2023) · Epilepsia · doi:10.1111/epi.17570 · Cited by 52 · cited 1×
“By combining these advancements, models have made significant progress in AIGC tasks and have been adopted in various industries, including health [175], [176], [177], [178], art [179], and education [180].”
A hybrid recommender system for health supplement e-commerce based on customer data implicit ratings
Keikhosrokiani, P., & Fye, G. M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17321-6 · Cited by 52 · cited 1×
“Various recommendation systems are utilized in this group, with AL [197] and RL [204] being the most common techniques.”
Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers
Ippolito, D., Yuan, A., Coenen, A., & Burnam, S. (2022) · arXiv · doi:10.48550/arxiv.2211.05030 · Cited by 52
V-MPO: On-Policy Maximum a Posteriori Policy Optimization for Discrete and Continuous Control
Song, H., Abdolmaleki, A., Springenberg, J. T., Clark, A., Soyer, H., Rae, J. W., Noury, S., Ahuja, A., Liu, S., Tirumala, D., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12238 · Cited by 50 · cited 1×
“They utilized a V-MPO [276], an RL algorithm featuring a ResNet plus LSTM architecture, to facilitate this coordination.”
Six challenges for human-AI Co-learning
van den Bosch, K., Schoonderwoerd, T., Blankendaal, R., & Neerincx, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22341-0_45 · Cited by 50 · cited 1×
“These capabilities enable AI to identify complex patterns in large datasets and process information at speeds that far exceed human abilities, all while remaining unaffected by factors such as stress, motivation, or fatigue [22].”
Editable User Profiles for Controllable Text Recommendations
Mysore, S., Jasim, M., McCallum, A., & Zamani, H. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591677 · Cited by 49 · cited 1×
“Personalization has been extensively explored in the development of recommender systems [302], [303], [304].”
WavJourney: Compositional Audio Creation with Large Language ModelsPreprint
Liu, X.-B., Zhu, Z., Liu, H., et al. (2023) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.48550/arxiv.2307.14335 · Cited by 48 · cited 1×
“For instance, WavJourney, developed by Liu et al., creates structured scripts for audio storytelling from text descriptions of auditory scenes [220].”
Zhang, S., Wang, X., Zhang, W., Chen, Y., Gao, L., Wang, D., Zhang, W., Wang, X., & Wen, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.08811 · Cited by 48 · cited 1×
“Another example of human-AI collaboration within the Overcooked framework is the work by Zhang et al. [271], which developed a chat system enabling users and AI to discuss strategies for resolving the game.”
Krak, I. V., Barmak, O., & Manziuk, E. (2020) · Computational Intelligence · doi:10.1111/coin.12289 · Cited by 47 · cited 1×
“For that, visual exploratory tools [55], [57], [58], [59], data analysis and interactive exploration approaches have been used to improve ML models [60], [61].”
Kopp, S., & Krämer, N. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.580955 · Cited by 47 · cited 1×
“Similarly, Koop et al. apply principles of human-to-human communication as the foundation for developing effective human-AI interactions [341].”
Factors that Influence the Adoption of Human-AI Collaboration in Clinical Decision-Making
Hemmer, P., Schemmer, M., Riefle, L., Rosellen, N., Vössing, M., & Kühl, N. (2022) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.48550/arxiv.2204.09082 · Cited by 46 · cited 1×
“( : No; : Yes). capabilities of AI in healthcare, thereby fostering greater acceptance and integration of AI in this domain [237].”
Human-in-the-Loop Issue in Context of the Cyber-Physical Systems
Jirgl, M., Bradáč, Z., & Fiedler, P. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.07.158 · Cited by 45 · cited 2×
“• Human-Computer Interaction : Seeks to optimize the design of intuitive and efficient interaction methods between users and autonomous systems [37], [38].”
Teaming Up with an AI: Exploring Human–AI Collaboration in a Writing Scenario with ChatGPT
Luther, T., Kimmerle, J., & Cress, U. (2024) · AI · doi:10.3390/ai5030065 · Cited by 45 · cited 1×
“Although these methods have recently gained traction and transformed the way many tasks are performed, particularly in education [239], [240], [241], they also hold potential influence over the academic peer review process [242].”
Learning how to Active Learn: A Deep Reinforcement Learning ApproachPreprint
Fang, M., Li, Y., & Cohn, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02383 · Cited by 45 · cited 1×
“For example, Fang et al. described the active learning scenario as a Markov decision process by considering a state as an unlabeled sample and the action as whether a label is required [113].”
Copyright Infringement in AI-Generated ArtworksPreprint
Gillotte, J. (2020) · SSRN Electronic Journal · Cited by 45
Wang, Y., Zhu, J., Liu, R., & Jiang, Y. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102755 · Cited by 43 · cited 1×
“Additionally, customization in recommender systems may raise concerns regarding user privacy [305].”
Adversarial Item Promotion on Visually-Aware Recommender Systems by Guided Diffusion
Chen, L., Yuan, W., Chen, T., Ye, G., Nguyen, Q. V. H., & Yin, H. (2024) · ACM Transactions on Information Systems · doi:10.1145/3666088 · Cited by 42
Self-citationMeta-learning in Healthcare: A Survey
Rafiei, A., Moore, R., Jahromi, S., Hajati, F., & Kamaleswaran, R. (2024) · SN Computer Science · doi:10.1007/s42979-024-03166-9 · Cited by 42
Sun, Y., Lank, E., & Terry, M. A. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025208 · Cited by 41 · cited 1×
“Given this relevance, Sun et al. studied users’ role in better understanding the available data by a system called label-and-learn, designed to help people without machine learning expertise understand the classifier’s behaviour in labelling tasks [76].”
Schmitt, O., & Buschek, D. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465253 · Cited by 41 · cited 1×
“Another example is the software developed by Schmitt et al., which supports the creation of fictional characters through interactive conversation and gradual development [226].”
Deep Reinforcement Learning Unleashing the Power of AI in Decision-Making
Shuford, J. (2024) · Journal of Artificial Intelligence General science (JAIGS) · doi:10.60087/jaigs.v1i1.36 · Cited by 41 · cited 1×
“A rapidly growing sub-field within reinforcement learning is Deep Reinforcement Learning, which leverages deep neural networks to learn the policy for RL problems [134], [135], [136], [137].”
Khang, A., Gupta, S. K., Rani, S., & Karras, D. A. (2023) · CRC Press eBooks · doi:10.1201/9781003376064 · Cited by 40
What Affects Human Decision Making in Human–Robot Collaboration?: A Scoping Review
Liu, Y., Caldwell, G. A., Rittenbruch, M., Teıxeıra, M. B. F., Burden, A. G., & Guertler, M. R. (2024) · Robotics · doi:10.3390/robotics13020030 · Cited by 40
AnchorViz: Facilitating Classifier Error Discovery through Interactive Semantic Data Exploration
Chen, N.-C., Suh, J., Verwey, J., Ramos, G., Drucker, S., & Simard, P. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172950 · Cited by 39 · cited 1×
“For that, visual exploratory tools [55], [57], [58], [59], data analysis and interactive exploration approaches have been used to improve ML models [60], [61].”
Interactive Machine Learning in Data Exploitation
Porter, R., Theiler, J., & Hush, D. (2013) · Computing in Science & Engineering · doi:10.1109/mcse.2013.74 · Cited by 38 · cited 1×
“That is, to gain understanding and insights into the data and the model, and then provide feedback to the model, e.g. providing training parameters or contributing to the examination of model outputs [63].”
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
Liang, P. P., Zadeh, A., & Morency, L.-P. (2022) · arXiv · doi:10.48550/arxiv.2209.03430 · Cited by 38
Towards Hybrid Human-AI Workflows for Unknown Unknown Detection
Liu, A., Guerra, S., Fung, I. P.-W., Matute, G., Kamar, E. S., & Lasecki, W. S. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380306 · Cited by 37 · cited 1×
“For instance, Liu et al. utilized non-experts to label system classification outputs and identify unknown-unknowns , learning from them to enhance initial classification [199].”
Ontology in Hybrid Intelligence: A Concise Literature Review
Pileggi, S. F. (2024) · Future Internet · doi:10.3390/fi16080268 · Cited by 36 · cited 1×
“• Hybrid Intelligence Systems : Examines socio-technical frameworks that synergize human and AI capabilities to address complex problems through collaborative efforts [39], [41], [42].”
Enhancing the diversity of conversational collaborative recommendations: a comparison
Kelly, J. P., & Bridge, D. (2007) · Artificial Intelligence Review · doi:10.1007/s10462-007-9023-8 · Cited by 35 · cited 1×
“Techniques proposed by Kelly et al. focus on enhancing exploration without deviating from the system’s core objectives [306].”
Vishwarupe, V., Maheshwari, S., Deshmukh, A., Mhaisalkar, S., Joshi, P. M., & Mathias, N. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.08.111 · Cited by 35 · cited 1×
“Considering this, Vishwarupe et al. [83] analyzed the challenges of getting a robust, transparent, ethical, intelligent and interactive mechanism for the co-existence of AI and HCI system that may be the basis of this collaboration.”
Model Personalization for Human Activity Recognition
Lin, C., & Mărculescu, R. (2020) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops48775.2020.9156229 · Cited by 34 · cited 1×
“Furthermore, it may also not be acceptable for new users whose data has never been viewed before [91].”
Decision-Oriented Dialogue for Human-AI Collaboration
Lin, J., Tomlin, N., Andreas, J., & Eisner, J. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00679 · Cited by 34 · cited 1×
“Lin et al. designed an AI assistant named Decision-Oriented Dialogue (DoD) to aid one or multiple humans in making complex decisions across three scenarios: assigning reviewers to conference papers, planning a multi-step itinerary in a city, and negotiating travel plans for a group of friends [205].”
Nguyen, A., Ilesanmi, F., Dang, B., Vuorenmaa, E., & Järvelä, S. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240198 · Cited by 34 · cited 1×
“Although these methods have recently gained traction and transformed the way many tasks are performed, particularly in education [239], [240], [241], they also hold potential influence over the academic peer review process [242].”
Individualized Mutual Adaptation in Human-Agent Teams
Li, H., Ni, T., Agrawal, S., Jia, F., Raja, S., Gui, Y., Hughes, D., Lewis, M., & Sycara, K. P. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3107675 · Cited by 33 · cited 1×
“According to Li et al., the success of a collaborative system depends on the members’ ability to work together and adjust their strategies to achieve mutually beneficial outcomes while completing tasks [291].”
WOZ experiments for understanding mutual adaptation
Xu, Y. D., Ueda, K., Komatsu, T., Okadome, T., Hattori, T., Sumi, Y., & Nishida, T. (2007) · AI & Society · doi:10.1007/s00146-007-0134-1 · Cited by 31
van Zoelen, E. M., van den Bosch, K., & Neerincx, M. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.692811 · Cited by 31 · cited 1×
“In this context, Van Zoelen et al. examine co-learning patterns in human-robot collaboration [295].”
Denardo, E. V. (1973) · Mathematical Programming · doi:10.1016/b978-0-12-358350-5.50005-1 · Cited by 30 · cited 1×
“Reinforcement learning problems can be modelled within the mathematical framework of the Markov decision problem (MDP) [127].”
Ethics, engineering, and sustainable development
Manion, M. (2002) · IEEE Technology and Society Magazine · doi:10.1109/mtas.2002.1035228 · Cited by 30 · cited 1×
“It is important to note that these principles are part of a broader set of considerations for effective, sustainable, and ethically sound technology design [186], [289].”
Reasoning Under Uncertainty: Towards Collaborative Interactive Machine Learning
Robert, S., Büttner, S., Röcker, C., & Holzinger, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50478-0_18 · Cited by 30 · cited 1×
“In such scenarios, the initial strategy for building some collaboration was relegated to allowing humans to alter a predefined parameter of an aML algorithm to improve its performance [48].”
Collaborative Sensing with Interactive Learning using Dynamic Intelligent Virtual Sensors
Tegen, A., Davidsson, P., Mihailescu, R., & Persson, J. (2019) · Sensors · doi:10.3390/s19030477 · Cited by 30 · cited 1×
“In this context, Tegen et al. demonstrated that designing applications where users provide feedback only when the system’s output is incorrect is more efficient than requiring users to provide correct labels consistently [228].”
(2023) · Wiley eBooks · doi:10.1002/9781119857433 · Cited by 30
Applicants’ Fairness Perception of Human and AI Collaboration in Resume Screening
Ling, B., Dong, B., & Cai, F. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2437235 · Cited by 30 · cited 1×
“Therefore, finding the right balance between user engagement, the amount of explanation provided, and the necessary human effort is crucial to maintaining user trust within appropriate boundaries [319].”
A Meta-Learning Approach to One-Step Active LearningPreprint
Contardo, G., Denoyer, L., & Artières, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08334 · Cited by 30 · cited 1×
“As stated by [110], these strategies are intended to replace traditional ones by selecting the optimal set of unlabeled items for labelling [99], [111].”
A Survey of Explainable Reinforcement Learning
Milani, S., Topin, N., Veloso, M., & Fang, F. (2022) · arXiv · doi:10.48550/arxiv.2202.08434 · Cited by 30
Conversational Collaborative Recommendation – An Experimental Analysis
Rafter, R., & Smyth, B. (2005) · Artificial Intelligence Review · doi:10.1007/s10462-005-9004-8 · Cited by 29 · cited 1×
“In this context, recommender systems can adjust aspects such as suggestion timing, the number of recommendations, and other factors to maintain user engagement while ensuring a balance between exploring new preferences and adhering to the system’s goals [307].”
How to Support Users in Understanding Intelligent Systems? Structuring the Discussion
Eiband, M., Buschek, D., & Hussmann, H. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450694 · Cited by 29 · cited 1×
“A lack of user trust can hinder their willingness to participate, negatively affecting the adoption of intelligent systems [313].”
Retrieval-Augmented Text-to-Audio Generation
Yuan, Y., Liu, H., Liu, X., Huang, Q., Plumbley, M. D., & Wang, W. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10447898 · Cited by 29
A Reflection on the Current State of Active Learning Research
Martella, A. M., & Schneider, D. W. (2024) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v24i3.35263 · Cited by 29
Towards Guidelines for Designing Human-in-the-Loop Machine Training Interfaces
van der Stappen, A., & Funk, M. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450668 · Cited by 28 · cited 1×
“Thus, the IML process should be characterized by the user being the primary driver of an interactive bi-directional process to achieve desired system behaviour [85].”
Survey and Tutorial on Hybrid Human-Artificial Intelligence
Shi, F., Zhou, F., Liu, H., Chen, L., & Ning, H. (2022) · Tsinghua Science & Technology · doi:10.26599/tst.2022.9010022 · Cited by 28 · cited 1×
“This variation has led to a fragmentation of the concept across different domains, with each area focusing on unique dimensions of collaborative processes [12], [13], [14], [15].”
Self-citationLeveraging the crowd to improve feature-sentiment analysis of user reviews
Huang, S., Tu, P.-F., Fu, W., & Amanzadeh, M. (2013) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2449396.2449400 · Cited by 27 · cited 1×
“…definition, applications as varied as predictive maintenance [66], the design of smart spaces [67], the analysis of insurance claims [68], sentient analysis [69] have emerged with this collaboration in mind in domains such as healthcare [53], education [70] or cyber-security [71], among others.”
Adaptive Leader-Follower Behavior in Human-Robot Collaboration
van Zoelen, E. M., Barakova, E. I., & Rauterberg, M. (2020) · IEEE RO-MAN · doi:10.1109/ro-man47096.2020.9223548 · Cited by 27 · cited 1×
“In another collaboration paradigm, Van Zoelen et al. study how humans adapt to continuous leadership shifts in human-robot collaboration and how this influences their trust and understanding [298].”
Design Patterns for Machine Learning-Based Systems With Humans in the Loop
Andersen, J. S., & Maalej, W. (2023) · IEEE Software · doi:10.1109/ms.2023.3340256 · Cited by 27 · cited 1×
“…of collaboration, especially in pinpointing the specific attributes that characterize collaboration within each field : • Human-in-the-loop (HiTL) : Focuses on a human-centered approach to collaboration by directly involving individuals in AI systems’ decision-making processes [29], [30], [31].”
Emerging Perspectives in Human-Centered Machine Learning
Ramos, G., Suh, J., Ghorashi, S., Meek, C., Banks, R., Amershi, S., Fiebrink, R., Smith-Renner, A., & Bansal, G. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3299014 · Cited by 26 · cited 1×
“In this line, Ramos et al. delved into user willingness to interact with a deployed system and determined that it may vary with context, task, and individual characteristics [324].”
Speech act theory as an evaluation tool for human-agent communication
Hanna, N., & Richards, D. (2019) · Algorithms · doi:10.3390/a12040079 · Cited by 26 · cited 1×
“Moreover, Hanna et al. developed a communication model called Speech Act Theory (SAT), which explores how utterances can facilitate actions in collaborative dialogues [342].”
A knowledge-light approach to personalised and open-ended human activity recognition
Wijekoon, A., Wiratunga, N., Sani, S., & Cooper, K. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105651 · Cited by 26 · cited 1×
“Thus, their expertise and willingness to interact with the system for model calibration and customization can be useful to improve the system’s accuracy, and this collaboration involving the user in assisting the learning system could imply improving its detection skills over time [95].”
Democratizing Knowledge Creation Through Human-AI Collaboration in Academic Peer Review
Sarker, S., University of Virginia, Susarla, A., Michigan State University, Gopal, R., University of Warwick, Thatcher, J. B., & University of Colorado / University of Manchester (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00872 · Cited by 25 · cited 1×
“Although these methods have recently gained traction and transformed the way many tasks are performed, particularly in education [239], [240], [241], they also hold potential influence over the academic peer review process [242].”
Advances and challenges in artificial intelligence text generation
Li, B., Yang, P., Sun, Y., Hu, Z., & Yi, M. (2024) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2300410 · Cited by 25 · cited 2×
“Artificial Intelligence Generated Content (AIGC) creates high-quality and quick content, such as images, text [148], music [149], 3D models, and natural language, utilizing Generated Artificial Intelligence (GAI) algorithms to meet users’ requirements.”
Yatawatta, S. (2024) · Astronomy and Computing · doi:10.1016/j.ascom.2024.100833 · Cited by 25
Interactive Machine Learning for End-User Innovation
Bernardo, F., Zbyszyński, M., Fiebrink, R. A., & Grierson, M. (2016) · Goldsmiths (University of London) · Cited by 25
Interactive learning for efficiently detecting errors in insurance claims
Ghani, R., & Kumar, M. (2011) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020463 · Cited by 24 · cited 1×
“Under this definition, applications as varied as predictive maintenance [66], the design of smart spaces [67], the analysis of insurance claims [68], sentient analysis [69] have emerged with this collaboration in mind in domains such as healthcare [53], education [70] or cyber-security [71], among…”
Theory of Mind based Communication for Human Agent Cooperation
Buehler, M. C., & Weisswange, T. H. (2020) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms49158.2020.9209472 · Cited by 24 · cited 1×
“This assertion was evaluated by Buehler et al., who explored the relationship between human reciprocal cooperation and its correlation with collaborative performance [292].”
From Human-in-the-Loop to Human-in-Power
Zheng, E. L., Jin, W., Hamarneh, G., & Lee, S. S. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2377139 · Cited by 23
LAMDA: Label Matching Deep Domain Adaptation
Le, T., Nguyen, T., Ho, N., Bui, H., & Phung, D. (2021) · Monash University Research Portal (Monash University) · Cited by 23
Reliability of AI-generated magnetograms from only EUV images
Liu, J., Wang, Y., Huang, X., Korsós, M. B., Jiang, Y., Wang, Y., & Erdélyi, R. (2021) · Nature Astronomy · doi:10.1038/s41550-021-01310-6 · Cited by 22 · cited 1×
“AI-generated images have various applications, ranging from artwork [185] to synthetic faces [187] and complex magnetograms of the Sun [221].”
Adetayo, A. J. (2026) · Library Hi Tech News · doi:10.1108/lhtn-01-2024-0005 · Cited by 22 · cited 1×
“DALL-E, a widely used AIGC application, generates images from textual descriptions [150], [154], [155], [249].”
Human adaptation to a miniature robot: Precursors of mutual adaptation
Mohammad, Y. F. O., & Nishida, T. (2008) · IEEE RO-MAN · doi:10.1109/roman.2008.4600654 · Cited by 21 · cited 1×
“For instance, in addition to developing a navigation collaboration system in which each agent possesses partial information, Mohammad et al. investigate the evolution of human adaptation in collaborative settings [297].”
Bidirectional Communication for Effective Human-Agent Teaming
Marathe, A. R., Schaefer, K. E., Evans, A. W., & Metcalfe, J. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91581-4_25 · Cited by 21 · cited 1×
“As Marathe et al. concluded, AI systems must be capable of understanding the state and intent of their human co-workers; simultaneously, humans must clearly articulate their intentions [333].”
Fuzzy Logic-Based Arbitration for Shared Control in Continuous Human–Robot Collaboration
Xing, X., Li, W., Yuan, S., & Li, Y. (2024) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2024.3386822 · Cited by 21 · cited 1×
“Similarly, Xing et al. devised a fuzzy logic-based arbitration rule to regulate the transition of the robot’s role in collaboration [268].”
The DEFACTO system for human omnipresence to coordinate agent teams
Schurr, N., Marecki, J., Kasinadhuni, N., Tambe, M., Lewis, J. P., & Scerri, P. (2005) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1082473.1082707 · Cited by 20 · cited 1×
“The initial efforts to incorporate an AI coordinator into human teams were based on shared control systems, which allowed humans to take control when the system encountered failures [208], [209].”
Rosero, A., Dinh, F., de Visser, E. J., Shaw, T. H., & Phillips, E. K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03071 · Cited by 20 · cited 1×
“The Overcooked game has been used for various research purposes, including studying human collaboration across different task loads in human-AI environments [278], [279].”
PECAN: Leveraging Policy Ensemble for Context-Aware Zero-Shot Human-AI Coordination
Lou, X., Guo, J., Zhang, J., Wang, J., Huang, K., & Du, Y. (2023) · Research Portal (King's College London) · doi:10.48550/arxiv.2301.06387 · Cited by 20 · cited 1×
“Their context-aware approach enables agents to analyze and identify potential policy primitives of their partners, allowing for appropriate action selection [258].”
A Study on Interaction in Human-in-the-Loop Machine Learning for Text Analytics.
Yang, Y., Kandogan, E., Li, Y., Sen, P., & Lasecki, W. S. (2019) · IUI Workshops · Cited by 20
Han, W., Tian, Z., Zhu, C., Huang, Z., Jia, Y., & Guizani, M. (2019) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2019.2959826 · Cited by 19 · cited 1×
“Han et al. and Smith et al. developed a system that identifies document topics based on word frequency [52], [195].”
Human-AI Collaboration – Coordinating Automation and Augmentation Tasks in a Digital Service Company
Schröder, A., Constantiou, I., Tuunainen, V. K., & Austin, R. D. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.025 · Cited by 19 · cited 1×
“Another illustrative example is provided by Schroder et al., who analyzed the Plant Jammer system [201].”
Image2speech: Automatically generating audio descriptions of images
Hasegawa‐Johnson, M., Black, A. W., Ondel, L., Scharenborg, O., & Ciannella, F. (2017) · HAL · Cited by 19
Ethical Challenges for Human–Agent Interaction in Virtual Collaboration at Work
Hofeditz, L., Mirbabaie, M., & Ortmann, M. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2279400 · Cited by 19 · cited 1×
“Inaccuracies or biases in this data can lead to flawed outcomes, particularly in sensitive areas such as race, gender, ethics, and politics [20], [23].”
Concept of Interactive Machine Learning in Urban Design Problems
Chirkin, A. M., & König, R. (2016) · Proceedings of the SEACHI 2016 on Smart Cities for Better Living with HCI and UX · doi:10.1145/2898365.2899795 · Cited by 18 · cited 1×
“Under this definition, applications as varied as predictive maintenance [66], the design of smart spaces [67], the analysis of insurance claims [68], sentient analysis [69] have emerged with this collaboration in mind in domains such as healthcare [53], education [70] or cyber-security [71], among…”
Human-in-the-Loop Large-Scale Predictive Maintenance of Workstations
Nikitin, A., & Kaski, S. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539196 · Cited by 18 · cited 1×
“Under this definition, applications as varied as predictive maintenance [66], the design of smart spaces [67], the analysis of insurance claims [68], sentient analysis [69] have emerged with this collaboration in mind in domains such as healthcare [53], education [70] or cyber-security [71], among…”
“The Device Is Not Well Designed for Me” on the Use of Activity Trackers in the Workplace?
Masson, C. B., Martin, D., Colombino, T., & Grasso, A. M. (2016) · Springer eBooks · doi:10.1007/978-3-319-33464-6_3 · Cited by 17 · cited 1×
“For instance, in an experimental evaluation by Masson et al. on user involvement with AI systems, participants initially took an active role in data capture [323].”
Trust-Aware Human–Robot Fusion Decision-Making for Emergency Indoor Patrolling
Li, Y., Xu, J., Guo, D., & Liu, H. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3350639 · Cited by 17 · cited 1×
“For example, Li et al. developed a human-AI collaboration system for indoor patrolling during sudden power outages, focusing on preserving human trust in the agent [257].”
Role Dynamic Assignment of Human–Robot Collaboration Based on Target Prediction and Fuzzy Inference
Wang, C., & Zhao, J. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3266378 · Cited by 16 · cited 1×
“For instance, Wang et al. developed a dynamic role-shifting system for human-robot collaboration in assembly tasks, aiming to alleviate human fatigue [267].”
Action Recognition for Human–Robot Teaming: Exploring Mutual Performance Monitoring Possibilities
Mehak, S., Kelleher, J. D., Guilfoyle, M., & Leva, M. C. (2024) · Machines · doi:10.3390/machines12010045 · Cited by 16 · cited 1×
“Another approach by Mehak et al. involves creating a system capable of recognizing human actions and predicting forthcoming actions to foster improved team coordination and communication [261].”
Understanding Human-AI Cooperation Through Game-Theory and Reinforcement Learning Models
Schelble, B. G., Flathmann, C., Canonico, L. B., & McNeese, N. J. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.041 · Cited by 15 · cited 1×
“Schelble et al. conducted an empirical study to explore how different modern RL algorithms and game theory scenarios could influence cooperation levels in human-AI teams [264].”
Designing for Bi-Directional Transparency in Human-AI-Robot-Teaming
Holder, E. W., Huang, L., Chiou, E. K., Jeon, M., & Lyons, J. B. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651052 · Cited by 15 · cited 2×
“For example, Holder et al. provide an overview of best practices and challenges in establishing bi-directional transparency at various stages of the human-AI-robot systems (HARTs) lifecycle [331], [340].”
Puerta-Beldarrain, M., Gómez–Carmona, O., Casado–Mansilla, D., & López–de–Ipiña, D. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-21333-5_38 · Cited by 15 · cited 1×
“Consequently, human requirements, such as trust, engagement, and usability, are as crucial as artificial requirements in this integration process [234].”
Self-citationHuman-Centered AI in Military Cyber Operations
Maathuis, C. (2024) · International Conference on Cyber Warfare and Security · doi:10.34190/iccws.19.1.1972 · Cited by 15 · cited 1×
“For example, Ramchurn et al. created a flexible human-AI interaction system for generating task allocation plans in emergent scenarios [207], [211].”
Probabilistic Active Learning: Towards Combining Versatility, Optimality and Efficiency
Krempl, G., Kottke, D., & Spiliopoulou, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11812-3_15 · Cited by 14 · cited 1×
“• Probabilistic Active Learning (PAL) [109]: This strategy operates on the premise that if two instances share close proximity in the feature space, their labels are likely to be similar.”
A Human-Centered Approach to Interactive Machine LearningPreprint
Mathewson, K. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.06289 · Cited by 14 · cited 2×
“In light of this, users’ participation has also been addressed from a Human-Computer Interaction (HCI) standpoint that seeks to facilitate the iterative design, improvement, and dissemination process of learning systems [82].”
Activity recognition through interactive machine learning in a dynamic sensor setting
Tegen, A., Davidsson, P., & Persson, J. (2020) · Personal and Ubiquitous Computing · doi:10.1007/s00779-020-01414-2 · Cited by 13 · cited 1×
“This partnership aims to enhance the categorization of human motions and behaviors by combining embodied and non-embodied sensory data [90].”
Text-Driven Stylization of Video Objects
Loeschcke, S., Belongie, S., & Benaim, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25069-9_38 · Cited by 13
Communication in Human-AI Teaming
Duan, W., McNeese, N. J., & Zhang, R. (2023) · Routledge eBooks · doi:10.4324/9781003227458-27 · Cited by 13
A meta-active learning approach exploiting instance importance
Flesca, S., Mandaglio, D., Scala, F., & Tagarelli, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123320 · Cited by 13 · cited 2×
“If you are interested, further exploration can be found in upcoming surveys [115], [116], [117], [118], [119], [120], [121].”
Quantifying Human Decision-Making: Implications for Bidirectional Communication in Human-Robot Teams
Schaefer, K. E., Perelman, B. S., Brewer, R. W., Wright, J. L., Roy, N., & Aksaray, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91581-4_27 · Cited by 12 · cited 1×
“Effective collaboration necessitates bi-directional communication to establish a mutual understanding that enables the participants to perceive each other through natural, fluid interactions [336], [337].”
Learning in games: a systematic review
Qin, R.-J., & Yu, Y. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-3955-x · Cited by 12 · cited 1×
“The combination of gaming and RL is advantageous due to its inherent qualities [280], [281].”
Formation conditions of mutual adaptation in human-agent collaborative interaction
Xu, Y. D., Ohmoto, Y., Okada, S., Ueda, K., Komatsu, T., Okadome, T., Kamei, K., Sumi, Y., & Nishida, T. (2010) · Applied Intelligence · doi:10.1007/s10489-010-0255-y · Cited by 11 · cited 2×
“For instance, Xu et al. examine adaptation from the agent’s viewpoint, suggesting that mutual adaptation could enable the agent to manage flexible mappings between human instructions and agent actions [269].”
A Brief Guide to Designing and Evaluating Human-Centered Interactive Machine LearningPreprint
Mathewson, K. W., & Pilarski, P. M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.09622 · Cited by 11 · cited 1×
“This idea directly connects to improving the interaction between human agents and learning models to make ML more accessible for participants, enabling humans to efficiently and effectively interact with the system [81].”
User-centric IoT: challenges and perspectives
Abdelghani, W., Zayani, C. A., Amous, I., & Sèdes, F. (2019) · Open Archive Toulouse Archive Ouverte (University of Toulouse) · Cited by 11
PUGCQ: A Large Scale Dataset for Quality Assessment of Professional User-Generated Content
Guo, L., Chen, B., Zhu, L., He, Q., Fan, H., & Wang, S. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475183 · Cited by 10 · cited 1×
“A few years ago, the most common content creation strategies were Professional Generated Content (PGC) [156], [157] and User Generated Content (UGC) [158].”
Human Factors in Interactive Machine Learning: A Cybersecurity Case Study
Chignell, M., Chung, M.-H., Yang, Y., Cento, G., & Raman, A. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651206 · Cited by 10 · cited 1×
“…definition, applications as varied as predictive maintenance [66], the design of smart spaces [67], the analysis of insurance claims [68], sentient analysis [69] have emerged with this collaboration in mind in domains such as healthcare [53], education [70] or cyber-security [71], among others.”
Human-Robot Collaboration Levels in Construction: Focusing on Individuals’ Cognitive Workload
Nassar, Y., Albeaino, G., Jeelani, I., Gheisari, M., & Issa, R. R. A. (2024) · ASCE Construction Research Congress (CRC) · doi:10.1061/9780784485262.065 · Cited by 10
Operational Criteria of Hybrid Intelligence for Generative AI Virtual Assistants
Sherson, J. F., Rafner, J. F., & Büyükgüzel, S. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240229 · Cited by 10 · cited 2×
“The primary purpose of collaboration is to leverage the strengths of each entity to compensate for the limitations of others, enabling achievements beyond what each could accomplish independently [12], [14], [17], [18].”
Text nailing: an efficient human-in-the-loop text-processing method
Kartoun, U. (2017) · interactions · doi:10.1145/3139488 · Cited by 9
TOWARDS AN INTEGRATIVE THEORETICAL FRAMEWORK OF INTERACTIVE MACHINE LEARNING SYSTEMS
Martínez, M. A. M., Nadj, M., & Maedche, A. (2019) · European Conference on Information Systems · Cited by 9
Music Recommendation System Using Real Time Parameters
Dawar, S., Chatterjee, S., Hossain, M. F., & Malarvizhi, S. (2023) · International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI) · doi:10.1109/raeeucci57140.2023.10134257 · Cited by 9 · cited 1×
“Dawar et al. developed a recommender system that considers music habits, preferences, and facial expressions to suggest suitable songs and playlists to users [194].”
Stephens, K. K., Harris, A., Hughes, A., Montagnolo, C., Nader, K., Stevens, S. A., Tasuji, T., Xu, Y., Purohit, H., & Zobel, C. W. (2023) · Human-Machine Communication · doi:10.30658/hmc.6.5 · Cited by 9 · cited 1×
“Technology has rapidly evolved to become an integral component of contemporary life, progressively incorporating humans into its decision-making processes and actively integrating them within the technological framework [1], [2], [3].”
Learning to Communicate Proactively in Human-Agent Teaming
van Zoelen, E. M., Cremers, A., Dignum, F. P. M., van Diggelen, J., & Peeters, M. M. M. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-51999-5_20 · Cited by 8 · cited 1×
“Zoelen et al. developed proactive communication techniques to enable more fluid human-AI collaboration by using context and adaptability to guide communication strategies [343].”
BeeMe: Real-Time Internet Control of Situated Human Agents
Pescetelli, N., Cebrián, M., & Rahwan, I. (2020) · Computer · doi:10.1109/mc.2020.2996824 · Cited by 8
Forming Real-World Human-Robot Cooperation for Tasks With General Goal
Tao, L., Bowman, M., Zhang, J., & Zhang, X. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3133588 · Cited by 8 · cited 1×
“For instance, Tao et al. developed a physical collaborative task involving a human and a robot, wherein both participants shared the same information [266].”
Generative AI: An In-depth Exploration of Methods, Uses, and Challenges
Wang, S. (2024) · Highlights in Science Engineering and Technology · doi:10.54097/czptrz11 · Cited by 8 · cited 1×
“• Artificial Intelligence Generative Content (AIGC) : Involves AI systems that generate creative outputs like text, images, or music in a process that promotes collaborative learning and user involvement [19], [20], [43], [44].”
GPT‐3‐ and DALL‐E‐Powered Applications
Vayadande, K. B., Pednekar, C. B., Khune, P., Prabhavalkar, V. S., & Dange, V. R. (2024) · doi:10.1002/9781394214167.ch19 · Cited by 8
Hanika, T., Herde, M., Kühn, J., Leimeister, J. M., Lukowicz, P., Oeste-Reiß, S., Schmidt, A., Sick, B., Stumme, G., Tomforde, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07264 · Cited by 8 · cited 2×
“• Collaborative Interactive Learning (CIL) : Aims to create intelligent systems that seamlessly assist humans in everyday tasks through continuous interaction and learning [13], [34].”
DYNAMICAL AND COMPLEX BEHAVIORS IN HUMAN-MACHINE CO-ADAPTIVE SYSTEMS
Sawaragi, T. (2005) · IFAC Proceedings Volumes · doi:10.3182/20050703-6-cz-1902.01418 · Cited by 7 · cited 1×
“This knowledge is acquired through the co-learning process inherent in their interactions [294].”
Promoting mutual adaptation in haptic negotiation using adaptive virtual fixture
Hua, Z., Wei, D. Y., Chen, Y., & Wu, F. (2021) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir-07-2020-0142 · Cited by 7 · cited 2×
“This aligns with the work of Zhou et al., which establishes mutual adaptation in unstructured environments that promote mutual communication and adaptation [272].”
Game-Theoretic Approaches for Step-wise Controllable Text Generation in Large Language ModelsPreprint
Sefeni, D., Johnson, M., & Lee, J. (2024) · doi:10.22541/au.172538388.88528596/v1 · Cited by 7
Online meta-learned gradient norms for active learning in science and technology
Dong, H., Barnard, A. S., & Parker, A. J. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad2e17 · Cited by 6 · cited 2×
“If you are interested, further exploration can be found in upcoming surveys [115], [116], [117], [118], [119], [120], [121].”
Li, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.10214 · Cited by 6 · cited 1×
“The progression of technology has significantly influenced the concept of collaboration across multiple disciplines over the years [10], [11].”
A Signaling Game Approach to Databases Querying and Interaction
Termehchy, A., & Touri, B. (2015) · doi:10.1145/2808194.2809487 · Cited by 5 · cited 3×
“Building on this concept, McCamish et al. have introduced a collaborative communication approach that implements a formal framework for representing and understanding information needs in database querying, aiming to develop a mutual language for representing these needs [259], [260].”
Frisse, M. (1992) · Academic Medicine · doi:10.1097/00001888-199210000-00004 · Cited by 5
Personalized Complementarity in Human-AI Collaboration
Breckner, K., Neumayr, T., Streit, M., & Augstein, M. (2024) · Gesellschaft für Informatik (GI) · doi:10.18420/muc2024-mci-ws11-206 · Cited by 5 · cited 1×
“Effective collaboration necessitates bi-directional communication to establish a mutual understanding that enables the participants to perceive each other through natural, fluid interactions [336], [337].”
Human-Machine Coadaptation Based on Reinforcement Learning with Policy Gradients
Tahboub, K. A. (2019) · International Conference on Systems and Control (ICSC) · doi:10.1109/icsc47195.2019.8950660 · Cited by 4 · cited 2×
“Alternatively, Tahboub et al. present a different perspective, advocating that co-adaptation and co-learning occur simultaneously during collaboration [280].”
The Internet of People: A Survey and TutorialPreprint
Shi, F., Wang, W., Wang, H., & Ning, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04079 · Cited by 4
Towards a Human-AI Hybrid Framework for Inter-Researcher Similarity Detection
Guimarães, D., Paulino, D., Correia, A., Trigo, L., Brazdil, P., & Paredes, H. (2021) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms53169.2021.9582633 · Cited by 3
Trust in Digital Human-AI Team Collaboration: A Systematic Review
Janhunen, E., Toivikko, T., Blomqvist, K., & Siemon, D. (2024) · Journal of the Association for Information Systems · Cited by 3
The Effect of Co-adaptive Learning & Feedback in Interactive Machine Learning
Zbyszyński, M., Donato, B. D., & Tanaka, A. (2019) · Cited by 3
Supporting Feature Engineering in End-User Machine Learning
McCallum, L., & Fiebrink, R. A. (2019) · Goldsmiths (University of London) · Cited by 3
A Game-theoretic Approach to Data Interaction
McCamish, B., Termehchy, A., & Touri, B. (2017) · Workshop on Human-In-the-Loop Data Analytics (HILDA) · doi:10.1145/3077257.3077270 · Cited by 2 · cited 2×
“Building on this concept, McCamish et al. have introduced a collaborative communication approach that implements a formal framework for representing and understanding information needs in database querying, aiming to develop a mutual language for representing these needs [259], [260].”
First Workshop on Generative AI for Recommender Systems and Personalization
Tabari, N., Deshmukh, A. A., Kang, W.-C., Zamani, H., Gangadharaiah, R., McAuley, J., & Karypis, G. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671486 · Cited by 2 · cited 1×
“For example, ChatGPT utilizes prior user input to generate more customized responses [151], [174], [300], [301].”
Human-In-The-Loop Learning of Qualitative Preference ModelsPreprint
Allen, J. H., Moussa, A., & Liu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09064 · Cited by 2 · cited 1×
“A similar approach is utilized by Allen et al., whose system learns users’ qualitative preferences to facilitate car selection [192].”
12 Conversational Archetypes for Human-AI Interaction
Marri, S. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i03.23226 · Cited by 1 · cited 1×
“Such AIGC algorithms are considered interactive due to the inherent nature of dialogue [244], [245].”
Sapphire vs Conventional YouTube Video RankingPreprint
Murthy, S. S., & Murthy, S. S. (2024) · doi:10.22541/au.171894017.74660532/v1 · Cited by 1
Quantifying Ethics and Trust in Human-AI Collaboration
Lane, O., & Klave, K. (2024) · DigitalCommons - CalPoly (California State Polytechnic University) · Cited by 1
Research works printed but not linked: 23
- Miletić, 2021, Human-artificial intelligence symbiosis: The possibility of moral augmentation
- Holzinger, On knowledge discovery and interactive intelligent visualization of biomedical data, 5
- Tegen, 2022, The Effects of Reluctant and Fallible Users in Interactive Online Machine Learning, 209
- Konyushkova, Learning active learning from data, 30, 4225
- Saadallah, Interpretable meta-active learning for regression ensemble learning, 1
- Ernst, 2024, Introduction to Reinforcement Learning, 111
- Winder, 2020, Reinforcement Learning
- Russell, 2010, Artificial Intelligence a Modern Approach
- Ng, PEGASUS: A policy search method for large MDPs and POMDPs, 406
- Schulman, 2022, ChatGPT: Optimizing language models for dialogue, OpenAI blog, 2
- Lehtinen, Noise2Noise: Learning image restoration without clean data, 4620
- Zhang, The ethics of AI-generated maps: DALL-E 2 and AI’s implications for cartography (short paper)
- Zakershahrak, 2021, Towards human-machine symbiosis: Design for effective AI facilitation
- Yang, AI as an active writer: Interaction strategies with generated text in human-AI collaborative fiction writing, 10, 1
- Cao, Enhancing human-AI collaboration through logic-guided reasoning
- Gómez-Carmona, 2021, Promoting the perception of emerging technologies in work environments through edge computing and hybrid intelligence
- 10.1504/IJBIC.2020.111267 · doi:10.1504/ijbic.2020.111267 · Paper page
- Song, V-MPO: On-policy maximum a posteriori policy optimization for discrete and continuous control
- Wiethof, Toward a hybrid intelligence system in customer service: Collaborative learning of human and AI
- Nikolaidis, 2017, Mathematical models of adaptation in human-robot collaboration
- Paripati, 2024, AI algorithms for personalization: Recommender systems, predictive analytics, and beyond, Darpan Int. Res. Anal., 12, 51
- Scharowski, 2024, Trust in artificial intelligence: Understanding and calibrating trust and distrust in the human-AI interaction
- Van Den Bosch, 2018, Human-AI Cooperation to Benefit Military Decision Making
Cited by
Zhang, R., Liu, G., Liu, Y., Zhao, C., Wang, J., Xu, Y., Niyato, D. T., Kang, J., Li, Y., Mao, S., et al. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3651702 · Cited by 148
“E.g., tokenization, stop-word removal, NER , VAD, MFCC feature extraction.”
Olawade, D. B., Plabon, S. B., Ojo, A., Ogunbona, M. A., Makanjuola, B. D., & Olasilola, R. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106362 · Cited by 105
Karim, M. M., Khan, S., Van, D. H., Liu, X. L., Wang, C., & Qu, Q. (2025) · Future Internet · doi:10.3390/fi17080353 · Cited by 50
Exploring pre-service teachers’ generative AI readiness and behavioral intentions: A pilot study
Bui, P., Korhonen, T., Kontkanen, S., Karme, S., Piispa-Hakala, S., & Veermans, M. (2025) · LUMAT International Journal on Math Science and Technology Education · doi:10.31129/lumat.13.1.2755 · Cited by 32
Human-Controllable AI: Meaningful Human Control
Liu, C., & Xu, W. (2025) · Springer eBooks · doi:10.1007/978-981-97-8440-0_58-1 · Cited by 26
Metadata
- Authors
- Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L.
- Affiliations
- Universidad de Deusto (ES)
- Deustotech, University of Deusto, Bilbao, Spain
- Faculty of Engineering, University of Deusto, Bilbao, Spain
- Dalian University of Technology (CN)
- ORCID
- Venue
- IEEE Access
- Published
- 2025
- Volume
- 13
- Pages
- 29375-29405
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4406947263
- Cited by
- 73
- References
- 329
- Citations by year
- 2026: 50 · 2025: 23
- FWCI
- 80.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DeustoTeka (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Basque Government, which recognizes Human-centric Computing for Smart Sustainable Communities and Environments (IT1582-22)
- excellent research group under the Basque university system. Besides, we acknowledge the Ministerio de Ciencia e Innovación for Internet of People (PID2020-119682RB-I00)
- European Commission through the Wearables and drones for City Socio-Environmental Observations and Behavioral Change (101037648)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- human-AI collaboration, human-in-the-loop systems, interactive machine learning, hybrid intelligence, human-agent interaction, end-user control, user engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.