The Design of Reciprocal Learning Between Human and Artificial Intelligence
The DOI matches its Crossref record; 71 of the 74 references it cites were found in a registry or an index.
Abstract
The need for advanced automation and artificial intelligence (AI) in various fields, including text classification, has dramatically increased in the last decade, leaving us critically dependent on their performance and reliability. Yet, as we increasingly rely more on AI applications, their algorithms are becoming more nuanced, more complex, and less understandable precisely at a time we need to understand them better and trust them to perform as expected. Text classification in the medical and cybersecurity domains is a good example of a task where we may wish to keep the human in the loop. Human experts lack the capacity to deal with the high volume and velocity of data that needs to be classified, and ML techniques are often unexplainable and lack the ability to capture the required context needed to make the right decision and take action. We propose a new abstract configuration of Human-Machine Learning (HML) that focuses on reciprocal learning, where the human and the AI are collaborating partners. We employ design-science research (DSR) to learn and design an application of the HML configuration, which incorporates software to support combining human and artificial intelligences. We define the HML configuration by its conceptual components and their function. We then describe the development of a system called Fusion that supports human-machine reciprocal learning. Using two case studies of text classification from the cyber domain, we evaluate Fusion and the proposed HML approach, demonstrating benefits and challenges. Our results show a clear ability of domain experts to improve the ML classification performance over time, while both human and machine, collaboratively, develop their conceptualization, i.e., their knowledge of classification. We generalize our insights from the DSR process as actionable principles for researchers and designers of 'human in the learning loop' systems. We conclude the paper by discussing HML configurations and the challenge of capturing and representing knowledge gained jointly by human and machine, an area we feel has great potential.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some systems integrate basic learning capabilities [72] through feedback loops [73,74], heuristics [75], or updated context buffers to refine behavior over time, particularly in settings like personalized recommendations or conversation flow management [7678].”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [74]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“Word embedding techniques are considered context-aware, in the sense that terms are modeled as an integral part of their linguistic surrounding [18, 36, 47].”
BackgroundSMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 2×
“All the supervised models shown, including the baseline model, used 10-fold cross validation to fit the model and synthetic minority oversampling technique (SMOTE) [13] to help overcome class imbalance.”
BackgroundMethodDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 2×
“Mathematically, context can be built from the corpus being classified or from an external (enhancement) corpus, a technique called word embedding [42].”
BackgroundMethodQualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“In one instance, the Lasso regression did not converge [23].”
BackgroundResearch design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745 · cited 1×
“We used recommended methods of qualitative analysis [12, 16, 17] to overcome inconsistencies and biases in creating the conceptualization of classification knowledge, and we added an external expert to increase reliability and minimize bias.”
Method(2006) · Cited by 18,730
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
The Knowledge-creating company: How Japanese companies create the dynamics of innovation
(1997) · Research Policy · doi:10.1016/s0048-7333(97)80234-x · Cited by 13,156 · cited 1×
“Learning in practice has been likened to a spiral of knowledge creation that pauses to take action and resumes to upgrade itself continuously [45, 69].”
BackgroundRudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“More recently, researchers began exploring explainability and explainable AI (XAI) techniques [8, 11, 20, 51, 60].”
BackgroundOrganizing and the process of sensemaking
Weick, K. E., Sutcliffe, K. M., & Obstfeld, D. (2005) · Organization Science · doi:10.1287/orsc.1050.0133 · Cited by 6,943
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Qualitative Content Analysis in Practice
Schreier, M. (2012) · doi:10.4135/9781529682571 · Cited by 5,801
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“These lexicons are similar in structure to the renown LIWC lexicon [64], yet differ in the”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 1×
“AI based screening systems can achieve higher accuracy in interpreting mammograms than trained radiologists [40].”
BackgroundPositioning and Presenting Design Science Research for Maximum Impact1
Gregor, S., & Hevner, A. R. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.2.01 · Cited by 3,028 · cited 6×
“Our DSR produces a conceptual artifact, namely the HML configuration , and a technical artifact, namely the Fusion prototype .”
MethodInfluentialArtificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755 · cited 1×
“…configurations that take into account additional considerations, such as organizational implications [31], the degree of automation versus augmentation [48], the contingencies of configurations based on parameters like task complexity or ambiguity [58], and ethical issues such as discretion [15].”
Background(2006) · Cited by 2,256
Qualitative Data Analysis: An Introduction
Grbich, C. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781529799606 · Cited by 2,032
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 1×
“More recently, researchers began exploring explainability and explainable AI (XAI) techniques [8, 11, 20, 51, 60].”
BackgroundPlans and situated actions: The problem of human-machine communication
Agre, P. E. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90078-e · Cited by 1,669
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., & Han, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_48 · Cited by 1,400 · cited 1×
“Our vision of keeping the human in the learning loop may be seen in contrast with a trend towards complete automation, notably in the promise of a Deep-learning systems that aim at automatic ML (AutoML) [32].”
BackgroundText Classification Algorithms: A Survey
Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019) · Information · doi:10.3390/info10040150 · Cited by 1,312
AllenNLP: A Deep Semantic Natural Language Processing Platform
Gardner, M., Grus, J., Neumann, M., Tafjord, O., Dasigi, P., Liu, N. F., Peters, M., Schmitz, M., & Zettlemoyer, L. (2018) · Proceedings of Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/w18-2501 · Cited by 1,252 · cited 1×
“[24]), and the use of an external knowledge base (e.”
BackgroundSein, M. K., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011) · Borås Academic Digital Archive (University of Borås) · doi:10.82444/warw.33619288 · Cited by 1,181
Organizational Decision-Making Structures in the Age of Artificial Intelligence
Shrestha, Y. R., Ben-Menahem, S. M., & von Krogh, G. (2019) · California Management Review · doi:10.1177/0008125619862257 · Cited by 1,108 · cited 4×
“Alongside these attempts, in the general AI research community [31, 58], there is growing agreement that not all decision-related tasks can be delegated to AI.”
BackgroundInfluentialQualitative Data Analysis: An Introduction
Kzillen, M., & Jarrett, N. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04365.x · Cited by 846
Moreno, R. (2004) · Instructional Science · doi:10.1023/b:truc.0000021811.66966.1d · Cited by 615 · cited 1×
“Research on learning with multimedia has shown that combinations of outcome (corrective) feedback and explanatory feedback ensure deeper learning [44].”
Background(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
context2vec: Learning Generic Context Embedding with Bidirectional LSTM
Melamud, O., Goldberger, J., & Dagan, I. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1006 · Cited by 513
Cognitive Psychology: Connecting Mind, Research and Everyday Experience
Goldstein, E. B. (2004) · Cited by 486
Designing Information Technology to Support Distributed Cognition
Boland, R. J., Tenkasi, R. V., & Te'eni, D. (1994) · Organization Science · doi:10.1287/orsc.5.3.456 · Cited by 481 · cited 3×
“It can therefore be seen as memory that supports distributed cognition [9].”
BackgroundSelf-citationApplying Authorship Analysis to Extremist-Group Web Forum Messages
Abbasi, A., & Chen, H. (2005) · IEEE Intelligent Systems · doi:10.1109/mis.2005.81 · Cited by 399 · cited 1×
“…methods in modeling a broader context are even more pronounced when the data have some behavioral aspects, in the sense that they contain elements of intention, deception, emotion, reciprocation, herding, or other forms of human behavior [56], as in the case of online discourse [1, 2, 47, 57, 73].”
MethodAugmenting the algorithm: Emerging human-in-the-loop work configurations
Grønsund, T., & Aanestad, M. (2020) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2020.101614 · Cited by 364 · cited 5×
“One possible approach for improving the detection performance is to “keep the human in the loop” [31, 55] in order to boost the artificial intelligence with human intelligence, going beyond the current practice of involving the human primarily during the initial training of machine learning (ML)…”
BackgroundInfluentialExplanatory Model Analysis: Explore, Explain and Examine Predictive Models
Biecek, P., & Burzykowski, T. (2021) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429027192 · Cited by 344 · cited 1×
“More recently, researchers began exploring explainability and explainable AI (XAI) techniques [8, 11, 20, 51, 60].”
BackgroundResearch Perspectives: The Anatomy of a Design Principle
Australian National University, A., Gregor, S., Kruse, L., University of Liechtentsein, L., Seidel, S., & University of Liechtentsein, L. (2020) · Journal of the Association for Information Systems · doi:10.17705/1jais.00649 · Cited by 341
Joint Cognitive Systems: Patterns in Cognitive Systems Engineering
Woods, D. D., & Hollnagel, E. (2006) · Thammasat University Digital Collections · Cited by 326
Formal concept analysis in information science
Priss, U. (2006) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440400120 · Cited by 303
Going Dark: Terrorism on the Dark Web
Weimann, G. (2015) · Studies in Conflict and Terrorism · doi:10.1080/1057610x.2015.1119546 · Cited by 202 · cited 1×
“This is particularly true for Darknet communication, where people who use it usually have something to hide or prefer to communicate anonymously [70], requiring common data-science tools to be tailored to mining and analyzing messages in the Darknet [14].”
BackgroundImproving Natural Language Inference Using External Knowledge in the Science Questions Domain
Wang, X., Kapanipathi, P., Musa, R., Yu, M., Talamadupula, K., Abdelaziz, I., Chang, M., Fokoue, A., Makni, B., Mattei, N., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017208 · Cited by 192
(1951) · Defense Technical Information Center (DTIC) · Cited by 179
Judgemental and statistical time series forecasting: a review of the literature
Webby, R., & O'Connor, M. (1996) · International Journal of Forecasting · doi:10.1016/0169-2070(95)00644-3 · Cited by 177 · cited 1×
“Nevertheless, combining human and artificial intelligences for decision making requires attention and careful application [5, 68].”
BackgroundInteractive data visualization using focusing and linking
Buja, A., McDonald, J. A., Michalak, J., & Stuetzle, W. (2002) · Proceeding Visualization '91 · doi:10.1109/visual.1991.175794 · Cited by 158
Human-Centred Machine Learning
Gillies, M. F. P., Fiebrink, R. A., Tanaka, A., Garcia, J., Bevilacqua, F. P., Héloir, A., Nunnari, F., Mackay, W. E., Amershi, S., Lee, B., et al. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2856492 · Cited by 152 · cited 1×
“Inspired by other researchers looking into how human-centered approaches affect machine learning [25, 59], we re-iterate the following two questions: (1) What role do humans play in HML configurations? and (2) Do HML configurations change the way in which machine learning is being done, if so, how? We believe that our…”
BackgroundAccelerating Human-in-the-loop Machine Learning: Challenges and Opportunities
Xin, D., Ma, L., Liu, J., Macke, S., Song, S., & Parameswaran, A. (2018) · Proceedings of the Second Workshop on Data Management for End-To-End Machine Learning · doi:10.1145/3209889.3209897 · Cited by 120 · cited 2×
“Domain experts, especially, are capable of seeing the big picture and using it to focus their judgment of the more specific messages, their distinctions and commonalities [72], offering more opportunities for humans to complement computers.”
BackgroundComments Mining With TF-IDF: The Inherent Bias and Its Removal
Yahav, I., Shehory, O. M., & Schwartz, D. G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2840127 · Cited by 115
Self-citationMixed Messages? The Limits of Automated Social Media Content Analysis
Duarte, N., Llansó, E., & Loup, A. C. (2018) · Cited by 112
How is New Organizational Knowledge Created in a Virtual Context? An Ethnographic Study
Baralou, E., & Tsoukas, H. (2015) · Organization Studies · doi:10.1177/0170840614556918 · Cited by 81 · cited 1×
“Indeed, in HML configurations, the bi-directional communication between human and machine enabled by the feedback is essential for sense making [6].”
BackgroundContextualization in Perspective
Son, J. Y., & Goldstone, R. L. (2008) · Cognition and Instruction · doi:10.1080/07370000802584539 · Cited by 79 · cited 1×
“Moreover, the process iterates, often in a trial-and-error manner, between a highly contextualized interpretation of a message to a more abstract, and necessarily decontextualized, view of the message [50, 61, 74].”
BackgroundHuman centered automation: oxymoron or common sense?
Sheridan, T. B. (2002) · 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century · doi:10.1109/icsmc.1995.537867 · Cited by 73 · cited 3×
“Several human-AI configurations that keep the human in the loop beyond the stage of machine training have been proposed to ensure the successful operation of intelligent systems [31, 55].”
BackgroundAmir, O., Doshi‐Velez, F., & Sarne, D. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09418-w · Cited by 63 · cited 1×
“This perspective leads to an allocation of tasks that requires mutual intelligibility [4, 62] and dialog between the human and the artificial in order to perform and learn more effectively.”
BackgroundCooperating Heterogeneous Systems
Schwartz, D. G. (1995) · Springer eBooks · doi:10.1007/978-1-4615-2211-9 · Cited by 56 · cited 1×
“First, the long standing relative-performance criterion for allocating tasks between the human and the machine [22] must be expanded to more complex and fuzzy criteria that consider also the transfer of control and responsibility from human to machine [53].”
BackgroundSelf-citationMaking Classifications (at) Work: Ordering Practices in Science
Roth, W. (2005) · Social Studies of Science · doi:10.1177/0306312705052102 · Cited by 56
The Contingent Impact of Contextualization on Computer-Mediated Collaboration
Katz, A., & Te’eni, D. (2007) · Organization Science · doi:10.1287/orsc.1060.0237 · Cited by 54 · cited 2×
“Katz and Te’eni [35] found that adding context to messages was effective only when their complexity was high.”
BackgroundSelf-citationSorting people out: The uses of one-dimensional classificatory schemes in a multi-dimensional world
Diedrich, A., Eriksson‐Zetterquist, U., & Styhre, A. (2011) · Culture and Organization · doi:10.1080/14759551.2011.590305 · Cited by 43
Alter, S. (2016) · Information Systems Journal · doi:10.1111/isj.12116 · Cited by 43 · cited 2×
“Our design science research (DSR) produces two artifacts that are described, respectively, in the paper’s two parts: a theory-based conceptual artifact [3] referred to as the HML configuration (in sections 2 and 4), and a technical artifact called Fusion (in sections 5-6 ).”
Analyzing Behavioral Big Data: Methodological, Practical, Ethical, and Moral Issues
Galit Shmueli, A. (2016) · Quality Engineering · doi:10.1080/08982112.2016.1210979 · Cited by 40
Research Dilemmas with Behavioral Big Data
Shmueli, G. (2017) · Big Data · doi:10.1089/big.2016.0043 · Cited by 40 · cited 2×
“The challenges of automated methods in modeling a broader context are even more pronounced when the data have some behavioral aspects, in the sense that they contain elements of intention, deception, emotion, reciprocation, herding, or other forms of human behavior [56], as in the case of online discourse [1, 2, 47, 5…”
BackgroundMethodBaecke, P., Baets, S. D., & Vanderheyden, K. (2017) · International Journal of Production Economics · doi:10.1016/j.ijpe.2017.05.016 · Cited by 39
Multiple-Criteria Decision-Making (MCDM) Techniques for Business Processes Information Management
Zavadskas, E. K., Antuchevičienė, J., & Chatterjee, P. (2019) · MDPI eBooks · doi:10.3390/books978-3-03897-643-1 · Cited by 36
Foreign Interference in the 2020 Election: Tools for Detecting Online Election Interference
Marcellino, W., Johnson, C., Posard, M. N., & Helmus, T. C. (2020) · RAND Corporation eBooks · doi:10.7249/rra704-2 · Cited by 19 · cited 2×
“[39] recently included human judgment to complement advanced automatic text classification to detect online interference on Twitter.”
BackgroundSo, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50334-5_9 · Cited by 18
Joint cognitive systems: Patterns in cognitive systems engineering
Naweed, A., & Bye, R. (2008) · Ergonomics · doi:10.1080/00140130701223774 · Cited by 17 · cited 1×
“We build on Suchman’s [63] idea of human-machine configurations to delineate the composition and bounds of our analysis, and take a joint cognitive-system perspective, in which the human and the artificial are cooperating partners aiming to learn rather than one being a tool for the other [71].”
MethodChallenging common interpretability assumptions in feature attribution explanationsPreprint
Dinu, J., Bigham, J. P., & Kolter, J. Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02748 · Cited by 17 · cited 1×
“More recently, researchers began exploring explainability and explainable AI (XAI) techniques [8, 11, 20, 51, 60].”
BackgroundThe Influence of Context on Sentence Acceptability Judgements
Bernardy, J.-P., Lappin, S., & Lau, J. H. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2073 · Cited by 11 · cited 1×
“[7] found that context improves acceptability ratings for ill-formed sentences, not for well-formed.”
BackgroundAnalyzing Behavioral Big Data: Methodological, Practical, Ethical, and Moral IssuesPreprint
Shmueli, G. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2736189 · Cited by 11
Uncovering the dark Web: A case study of Jihad on the Web
ChenHsinchun, ChungWingyan, QinJialun, ReidEdna, SagemanMarc, & WeimannGabriel (2008) · Journal of the American Society for Information Science and Technology · doi:10.5555/1388299.1388313 · Cited by 9
The use of task allocation charts in system design: A critical appraisal
Ip, W.-M., Damodaran, L., Olphert, C. W., & Maguire, M. C. (1990) · International Conference on Human-Computer Interaction · Cited by 8
So, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05268 · Cited by 3 · cited 4×
“Inspired by other researchers looking into how human-centered approaches affect machine learning [25, 59], we re-iterate the following two questions: (1) What role do humans play in HML configurations? and (2) Do HML configurations change the way in which machine learning is being done, if so, how? We believe that our…”
BackgroundInfluential
Research works printed but not linked: 10
- Ahmed Abbasi and Hsinchun Chen. 2008. CyberGate: a design framework and system for text analysis of computer-mediated communication. MIS Quarterly (2008), 811--837.
- 10.5555/1622407.1622416 · doi:10.5555/1622407.1622416
- Charles Goodwin. 2000. Practices of color classification. Mind, culture, and activity 7, 1--2 (2000), 19--36.
- 10.5555/647402.725294 · doi:10.5555/647402.725294
- Ton Jörg. 2004. A theory of reciprocal learning in dyads. Cognitive systems 6, 2 (2004), 3.
- Daniel Khashabi, Erfan Sadeqi Azer, Tushar Khot, Ashish Sabharwal, and Dan Roth. 2020. On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections. arXiv:1901.02522 [cs.CL] · arXiv
- 10.5555/3019323 · doi:10.5555/3019323
- Chaehan So. 2020. Understanding the Prediction Mechanism of Sentiments by XAI Visualization. arXiv preprint arXiv:2003.01425 (2020). · arXiv
- Dov Te'eni. 2001. A cognitive-affective model of organizational communication for designing IT. MIS quarterly 25, 2 (2001), 251--312.
- Efpraxia D Zamani, Anastasia Griva, Konstantina Spanaki, Paidi O'Raghallaigh, and David Sammon. 2021. Making sense of business analytics in project selection and prioritisation: insights from the start-up trenches. Information Technology & People (2021).
Cited by
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 671
“Some systems integrate basic learning capabilities [72] through feed-back loops [73,74], heuristics [75], or updated context buffers to refine behavior over time, particularly in settings like personalized recommendations or conversation flow management [76– 78].”
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · arXiv · doi:10.48550/arxiv.2505.10468 · Cited by 295
“Some systems integrate basic learning capabilities [72] through feed-back loops [73,74], heuristics [75], or updated context buffers to refine behavior over time, particularly in settings like personalized recommendations or conversation flow management [76– 78].”
What is Human-Centered about Human-Centered AI? A Map of the Research Landscape
Capel, T., & Brereton, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580959 · Cited by 228
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186
Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis
Calisto, F. M., Fernandes, J., Morais, M., Santiago, C., Abrantes, J. M., Nunes, N., & Nascimento, J. C. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580682 · Cited by 93
“From the HCI literature [15, 61, 124], we know that the development of trust is influenced by the positive motivational attribution between the communication entity and the user.”
Background
Metadata
- Authors
- Zagalsky, A., Te'eni, D., Yahav, I., Schwartz, D. G., Silverman, G., Cohen, D., Mann, Y., & Lewinsky, D.
- Affiliations
- Tel Aviv University (IL)
- Tel Aviv University, Tel Aviv, Israel
- Bar-Ilan University (IL)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-10-13
- Volume
- 5
- Issue
- CSCW2
- Pages
- 1-36
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3206213635
- Cited by
- 35
- References
- 74
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 6 · 2023: 9 · 2022: 6 · 2021: 1
- FWCI
- 1.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Funders
- Israel National Cyber Directorate (0612018391)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- mutual learning, human-AI collaboration, text classification, cybersecurity, clinical text classification, explainable AI, design principles, fusion systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.