CoChat

The Design of Reciprocal Learning Between Human and Artificial Intelligence

Zagalsky, Alexey, Te'eni, Dov, Yahav, Inbal, Schwartz, David G., Silverman, Gahl, Cohen, Daniel, Mann, Yossi, Lewinsky, Dafna · 2021 · Proceedings of the ACM on Human-Computer Interaction

The DOI matches its Crossref record; 71 of the 74 references it cites were found in a registry or an index.

Abstract

The need for advanced automation and artificial intelligence (AI) in various fields, including text classification, has dramatically increased in the last decade, leaving us critically dependent on their performance and reliability. Yet, as we increasingly rely more on AI applications, their algorithms are becoming more nuanced, more complex, and less understandable precisely at a time we need to understand them better and trust them to perform as expected. Text classification in the medical and cybersecurity domains is a good example of a task where we may wish to keep the human in the loop. Human experts lack the capacity to deal with the high volume and velocity of data that needs to be classified, and ML techniques are often unexplainable and lack the ability to capture the required context needed to make the right decision and take action. We propose a new abstract configuration of Human-Machine Learning (HML) that focuses on reciprocal learning, where the human and the AI are collaborating partners. We employ design-science research (DSR) to learn and design an application of the HML configuration, which incorporates software to support combining human and artificial intelligences. We define the HML configuration by its conceptual components and their function. We then describe the development of a system called Fusion that supports human-machine reciprocal learning. Using two case studies of text classification from the cyber domain, we evaluate Fusion and the proposed HML approach, demonstrating benefits and challenges. Our results show a clear ability of domain experts to improve the ML classification performance over time, while both human and machine, collaboratively, develop their conceptualization, i.e., their knowledge of classification. We generalize our insights from the DSR process as actionable principles for researchers and designers of 'human in the learning loop' systems. We conclude the paper by discussing HML configurations and the challenge of capturing and representing knowledge gained jointly by human and machine, an area we feel has great potential.

Overview

Integrity signals

Registry

Crossref · 10.1145/3479587

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 71 references

Research works printed but not linked: 10

  1. Ahmed Abbasi and Hsinchun Chen. 2008. CyberGate: a design framework and system for text analysis of computer-mediated communication. MIS Quarterly (2008), 811--837.
  2. 10.5555/1622407.1622416 · doi:10.5555/1622407.1622416
  3. Charles Goodwin. 2000. Practices of color classification. Mind, culture, and activity 7, 1--2 (2000), 19--36.
  4. 10.5555/647402.725294 · doi:10.5555/647402.725294
  5. Ton Jörg. 2004. A theory of reciprocal learning in dyads. Cognitive systems 6, 2 (2004), 3.
  6. Daniel Khashabi, Erfan Sadeqi Azer, Tushar Khot, Ashish Sabharwal, and Dan Roth. 2020. On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections. arXiv:1901.02522 [cs.CL] · arXiv
  7. 10.5555/3019323 · doi:10.5555/3019323
  8. Chaehan So. 2020. Understanding the Prediction Mechanism of Sentiments by XAI Visualization. arXiv preprint arXiv:2003.01425 (2020). · arXiv
  9. Dov Te'eni. 2001. A cognitive-affective model of organizational communication for designing IT. MIS quarterly 25, 2 (2001), 251--312.
  10. Efpraxia D Zamani, Anastasia Griva, Konstantina Spanaki, Paidi O'Raghallaigh, and David Sammon. 2021. Making sense of business analytics in project selection and prioritisation: insights from the start-up trenches. Information Technology & People (2021).

Cited by

Metadata

Authors
Zagalsky, A., Te'eni, D., Yahav, I., Schwartz, D. G., Silverman, G., Cohen, D., Mann, Y., & Lewinsky, D.
Affiliations
  • Tel Aviv University (IL)
  • Tel Aviv University, Tel Aviv, Israel
  • Bar-Ilan University (IL)
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2021-10-13
Volume
5
Issue
CSCW2
Pages
1-36
ISSN
2573-0142 (ISSN-L)
OpenAlex
W3206213635
Cited by
35
References
74
Citations by year
2026: 5 · 2025: 8 · 2024: 6 · 2023: 9 · 2022: 6 · 2021: 1
FWCI
1.94
Type
journal article
Language
en
Open access
closed
Locations
Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
Funders
Israel National Cyber Directorate (0612018391)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
Keywords
mutual learning, human-AI collaboration, text classification, cybersecurity, clinical text classification, explainable AI, design principles, fusion systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.