Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 211Human-Automation Interaction and SafetyExplainable Artificial Intelligence (XAI)Usability and User Interface Design

The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index; none of the 84 sources its claims cite is checked for support yet.

Human-AI collaboration is not very collaborative yet: a taxonomy of interaction patterns in AI-assisted decision making from a systematic review

Open access
Gomez, Catalina, Cho, Sue Min, Ke, Shichang, Huang, Chien-Ming, Unberath, Mathias·2025·Frontiers in Computer Science

Abstract

Leveraging Artificial Intelligence (AI) in decision support systems has disproportionately focused on technological advancements, often overlooking the alignment between algorithmic outputs and human expectations. A human-centered perspective attempts to alleviate this concern by designing AI solutions for seamless integration with existing processes. Determining what information AI should provide to aid humans is vital, a concept underscored by explainable AI's efforts to justify AI predictions. However, how the information is presented, e.g., the sequence of recommendations and solicitation of interpretations, is equally crucial as complex interactions may emerge between humans and AI. While empirical studies have evaluated human-AI dynamics across domains, a common vocabulary for human-AI interaction protocols is lacking. To promote more deliberate consideration of interaction designs, we introduce a taxonomy of interaction patterns that delineate various modes of human-AI interactivity. We summarize the results of a systematic review of AI-assisted decision making literature and identify trends and opportunities in existing interactions across application domains from 105 articles. We find that current interactions are dominated by simplistic collaboration paradigms, leading to little support for truly interactive functionality. Our taxonomy offers a tool to understand interactivity with AI in decision-making and foster interaction designs for achieving clear communication, trustworthiness, and collaboration.

Overview

CoChat Summary

TL;DR

This systematic review of 105 empirical studies proposes a taxonomy of interaction patterns for AI-assisted decision making. It finds that current human-AI interactions are dominated by simple AI-first and AI-follow assistance, with limited support for more interactive collaboration.

Key findings

  • Across 105 articles and 131 interaction sequences, AI-first assistance was most common (n = 67), followed by AI-follow assistance (n = 28); AI solutions were accompanied by additional information in 81% and 68% of those patterns, respectively.
  • More interactive patterns were less frequent: Request-driven AI assistance (n = 25; 14 for direct solution, 13 for support information), Secondary assistance (n = 16), User-guided interactive adjustments (n = 9), Delegation (n = 9), and AI-guided dialogic user engagement (n = 6, of which 5 were conversational).
  • Domains included healthcare (26/108), generic tasks (20/108), finance/business (15/108), and law (6/108); most evaluations used non-expert users (60/108), and less than 15% used artificial tasks. AI systems were simulated/Wizard of Oz (39/105), deep learning-based (34/105), or shallow models (35/105).
  • The taxonomy comprises seven interaction patterns—AI-first assistance, AI-follow assistance, Secondary assistance, Request-driven AI assistance, AI-guided dialogic user engagement, User-guided interactive adjustments, and Delegation—plus an “Others” category.

Methods

  • Systematic review of empirical human-AI decision-making studies from 2013 to June 2023 across ACM Digital Library, IEEE Xplore, Compendex, Scopus, and PubMed; the initial search returned 3,770 papers, 358 duplicates were removed, 3,412 were screened, and 105 articles were included.
  • Inclusion required complete decision-making tasks, an implemented interface for human-AI interaction, screen-based/virtual/non-embodied setups, and empirical user studies; robotics, gaming, short papers (<8 pages), non-peer-reviewed works, and reviews/surveys were excluded.
  • Data extraction coded context, AI system, and interaction building blocks (action-output pairs); interaction sequences were grouped iteratively into the taxonomy, and pattern frequency was quantified via automated search plus manual inspection.

Limitations

  • Stated: search terminology may have excluded relevant work if interaction design was not explicitly mentioned; publication bias is possible; including only one healthcare-focused database alongside general databases may limit observed domain frequencies; analysis was restricted to screen-based interfaces; strict complete-decision-task criteria were used; some papers lacked sufficient interface detail for full recreation; and further use-case evaluations are needed to assess the taxonomy’s utility.
  • Evident from the text: because interaction patterns are not mutually exclusive and the taxonomy was iteratively refined by the authors, category assignments may involve subjective interpretation.
  • Evident from the text: the corpus ends in June 2023, so newer interaction patterns or studies published after that date are not represented.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fcomp.2024.1521066

Cites

130 of 130 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Image 1
CC-BY · From the PDF
Image 2
CC-BY · From the PDF
Image 3
CC-BY · From the PDF

Verification

Claims the paper makes

0 Valid · 0 Not valid · 45 Not checked · 126 Own results and interpretations

81 more claims

Create a free account to see all 171 claims and to verify the 77 references still open.

See all claims — free account
  • Probably not a substantial claim. 73
  • It may state two separate claims as one. 26
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

1 of 1

Citations

Cites

Show all 129 references

Research works printed but not linked: 1

  1. David, 2022, “Interaction templates: a data-driven approach for authoring robot programs,”, PLATEAU: 12th Annual Workshop at the Intersection of PL and HCI

Cited by

Metadata

Authors
Gomez, C., Cho, S. M., Ke, S., Huang, C.-M., & Unberath, M.
Affiliations
Johns Hopkins University (US)
Corresponding author
Unberath, Mathias
Venue
Frontiers in Computer Science
Published
2025-01-06
Volume
6
ISSN
2624-9898 (ISSN-L)
OpenAlex
W4406083100
Cited by
209
References
129
Citations by year
2026: 160 · 2025: 46
FWCI
20.79
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Computer Science (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University) (cc-by-nc-nd)
Funders
Johns Hopkins University
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
human-AI collaboration, AI-assisted decision-making, interaction design, decision support system, explainable AI, trust in AI, human-centered AI, interaction protocols

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.