CoChat

Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process

Zhang, Zelun Tony, Feger, Sebastian S., Dullenkopf, Lucas, Liao, Rulu, Süsslin, Lou, Liu, Yuanting, Butz, Andreas · 2024 · Proceedings of the ACM on Human-Computer Interaction
Cited by 16

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decision-making process. Alternative support paradigms are rare, and it remains unclear how the few that do exist compare to recommendation-centric support. In this work, we aimed to empirically compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We conducted a mixed-methods study with 32 professional pilots in a realistic setting. To ensure the quality of our study scenarios, we conducted a focus group with four additional pilots prior to the study. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system and make faster decisions when combined with recommendations, though the forward support can be disrupted. Participants' statements further suggest a shift in design goal away from providing recommendations, to supporting quick information gathering. Our results show ways to design more helpful and effective AI decision support that goes beyond end-to-end recommendations.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3687024

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 45 references

Research works printed but not linked: 34

  1. 10.1007/978--3-031-02217--3_5 · doi:10.1007/978--3-031-02217--3_5
  2. 10.1111/1559-8918.2018.01208 · DOI
  3. 10.1145/3544548.3581251 · DOI · Paper page
  4. Zana Buçinca, Alexandra Chouldechova, Jennifer Wortman Vaughan, and Krzysztof Z. Gajos. 2022. Beyond end predictions: stop putting machine learning first and design human-centered AI for decision support. In Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22). Virtual Event, USA, 1--4.
  5. 10.1145/3449287 · doi:10.1145/3449287 · Paper page
  6. 10.1145/3502289 · DOI · Paper page
  7. 10.1145/3544548.3581253 · DOI
  8. 10.1145/3564040 · doi:10.1145/3564040
  9. 10.1145/3531146.3533193 · DOI · Paper page
  10. 10.1145/3544548.3580694 · DOI · Paper page
  11. 10.1108/00022660710780650 · DOI
  12. 10.1145/3610067 · DOI · Paper page
  13. 10.1207/s15327108ijap0901_2 · DOI · Paper page
  14. 10.1145/3581641.3584052 · DOI · Paper page
  15. Hans-Jürgen Hörmann. 1994. FOR-DEC - A prescriptive model for aeronautical decision making. In Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP). Avebury Aviation, Dublin, Ireland, 17--23.
  16. 10.1145/3357236.3395436 · DOI · Paper page
  17. 10.1145/3532106.3533556 · DOI · Paper page
  18. Sean Koon. 2022. A human-capabilities orientation for human-AI interaction design. In Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22). Virtual Event, USA, 1--5.
  19. 10.3357/AMHP.5720.2021 · doi:10.3357/amhp.5720.2021
  20. 10.48550/arXiv.2302.01241 · DOI
  21. 10.1145/3397481.3450681 · DOI
  22. 10.1109/MSEC.2019.2925649 · DOI · Paper page
  23. 10.1007/978--3-030--21451--7_22 · doi:10.1007/978--3-030--21451--7_22
  24. 10.1007/978--3-030--57321--8_24 · doi:10.1007/978--3-030--57321--8_24
  25. 10.1518/001872007X312469 · DOI · Paper page
  26. 10.1109/TTS.2020.2992669 · DOI · Paper page
  27. 10.1109/3468.568744 · DOI · Paper page
  28. 10.1145/3422156 · DOI · Paper page
  29. 10.1159/000511930 · DOI · Paper page
  30. 10.1007/978--3--642--50329-0_11 · doi:10.1007/978--3--642--50329-0_11
  31. 10.54941/ahfe1003844 · DOI
  32. 10.1145/3544548.3581393 · DOI · Paper page
  33. 10.1145/3464385.3464696 · DOI
  34. 10.1145/3581641.3584056 · DOI

Cited by

Metadata

Authors
Zhang, Z. T., Feger, S. S., Dullenkopf, L., Liao, R., Süsslin, L., Liu, Y., & Butz, A.
Affiliations
  • fortiss GmbH & LMU Munich, Munich, Germany
  • LMU Munich & TH Rosenheim, Munich, Germany
  • Airbus Defence and Space GmbH, Manching, Germany
  • LMU Munich, Munich, Germany
  • TU Wien, Vienna, Austria
  • Research Institute of the Free State of Bavaria, fortiss GmbH, Munich, Germany
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2024-11-07
Volume
8
Issue
CSCW2
Pages
1-32
ISSN
2573-0142
Cited by
16
References
45
Language
en
Funders
German Federal Ministry for Economic Affairs and Climate Action (LuFo VI-1 program, project KIEZ4-0)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.