Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.

What can AI do for me?: evaluating machine learning interpretations in cooperative play

Feng, Shi, Boyd-Graber, Jordan · 2019 · Proceedings of the 24th International Conference on Intelligent User Interfaces

Abstract

Machine learning is an important tool for decision making, but its ethical and responsible application requires rigorous vetting of its interpretability and utility: an understudied problem, particularly for natural language processing models. We propose an evaluation of interpretation on a real task with real human users, where the effectiveness of interpretation is measured by how much it improves human performance. We design a grounded, realistic human-computer cooperative setting using a question answering task, Quizbowl. We recruit both trivia experts and novices to play this game with computer as their teammate, who communicates its prediction via three different interpretations. We also provide design guidance for natural language processing human-in-the-loop settings.

Overview

Integrity signals

Registry

Crossref · 10.1145/3301275.3302265

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 6

  1. Ian J. Goodfellow , Jonathon Shlens , and Christian Szegedy . 2015 . Explaining and Harnessing Adversarial Examples . In Proceedings of the International Conference on Learning Representations. Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. In Proceedings of the International Conference on Learning Representations.
  2. Pieter-Jan Kindermans , Sara Hooker , Julius Adebayo , Maximilian Alber , Kristof T. Schütt , Sven Dähne , Dumitru Erhan , and Been Kim . 2017. The (Un)reliability of saliency methods. arXiv preprint arXiv: 1711.00867 ( 2017 ). Pieter-Jan Kindermans, Sara Hooker, Julius Adebayo, Maximilian Alber, Kristof T. Schütt, Sven Dähne, Dumitru Erhan, and Been Kim. 2017. The (Un)reliability of saliency methods. arXiv preprint arXiv: 1711.00867 (2017). · arXiv
  3. Zachary Chase Lipton . 2016. The Mythos of Model Interpretability. arXiv preprint arXiv: 1606.03490 ( 2016 ). Zachary Chase Lipton. 2016. The Mythos of Model Interpretability. arXiv preprint arXiv: 1606.03490 (2016). · arXiv
  4. Tim Miller . 2017. Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269 ( 2017 ). Tim Miller. 2017. Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269 (2017). · arXiv
  5. Cynthia Rudin . 2018. Please Stop Explaining Black Box Models for High Stakes Decisions. arXiv preprint arXiv:1811.10154 ( 2018 ). Cynthia Rudin. 2018. Please Stop Explaining Black Box Models for High Stakes Decisions. arXiv preprint arXiv:1811.10154 (2018). · arXiv
  6. USACM. 2017. Statement on algorithmic transparency and accountability . Public Policy Council ( 2017 ). USACM. 2017. Statement on algorithmic transparency and accountability. Public Policy Council (2017).

Cited by

See all 106

Metadata

Authors
Feng, S., & Boyd-Graber, J.
Affiliations
University of Maryland, College Park (US)
Venue
Proceedings of the 24th International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2019-03-17
Pages
229-239
OpenAlex
W2896487960
Cited by
92
References
68
Citations by year
2026: 3 · 2025: 11 · 2024: 14 · 2023: 24 · 2022: 9 · 2021: 15 · 2020: 11 · 2019: 5
FWCI
3.83
Type
conference paper
Language
en
Open access
closed
Locations
ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
Funders
  • National Science Foundation
  • Raytheon Company
  • Raytheon Technologies
  • Defense Advanced Research Projects Agency
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
interpretability, explainable AI, human-computer collaboration, question answering, human-in-the-loop, natural language processing models, ethical AI, human performance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.