Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 45

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior

Boggust, Angie, Hoover, Benjamin, Satyanarayan, Arvind, Strobelt, Hendrik · 2022 · CHI Conference on Human Factors in Computing Systems

Abstract

Saliency methods — techniques to identify the importance of input features on a model’s output — are a common step in understanding neural network behavior. However, interpreting saliency requires tedious manual inspection to identify and aggregate patterns in model behavior, resulting in ad hoc or cherry-picked analysis. To address these concerns, we present Shared Interest: metrics for comparing model reasoning (via saliency) to human reasoning (via ground truth annotations). By providing quantitative descriptors, Shared Interest enables ranking, sorting, and aggregating inputs, thereby facilitating large-scale systematic analysis of model behavior. We use Shared Interest to identify eight recurring patterns in model behavior, such as cases where contextual features or a subset of ground truth features are most important to the model. Working with representative real-world users, we show how Shared Interest can be used to decide if a model is trustworthy, uncover issues missed in manual analyses, and enable interactive probing.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3491102.3501965

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 37

  1. Julius Adebayo , Justin Gilmer , Michael Muelly , Ian J. Goodfellow , Moritz Hardt , and Been Kim . 2018 . Sanity Checks for Saliency Maps . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS) . Montréal, Canada, 9525–9536. Julius Adebayo, Justin Gilmer, Michael Muelly, Ian J. Goodfellow, Moritz Hardt, and Been Kim. 2018. Sanity Checks for Saliency Maps. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS). Montréal, Canada, 9525–9536.
  2. Julius Adebayo Michael Muelly Ilaria Liccardi and Been Kim. 2020. Debugging Tests for Model Explanations. arXiv preprint arXiv:2011.05429(2020). Julius Adebayo Michael Muelly Ilaria Liccardi and Been Kim. 2020. Debugging Tests for Model Explanations. arXiv preprint arXiv:2011.05429(2020). · arXiv
  3. Brandon Carter , Siddhartha Jain , Jonas Mueller , and David Gifford . 2021 . Overinterpretation reveals image classification model pathologies . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS). Virtual Event. Brandon Carter, Siddhartha Jain, Jonas Mueller, and David Gifford. 2021. Overinterpretation reveals image classification model pathologies. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS). Virtual Event.
  4. Brandon Carter , Jonas Mueller , Siddhartha Jain , and David K. Gifford . 2019 . What made you do this? Understanding black-box decisions with sufficient input subsets . In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS). PMLR , Naha, Japan, 567–576. Brandon Carter, Jonas Mueller, Siddhartha Jain, and David K. Gifford. 2019. What made you do this? Understanding black-box decisions with sufficient input subsets. In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS). PMLR, Naha, Japan, 567–576.
  5. Noel Codella Veronica Rotemberg Philipp Tschandl M. Emre Celebi Stephen Dusza David Gutman Brian Helba Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler and Allan Halpern. 2019. Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC). arxiv:1902.03368 [cs.CV] Noel Codella Veronica Rotemberg Philipp Tschandl M. Emre Celebi Stephen Dusza David Gutman Brian Helba Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler and Allan Halpern. 2019. Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC). arxiv:1902.03368 [cs.CV] · arXiv
  6. Finale Doshi-Velez and Been Kim. 2017. Towards A Rigorous Science of Interpretable Machine Learning. arxiv:1702.08608 [stat.ML] Finale Doshi-Velez and Been Kim. 2017. Towards A Rigorous Science of Interpretable Machine Learning. arxiv:1702.08608 [stat.ML] · arXiv
  7. Andre Esteva , Brett Kuprel , Roberto A. Novoa , Justin Ko , Susan M. Swetter , Helen M. Blau , and Sebastian Thrun . 2017. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 7639 ( 2017 ), 115–118. Andre Esteva, Brett Kuprel, Roberto A. Novoa, Justin Ko, Susan M. Swetter, Helen M. Blau, and Sebastian Thrun. 2017. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 7639 (2017), 115–118.
  8. 10.1109/TVCG.2019.2934659 · DOI · Paper page
  9. 10.1109/TVCG.2017.2744718 · DOI · Paper page
  10. 10.1109/TVCG.2018.2864500 · DOI · Paper page
  11. Been Kim , Martin Wattenberg , Justin Gilmer , Carrie Cai , James Wexler , Fernanda Viegas , and Rory Sayres . 2018 . Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) . In Proceedings of the International Conference on Machine Learning (ICML). PMLR , Stockholm, Sweden, 2668–2677. Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory Sayres. 2018. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In Proceedings of the International Conference on Machine Learning (ICML). PMLR, Stockholm, Sweden, 2668–2677.
  12. Pieter-Jan Kindermans , Sara Hooker , Julius Adebayo , Maximilian Alber , Kristof T. Schütt , Sven Dähne , Dumitru Erhan , and Been Kim . 2019. The (Un)reliability of Saliency Methods . In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Vol. 11700 . Springer , 267–280. Pieter-Jan Kindermans, Sara Hooker, Julius Adebayo, Maximilian Alber, Kristof T. Schütt, Sven Dähne, Dumitru Erhan, and Been Kim. 2019. The (Un)reliability of Saliency Methods. In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Vol. 11700. Springer, 267–280.
  13. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization . In Proceedings of the International Conference on Learning Representations (ICLR) . San Diego, USA. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In Proceedings of the International Conference on Learning Representations (ICLR). San Diego, USA.
  14. Narine Kokhlikyan , Vivek Miglani , Miguel Martin , Edward Wang , Bilal Alsallakh , Jonathan Reynolds , Alexander Melnikov , Natalia Kliushkina , Carlos Araya , Siqi Yan , and Orion Reblitz-Richardson . 2020 . Captum: A unified and generic model interpretability library for PyTorch. arxiv:2009.07896 [cs.LG] Narine Kokhlikyan, Vivek Miglani, Miguel Martin, Edward Wang, Bilal Alsallakh, Jonathan Reynolds, Alexander Melnikov, Natalia Kliushkina, Carlos Araya, Siqi Yan, and Orion Reblitz-Richardson. 2020. Captum: A unified and generic model interpretability library for PyTorch. arxiv:2009.07896 [cs.LG] · arXiv
  15. Scott M. Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions . In Proceedings of the Conference on Neural Information Processing Systems (NIPS) . Long Beach, USA, 4765–4774. Scott M. Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Proceedings of the Conference on Neural Information Processing Systems (NIPS). Long Beach, USA, 4765–4774.
  16. 10.1109/ICDM.2012.110 · DOI · Paper page
  17. Christopher Meek. 2016. A Characterization of Prediction Errors. arxiv:1611.05955 [cs.LG] Christopher Meek. 2016. A Characterization of Prediction Errors. arxiv:1611.05955 [cs.LG] · arXiv
  18. Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , and Aram Galstyan . 2021. A Survey on Bias and Fairness in Machine Learning. Comput. Surveys 54, 6 ( 2021 ), 115:1–115:35. Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A Survey on Bias and Fairness in Machine Learning. Comput. Surveys 54, 6 (2021), 115:1–115:35.
  19. Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , Alban Desmaison , Andreas Köpf , Edward Z. Yang , Zachary DeVito , Martin Raison , Alykhan Tejani , Sasank Chilamkurthy , Benoit Steiner , Lu Fang , Junjie Bai , and Soumith Chintala . 2019 . PyTorch: An Imperative Style, High-Performance Deep Learning Library . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS) . Vancouver, Canada, 8024–8035. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS). Vancouver, Canada, 8024–8035.
  20. 10.1007/s11747-019-00710-5 · DOI · Paper page
  21. 10.1109/TVCG.2016.2598828 · DOI · Paper page
  22. 10.1145/2939672.2939778 · DOI · Paper page
  23. 10.1109/ICCV.2017.74 · DOI · Paper page
  24. Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2014 . Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps . In Proceedings of the International Conference on Learning Representations (ICLR), Workshop Track . Banff, Canada. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In Proceedings of the International Conference on Learning Representations (ICLR), Workshop Track. Banff, Canada.
  25. Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , and Martin A. Riedmiller . 2015 . Striving for Simplicity: The All Convolutional Net . In Proceedings of the International Conference on Learning Representations (ICLR), Workshop Track, Yoshua Bengio and Yann LeCun (Eds.) . San Diego, USA. Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin A. Riedmiller. 2015. Striving for Simplicity: The All Convolutional Net. In Proceedings of the International Conference on Learning Representations (ICLR), Workshop Track, Yoshua Bengio and Yann LeCun (Eds.). San Diego, USA.
  26. 10.1109/TVCG.2017.2744158 · DOI · Paper page
  27. Pascal Sturmfels , Scott Lundberg , and Su-In Lee . 2020. Visualizing the Impact of Feature Attribution Baselines. Distill ( 2020 ). https://doi.org/10.23915/distill.00022 https://distill.pub/2020/attribution-baselines. Pascal Sturmfels, Scott Lundberg, and Su-In Lee. 2020. Visualizing the Impact of Feature Attribution Baselines. Distill (2020). https://doi.org/10.23915/distill.00022 https://distill.pub/2020/attribution-baselines. · DOI · Paper page
  28. Mukund Sundararajan , Ankur Taly , and Qiqi Yan . 2017 . Axiomatic Attribution for Deep Networks . In Proceedings of the International Conference on Machine Learning (ICML). PMLR , Sydney, Australia, 3319–3328. Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017. Axiomatic Attribution for Deep Networks. In Proceedings of the International Conference on Machine Learning (ICML). PMLR, Sydney, Australia, 3319–3328.
  29. 10.1609/aaai.v34i04.6064 · DOI · Paper page
  30. Philipp Tschandl , Cliff Rosendahl , and Harald Kittler . 2018. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific Data 5, 1 ( 2018 ). Philipp Tschandl, Cliff Rosendahl, and Harald Kittler. 2018. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific Data 5, 1 (2018).
  31. Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Andrew Ilyas , and Aleksander Madry . 2020 . From ImageNet to Image Classification: Contextualizing Progress on Benchmarks . In Proceedings of the International Conference on Machine Learning (ICML), Vol. 119 . PMLR, Virtual Event, 9625–9635. Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Andrew Ilyas, and Aleksander Madry. 2020. From ImageNet to Image Classification: Contextualizing Progress on Benchmarks. In Proceedings of the International Conference on Machine Learning (ICML), Vol. 119. PMLR, Virtual Event, 9625–9635.
  32. 10.1007/978-3-540-88693-8_52 · DOI · Paper page
  33. James Wexler , Mahima Pushkarna , Tolga Bolukbasi , Martin Wattenberg , Fernanda B. Viégas , and Jimbo Wilson . 2020 . The What-If Tool: Interactive Probing of Machine Learning Models . IEEE Transactions on Visualization and Computer Graphics 26 , 1(2020), 56 – 65 . James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda B. Viégas, and Jimbo Wilson. 2020. The What-If Tool: Interactive Probing of Machine Learning Models. IEEE Transactions on Visualization and Computer Graphics 26, 1(2020), 56–65.
  34. 10.1109/TVCG.2017.2744878 · DOI · Paper page
  35. Kai Yuanqing Xiao , Logan Engstrom , Andrew Ilyas , and Aleksander Madry . 2021 . Noise or Signal: The Role of Image Backgrounds in Object Recognition . In Proceedings of the International Conference on Learning Representations (ICLR). OpenReview.net, Virtual Event. Kai Yuanqing Xiao, Logan Engstrom, Andrew Ilyas, and Aleksander Madry. 2021. Noise or Signal: The Role of Image Backgrounds in Object Recognition. In Proceedings of the International Conference on Learning Representations (ICLR). OpenReview.net, Virtual Event.
  36. Mengjiao Yang and Been Kim. 2019. Benchmarking Attribution Methods with Relative Feature Importance. arxiv:1907.09701 [cs.LG] Mengjiao Yang and Been Kim. 2019. Benchmarking Attribution Methods with Relative Feature Importance. arxiv:1907.09701 [cs.LG] · arXiv
  37. Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and Understanding Convolutional Networks . In Proceedings of the European Conference on Computer Vision (ECCV), Vol. 8689 . Springer, Zurich, Switzerland, 818–833. Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and Understanding Convolutional Networks. In Proceedings of the European Conference on Computer Vision (ECCV), Vol. 8689. Springer, Zurich, Switzerland, 818–833.

Cited by

See all 45

Metadata

Authors
Boggust, A., Hoover, B., Satyanarayan, A., & Strobelt, H.
Affiliations
  • CSAIL, Massachusetts Institute of Technology, United States
  • IBM Research, United States
Venue
CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2022-04-27
Pages
1-17
Cited by
45
References
12
Funders
  • United States Air Force Research Laboratory and United States Air Force Artificial Intelligence Accelerator (FA8750-19-2-1000)
  • MIT-IBM Watson AI Lab (Towards Intuitive AI)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior. https://app.cochat.ai/papers/10.1145/3491102.3501965
The paper
Boggust, A., Hoover, B., Satyanarayan, A., & Strobelt, H. (2022). Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3501965

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.