Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 21

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models

Mishra, Swati, Rzeszotarski, Jeffrey M. · 2021 · Proceedings of the ACM on Human-Computer Interaction

Abstract

An important challenge in building explainable artificially intelligent (AI) systems is designing interpretable explanations. AI models often use low-level data features which may be hard for humans to interpret. Recent research suggests that situating machine decisions in abstract, human understandable concepts can help. However, it is challenging to determine the right level of conceptual mapping. In this research, we explore granularity (of data features) and context (of data instances) as dimensions underpinning conceptual mappings. Based on these measures, we explore strategies for designing explanations in classification models. We introduce an end-to-end concept elicitation pipeline that supports gathering high-level concepts for a given data set. Through crowd-sourced experiments, we examine how providing conceptual information shapes the effectiveness of explanations, finding that a balance between coarse and fine-grained explanations help users better estimate model predictions. We organize our findings into systematic themes that can inform design considerations for future systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3449213

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 58

  1. 10.1109/TPAMI.2012.120 · DOI · Paper page
  2. 10.1145/3097983.3098070 · DOI · Paper page
  3. Ashwin Bhandare, Maithili Bhide, Pranav Gokhale, and Rohan Chandavarkar. 2016. Applications of convolutional neural networks. International Journal of Computer Science and Information Technologies, Vol. 7, 5 (2016), 2206--2215.
  4. Mustafa Bilgic and Raymond J. Mooney. 2005. Explaining Recommendations: Satisfaction vs. Promotion. In Proceedings of Beyond Personalization 2005: A Workshop on the Next Stage of Recommender Systems Research at the 2005 International Conference on Intelligent User Interfaces, Vol. 5. IUI, San Diego, CA, 153. http://www.cs.utexas.edu/users/ai-lab?bilgic:iui-bp05
  5. 10.1007/978-981-10-0557-2_87 · DOI · Paper page
  6. 10.5555/1866696.1866697 · doi:10.5555/1866696.1866697
  7. 10.1017/S0140525X10000919 · DOI · Paper page
  8. 10.1145/2818048.2820023 · DOI
  9. 10.1145/3025453.3026044 · DOI · Paper page
  10. 10.1145/2470654.2466265 · DOI · Paper page
  11. 10.18653/v1 · doi:10.18653/v1
  12. 10.1109/CVPR.2013.81 · DOI · Paper page
  13. 10.1145/1015330.1015408 · DOI · Paper page
  14. Anthony Elliott. 2019. The culture of AI: Everyday life and the digital revolution .Routledge, Australia.
  15. 10.1145/2702123.2702556 · DOI · Paper page
  16. 10.5555/1866696.1866709 · doi:10.5555/1866696.1866709
  17. Nils Gehlenborg and Bang Wong. 2012. Points of view: heat maps. · DOI
  18. 10.1109/CVPR.2014.81 · DOI · Paper page
  19. 10.5120/11638-7118 · DOI · Paper page
  20. 10.1145/2856767.2856811 · DOI
  21. 10.1145/1807342.1807376 · DOI · Paper page
  22. Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications.
  23. Minsuk Kahng, Nikhil Thorat, Duen Horng Polo Chau, Fernanda B Viégas, and Martin Wattenberg. 2018. Gan lab: Understanding complex deep generative models using interactive visual experimentation. IEEE transactions on visualization and computer graphics, Vol. 25, 1 (2018), 1--11.
  24. Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory sayres. 2018. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research), Jennifer Dy and Andreas Krause (Eds.), Vol. 80. PMLR, Stockholmsmässan, Stockholm Sweden, 2668--2677. http://proceedings.mlr.press/v80/kim18d.html
  25. 10.1145/1357054.1357127 · DOI · Paper page
  26. 10.1109/WACV.2007.18 · DOI
  27. N. Luhmann H. Davis J. Raffan K. Rooney M. King and C. Morgner. 1979. Trust and Power. Wiley USA.
  28. Scott M. Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 4768--4777.
  29. 10.1109/IECON.2018.8591457 · DOI · Paper page
  30. 10.2307/258792 · DOI · Paper page
  31. Sina Mohseni, Niloofar Zarei, and Eric D. Ragan. 2020. A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems. arxiv: cs.HC/1811.11839
  32. Gregory Murphy. 2004. The big book of concepts. MIT press, USA.
  33. 10.18653/v1 · doi:10.18653/v1
  34. David Oleson, Alexander Sorokin, Greg Laughlin, Vaughn Hester, John Le, and Lukas Biewald. 2011. Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing. In Proceedings of the 11th AAAI Conference on Human Computation (AAAIWS'11-11). AAAI Press, San Francisco, USA, 43--48.
  35. Forough Poursabzi-Sangdeh, Dan Goldstein, Jake Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018a. Manipulating and Measuring Model Interpretability. https://www.microsoft.com/en-us/research/publication/manipulating-and-measuring-model-interpretability/
  36. Forough Poursabzi-Sangdeh, Dan Goldstein, Jake Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018b. Manipulating and Measuring Model Interpretability. https://www.microsoft.com/en-us/research/publication/manipulating-and-measuring-model-interpretability/
  37. Daryl Pregibon et almbox. 1981. Logistic regression diagnostics. The Annals of Statistics, Vol. 9, 4 (1981), 705--724.
  38. J. Ross Quinlan. 1986. Induction of decision trees. Machine learning, Vol. 1, 1 (1986), 81--106.
  39. 10.1145/2939672.2939778 · DOI · Paper page
  40. Eleanor H Rosch. 1973. Natural categories. Cognitive psychology, Vol. 4, 3 (1973), 328--350.
  41. Denise M Rousseau, Sim B Sitkin, Ronald S Burt, and Colin Camerer. 1998. Not so different after all: A cross-discipline view of trust. Academy of management review, Vol. 23, 3 (1998), 393--404.
  42. 10.1145/2047196.2047199 · DOI · Paper page
  43. 10.1016/j.eswa.2019.113100 · DOI · Paper page
  44. Philipp Schmidt and Felix Biessmann. 2019. Quantifying Interpretability and Trust in Machine Learning Systems. arxiv: cs.LG/1901.08558
  45. 10.1109/ICCV.2017.74 · DOI · Paper page
  46. 10.1109/ICCV.2019.00268 · DOI · Paper page
  47. Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. arxiv: cs.CV/1409.1556
  48. 10.1145/2968219.2968326 · DOI
  49. 10.1109/CVPR.2015.7298935 · DOI · Paper page
  50. 10.1108/00330330610681295 · DOI · Paper page
  51. Svante Wold, Kim Esbensen, and Paul Geladi. 1987. Principal component analysis. Chemometrics and intelligent laboratory systems, Vol. 2, 1--3 (1987), 37--52.
  52. 10.3115/981732.981751 · DOI · Paper page
  53. Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and Understanding Convolutional Networks. In Computer Vision -- ECCV 2014,, David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars (Eds.). Springer International Publishing, Cham, 818--833.
  54. 10.1631/FITEE.1700808 · DOI · Paper page
  55. Bolei Zhou, David Bau, Aude Oliva, and Antonio Torralba. 2018a. Interpreting deep visual representations via network dissection. IEEE transactions on pattern analysis and machine intelligence, Vol. 41, 9 (2018), 2131--2145.
  56. 10.1109/CVPR.2016.319 · DOI · Paper page
  57. 10.1007/978-3-030-01237-3_8 · DOI · Paper page
  58. Radim ?eh??ek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. pam??ový nosi?. In Proceedings of LREC 2010 workshop New Challenges for NLP Frameworks (Valletta, Malta). University of Malta, Valletta, Malta, 46--50. http://www.fi.muni.cz/usr/sojka/presentations/lrec2010-poster-rehurek-sojka.pdf

Cited by

See all 21

Metadata

Authors
Mishra, S., & Rzeszotarski, J. M.
Affiliations
Cornell University, Ithaca, NY, USA
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2021-04-13
Volume
5
Issue
CSCW1
Pages
1-26
ISSN
2573-0142
Cited by
21
References
12
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models. https://app.cochat.ai/papers/10.1145/3449213
The paper
Mishra, S., & Rzeszotarski, J. M. (2021). Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3449213

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.