The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
Open accessAbstract
We propose a framework for interactive and explainable machine learning that enables users to (1) understand machine learning models; (2) diagnose model limitations using different explainable AI methods; as well as (3) refine and optimize the models. Our framework combines an iterative XAI pipeline with eight global monitoring and steering mechanisms, including quality monitoring, provenance tracking, model comparison, and trust building. To operationalize the framework, we present explAIner, a visual analytics system for interactive and explainable machine learning that instantiates all phases of the suggested pipeline within the commonly used TensorBoard environment. We performed a user-study with nine participants across different expertise levels to examine their perception of our workflow and to collect suggestions to fill the gap between our system and framework. The evaluation confirms that our tightly integrated system leads to an informed machine learning process while disclosing opportunities for further extensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use both a simple and a complex network trained on the MNIST dataset [40], simulating a real-life environment.”
MethodGrad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Axiomatic attribution for deep networks
Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“Especially for deciding when to stop the training and retraining [24], a measurement for the data fitness of the model is of immense importance.”
BackgroundDeep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503 · cited 1×
“For example, DL methods outperform traditional algorithms for image processing [56] or natural language processing [82] and can often be applied by domain experts without prior ML expertise [12].”
MethodTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Learning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 2×
“These can implement user guidance [4] or propose the use of alternative mediums of explanation, such as verbalization [62].”
BackgroundAnchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162
Bergstra, J., Yamins, D. L. K., & Cox, D. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1,852
Neural Architecture Search: A Survey
Elsken, T., Metzen, J. H., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1808.05377 · Cited by 1,763
Deep Reinforcement Learning That Matters
Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685
Zeiler, M. D., Krishnan, D., Taylor, G. W., & Fergus, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539957 · Cited by 1,666
Dataset Shift in Machine Learning
(2008) · doi:10.7551/mitpress/9780262170055.001.0001 · Cited by 1,553
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Explaining nonlinear classification decisions with deep taylor decomposition
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357 · cited 9×
“Besides LIME as an example for surrogate models, we implemented several other model-based explainers, including Layer-Wise Relevance Propagation (LRP) and several gradient-based methods, such as Saliency and Deeplift [6, 68, 64].”
BackgroundInfluentialKim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., & Sayres, R. (2017) · arXiv · doi:10.48550/arxiv.1711.11279 · Cited by 1,240
Recent Trends in Deep Learning Based Natural Language Processing
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02709 · Cited by 1,192
A logical calculus of the ideas immanent in nervous activity
MCCULLOCH, W., & PITTS, W. (1990) · Bulletin of Mathematical Biology · doi:10.1016/s0092-8240(05)80006-0 · Cited by 922
Dataset Shift in Machine Learning
Adams, N. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00624_10.x · Cited by 694
Fails, J. A., & Olsen, D. R. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604056 · Cited by 633
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629
Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers
Hohman, F., Kahng, M., Pienta, R., & Chau, D. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2843369 · Cited by 582
Towards Better Analysis of Deep Convolutional Neural Networks
Liu, M., Shi, J., Li, Z., Li, C., Zhu, J., & Liu, S. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598831 · Cited by 498
Not Just a Black Box: Learning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., Shcherbina, A., & Kundaje, A. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01713 · Cited by 496
iNNvestigate neural networks!Preprint
Alber, M., Lapuschkin, S., Seegerer, P., Hägele, M., Schütt, K. T., Montavon, G., Samek, W., Müller, K., Dähne, S., & Kindermans, P.-J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04260 · Cited by 438
Optimizing deep learning hyper-parameters through an evolutionary algorithm
Young, S. R., Rose, D. C., Karnowski, T. P., Lim, S.-H., & Patton, R. M. (2015) · Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments · doi:10.1145/2834892.2834896 · Cited by 424
Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making
Cai, C. J., Reif, E., Hegde, N., Hipp, J., Kim, B., Smilkov, D., Wattenberg, M., Viegas, F., Corrado, G. S., Stumpe, M. C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300234 · Cited by 405
On the Role of Scientific Thought
Dijkstra, E. W. (1982) · Selected Writings on Computing: A personal Perspective · doi:10.1007/978-1-4612-5695-3_12 · Cited by 397
Towards better analysis of machine learning models: A visual analytics perspective
Liu, S., Wang, X., Liu, M., & Zhu, J. (2017) · Visual Informatics · doi:10.1016/j.visinf.2017.01.006 · Cited by 397
Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models
Krause, J., Perer, A., & Ng, K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858529 · Cited by 390
(2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 390
Knowledge Generation Model for Visual Analytics
Sacha, D., Stoffel, A., Stoffel, F., Kwon, B. C., Ellis, G., & Keim, D. A. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346481 · Cited by 387
LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
Strobelt, H., Gehrmann, S., Pfister, H., & Rush, A. M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744158 · Cited by 371
Towards better understanding of gradient-based attribution methods for Deep Neural Networks
Ancona, M., Ceolini, E., Öztireli, C., & Groß, M. H. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000249929 · Cited by 368
ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Models
Kahng, M., Andrews, P. Y., Kalro, A., & Chau, D. H. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744718 · Cited by 337
Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow
Wongsuphasawat, K., Smilkov, D., Wexler, J., Wilson, J., Mane, D., Fritz, D., Krishnan, D., Viegas, F. B., & Wattenberg, M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744878 · Cited by 331
Deep Reinforcement Learning that Matters
Henderson, P. B., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.06560 · Cited by 324
NN-SVG: Publication-Ready Neural Network Architecture Schematics
LeNail, A. (2019) · Journal of Open Source Software · doi:10.21105/joss.00747 · Cited by 309
Kwon, B. C., Choi, M.-J., Kim, J. T., Choi, E., Kim, Y. B., Kwon, S., Sun, J., & Choo, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865027 · Cited by 294 · cited 1×
“We have identified works that are designed to diagnose and refine single ML models, e.g., [44, 52, 39].”
BackgroundVisualizing the Hidden Activity of Artificial Neural Networks
Rauber, P. E., Fadel, S. G., Falcao, A. X., & Telea, A. C. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598838 · Cited by 280
A novel method to estimate model uncertainty using machine learning techniques
Solomatine, D. P., & Shrestha, D. L. (2009) · Water Resources Research · doi:10.1029/2008wr006839 · Cited by 246
Rulematrix: Visualizing and understanding classifiers with rules
Ming, Y., Qu, H., & Bertini, E. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864812 · Cited by 243
Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
Strobelt, H., Gehrmann, S., Behrisch, M., Perer, A., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865044 · Cited by 239
Machine Learning Bias, Statistical Bias, and Statistical Variance of Decision Tree Algorithms
Dietterich, T. G., & Bae, E. H. (2008) · Cited by 224
Machine Teaching: A New Paradigm for Building Machine Learning SystemsPreprint
Simard, P. Y., Amershi, S., Chickering, D. M., Pelton, A. E., Ghorashi, S., Meek, C., Ramos, G., Suh, J., Verwey, J., Wang, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06742 · Cited by 220
Manifold: A Model-Agnostic Framework for Interpretation and Diagnosis of Machine Learning Models
Zhang, J., Wang, Y., Molino, P., Li, L., & Ebert, D. S. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864499 · Cited by 220
Explainable Artificial Intelligence (XAI)
Mohaghegh, S. D. (2024) · Artificial Intelligence for Science and Engineering Applications · doi:10.1201/9781003369356-8 · Cited by 215
Understanding Hidden Memories of Recurrent Neural Networks
Ming, Y., Cao, S., Zhang, R., Li, Z., Chen, Y., Song, Y., & Qu, H. (2017) · 2017 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585721 · Cited by 207
GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentation
Kahng, M., Thorat, N., Chau, D. H. P., Viegas, F. B., & Wattenberg, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864500 · Cited by 206
iForest: Interpreting Random Forests via Visual Analytics
Zhao, X., Wu, Y., Lee, D. L., & Cui, W. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864475 · Cited by 203
Do Convolutional Neural Networks Learn Class Hierarchy?
Bilal, A., Jourabloo, A., Ye, M., Liu, X., & Ren, L. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744683 · Cited by 199
The State of the Art in Integrating Machine Learning into Visual Analytics
Endert, A., Ribarsky, W., Turkay, C., Wong, B. L. W., Nabney, I., Blanco, I. D., & Rossi, F. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13092 · Cited by 192
Analyzing the Training Processes of Deep Generative Models
Liu, M., Shi, J., Cao, K., Zhu, J., & Liu, S. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744938 · Cited by 169
DeepEyes: Progressive Visual Analytics for Designing Deep Neural Networks
Pezzotti, N., Hollt, T., Van Gemert, J., Lelieveldt, B. P. F., Eisemann, E., & Vilanova, A. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744358 · Cited by 165
DQNViz: A Visual Analytics Approach to Understand Deep Q-Networks
Wang, J., Gou, L., Shen, H., & Yang, H. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864504 · Cited by 153
VIS4ML: An Ontology for Visual Analytics Assisted Machine Learning
Sacha, D., Kraus, M., Keim, D. A., & Chen, M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864838 · Cited by 153
An Interactive Node-Link Visualization of Convolutional Neural Networks
Harley, A. W. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27857-5_77 · Cited by 150
Recent research advances on interactive machine learning
Jiang, L., Liu, S., & Chen, C. (2018) · Journal of Visualization · doi:10.1007/s12650-018-0531-1 · Cited by 119
A Workflow for Visual Diagnostics of Binary Classifiers using Instance-Level Explanations
Krause, J., Dasgupta, A., Swartz, J. L., Aphinyanaphongs, Y., & Bertini, E. (2017) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585720 · Cited by 110
Supporting Story Synthesis: Bridging the Gap between Visual Analytics and Storytelling
Chen, S., Li, J., Andrienko, G., Andrienko, N. V., Wang, Y., Nguyen, P. H., & Turkay, Ç. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2889054 · Cited by 100
Progressive Learning of Topic Modeling Parameters: A Visual Analytics Framework
El‐Assady, M., Sevastjanova, R., Sperrle, F., Keim, D. A., & Collins, C. M. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2745080 · Cited by 91
Self-citationAnalyzing the Noise Robustness of Deep Neural Networks
Liu, M., Liu, S., Su, H., Cao, K., & Zhu, J. (2018) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2018.8802509 · Cited by 85
Direct-Manipulation Visualization of Deep NetworksPreprint
Smilkov, D., Carter, S., Sculley, D., Viégas, F. B., & WATTENBERG, M. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03788 · Cited by 84
Analyzing the Noise Robustness of Deep Neural Networks
Cao, K., Liu, M., Su, H., Wu, J., Zhu, J., & Liu, S. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.2969185 · Cited by 81
Fails, J. A., & Olsen, D. R. (2003) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/604050.604056 · Cited by 79
Visual Analytics for Topic Model Optimization based on User-Steerable Speculative Execution
El‐Assady, M., Sperrle, F., Deußen, O., Keim, D. A., & Collins, C. M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864769 · Cited by 76
Self-citationBayesian optimization for automated model selection
Malkomes, G., Schaff, C., & Garnett, R. (2016) · neural information processing systems · Cited by 65
How AI detectives are cracking open the black box of deep learning
(2017) · AAAS Articles DO Group · doi:10.1126/science.aan7059 · Cited by 59
DeepCompare: Visual and Interactive Comparison of Deep Learning Model Performance
Murugesan, S., Malik, S., Du, F., Koh, E., & Lai, T. (2019) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2019.2919033 · Cited by 57
AVOCADO: Visualization of Workflow–Derived Data Provenance for Reproducible Biomedical Research
Stitz, H., Luger, S., Streit, M., & Gehlenborg, N. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12924 · Cited by 56
Semantic Concept Spaces: Guided Topic Model Refinement using Word-Embedding Projections
El‐Assady, M., Kehlbeck, R., Collins, C. M., Keim, D. A., & Deußen, O. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934654 · Cited by 56
Self-citationGoing beyond Visualization. Verbalization as Complementary Medium to Explain Machine Learning Models
Sevastjanova, R., Beck, F., Ell, B., Turkay, Ç., Henkin, R., Butt, M., Keim, D. A., & El‐Assady, M. (2018) · City Research Online (City University London) · Cited by 43
Self-citationField experiment methodology for pair analytics
Kaastra, L. T., & Fisher, B. (2014) · Workshop on Beyond Time and Errors · doi:10.1145/2669557.2669572 · Cited by 26
Visualization methods for neural networks
Bischof, H., Pinz, A. J., & Kropatsch, W. G. (2003) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1992.201845 · Cited by 23
Speculative Execution for Guided Visual Analytics
Sperrle, F., Bernard, J., Sedlmair, M., Keim, D. A., & El‐Assady, M. (2018) · doi:10.1109/mlui52768.2018.10075559 · Cited by 16
Self-citation
Cited by
Explainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
Notions of explainability and evaluation approaches for explainable artificial intelligence
Vilone, G., & Longo, L. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.009 · Cited by 598
Expanding Explainability: Towards Social Transparency in AI systems
Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445188 · Cited by 538
Metadata
- Authors
- Spinner, T., Schlegel, U., Schafer, H., & El-Assady, M.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2019
- Volume
- 26
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W2965446359
- Cited by
- 254
- References
- 84
- FWCI
- 12.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.