Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Understanding predictive models, in terms of interpreting and identifying actionable insights, is a challenging task. Often the importance of a feature in a model is only a rough estimate condensed into one number. However, our research goes beyond these naïve estimates through the design and implementation of an interactive visual analytics system, Prospector. By providing interactive partial dependence diagnostics, data scientists can understand how features affect the prediction overall. In addition, our support for localized inspection allows data scientists to understand how and why specific datapoints are predicted as they are, as well as support for tweaking feature values and seeing how the prediction responds. Our system is then evaluated using a case study involving a team of data scientists improving predictive models for detecting the onset of diabetes from electronic medical records.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Lecture Notes in Computer Science 1205
(1999) · Industrial Robot: An International Journal · doi:10.1108/ir.1999.04926fae.001 · Cited by 38,662
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731 · cited 3×
“Partial dependence was proposed by Friedman [14] for analyzing gradient boosting models and has since been used for other models as well (e.”
MethodThe Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,370
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Kuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788 · cited 2×
“Predictive modeling is defined as the process of developing a mathematical tool or model that generates an accurate prediction [24].”
MethodStatistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.907095 · Cited by 1,861
Research works printed but not linked: 8
- Cortez Paulo, IEEE Symposium on. 341-348
- Frank Eibe, Knowledge Discovery in Databases (PKDD), Nada Lavra, Dragan Gamberger, Ljupo Todorovski, and Hendrik Blockeel (Eds.)
- Kim Been, 2014, The Bayesian Case Model, In Advances in Neural Information Processing Systems., 1952
- Carson, Knowledge-Based and Intelligent Information & Engineering Systems 18th Annual Conference (KES), Proceedings of.
- 10.5555/2283516.2283682 · doi:10.5555/2283516.2283682
- Plate Tony, 1997, Progress in Connectionist-Based Information Systems: Proceedings of The Fourth International Conference on Neural Information Processing (ICONIP'97), 306
- Tzeng Fan-Yin, 2005, Proceedings of IEEE Visualization '05 Conference. IEEE, 383-390
- van den Elzen Stef, IEEE Conference on. 151-160
Cited by
Items 101–200 of 513
Symphony: Composing Interactive Interfaces for Machine Learning
Bäuerle, A., Cabrera, Á. A., Hohman, F., Maher, M., Koski, D., Suau, X., Barik, T., & Moritz, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502102 · Cited by 69
Explainable recommendation: when design meets trust calibration
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2021) · World Wide Web · doi:10.1007/s11280-021-00916-0 · Cited by 68
Explainable Machine Learning with Prior Knowledge: An Overview
Beckh, K., Müller, S., Jakobs, M., Toborek, V., Tan, H., Fischer, R., Welke, P., Houben, S., & von Rueden, L. (2021) · Lancaster EPrints (Lancaster University) · doi:10.48550/arxiv.2105.10172 · Cited by 68
Bove, C., Aigrain, J., Lesot, M.-J., Tijus, C., & Detyniecki, M. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511139 · Cited by 67
Lu, S., Chen, R., Wei, W., & Lu, X. (2021) · PubMed Central · doi:10.48550/arxiv.2103.11254 · Cited by 66
Can We Trust Your Explanations? Sanity Checks for Interpreters in Android Malware Analysis
Fan, M., Wei, W., Xie, X., Liu, Y., Guan, X., & Liu, T. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3021924 · Cited by 65
Many hands make many fingers to point: challenges in creating accountable AI
Slota, S. C., Fleischmann, K. R., Greenberg, S. R., Verma, N., Cummings, B., Li, L., & Shenefiel, C. (2021) · AI & Society · doi:10.1007/s00146-021-01302-0 · Cited by 65
Liu, S., Li, Z., Li, T., Srikumar, V., Pascucci, V., & Bremer, P. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865230 · Cited by 65
Zytek, A., Liu, D., Vaithianathan, R., & Veeramachaneni, K. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114864 · Cited by 62
“[11] developed P ROSPECTOR , a comprehensive visualization system for data scientists.”
BackgroundOutlining the Design Space of Explainable Intelligent Systems for Medical DiagnosisPreprint
Xie, Y., Gao, G., & Chen, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06019 · Cited by 62
Are MOOC Learning Analytics Results Trustworthy? With Fake Learners, They Might Not Be!
Alexandron, G., Yoo, L. Y., Ruipérez‐Valiente, J. A., Lee, S., & Pritchard, D. E. (2019) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00183-1 · Cited by 62
Good systems, bad data?: Interpretations of AI hype and failures
Slota, S. C., Fleischmann, K. R., Greenberg, S. R., Verma, N., Cummings, B., Li, L., & Shenefiel, C. (2020) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.275 · Cited by 60
Xie, X., Du, F., & Wu, Y. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3028957 · Cited by 60
Effects of Uncertainty and Cognitive Load on User Trust in Predictive Decision Making
Zhou, J., Arshad, S. Z., Luo, S., & Chen, F. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68059-0_2 · Cited by 59
“…ML models transparent through revealing user responses to ML models, but not directly explain how ML algorithms process data to get outputs with visualizations or feature contributions [36–38], where domain users still have difficulty to understand those complex visualizations and abstract numbers.”
Rationalization: A Neural Machine Translation Approach to Generating Natural Language ExplanationsPreprint
Ehsan, U., Harrison, B. E., Chan, L., & Riedl, M. O. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07826 · Cited by 59
Granger-Causal Attentive Mixtures of Experts: Learning Important Features with Neural Networks
Schwab, P., Miladinovic, D., & Karlen, W. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014846 · Cited by 63
AlphaPortfolio for Investment and Economically Interpretable AIPreprint
Cong, L. W., Tang, K., Wang, J., & Zhang, Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3554486 · Cited by 58
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference
Gehrmann, S., Strobelt, H., Kruger, R., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934595 · Cited by 58
Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignment
Gao, Y., Sun, T., Zhao, L., & Hong, S.-S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555590 · Cited by 58
Exploring the effects of human-centered AI explanations on trust and reliance
Scharowski, N., Perrig, S. A. C., Svab, M., Opwis, K., & Brühlmann, F. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1151150 · Cited by 57
Visual Analysis of Hidden State Dynamics in Recurrent Neural NetworksPreprint
Strobelt, H., Gehrmann, S., Huber, B., Pfister, H., & Rush, A. M. (2016) · RePEc: Research Papers in Economics · Cited by 57
Visualizing Uncertainty and Alternatives in Event Sequence Predictions
Guo, S., Du, F., Malik, S., Koh, E., Kim, S., Liu, Z., Kim, D., Zha, H., & Cao, N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300803 · Cited by 56
Baselli, G., Codari, M., & Sardanelli, F. (2020) · European Radiology Experimental · doi:10.1186/s41747-020-00159-0 · Cited by 56
Hoque, M. N., & Mueller, K. D. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3102051 · Cited by 55
Explaining artificial intelligence with visual analytics in healthcare
Ooge, J., Štiglic, G., & Verbert, K. (2021) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1427 · Cited by 55
Explainable Artificial Intelligence in Cybersecurity: A Brief Review
Hariharan, S., Velicheti, A., Anagha, A. S., Thomas, C., & Balakrishnan, N. (2021) · doi:10.1109/isea-isap54304.2021.9689765 · Cited by 54
Generating Realistic Natural Language Counterfactuals
Robeer, M., Bex, F., & Feelders, A. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.306 · Cited by 55
Principles of Explainable Artificial Intelligence
Guidotti, R., Monreale, A., Pedreschi, D., & Giannotti, F. (2021) · Springer eBooks · doi:10.1007/978-3-030-76409-8_2 · Cited by 53
Shen, H., Jin, H., Cabrera, Á. A., Perer, A., Zhu, H., & Hong, J. I. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415224 · Cited by 52
Self-citationEXMOS: Explanatory Model Steering through Multifaceted Explanations and Data Configurations
Bhattacharya, A., Stumpf, S., Gosak, L., Štiglic, G., & Verbert, K. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642106 · Cited by 53
Response Quality in Human-Chatbot Collaborative Systems
Jiang, J., & Ahuja, N. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401234 · Cited by 52
A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?
Wang, Z., Huang, C., & Yao, X. (2024) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3702004 · Cited by 52
Hernandez-Bocanegra, D. C., & Ziegler, J. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3579541 · Cited by 50
Responsible AI in Farming: A Multi-Criteria Framework for Sustainable Technology Design
Mallinger, K., & Baeza-Yates, R. A. (2024) · Applied Sciences · doi:10.3390/app14010437 · Cited by 49
Analysis and visualization of sleep stages based on deep neural networks
Krauß, P., Metzner, C., Joshi, N., Schulze, H., Traxdorf, M., Maier, A., & Schilling, A. (2021) · Neurobiology of Sleep and Circadian Rhythms · doi:10.1016/j.nbscr.2021.100064 · Cited by 48
A Visual Analytics Conceptual Framework for Explorable and Steerable Partial Dependence Analysis
Angelini, M., Blasilli, G., Lenti, S., & Santucci, G. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3263739 · Cited by 47
Sokol, K., & Flach, P. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.14466 · Cited by 47
A Study on Interaction in Human-in-the-Loop Machine Learning for Text Analytics.
Yang, Y., Kandogan, E., Li, Y., Sen, P., & Lasecki, W. S. (2019) · IUI Workshops · Cited by 47
BEAMES: Interactive Multimodel Steering, Selection, and Inspection for Regression Tasks
Das, S., Cashman, D., Chang, R., & Endert, A. (2019) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2019.2922592 · Cited by 46
BlowFab: Rapid Prototyping for Rigid and Reusable Objects using Inflation of Laser-cut Surfaces
Yamaoka, J., Niiyama, R., & Kakehi, Y. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126624 · Cited by 46
Eliciting Personality Traits in Large Language ModelsPreprint
Hilliard, A., Muñoz, C., Wu, Z., & Koshiyama, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.08341 · Cited by 45
Explainable predictive process monitoring: a user evaluation
Rizzi, W., Comuzzi, M., Francescomarino, C. D., Ghidini, C., Lee, S., Maggi, F. M., & Nolte, A. (2024) · Process Science · doi:10.1007/s44311-024-00003-3 · Cited by 45
Yu, B., Yuan, Y., Terveen, L., Wu, Z. S., Forlizzi, J., & Zhu, H. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395528 · Cited by 44
TeleGam: Combining Visualization and Verbalization for Interpretable Machine Learning
Hohman, F., Srinivasan, A., & Drucker, S. M. (2019) · 2019 IEEE Visualization Conference (VIS) · doi:10.1109/visual.2019.8933695 · Cited by 44
An Interpretable Hand-Crafted Feature-Based Model for Atrial Fibrillation Detection
Rouhi, R., Clausel, M., Oster, J., & Lauer, F. (2021) · Frontiers in Physiology · doi:10.3389/fphys.2021.657304 · Cited by 44
Linder, R., Mohseni, S., Yang, F., Pentyala, S., Ragan, E. D., & Hu, X. (2021) · Applied AI Letters · doi:10.1002/ail2.49 · Cited by 43
A Visual Analytics Framework for Explaining and Diagnosing Transfer Learning Processes
Ma, Y., Fan, A., He, J., Nelakurthi, A. R., & Maciejewski, R. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3028888 · Cited by 44
Automated coding of implicit motives: A machine-learning approach
Pang, J. S., & Ring, H. (2020) · Motivation and Emotion · doi:10.1007/s11031-020-09832-8 · Cited by 43
Badaoui, M., Buigues, P. J., Berta, D., Mandana, G. M., Gu, H., Földes, T., Dickson, C. J., Horn̆ák, V., Kato, M., Molteni, C., et al. (2022) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.1c00924 · Cited by 43
VAC-CNN: A Visual Analytics System for Comparative Studies of Deep Convolutional Neural Networks
Xuan, X., Zhang, X., Kwon, O.-H., & Ma, K. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3165347 · Cited by 42
Interpretability and Transparency in Artificial Intelligence
Mittelstadt, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.20 · Cited by 41
Towards Explainable Evaluation Metrics for Natural Language GenerationPreprint
Leiter, C., Lertvittayakumjorn, P., Fomicheva, M., Zhao, W., Gao, Y., & Eger, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.11131 · Cited by 41
Evaluating the Interpretability of Generative Models by Interactive Reconstruction
Ross, A., Chen, N., Hang, E. Z., Glassman, E. L., & Doshi-Velez, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445296 · Cited by 40
“While some of this work has used user studies to quantify interpretability [35, 42, 45, 59], there have been concerns within the HCI community that these studies do not generalize to more realistic use cases [13].”
ResultBhattacharya, A., Ooge, J., Stiglic, G., & Verbert, K. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584075 · Cited by 40
Wu, T., Weld, D. S., & Heer, J. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3319616 · Cited by 39
How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Games
Dodge, J. E., Penney, S., Hilderbrand, C., Anderson, A. W., & Burnett, M. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174136 · Cited by 38
Identifying Factors Associated with Neonatal Mortality in Sub-Saharan Africa using Machine LearningPreprint
Ogallo, W., Speakman, S., Akinwande, V., Varshney, K. R., Walcott-Bryant, A., Wayua, C., Weldemariam, K., Mershon, C.-H., & Orobaton, N. (2020) · medRxiv · doi:10.1101/2020.10.14.20212225 · Cited by 38
Guesmi, M., Chatti, M. A., Joarder, S., Ain, Q. U., Alatrash, R., Siepmann, C., & Vahidi, T. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2262797 · Cited by 37
Predicting Health Care Costs Using Evidence Regression
Panay, B., Baloian, N. A., Pino, J. A., Peñafiel, S., Sanson, H., & Bersano, N. (2019) · International Conference on Ubiquitous Computing and Ambient Intelligence (UCAmI) · doi:10.3390/proceedings2019031074 · Cited by 37
Interactive Machine Learning: A State of the Art ReviewPreprint
Wondimu, N., Buche, C., & Visser, U. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.06196 · Cited by 37
Incremental XAI: Memorable Understanding of AI with Incremental Explanations
Bo, J. Y., Hao, P., & Lim, B. Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642689 · Cited by 36
Interactive Machine Learning by Visualization: A Small Data Solution
Li, H., Fang, S., Mukhopadhyay, S., Saykin, A. J., & Shen, L. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8621952 · Cited by 36
Managing Randomness to Enable Reproducible Machine Learning
Ahmed, H., & Lofstead, J. (2022) · International Workshop on Practical Reproducible Evaluation of Computer Systems (P-RECS) · doi:10.1145/3526062.3536353 · Cited by 37
Bhusal, D., Shin, H. J., Shewale, A. A., Veerabhadran, M. K., Clifford, M., Rampazzi, S., & Rastogi, N. (2023) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3600160.3600193 · Cited by 36
Using image processing and automated classification models to classify microscopic gram stain images
Kristensen, K., Ward, L., Mogensen, M. L., & Cichosz, S. L. (2022) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2022.100091 · Cited by 36
Getting Playful with Explainable AI: Games with a Purpose to Improve Human Understanding of AI
Fulton, L. B., Lee, J. Y., Wang, Q., Yuan, Z., Hammer, J., & Perer, A. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382831 · Cited by 35
Self-citationShow or suppress? Managing input uncertainty in machine learning model explanations
Wang, D., Zhang, W., & Lim, B. Y. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103456 · Cited by 35
A New Perspective on Evaluation Methods for Explainable Artificial Intelligence (XAI)
Speith, T., & Langer, M. (2023) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00061 · Cited by 35
GAM Coach: Towards Interactive and User-centered Algorithmic Recourse
Wang, Z. J., Vaughan, J. W., Caruana, R., & Chau, D. H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580816 · Cited by 35
DFSeer: A Visual Analytics Approach to Facilitate Model Selection for Demand Forecasting
Sun, D. B., Feng, Z., Chen, Y., Wang, Y., Zeng, J., Yuan, M., Pong, T.-C., & Qu, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376866 · Cited by 35
Evaluating Explanation Without Ground Truth in Interpretable Machine Learning
Yang, F., Du, M., & Hu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06831 · Cited by 34
Explainable AI for Cybersecurity
Sindiramutty, S. R., Tan, C. E., Lau, S. P., Thangaveloo, R., Gharib, A. H., Manchuri, A. R., Khan, N. A., Tee, W. J., & Muniandy, L. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-6684-6361-1.ch002 · Cited by 34
Johs, A. J., Agosto, D. E., & Weber, R. O. (2022) · Applied AI Letters · doi:10.1002/ail2.64 · Cited by 34
Sopan, A., Berninger, M. L., Mulakaluri, M., & Katakam, R. (2018) · IEEE Symposium on Visualization for Cyber Security (VIZSEC) · doi:10.1109/vizsec.2018.8709231 · Cited by 34
Improving Visualization Interpretation Using Counterfactuals
Kaul, S., Borland, D., Cao, N., & Gotz, D. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114779 · Cited by 33
VINE: Visualizing Statistical Interactions in Black Box ModelsPreprint
Britton, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.00561 · Cited by 33
Harnessing Prior Knowledge for Explainable Machine Learning: An Overview
Beckh, K., Müller, S., Jakobs, M., Toborek, V., Tan, H., Fischer, R., Welke, P., Houben, S., & von Rueden, L. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00038 · Cited by 33
Bae, S. W., Suffoletto, B. P., Zhang, T., Chung, T. A., Ozolcer, M., Islam, R., & Dey, A. K. (2023) · JMIR Formative Research · doi:10.2196/39862 · Cited by 33
PDPilot: Exploring Partial Dependence Plots Through Ranking, Filtering, and Clustering
Kerrigan, D., Barr, B., & Bertini, E. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3545025 · Cited by 33
Instance-Level Explanations for Fraud Detection: A Case StudyPreprint
Collaris, D., Vink, L. M., & van Wijk, J. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07129 · Cited by 32
Wang, R., Miao, Z., Liu, T., Liu, M., Grdinovac, K., Song, X., Liang, Y., Delen, D., & Paiva, W. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10071473 · Cited by 32
Wong, L. J., Clark, W. H., Flowers, B., Buehrer, R. M., Michaels, A. J., & Headley, W. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00432 · Cited by 32
Ouyang, Y., Wu, Y., Wang, H., Zhang, C., Cheng, F., Jiang, C., Jin, L., Cao, Y., & Li, Q. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326929 · Cited by 31
Explanations of Black-Box Model Predictions by Contextual Importance and Utility
Anjomshoae, S., Främling, K., & Najjar, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30391-4_6 · Cited by 31
IF-City: Intelligible Fair City Planning to Measure, Explain and Mitigate Inequality
Lyu, Y., Lu, H., Lee, M. K., Schmitt, G., & Lim, B. Y. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3239909 · Cited by 31
“Interfaces for explanations in human-AI interaction: proposing a design evaluation approach,”
Mucha, H., Robert, S., Breitschwerdt, R., & Fellmann, M. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451759 · Cited by 30
Nourani, M., Roy, C., Rahman, T., Ragan, E. D., Ruozzi, N., & Gogate, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02335 · Cited by 29
Caicedo-Torres, W., & Gutiérrez, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117190 · Cited by 29
Bachinger, F., Kronberger, G., & Affenzeller, M. (2021) · IET Collaborative Intelligent Manufacturing · doi:10.1049/cim2.12009 · Cited by 30
Wong, L. J., Clark, W. H., Flowers, B., Buehrer, R. M., Headley, W. C., & Michaels, A. J. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3112939 · Cited by 29
Visual Analytics of a Computer-Aided Diagnosis System for Pancreatic Lesions
Dmitriev, K., Marino, J., Baker, K. D., & Kaufman, A. E. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2947037 · Cited by 28
Chasing Luck: Data-driven Prediction, Faith, Hunch, and Cultural Norms in Rural Betting Practices
Sultana, S., Mozumder, M. M. H., & Ahmed, S. I. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445047 · Cited by 28
Usage of statistical modeling techniques in surface and groundwater level prediction
Kenda, K., Peternelj, J., Mellios, N. K., Kofinas, D., Čerin, M., & Rožanec, J. M. (2020) · AQUA - Water Infrastructure Ecosystems and Society · doi:10.2166/aqua.2020.143 · Cited by 28
Lim, B. Y., Cahaly, J. P., Sng, C. Y. F., & Chew, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714058 · Cited by 27
Hsueh, P.-Y. S., Cheung, Y. K., Dey, S., Kim, K. K., Martin-Sanchez, F. J., Petersen, S. K., & Wetter, T. C. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-009 · Cited by 26
Sokol, K., & Flach, P. A. (2020) · Bristol Research (University of Bristol) · Cited by 26
Learning-From-Disagreement: A Model Comparison and Visual Analytics Framework
Wang, J., Wang, L., Zheng, Y. L., Yeh, C. M., Jain, S., & Zhang, W. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3172107 · Cited by 26
mTSeer: Interactive Visual Exploration of Models on Multivariate Time-series Forecast
Xu, K., Yuan, J., Wang, Y., Silva, C. T., & Bertini, E. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445083 · Cited by 25
Decision Boundary Visualization for Counterfactual Reasoning
Sohns, J., Garth, C., & Leitte, H. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14650 · Cited by 25
Score Following as a Multi-Modal Reinforcement Learning Problem
Henkel, F., Balke, S., Dorfer, M., & Widmer, G. (2019) · Transactions of the International Society for Music Information Retrieval · doi:10.5334/tismir.31 · Cited by 25
Metadata
- Authors
- Krause, J., Perer, A., & Ng, K.
- Affiliations
- New York University (US)
- IBM (United States) (US)
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 5686-5697
- OpenAlex
- W2394669110
- Cited by
- 390
- References
- 50
- Citations by year
- 2026: 14 · 2025: 31 · 2024: 37 · 2023: 38 · 2022: 33 · 2021: 83 · 2020: 54 · 2019: 48 · 2018: 27 · 2017: 19 · 2016: 6
- FWCI
- 11.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- interactive visual analysis, partial dependence, model interpretability, feature importance, explainable machine learning, electronic health records, prospectors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.