InterpretML: A Unified Framework for Machine Learning Interpretability
Open accessAbstract
InterpretML is an open-source Python package which exposes machine learning interpretability algorithms to practitioners and researchers. InterpretML exposes two types of interpretability - glassbox models, which are machine learning models designed for interpretability (ex: linear models, rule lists, generalized additive models), and blackbox explainability techniques for explaining existing systems (ex: Partial Dependence, LIME). The package enables practitioners to easily compare interpretability algorithms by exposing multiple methods under a unified API, and by having a built-in, extensible visualization platform. InterpretML also includes the first implementation of the Explainable Boosting Machine, a powerful, interpretable, glassbox model that can be as accurate as many blackbox models. The MIT licensed source code can be downloaded from github.com/microsoft/interpret.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Only features related to other features are considered relevant for anomaly detection.
“Therefore, only features that are related to other features are considered relevant for anomaly detection.”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [154]
Section 3 (p. 3) discusses individual feature contributions and optional pairwise interactions in Explainable Boosting Machines, but does not set a relevance criterion for anomaly detection. Searches for anomaly detection and relationships between features found no passage addressing the claim. (LLM, conf=0.76)
Experimental — accuracy not yet measuredNoto et al. and Paulheim & Meusel assume that anomalies are instances that violate normal dependencies between features.
“They assume that anomalies are those instances that violate the normal dependencies between features.”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [154]
The Introduction (p. 1) describes InterpretML as a framework for explaining machine-learning models, and the Blackbox section (p. 2) gives an interpretability example. Neither addresses the claim that anomalies violate normal dependencies between features; searches for that phrasing and for anomaly detection with the named authors found no supporting passage. (LLM, conf=0.76)
Experimental — accuracy not yet measuredNoto et al. and Paulheim & Meusel try to find a relevant feature subset for anomaly detection by exploring correlations between features.
“Meanwhile, Noto et al. [154] and Paulheim & Meusel [167] try to find a relevant feature subset for anomaly detection by exploring the correlations between features.”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [154]
The Explainable Boosting Machine section (p. 3) discusses feature contributions and pairwise interactions, but not selecting feature subsets for anomaly detection by exploring feature correlations. Searches for that method and for Noto, Paulheim, and Meusel found no passage addressing the claim in our copy. (LLM, conf=0.76)
Experimental — accuracy not yet measured[154] feature selection only explores correlations between features.
“Only explores”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [154]
The Explainable Boosting Machine section (p. 3) discusses feature contributions and the selection of pairwise interaction terms, but does not say that feature selection only explores correlations between features. Searches for that phrase and for feature selection and correlations found no passage addressing the claimed limitation. (LLM, conf=0.73)
Experimental — accuracy not yet measured[154] feature selection is robust to noisy and high-dimensional data.
“Robust to noisy”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [154]
The Explainable Boosting Machine section (pp. 3–4) discusses feature contributions, predictive performance and training costs, but does not assess whether feature selection is robust to noisy or high-dimensional data. Searches for “feature selection,” “noisy” and “high-dimensional” found no passage supporting that claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731 · see citing works
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685 · see citing works
Self-citationSALib: An open-source Python library for Sensitivity Analysis
Herman, J. D., & Usher, W. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00097 · Cited by 1,549 · see citing works
Interpretable Machine Learning in Healthcare
Ahmad, M. A., Eckert, C., & Teredesai, A. (2018) · Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics · doi:10.1145/3233547.3233667 · Cited by 583 · see citing works
Accurate intelligible models with pairwise interactions
Lou, Y., Caruana, R., Gehrke, J., & Hooker, G. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487579 · Cited by 564 · see citing works
Self-citationIntelligible models for classification and regression
Lou, Y., Caruana, R., & Gehrke, J. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339556 · Cited by 547 · see citing works
Self-citationGeneralized Additive Models; Some Applications
Hastie, T. J., & Tibshirani, R. J. (1985) · Lecture notes in statistics · doi:10.1007/978-1-4615-7070-7_8 · Cited by 407 · see citing works
Hohman, F., Head, A., Caruana, R., DeLine, R. A., & Drucker, S. M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300809 · Cited by 225 · see citing works
Self-citationTan, S., Caruana, R., Hooker, G., & Lou, Y. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278725 · Cited by 127 · see citing works
Self-citationAn Interpretable Model with Globally Consistent Explanations for Credit RiskPreprint
Chen, C.-F., Lin, K., Rudin, C., Shaposhnik, Y., Wang, S., & Wang, T. (2018) · arXiv.org · doi:10.48550/arxiv.1811.12615 · Cited by 108 · see citing works
Interpretable Fuzzy Rule-Based Systems for Detecting Financial Statement Fraud
Hájek, P. (2019) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-19823-7_36 · Cited by 24 · see citing works
Zhang, X., Tan, S., Koch, P., Lou, Y., Chajewska, U., & Caruana, R. (2018) · arXiv (Cornell University) · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762 · see citing works
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958 · see citing works
Interpretable Machine Learning – A Brief History, State-of-the-Art and Challenges
Molnar, C., Casalicchio, G., & Bischl, B. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-65965-3_28 · Cited by 677 · see citing works
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · see citing works
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612 · see citing works
Interpretable and Explainable Machine Learning for Materials Science and Chemistry
Oviedo, F., Ferres, J. L., Buonassisi, T., & Butler, K. T. (2022) · Accounts of Materials Research · doi:10.1021/accountsmr.1c00244 · Cited by 435 · see citing works
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436 · see citing works
Explainable Artificial Intelligence in CyberSecurity: A Survey
Capuano, N., Fenza, G., Loia, V., & Stanzione, C. (2022) · IEEE Access · doi:10.1109/access.2022.3204171 · Cited by 330 · see citing works
“The last analyzed work is [173], where the authors use LIME and Explainable Boosting Machine (EBM) [174].”
MethodBenchmarking and survey of explanation methods for black box models
Bodria, F., Giannotti, F., Guidotti, R., Naretto, F., Pedreschi, D., & Rinzivillo, S. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00933-9 · Cited by 353 · see citing works
Interpretable machine learning with an ensemble of gradient boosting machines
Konstantinov, A. V., & Utkin, L. V. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106993 · Cited by 287 · see citing works
Topçuoğlu, B. D., Lesniak, N. A., Ruffin, M. T., Wiens, J., & Schloss, P. D. (2020) · mBio · doi:10.1128/mbio.00434-20 · Cited by 278 · see citing works
Trustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261 · see citing works
Neural Additive Models: Interpretable Machine Learning with Neural NetsPreprint
Agarwal, R., Melnick, L., Frosst, N., Zhang, X., Lengerich, B. J., Caruana, R., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13912 · Cited by 246 · see citing works
Self-citationInterpretable Machine Learning
Boehmke, B., & Greenwell, B. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367816377-16 · Cited by 271 · see citing works
Explainable AI for clinical and remote health applications: A survey on tabular and time series data
Di Martino, F., & Delmastro, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10304-3 · Cited by 216 · see citing works
Kobayashi, K., Almutairi, B., Sakib, M. N., Chakraborty, S., & Alam, S. B. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107620 · Cited by 202 · see citing works
Roadmap on Machine learning in electronic structure
Kulik, H. J., Hammerschmidt, T., Schmidt, J., Botti, S., Marques, M. A. L., Boley, M., Scheffler, M., Todorović, M., Rinke, P., Oses, C., et al. (2022) · Electronic Structure · doi:10.1088/2516-1075/ac572f · Cited by 183 · see citing works
Interpretability research of deep learning: A literature survey
Xu, B., & Yang, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102721 · Cited by 159 · see citing works
A Comparative Analysis of LIME and SHAP Interpreters With Explainable ML-Based Diabetes Predictions
Ahmed, S., Kaiser, M. S., Hossain, M. S., & Andersson, K. (2024) · IEEE Access · doi:10.1109/access.2024.3422319 · Cited by 168 · see citing works
Ethical Considerations in AI-Based Recruitment
Mujtaba, D. F., & Mahapatra, N. R. (2019) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas48451.2019.8937920 · Cited by 142 · see citing works
Tenney, I., Wexler, J., Bastings, J., Bolukbasi, T., Coenen, A., Gehrmann, S., Jiang, E., Pushkarna, M., Radebaugh, C., Reif, E., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.15 · Cited by 138 · see citing works
“Many are general-purpose, such as the What-If Tool (Wexler et al., 2020), Cap-tum (Kokhlikyan et al., 2019), Manifold (Zhang et al., 2018), or InterpretML (Nori et al., 2019), while others focus on specific applications like fairness, including FairVis (Cabrera et al., 2019) and FairSight (Ahn and Lin, 2019).”
BackgroundLung cancer survival period prediction and understanding: Deep learning approaches
Doppalapudi, S., Qiu, R. G., & Badr, Y. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104371 · Cited by 138 · see citing works
A Survey of Deep Learning for Scientific DiscoveryPreprint
Raghu, M., & Schmidt, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11755 · Cited by 174 · see citing works
A Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139 · see citing works
Guo, R., Yang, B., Guo, Y., He, L., Li, Z., Zhou, B., Hong, B., & Wang, F. (2024) · Building and Environment · doi:10.1016/j.buildenv.2024.111301 · Cited by 134 · see citing works
Explainable Predictive Maintenance: A Survey of Current Methods, Challenges and Opportunities
Cummins, L., Sommers, A., Ramezani, S. B., Mittal, S., Jabour, J. E., Seale, M. A., & Rahimi, S. (2024) · IEEE Access · doi:10.1109/access.2024.3391130 · Cited by 152 · see citing works
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124 · see citing works
Lin, M., Yan, C., Wang, W., Dong, G., Meng, J., & Wu, J. (2023) · Energy · doi:10.1016/j.energy.2023.127675 · Cited by 122 · see citing works
Khare, S. K., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106676 · Cited by 116 · see citing works
Robustness Gym: Unifying the NLP Evaluation Landscape
Goel, K., Rajani, N. F., Vig, J., Taschdjian, Z., Bansal, M., & Ré, C. (2021) · doi:10.18653/v1/2021.naacl-demos.6 · Cited by 109 · see citing works
Land-surface parameters for spatial predictive mapping and modeling
Maxwell, A. E., & Shobe, C. M. (2022) · Earth-Science Reviews · doi:10.1016/j.earscirev.2022.103944 · Cited by 104 · see citing works
COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96 · see citing works
Aberrant splicing prediction across human tissues
Wagner, N., Çelik, M. H., Hölzlwimmer, F. R., Mertes, C., Prokisch, H., Yépez, V. A., & Gagneur, J. (2023) · Nature Genetics · doi:10.1038/s41588-023-01373-3 · Cited by 90 · see citing works
Interpretable Machine Learning Tools: A Survey
Agarwal, N., & Das, S. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308260 · Cited by 88 · see citing works
Methodology and evaluation in sports analytics: challenges, approaches, and lessons learned
Davis, J. J., Bransen, L., Devos, L., Jaspers, A., Meert, W., Robberechts, P., Haaren, J. V., & Roy, M. V. (2024) · Machine Learning · doi:10.1007/s10994-024-06585-0 · Cited by 102 · see citing works
Analyzing and assessing explainable AI models for smart agriculture environments
Cartolano, A., Cuzzocrea, A., & Pilato, G. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17978-z · Cited by 92 · see citing works
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing
Wang, X., Liu, Q., Gui, T., Zhang, Q., Zou, Y., Zhou, X., Ye, J., Zhang, Y., Zheng, R., Pang, Z., et al. (2021) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2021.acl-demo.41 · Cited by 84 · see citing works
dalex: Responsible Machine Learning with Interactive Explainability and Fairness in PythonPreprint
Baniecki, H., Kretowicz, W., Piątyszek, P., Wisniewski, J., & Biecek, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14406 · Cited by 105 · see citing works
Petersen, E., Potdevin, Y., Mohammadi, E., Zidowitz, S., Breyer, S., Nowotka, D., Henn, S., Pechmann, L., Leucker, M., Rostalski, P., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3178382 · Cited by 83 · see citing works
A survey on artificial intelligence in histopathology image analysis
Abdelsamea, M. M., Zidan, U., Senousy, Z., Gaber, M. M., Rakha, E. A., & Ilyas, M. (2022) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1474 · Cited by 80 · see citing works
Big data analytics for default prediction using graph theory
Yıldırım, M., Okay, F. Y., & Özdemi̇r, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114840 · Cited by 77 · see citing works
Hasib, K. M., Tanzim, A., Shin, J., Faruk, K. O., Mahmud, J. A., & Mridha, M. F. (2022) · IEEE Access · doi:10.1109/access.2022.3213818 · Cited by 73 · see citing works
Duell, J., Fan, X., Burnett, B., Gert Aarts, A., & Zhou, S. (2021) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi50953.2021.9508618 · Cited by 68 · see citing works
Gurmessa, D. K., & Jimma, W. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100954 · Cited by 74 · see citing works
Koshiyama, A., Kazim, E., & Treleaven, P. (2022) · Computer · doi:10.1109/mc.2021.3067225 · Cited by 55 · see citing works
PsychBERT: A Mental Health Language Model for Social Media Mental Health Behavioral Analysis
Vajre, V., Naylor, M., Kamath, U., & Shehu, A. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669469 · Cited by 55 · see citing works
Ride-sourcing compared to its public-transit alternative using big trip data
Liao, Y. J. (2021) · Journal of Transport Geography · doi:10.1016/j.jtrangeo.2021.103135 · Cited by 50 · see citing works
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00248-9 · Cited by 57 · see citing works
Esterhuizen, J. A., Goldsmith, B. R., & Linic, S. (2021) · Chem Catalysis · doi:10.1016/j.checat.2021.07.014 · Cited by 49 · see citing works
Extending the Tsetlin Machine With Integer-Weighted Clauses for Increased Interpretability
Abeyrathna, K. D., Granmo, O., & Goodwin, M. (2021) · IEEE Access · doi:10.1109/access.2021.3049569 · Cited by 48 · see citing works
Explainable Artificial Intelligence for Cotton Yield Prediction With Multisource Data
Çelik, M. F., Ișık, M. S., Taşkın, G., Erten, E., & Camps‐Valls, G. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3303643 · Cited by 46 · see citing works
An Explainable AI Approach for the Rapid Diagnosis of COVID-19 Using Ensemble Learning Algorithms
Gong, H., Wang, M., Zhang, H., Elahe, M. F., & Jin, M. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.874455 · Cited by 43 · see citing works
Coding energy knowledge in constructed responses with explainable NLP models
Gombert, S., Mitri, D. D., Karademir, O., Kubsch, M., Kolbe, H., Tautz, S., Grimm, A., Bohm, I., Neumann, K., & Drachsler, H. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12767 · Cited by 47 · see citing works
Jamei, M., Ali, M., Karbasi, M., Karimi, B., Jahannemaei, N., Farooque, A. A., & Yaseen, Z. M. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121512 · Cited by 44 · see citing works
Explainable Artificial Intelligence in Cybersecurity: A Brief Review
Hariharan, S., Velicheti, A., Anagha, A. S., Thomas, C., & Balakrishnan, N. (2021) · doi:10.1109/isea-isap54304.2021.9689765 · Cited by 44 · see citing works
The grammar of interactive explanatory model analysis
Baniecki, H., Parzych, D., & Biecek, P. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00924-w · Cited by 50 · see citing works
Wang, H., Huang, Z., Zhang, D., Arief, J., Tiewei, L., & Tian, J. (2020) · IEEE Access · doi:10.1109/access.2020.2996302 · Cited by 42 · see citing works
Cheminformatics and artificial intelligence for accelerating agrochemical discovery
Djoumbou-Feunang, Y., Wilmot, J. T., Kinney, J., Chanda, P., Yu, P., Sader, C. A., Sharifi, M., Smith, S., Ou, J., Hu, J. K., et al. (2023) · Frontiers in Chemistry · doi:10.3389/fchem.2023.1292027 · Cited by 41 · see citing works
AI Regulation Is (not) All You Need
Lucaj, L., van der Smagt, P., & Benbouzid, D. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594079 · Cited by 40 · see citing works
Responsible AI: A Primer for the Legal Community
Golbin, I., Rao, A. S., Hadjarian, A., & Krittman, D. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9377738 · Cited by 38 · see citing works
Joy, U. G., Hoque, K. E., Uddin, M. N., Chowdhury, L., & Park, S.-B. (2024) · IEEE Access · doi:10.1109/access.2024.3401247 · Cited by 38 · see citing works
Phishing Detection Using URL-based XAI Techniques
Hernandes, P. R. G., Floret, C. P., Almeida, K. F. C. D., Silva, V. C. D., Papa, J. P., & da Costa, K. A. P. (2021) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9659981 · Cited by 38 · see citing works
Arya, V., Bellamy, R., Chen, P., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2020) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3430984.3430987 · Cited by 37 · see citing works
Locally interpretable tree boosting: An application to house price prediction
Hjort, A., Scheel, I., Sommervoll, D. E., & Pensar, J. (2023) · Decision Support Systems · doi:10.1016/j.dss.2023.114106 · Cited by 37 · see citing works
Pramanik, P., Jana, R. K., & Ghosh, I. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123482 · Cited by 38 · see citing works
Considerations when learning additive explanations for black-box models
Tan, S., Hooker, G., Koch, P., Gordo, A., & Caruana, R. (2023) · Machine Learning · doi:10.1007/s10994-023-06335-8 · Cited by 33 · see citing works
Self-citationJiang, S., Liang, Y., Shi, S., Wu, C., & Shi, Z. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.166623 · Cited by 32 · see citing works
Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
Najjar, H., Miranda, M., Nuske, M., Roscher, R., & Dengel, A. R. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3528068 · Cited by 32 · see citing works
Qu, Y., Deng, X., Lin, S., Han, F., Chang, H. H., Ou, Y., Nie, Z., Mai, J., Wang, X., Gao, X., et al. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.797002 · Cited by 32 · see citing works
SurvNAM: The machine learning survival model explanation
Utkin, L. V., Satyukov, E. D., & Konstantinov, A. V. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.015 · Cited by 30 · see citing works
Explainable artificial intelligence models in intrusion detection systems
Al, S., & Sağıroğlu, Ş. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110145 · Cited by 42 · see citing works
epitope1D: accurate taxonomy-aware B-cell linear epitope prediction
Silva¹, B. F. D., Ascher, D. B., & Pires, D. E. V. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad114 · Cited by 29 · see citing works
FAT Forensics: A Python toolbox for algorithmic fairness, accountability and transparency
Sokol, K., Santos‐Rodríguez, R., & Flach, P. A. (2022) · Software Impacts · doi:10.1016/j.simpa.2022.100406 · Cited by 15 · see citing works
Combining ChatGPT and knowledge graph for explainable machine learning-driven design: a case study
Hu, X., Liu, A., & Dai, Y. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2355758 · Cited by 31 · see citing works
Explainable artificial intelligence in orthopedic surgery
Oettl, F. C., Oeding, J. F., & Samuelsson, K. (2024) · Journal of Experimental Orthopaedics · doi:10.1002/jeo2.12103 · Cited by 27 · see citing works
Spielvogel, C. P., Schindler, N., Schröder, C., Stellnberger, S. L., Wadsak, W., Mitterhauser, M., Papp, L., Hacker, M., Pichler, V., & Vraka, C. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c02212 · Cited by 27 · see citing works
Interactive Data Visualization in Jupyter Notebooks
Ono, J. P., Freire, J., & Silva, C. T. (2021) · Computing in Science & Engineering · doi:10.1109/mcse.2021.3052619 · Cited by 27 · see citing works
Revisiting Popularity and Demographic Biases in Recommender Evaluation and Effectiveness
Neophytou, N., Mitra, B., & Stinson, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99736-6_43 · Cited by 31 · see citing works
van den Berg, M., Medina, O. A. G., Loohuis, I., van der Flier, M., Dudink, J., Benders, M. J. N. L., Bartels, R., & Vijlbrief, D. C. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107156 · Cited by 26 · see citing works
Machine Learning With Computer Networks: Techniques, Datasets, and Models
Afifi, H., Pochaba, S., Boltres, A., Laniewski, D., Haberer, J., Paeleke, L., Poorzare, R., Stolpmann, D., Wehner, N., Redder, A., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3384460 · Cited by 32 · see citing works
StickyLand: Breaking the Linear Presentation of Computational Notebooks
Wang, Z. J., Dai, K., & Edwards, W. K. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519653 · Cited by 25 · see citing works
Explainable machine learning models to analyse maternal health
Patel, S. S. (2023) · Data & Knowledge Engineering · doi:10.1016/j.datak.2023.102198 · Cited by 25 · see citing works
Automated Assessment of Psychiatric Disorders Using Speech: A Systematic ReviewPreprint
Low, D. M., Bentley, K. H., & Ghosh, S. (2019) · doi:10.31219/osf.io/5pwze · Cited by 25 · see citing works
Barbado, A., & Oscar Corcho, B. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105222 · Cited by 30 · see citing works
Morgan, H. E., Wang, K., Dohopolski, M. J., Liang, X., Folkert, M. R., Sher, D. J., & Wang, J. (2021) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-274 · Cited by 24 · see citing works
Liu, X., Shi, X.-Q., Peng, Z., & He, H.-D. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104524 · Cited by 24 · see citing works
Quillivic, R., Gayraud, F., Auxéméry, Y., Vanni, L., Peschanski, D., Eustache, F., Dayan, J., & Mesmoudi, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-61557-7 · Cited by 24 · see citing works
Interpretable machine learning for creditor recovery rates
Nazemi, A., & Fabozzi, F. J. (2024) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2024.107187 · Cited by 23 · see citing works
Kuźba, M., & Biecek, P. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-65965-3_30 · Cited by 23 · see citing works
Zeitlin, J. H., Parides, M. K., Lane, J. M., Russell, L., & Kunze, K. N. (2023) · Archives of Osteoporosis · doi:10.1007/s11657-023-01292-0 · Cited by 23 · see citing works
Çil, A. E., & Yıldız, K. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101696 · Cited by 27 · see citing works
Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Values
Wang, Z. J., Kale, A. M., Nori, H., Stella, P., Nunnally, M., Chau, D. H., Vorvoreanu, M., Vaughan, J. W., & Caruana, R. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539074 · Cited by 21 · see citing works
Self-citationTruVR: Trustworthy Cybersickness Detection using Explainable Machine Learning
Kundu, R. K., Islam, R., Calyam, P. P., & Hoque, K. A. (2022) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar55827.2022.00096 · Cited by 21 · see citing works
Wahab, S., Salami, B. A., Danish, H., Nisar, S., AlAteah, A. H., & Alsubeai, A. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110458 · Cited by 21 · see citing works
Calibrate: Interactive Analysis of Probabilistic Model Output
Xenopoulos, P., Rulff, J., Nonato, L. G., Barr, B., & Silva, C. T. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209489 · Cited by 21 · see citing works
GAM Coach: Towards Interactive and User-centered Algorithmic Recourse
Wang, Z. J., Vaughan, J. W., Caruana, R., & Chau, D. H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580816 · Cited by 20 · see citing works
Self-citationCaleca, F., Confuorto, P., Raspini, F., Segoni, S., Tofani, V., Casagli, N., & Moretti, S. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.175277 · Cited by 21 · see citing works
Coalesced Multi-Output Tsetlin Machines with Clause SharingPreprint
Glimsdal, S., & Granmo, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.07594 · Cited by 20 · see citing works
Rule extraction with guarantees from regression models
Johansson, U., Sönströd, C., Löfström, T., & Boström, H. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108554 · Cited by 19 · see citing works
Yao, H., Derksen, H., Golbus, J. R., Zhang, J., Aaronson, K. D., Gryak, J., & Najarian, K. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3211765 · Cited by 19 · see citing works
- Authors
- Nori, H., Jenkins, S., Koch, P., & Caruana, R.
- Affiliations
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1909.09223
- OpenAlex
- W2973631113
- Cited by
- 322
- References
- 16
- Citations by year
- 2026: 14 · 2025: 47 · 2024: 63 · 2023: 68 · 2022: 50 · 2021: 54 · 2020: 22 · 2019: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- model interpretability, explainable AI, partial dependence, lime, explainable boosting machine, model visualization, Python library
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
