Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 801–900 of 1,032

Application of machine learning models and SHAP to examine crashes involving young drivers in New Jersey
Hasan, A. S., Jalayer, M., Das, S., & Kabir, M. A. B. (2023) · International Journal of Transportation Science and Technology · doi:10.1016/j.ijtst.2023.04.005 · Cited by 45
Disparities in affecting factors of housing price: A machine learning approach to the effects of housing status, public transit, and density factors on single-family housing price
Chen, Y., Jiao, J., & Farahi, A. (2023) · Cities · doi:10.1016/j.cities.2023.104432 · Cited by 48
High-throughput screening of CO2 cycloaddition MOF catalyst with an explainable machine learning model
Bai, X., Li, Y., Xie, Y.-B., Chen, Q., Zhang, X., & Li, J. (2024) · Green Energy & Environment · doi:10.1016/j.gee.2024.01.010 · Cited by 49
A comprehensive framework for explainable cluster analysis
Alvarez-Garcia, M., Ibar-Alonso, R., & Arenas‐Parra, M. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120282 · Cited by 44
The explainable potential of coupling hybridized metaheuristics, XGBoost, and SHAP in revealing toluene behavior in the atmosphere
Bačanin, N., Perišić, M. D., Jovanović, G., Damaševičius, R., Stanišić, S., Šimić, V., Zivkovic, M. Z., & Stojić, A. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.172195 · Cited by 44
A novel interpretable machine learning model approach for the prediction of TiO2 photocatalytic degradation of air contaminants
Schossler, R. T., Ojo, S., Jiang, Z., Hu, J., & Yu, X. B. (2024) · Scientific Reports · doi:10.1038/s41598-024-62450-z · Cited by 46
Metformin-induced changes in the gut microbiome and plasma metabolome are associated with cognition in men
Rosell-Díaz, M., Petit-Gay, A., Molas-Prat, C., Gallardo‐Nuell, L., Ramió‐Torrentà, L., Garre‐Olmo, J., Pérez‐Brocal, V., Moyá, A., Jové, M., Pamplona, R., et al. (2024) · Metabolism · doi:10.1016/j.metabol.2024.155941 · Cited by 46
Interpretable machine learning guided by physical mechanisms reveals drivers of runoff under dynamic land use changes
Wang, S., Liu, Y., Wang, W., Zhao, G., & Liang, H. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.121978 · Cited by 44
Academic achievement prediction in higher education through interpretable modeling
Wang, S., & Luo, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309838 · Cited by 64
AIPs-DeepEnC-GA: Predicting anti-inflammatory peptides using embedded evolutionary and sequential feature integration with genetic algorithm based deep ensemble model
Raza, A., Uddin, J., Zou, Q., Akbar, S., Alghamdi, W., & Liu, R. (2024) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2024.105239 · Cited by 44
Advancing ensemble learning techniques for residential building electricity consumption forecasting: Insight from explainable artificial intelligence
Moon, J., Maqsood, M., So, D., Baik, S. W., Rho, S., & Nam, Y. (2024) · PLoS ONE · doi:10.1371/journal.pone.0307654 · Cited by 44
Machine learning for predicting in-hospital mortality in elderly patients with heart failure combined with hypertension: a multicenter retrospective study
Liu, X., Xie, Z., Zhang, Y., Huang, J., Kuang, L., Li, X., Li, H., Zou, Y., Xiang, T., Yin, N., et al. (2024) · Cardiovascular Diabetology · doi:10.1186/s12933-024-02503-9 · Cited by 52
Machine learning-assisted production data analysis in liquid-rich Duvernay Formation
Kong, B., Chen, Z., Chen, S., & Qin, T. (2021) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2021.108377 · Cited by 43
Screening for Early-Stage Alzheimer’s Disease Using Optimized Feature Sets and Machine Learning
Kleiman, M. J., Barenholtz, E., Galvin, J. E., & Initiative, F. T. A. D. N. (2021) · Journal of Alzheimer s Disease · doi:10.3233/jad-201377 · Cited by 42
Identification of active molecules againstMycobacterium tuberculosisthrough machine learning
Ye, Q., Chai, X., Jiang, D., Liu, Y., Shen, C., Zhang, X., Li, D., Cao, D., & Hou, T. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab068 · Cited by 49
Machine learning to predict dynamic changes of pathogenic Vibrio spp. abundance on microplastics in marine environment
Jiang, J., Zhou, H., Zhang, T., Yao, C., Du, D., Zhao, L., Cai, W., Che, L., Cao, Z., & Wu, X. (2022) · Environmental Pollution · doi:10.1016/j.envpol.2022.119257 · Cited by 46
A massively parallel reporter assay reveals focused and broadly encoded RNA localization signals in neurons
Mikl, M., Eletto, D., Nijim, M., Lee, M., Lafzi, A., Mhamedi, F., David, O., Sain, S. B., Handler, K., & Moor, A. E. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac806 · Cited by 41
On the explanatory power of Boolean decision trees
Audemard, G., Bellart, S., Bounia, L., Koriche, F., Lagniez, J.-M., & Marquis, P. (2022) · Data & Knowledge Engineering · doi:10.1016/j.datak.2022.102088 · Cited by 65
An Analysis of Vocal Features for Parkinson’s Disease Classification Using Evolutionary Algorithms
Dao, S. V. T., Yu, Z., Tran, L. V., Phan, P. N. K., Huynh, T., & Le, T. M. (2022) · Diagnostics · doi:10.3390/diagnostics12081980 · Cited by 43
Exploring the Individualized Effect of Climatic Drivers on MODIS Net Primary Productivity through an Explainable Machine Learning Framework
Li, L., Zeng, Z., Zhang, G., Duan, K., Liu, B., & Cai, X. (2022) · Remote Sensing · doi:10.3390/rs14174401 · Cited by 42
Automated machine learning‐based model for the prediction of delirium in patients after surgery for degenerative spinal disease
Zhang, Y., Wan, D., Chen, M., Li, Y., Ying, H., Yao, G., Liu, Z., & Zhang, G. (2022) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.14002 · Cited by 46
Machine learning-based prediction of harmful algal blooms in water supply reservoirs
Jeong, B., Chapeta, M. R., Kim, M., Kim, J., Shin, J., & Cha, Y. (2022) · Water Quality Research Journal · doi:10.2166/wqrj.2022.019 · Cited by 43
On The Philosophy of Unsupervised Learning
Watson, D. (2022) · Philosophy & Technology · doi:10.1007/s13347-023-00635-6 · Cited by 46
Estimation and interpretation of equilibrium scour depth around circular bridge piers by using optimized XGBoost and SHAP
Eini, N., Bateni, S. M., Jun, C., Heggy, E., & Band, S. S. (2023) · Engineering Applications of Computational Fluid Mechanics · doi:10.1080/19942060.2023.2244558 · Cited by 43
A Machine Learning Explainability Tutorial for Atmospheric Sciences
Flora, M. L., Potvin, C. K., McGovern, A., & Handler, S. L. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-23-0018.1 · Cited by 49
Revealing the driving factors and mobility patterns of bike-sharing commuting demands for integrated public transport systems
Zhu, B. S., Hu, S., Kaparias, I., Zhou, W., Ochieng, W. Y., & Lee, D. (2024) · Sustainable Cities and Society · doi:10.1016/j.scs.2024.105323 · Cited by 43
Prediction of compressive strength of glass powder concrete based on artificial intelligence
Miao, X., Chen, B., & Zhao, Y. (2024) · Journal of Building Engineering · doi:10.1016/j.jobe.2024.109377 · Cited by 43
Revolutionizing inverse design of ionic liquids through the multi-property prediction of over 300,000 novel variants using ensemble deep learning
Lemaoui, T., Eid, T., Darwish, A. S., Arafat, H. A., BANAT, F. A., & AlNashef, I. M. (2024) · Materials Science and Engineering R Reports · doi:10.1016/j.mser.2024.100798 · Cited by 43
Heatwave exacerbates air pollution in China through intertwined climate-energy-environment interactions
Chen, T., Wang, T., Xue, L., & Brasseur, G. P. (2024) · 中国科学通报：英文版 · doi:10.1016/j.scib.2024.05.018 · Cited by 48
An interpretable framework for high-precision flatness prediction in strip cold rolling
Ding, C.-Y., Ye, J.-C., Lei, J.-W., Wang, F., Li, Z., Peng, W. J., Zhang, D., & Sun, J. (2024) · Journal of Materials Processing Technology · doi:10.1016/j.jmatprotec.2024.118452 · Cited by 45
Advancing credit risk modelling with Machine Learning: A comprehensive review of the state-of-the-art
Montevechi, A. A., Miranda, R. D. C., Medeiros, A. L., & Montevechi, J. A. B. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109082 · Cited by 59
Predicting Pseudomonas aeruginosa drug resistance using artificial intelligence and clinical MALDI-TOF mass spectra
Nguyen, H.-A., Peleg, A. Y., Song, J., Antony, B. J., Webb, G. I., Wisniewski, J. A., Blakeway, L. V., Badoordeen, G. Z., Theegala, R., Zisis, H., et al. (2024) · mSystems · doi:10.1128/msystems.00789-24 · Cited by 46
Machine learning models for predicting the rejection of organic pollutants by forward osmosis and reverse osmosis membranes and unveiling the rejection mechanisms
Tayara, A., Shang, C., Zhao, J., & Xiang, Y. (2024) · Water Research · doi:10.1016/j.watres.2024.122363 · Cited by 43
Prediction and interpretation of crash severity using machine learning based on imbalanced traffic crash data
Chen, J., Liu, P., Wang, S., Zheng, N., & Guo, X. (2025) · Journal of Safety Research · doi:10.1016/j.jsr.2025.02.018 · Cited by 43
Predicting and Interpreting Students’ Grades in Distance Higher Education through a Semi-Regression Method
Karlos, S., Kostopoulos, G., & Kotsiantis, S. B. (2020) · Applied Sciences · doi:10.3390/app10238413 · Cited by 43
Detection of abnormal left ventricular geometry in patients without cardiovascular disease through machine learning: An ECG‐based approach
Angelaki, E., Marketou, M. E., Barmparis, G. D., Patrianakos, A. P., Vardas, P. E., PARTHENAKIS, F. I., & Tsironis, G. P. (2021) · Journal of Clinical Hypertension · doi:10.1111/jch.14200 · Cited by 41
Machine Learning for the Prediction of Red Blood Cell Transfusion in Patients During or After Liver Transplantation Surgery
Liu, L., Zhao, Q., Wu, J., Luo, Y., Dong, H., Chen, Z.-W., Gui, R., & Wang, Y. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.632210 · Cited by 43
Development of digital measures for nighttime scratch and sleep using wrist-worn wearable devices
Mahadevan, N., Christakis, Y., Di, J., Bruno, J., Zhang, Y., Dorsey, E. R., Pigeon, W. R., Beck, L. A., Thomas, K. C., Liu, Y., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00402-x · Cited by 42
Interpretable machine learning for early neurological deterioration prediction in atrial fibrillation-related stroke
Kim, S.-H., Jeon, E., Yu, S., Oh, K., Kim, C. K., Song, T., Kim, Y., Heo, S. H., Park, K., Kim, J., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-99920-7 · Cited by 45
Phenotypic signatures in clinical data enable systematic identification of patients for genetic testing
Morley, T. J., Han, L., Castro, V. M., Morra, J. H., Perlis, R. H., Cox, N. J., Bastarache, L. A., & Ruderfer, D. M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01356-z · Cited by 43
Decoding river pollution trends and their landscape determinants in an ecologically fragile karst basin using a machine learning model
Xu, G., Fan, H., Oliver, D. M., Dai, Y., Li, H., Shi, Y., Long, H., Xiong, K., & Zhao, Z. (2022) · Environmental Research · doi:10.1016/j.envres.2022.113843 · Cited by 48
Identification of Patients with Sarcopenia Using Gait Parameters Based on Inertial Sensors
Kim, J.-K., Bae, M., Lee, K. B., & Hong, S. G. (2021) · Sensors · doi:10.3390/s21051786 · Cited by 42
Calibrating DFT Formation Enthalpy Calculations by Multifidelity Machine Learning
Gong, S., Wang, S., Xie, T., Chae, W. H., Liu, R., Shao‐Horn, Y., & Grossman, J. C. (2022) · JACS Au · doi:10.1021/jacsau.2c00235 · Cited by 46
Comparison of machine learning and stress concentration factors‐based fatigue failure prediction in small‐scale butt‐welded joints
Braun, M., & Kellner, L. (2022) · Fatigue & Fracture of Engineering Materials & Structures · doi:10.1111/ffe.13800 · Cited by 42
Investigating the effects of local weather, streamflow lag, and global climate information on 1-month-ahead streamflow forecasting by using XGBoost and SHAP: two case studies involving the contiguous USA
Liu, J., Ren, K., Ming, T., Qu, J., Guo, W., & Li, H. (2022) · Acta Geophysica · doi:10.1007/s11600-022-00928-y · Cited by 44
Hospitality order cancellation prediction from a profit-driven perspective
Liu, Z., Jiang, P., Wang, J., Du, Z., Niu, X., & Zhang, L. (2022) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-06-2022-0737 · Cited by 42
Look the Part? The Role of Profile Pictures in Online Labor Markets
Troncoso, I., & Luo, L. (2020) · Marketing Science · doi:10.1287/mksc.2022.1425 · Cited by 42
Clinical characteristics of hospitalized children with community-acquired pneumonia and respiratory infections: Using machine learning approaches to support pathogen prediction at admission
Chang, T., Liu, Y., Lin, S.-R., Chiu, P., Chou, C., Chang, L., & Lai, F. (2023) · Journal of Microbiology Immunology and Infection · doi:10.1016/j.jmii.2023.04.011 · Cited by 42
Local interpretation of machine learning models in remote sensing with SHAP: the case of global climate constraints on photosynthesis phenology
Descals, A., Verger, A., Yin, G., Filella, I., & Peñuelas, J. (2023) · International Journal of Remote Sensing · doi:10.1080/01431161.2023.2217982 · Cited by 42
Addressing feature selection and extreme learning machine tuning by diversity-oriented social network search: an application for phishing websites detection
Bačanin, N., Zivkovic, M. Z., Antonijević, M., Venkatachalam, K., Lee, J., Nam, Y., Marjanovic, M., Strumberger, I., & Abouhawwash, M. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01118-z · Cited by 42
Study on risk factors of diabetic peripheral neuropathy and establishment of a prediction model by machine learning
Lian, X., Qi, J., Yuan, M., Li, X., Wang, M., Li, G., Yang, T., & Zhong, J. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02232-1 · Cited by 46
Explainable AI for Soil Fertility Prediction
Chandra, H., Pawar, P. M., Elakkiya, R., Tamizharasan, P. S., Muthalagu, R., & Panthakkan, A. (2023) · IEEE Access · doi:10.1109/access.2023.3311827 · Cited by 42
An eXplainable Artificial Intelligence analysis of Raman spectra for thyroid cancer diagnosis
Bellantuono, L., Tommasi, R., Pantaleo, E., Verri, M., Amoroso, N., Crucitti, P., Gioacchino, M. D., Longo, F., Monaco, A., Naciu, A. M., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-43856-7 · Cited by 49
Predicting risk of obesity in overweight adults using interpretable machine learning algorithms
Lin, W., Shi, S., Huang, H., Wen, J., & Chen, G. (2023) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1292167 · Cited by 49
Elucidating Key Characteristics of PFAS Binding to Human Peroxisome Proliferator-Activated Receptor Alpha: An Explainable Machine Learning Approach
Maeda, K., Hirano, M., Hayashi, T., Iida, M., Kurata, H., & Ishibashi, H. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c06561 · Cited by 42
Explainable AI Frameworks: Navigating the Present Challenges and Unveiling Innovative Applications
Sharma, N. A., Chand, R. R., Buksh, Z., Ali, A. B. M. S., Hanif, A., & Beheshti, A. (2024) · Algorithms · doi:10.3390/a17060227 · Cited by 51
A new approach for predicting oil mobilities and unveiling their controlling factors in a lacustrine shale system: Insights from interpretable machine learning model
Wang, E., Fu, Y., Guo, T., & Li, M. (2024) · Fuel · doi:10.1016/j.fuel.2024.132958 · Cited by 42
Review on machine learning application in tissue engineering: What has been done so far? Application areas, challenges, and perspectives
Jeznach, O., Tabakoglu, S., Zaszczyńska, A., & Sajkiewicz, P. (2024) · Journal of Materials Science · doi:10.1007/s10853-024-10449-2 · Cited by 45
Development and validation of an explainable machine learning model for mortality prediction among patients with infected pancreatic necrosis
Ning, C., Ouyang, H. X., Xiao, J., Wu, D., Sun, Z., Liu, B., Shen, D., Hong, X., Lin, C., Li, J., et al. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103074 · Cited by 46
Personalized explanations for clinician-AI interaction in breast imaging diagnosis by adapting communication to expertise levels
Calisto, F. M., Abrantes, J., Santiago, C., Nunes, N., & Nascimento, J. C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103444 · Cited by 46
Impact of 2D and 3D factors on urban flooding: Spatial characteristics and interpretable analysis of drivers
Wang, Y., Zhang, Q., Zhang, J., & Lin, K. (2025) · Water Research · doi:10.1016/j.watres.2025.123537 · Cited by 42
A systematic review of explainable artificial intelligence in urban building energy modeling: methods, applications, and future directions
Darvishvand, L., Kamkari, B., Huang, M. J., & Hewitt, N. J. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106492 · Cited by 42
Challenges and opportunities of ML and explainable AI in large-sample hydrology
Slater, L. J., Blougouras, G., Deng, L., Deng, Q., Ford, E., van Dijke, A. J. H., Huang, F., Jiang, S., Liu, Y., Moulds, S., et al. (2025) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2024.0287 · Cited by 53
Fundamental flaws of physics-informed neural networks and explainability methods in engineering systems
Naser, M. Z. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.111704 · Cited by 42
The grammar of interactive explanatory model analysis
Baniecki, H., Parzych, D., & Biecek, P. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00924-w · Cited by 50
T4SE-XGB: Interpretable Sequence-Based Prediction of Type IV Secreted Effectors Using eXtreme Gradient Boosting Algorithm
Chen, T., Wang, X., Chu, Y., Wang, Y., Jiang, M., Wei, D., & Xiong, Y. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.580382 · Cited by 42
Design and rationale of the COVID-19 Critical Care Consortium international, multicentre, observational study
Bassi, G. L., Suen, J. Y., Barnett, A. G., Corley, A., Millar, J. E., Fanning, J. P., Lye, I., Colombo, S. M., Wildi, K. S., Livingstone, S., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041417 · Cited by 41
An Interpretable Hand-Crafted Feature-Based Model for Atrial Fibrillation Detection
Rouhi, R., Clausel, M., Oster, J., & Lauer, F. (2021) · Frontiers in Physiology · doi:10.3389/fphys.2021.657304 · Cited by 43
Developing random forest hybridization models for estimating the axial bearing capacity of pile
Pham, T. A., & Tran, V. Q. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265747 · Cited by 42
Analysis of financial pressure impacts on the health care industry with an explainable machine learning method: China versus the USA
Weng, F., Zhu, J., Yang, C., Gao, W., & Zhang, H. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118482 · Cited by 42
Cross-validation of predictive models for functional recovery after post-stroke rehabilitation
Campagnini, S., Liuzzi, P., Mannini, A., Basagni, B., Macchi, C., Carrozza, M. C., & Cecchi, F. (2022) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-022-01075-7 · Cited by 42
Do Municipal Bond Dealers Give Their Customers “Fair and Reasonable” Pricing?
Griffin, J. M., Hirschey, N., & Kruger, S. (2023) · The Journal of Finance · doi:10.1111/jofi.13214 · Cited by 42
On Explaining Decision TreesPreprint
Izza, Y., Ignatiev, A., & Marques-Silva, J. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11034 · Cited by 107
Measuring activities of daily living in stroke patients with motion machine learning algorithms: A pilot study
Chen, P.-W., Baune, N. A., Zwir, I., Wang, J., Swamidass, V., & Wong, A. W. K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041634 · Cited by 41
Machine learning approach towards explaining water quality dynamics in an urbanised river
Schäfer, B., Beck, C., Rhys, H. I., Soteriou, H., Jennings, P., Beechey, A., & Heppell, C. (2022) · Scientific Reports · doi:10.1038/s41598-022-16342-9 · Cited by 50
On the explainability of machine-learning-assisted turbulence modeling for transonic flows
He, X. G., Tan, J., Rigas, G., & Vahdati, M. (2022) · International Journal of Heat and Fluid Flow · doi:10.1016/j.ijheatfluidflow.2022.109038 · Cited by 41
Peripheral blood mononuclear cell derived biomarker detection using eXplainable Artificial Intelligence (XAI) provides better diagnosis of breast cancer
Kumar, S., & Das, A. (2023) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2023.107867 · Cited by 44
ACP-MLC: A two-level prediction engine for identification of anticancer peptides and multi-label classification of their functional types
Deng, H., Ding, M., Wang, Y., Li, W., Liu, G., & Tang, Y. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106844 · Cited by 41
Social Determinants of Health and Racial Disparities in Cardiac Events in Breast Cancer
Stabellini, N., Dmukauskas, M., Bittencourt, M. S., Cullen, J. C., Barda, A. J., Moore, J. X., Dent, S. F., Abdel-Qadir, H. M., Kawatkar, A. A., Pandey, A., et al. (2023) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2023.7023 · Cited by 41
Quantifying the impacts of emissions and meteorology on the interannual variations of air pollutants in major Chinese cities from 2015 to 2021
Dai, Q., Dai, T., Hou, L., Li, L., Bi, X., Zhang, Y., & Feng, Y. (2023) · Science China Earth Sciences · doi:10.1007/s11430-022-1128-1 · Cited by 41
Thresholding Gini variable importance with a single-trained random forest: An empirical Bayes approach
Dunne, R. A., Reguant, R., Ramarao-Milne, P., Szul, P., Sng, L. M. F., Lundberg, M., Twine, N. A., & Bauer, D. C. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.08.033 · Cited by 41
Machine learning small molecule properties in drug discovery
Schapin, N., Majewski, M., Varela‐Rial, A., Arróniz, C., & Fabritiis, G. D. (2023) · Artificial Intelligence Chemistry · doi:10.1016/j.aichem.2023.100020 · Cited by 44
Explainability as the key ingredient for AI adoption in Industry 5.0 settings
Agostinho, C., Dikopoulou, Z., Lavasa, E., Perakis, Κ., Pitsios, S., Branco, R., Reji, S., Hetterich, J., Biliri, E., Lampathaki, F., et al. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1264372 · Cited by 41
A generic machine learning model for CO2 equilibrium solubility into blended amine solutions
Liu, H., Qu, J., Bhatti, A. H., Barzagli, F., Li, C., Bi, J., & Zhang, R. (2023) · Separation and Purification Technology · doi:10.1016/j.seppur.2023.126100 · Cited by 41
Multi-Variable Multi-Metric Optimization of Self-Assembled Photocatalytic CO 2 Reduction Performance Using Machine Learning Algorithms
Bonke, S. A., Trezza, G., Bergamasco, L., Song, H., Rodríguez‐Jiménez, S., Hammarström, L., Chiavazzo, E., & Reisner, E. (2024) · Journal of the American Chemical Society · doi:10.1021/jacs.4c01305 · Cited by 41
Modern machine‐learning for binding affinity estimation of protein–ligand complexes: Progress, opportunities, and challenges
Harren, T., Gutermuth, T., Grebner, C., Heßler, G., & Rarey, M. (2024) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1716 · Cited by 46
Explainable artificial intelligence-driven prostate cancer screening using exosomal multi-marker based dual-gate FET biosensor
Choi, J. Y., Park, S., Shim, J. S., Park, H. J., Kuh, S. U., Jeong, Y., Park, M. G., Noh, T. I., Yoon, S. G., Park, Y. M., et al. (2024) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2024.116773 · Cited by 41
Self-citation
Improved LightGBM for Extremely Imbalanced Data and Application to Credit Card Fraud Detection
Zhao, X., Liu, Y., & Zhao, Q. (2024) · IEEE Access · doi:10.1109/access.2024.3487212 · Cited by 50
A combined deep learning framework for mammalian m6A site prediction
Fan, R., Cui, C., Kang, B., Chang, Z., Wang, G., & Cui, Q. (2024) · Cell Genomics · doi:10.1016/j.xgen.2024.100697 · Cited by 43
From Data to Insights: Modeling Urban Land Surface Temperature Using Geospatial Analysis and Interpretable Machine Learning
Hoang, N., Tran, V.-D., & Huynh, T. (2025) · Sensors · doi:10.3390/s25041169 · Cited by 41
Soil health in Latin America and the Caribbean
Poppiel, R. R., Cherubin, M. R., Novais, J. J., & Demattê, J. A. M. (2025) · Communications Earth & Environment · doi:10.1038/s43247-025-02021-w · Cited by 46
Mechanisms of meteorological drought propagation to agricultural drought in China: insights from causality chain
You, Z., Sun, X., Sun, H., Chen, L., Lu, M., Xue, J., Ban, X., Yan, B., Tuo, Y., Qin, H., et al. (2025) · npj natural hazards. · doi:10.1038/s44304-025-00073-8 · Cited by 47
Improved prediction and risk stratification of major adverse cardiovascular events using an explainable machine learning approach combining plasma biomarkers and traditional risk factors
Zhang, X.-R., Zhong, W.-F., Liu, R., Huang, J., Fu, J., Gao, J., Zhang, P., Liu, D., Li, Z., He, Y., et al. (2025) · Cardiovascular Diabetology · doi:10.1186/s12933-025-02711-x · Cited by 41
Ethical and regulatory challenges in machine learning-based healthcare systems: A review of implementation barriers and future directions
Mohammed, S., & Malhotra, N. (2025) · BenchCouncil Transactions on Benchmarks Standards and Evaluations · doi:10.1016/j.tbench.2025.100215 · Cited by 53
Explainable artificial intelligence (XAI) for interpreting predictive models and key variables in flood susceptibility
Choubin, B., Jaafari, A., Henareh, J., Karimi, O., & Hosseini, F. S. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.105976 · Cited by 41
Interpreting a recurrent neural network’s predictions of ICU mortality risk
Ho, V. L., Aczon, M., Ledbetter, D., & Wetzel, R. C. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103672 · Cited by 45
Catalytic Methylation of m-Xylene, Toluene, and Benzene Using CO2 and H2 over TiO2-Supported Re and Zeolite Catalysts: Machine-Learning-Assisted Catalyst Optimization
Ting, K. W., Kamakura, H., Poly, S. S., Takao, M., Siddiki, S. M. A. H., Maeno, Z., Matsushita, K., Shimizu, K., & Toyao, T. (2021) · ACS Catalysis · doi:10.1021/acscatal.0c05661 · Cited by 41
The Contribution of Machine Learning in the Validation of Commercial Wearable Sensors for Gait Monitoring in Patients: A Systematic Review
Jourdan, T., Debs, N., & Frindel, C. (2021) · Sensors · doi:10.3390/s21144808 · Cited by 46
Inverse Design of Hybrid Organic–Inorganic Perovskites with Suitable Bandgaps via Proactive Searching Progress
Lu, T., Li, H., Li, M., Wang, S., & Lu, W. (2022) · ACS Omega · doi:10.1021/acsomega.2c01380 · Cited by 41
On the Tractability of SHAP Explanations
den Broeck, G. V., Lykov, A., Schleich, M., & Suciu, D. (2020) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16806 · Cited by 572

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks