Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 901–1,000 of 1,032

Predicting outcome of patients with prolonged disorders of consciousness using machine learning models based on medical complexity
Liuzzi, P., Magliacano, A., Bellis, F. D., Mannini, A., & Estraneo, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-17561-w · Cited by 41
Extracting structural motifs from pair distribution function data of nanostructures using explainable machine learning
Anker, A. S., Kjær, E. T. S., Juelsholt, M., Christiansen, T. L., Skjærvø, S. L., Jørgensen, M. R. V., Kantor, I. Y., Sørensen, D. R., Billinge, S. J. L., Selvan, R., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00896-3 · Cited by 41
Respiratory effort during sleep and prevalent hypertension in obstructive sleep apnoea
Martinot, J., Lê-Dông, N.-N., Malhotra, A., & Pépin, J. (2022) · European Respiratory Journal · doi:10.1183/13993003.01486-2022 · Cited by 41
OptiLIME: Optimized LIME Explanations for Diagnostic Computer AlgorithmsPreprint
Visani, G., Bagli, E., & Chesani, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05714 · Cited by 94
Explainable machine learning to predict long-term mortality in critically ill ventilated patients: a retrospective study in central Taiwan
Chan, M.-C., Pai, K.-C., Su, S.-A., Wang, M.-S., Wu, C., & Chao, W. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01817-6 · Cited by 43
Mining Campus Big Data: Prediction of Career Choice Using Interpretable Machine Learning Method
Wang, Y., Yang, L., Wu, J. Y., Song, Z., & Shi, L. (2022) · Mathematics · doi:10.3390/math10081289 · Cited by 40
A CFD-based surrogate model for predicting flow parameters in a ventilated room using sensor readings
Morozova, N., Trias, F. X., Capdevila, R., Schillaci, E., & Oliva, A. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.112146 · Cited by 40
Emergence of the physiological effects of elevated CO 2 on land–atmosphere exchange of carbon and water
Zhan, C., Orth, R., Migliavacca, M., Zaehle, S., Reichstein, M., Engel, J., Rammig, A., & Winkler, A. J. (2022) · Global Change Biology · doi:10.1111/gcb.16397 · Cited by 42
Improving artificial intelligence pipeline for liver malignancy diagnosis using ultrasound images and video frames
Xu, Y., Zheng, B., Liu, X., Wu, T., Ju, J., Wang, S., Lian, Y., Zhang, H., Liang, T., Sang, Y., et al. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac569 · Cited by 47
PASSerRank: Prediction of allosteric sites with learning to rank
Tian, H., Xiao, S., Jiang, X., & Tao, P. (2023) · Journal of Computational Chemistry · doi:10.1002/jcc.27193 · Cited by 38
A machine-learning based data-oriented pipeline for Prognosis and Health Management Systems
Souza, M. L. H., da Costa, C. A., & Ramos, G. D. O. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.103903 · Cited by 40
Interpretable machine learning model for autogenous shrinkage prediction of low-carbon cementitious materials
Hilloulin, B., & Tran, V. Q. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.132343 · Cited by 42
Machine learning-based water quality prediction using octennial in-situ Daphnia magna biological early warning system data
Jeong, H., Park, S., Choi, B., Yu, C. S., Hong, J. Y., Jeong, T.-Y., & Cho, K. H. (2023) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2023.133196 · Cited by 43
Hydrologic interpretation of machine learning models for 10-daily streamflow simulation in climate sensitive upper Indus catchments
Mushtaq, H., Akhtar, T., Hashmi, M. Z. U. R., Masood, A., & Saeed, F. (2024) · Theoretical and Applied Climatology · doi:10.1007/s00704-024-04932-8 · Cited by 40
Indirect prediction of graphene nanoplatelets-reinforced cementitious composites compressive strength by using machine learning approaches
Fawad, M., Alabduljabbar, H., Farooq, F., Najeh, T., Gamil, Y., & Ahmed, B. (2024) · Scientific Reports · doi:10.1038/s41598-024-64204-3 · Cited by 40
Biodiversity buffers the response of spring leaf unfolding to climate warming
Shen, P., Wang, X., Zohner, C. M., Peñuelas, J., Zhou, Y., Tang, Z., Xia, J., Zheng, H., Fu, Y. H., Liang, J., et al. (2024) · Nature Climate Change · doi:10.1038/s41558-024-02035-w · Cited by 41
Reliable Autism Spectrum Disorder Diagnosis for Pediatrics Using Machine Learning and Explainable AI
Jeon, I., Kim, M., So, D., Kim, E. Y., Nam, Y., Kim, S., Shim, S.-H., Kim, J., & Moon, J. (2024) · Diagnostics · doi:10.3390/diagnostics14222504 · Cited by 40
Investigating the causal effects of anthropogenic factors on urban streams and lakes water quality by integrating causal inference with interpretable machine learning
Liu, S., Xu, J., Wang, R., Fu, X., Liu, X., Zhao, Y., & Zhang, X. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.144626 · Cited by 39
Satellite-based evidence of recent decline in global forest recovery rate from tree mortality events
Yan, Y., Hong, S., Chen, A., Peñuelas, J., Allen, C. D., Hammond, W. M., Munson, S. M., Myneni, R. B., & Piao, S. L. (2025) · Nature Plants · doi:10.1038/s41477-025-01948-4 · Cited by 45
Computing the Hazard Ratios Associated With Explanatory Variables Using Machine Learning Models of Survival Data
Sundrani, S. C., & Lu, J. (2021) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00172 · Cited by 42
Explainable Student Agency Analytics
Saarela, M., Heilala, V., Jääskelä, P., Rantakaulio, A., & Kärkkäinen, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116664 · Cited by 48
Using Explainable Machine Learning to Improve Intensive Care Unit Alarm Systems
González‐Nóvoa, J. A., Busto, L., Rodriguez-Andina, J. J., Fariña, J., Segura, M., Gómez, V., Vila, D., & Veiga, C. (2021) · Sensors · doi:10.3390/s21217125 · Cited by 39
Zero-Day Malware Detection and Effective Malware Analysis Using Shapley Ensemble Boosting and Bagging Approach
Kumar, R., & Geetha, S. (2022) · Sensors · doi:10.3390/s22072798 · Cited by 40
Using SincNet for Learning Pathological Voice Disorders
Hung, C.-H., Wang, S.-S., Wang, C.-T., & Fang, S.-H. (2022) · Sensors · doi:10.3390/s22176634 · Cited by 39
Real-world data to build explainable trustworthy artificial intelligence models for prediction of immunotherapy efficacy in NSCLC patients
Prelaj, A., Galli, E. G., Miskovic, V., Pesenti, M., Viscardi, G., Pedica, B., Mazzeo, L., Bottiglieri, A., Provenzano, L., Spagnoletti, A., et al. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2022.1078822 · Cited by 39
Explainable AI-based Federated Deep Reinforcement Learning for Trusted Autonomous Driving
Rjoub, G., Bentahar, J., & Wahab, O. A. (2022) · 2022 International Wireless Communications and Mobile Computing (IWCMC) · doi:10.1109/iwcmc55113.2022.9824617 · Cited by 44
Adding interpretability to predictive maintenance by machine learning on sensor data
Steurtewagen, B., & den Poel, D. V. (2021) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2021.107381 · Cited by 39
A cost-aware framework for the development of AI models for healthcare applications
Erion, G., Janizek, J. D., Hudelson, C. E., Utarnachitt, R. B., McCoy, A. M., Sayre, M. R., White, N. J., & Lee, S. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00872-8 · Cited by 51
Self-citation
Prediction of type 2 diabetes mellitus onset using logistic regression-based scorecards
Edlitz, Y., & Segal, E. (2022) · eLife · doi:10.7554/elife.71862 · Cited by 43
Application of SHAP values for inferring the optimal functional form of covariates in pharmacokinetic modeling
Janßen, A., Hoogendoorn, M., Cnossen, M. H., & Mathôt, R. A. A. (2022) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12828 · Cited by 39
A systems approach towards remote health-monitoring in older adults: Introducing a zero-interaction digital exhaust
Schütz, N., Knobel, S. E. J., Botros, A., Single, M., Pais, B., Santschi, V., Gática-Pérez, D., Buluschek, P., Urwyler, P., Gerber, S. M., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00657-y · Cited by 38
Investigation of hydrometeorological influences on reservoir releases using explainable machine learning methods
Fan, M., Zhang, L., Liu, S., Yang, T., & Lu, D. (2023) · Frontiers in Water · doi:10.3389/frwa.2023.1112970 · Cited by 39
Nationwide health, socio-economic and genetic predictors of COVID-19 vaccination status in Finland
Hartonen, T., Jermy, B. S., Sõnajalg, H., Vartiainen, P., Krebs, K., Vabalas, A., FinnGen, Metspalu, A., Esko, T., Nelis, M., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01591-z · Cited by 42
Data‐Driven Estimation of Groundwater Level Time‐Series at Unmonitored Sites Using Comparative Regional Analysis
Haaf, E., Giese, M., Reimann, T., & Barthel, R. (2023) · Water Resources Research · doi:10.1029/2022wr033470 · Cited by 40
Prediction of CO2 solubility in ionic liquids via convolutional autoencoder based on molecular structure encoding
Liu, T., Fan, D., Chen, Y., Dai, Y., Jiao, Y., Cui, P., Wang, Y., & Zhu, Z. (2023) · AIChE Journal · doi:10.1002/aic.18182 · Cited by 39
Machine-Learning-Enabled Framework in Engineering Plastics Discovery: A Case Study of Designing Polyimides with Desired Glass-Transition Temperature
Zhang, S., He, X., Xia, X., Xiao, P., Wu, Q., Zheng, F., & Lu, Q. (2023) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.3c05376 · Cited by 39
Predictive models of long COVID
Antony, B., Blau, H., Casiraghi, E., Loomba, J. J., Callahan, T. J., Laraway, B. J., Wilkins, K. J., Antonescu, C., Valentini, G., Williams, A. E., et al. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104777 · Cited by 39
Explainable machine learning model for multi-step forecasting of reservoir inflow with uncertainty quantification
Fan, M., Liu, S., Lu, D., Gangrade, S., & Kao, S. (2023) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2023.105849 · Cited by 39
Spatial distribution and source identification of potentially toxic elements in Yellow River Delta soils, China: An interpretable machine-learning approach
Zhou, M., & Li, Y. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.169092 · Cited by 39
Occupancy modeling on non-intrusive indoor environmental data through machine learning
Banihashemi, F., Weber, M., Deghim, F., Zong, C., & Lang, W. (2024) · Building and Environment · doi:10.1016/j.buildenv.2024.111382 · Cited by 39
Understanding the effects of flash drought on vegetation photosynthesis and potential drivers over China
Zhao, Y., Xiong, L., Yin, J., Zha, X., Li, W., & Han, Y. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.172926 · Cited by 41
Enhancing hERG Risk Assessment with Interpretable Classificatory and Regression Models
Sanches, I. H., Braga, R. C., Alves, V. M., & Andrade, C. H. (2024) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.3c00400 · Cited by 42
Comparative analysis of hyperspectral Image reconstruction using deep learning for agricultural and biological applications
Ahmed, M. T., Villordon, A. Q., & Kamruzzaman, M. (2024) · Results in Engineering · doi:10.1016/j.rineng.2024.102623 · Cited by 39
C-SHAP: A Hybrid Method for Fast and Efficient Interpretability
Ranjbaran, G., Recupero, D. R., Roy, C. K., & Schneider, K. A. (2025) · Applied Sciences · doi:10.3390/app15020672 · Cited by 49
Simulation and prediction of PM2.5 concentrations and analysis of driving factors using interpretable tree-based models in Shanghai, China
Qing, W., Chen, Y., Zhang, H., Jia, Z., Yang, J., & Niu, B. (2025) · Environmental Research · doi:10.1016/j.envres.2025.121003 · Cited by 39
Axial compressive capacity prediction of coal gangue concrete-filled steel tube stub columns: Genetic programming-augmented code calibration and Bayesian-optimized machine learning
Zhang, Y., Meng, X., Liu, J., Wang, W., & Lyu, X. (2025) · Structures · doi:10.1016/j.istruc.2025.110119 · Cited by 39
High-resolution urban LST downscaling via machine learning and SHAP: A case study in a rapidly urbanizing semi-arid region
Tahooni, A., Kakroodi, A. A., Kiavarz, M., & Mansourian, H. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106897 · Cited by 42
Amino Acid k-mer Feature Extraction for Quantitative Antimicrobial Resistance (AMR) Prediction by Machine Learning and Model Interpretation for Biological Insights
ValizadehAslani, T., Zhao, Z., Sokhansanj, B. A., & ROSEN, G. L. (2020) · Biology · doi:10.3390/biology9110365 · Cited by 39
Logic Synthesis Meets Machine Learning: Trading Exactness for Generalization
Rai, S., Neto, W. L., Miyasaka, Y., Zhang, X., Yu, M., Yi, Q., Fujita, M., Manske, G. B., Pontes, M. F., Júnior, L. S. D. R., et al. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9473972 · Cited by 39
Recording of elapsed time and temporal information about biological events using Cas9
Park, J., Lim, J. M., Jung, I., Heo, S., Park, J., Chang, Y. J., Kim, H. K., Jung, D., Yu, J. H., Min, S., et al. (2021) · Cell · doi:10.1016/j.cell.2021.01.014 · Cited by 35
Predicting and investigating cytotoxicity of nanoparticles by translucent machine learning
Yu, H., Zhao, Z., & Cheng, F. (2021) · Chemosphere · doi:10.1016/j.chemosphere.2021.130164 · Cited by 40
Machine Learning Outperforms Existing Clinical Scoring Tools in the Prediction of Postoperative Atrial Fibrillation During Intensive Care Unit Admission After Cardiac Surgery
Karri, R., Kawai, A., Thong, Y. J., Ramson, D. M., Perry, L. A., Segal, R., Smith, J. A., & Penny‐Dimri, J. C. (2021) · Heart Lung and Circulation · doi:10.1016/j.hlc.2021.05.101 · Cited by 41
Bone mineral density response prediction following osteoporosis treatment using machine learning to aid personalized therapy
Tanphiriyakun, T., Rojanasthien, S., & Khumrin, P. (2021) · Scientific Reports · doi:10.1038/s41598-021-93152-5 · Cited by 42
Explainable deep learning predictions for illness risk of mental disorders in Nanjing, China
Wang, C., Feng, L., & Qi, Y. (2021) · Environmental Research · doi:10.1016/j.envres.2021.111740 · Cited by 39
Machine Learning Models for Predicting In-Hospital Mortality in Acute Aortic Dissection Patients
Guo, T., Fang, Z., Yang, G., Zhou, Y., Ding, N., Peng, W., Gong, X., He, H., Pan, X., & Chai, X. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.727773 · Cited by 39
A Machine Learning-Based Prediction Model for Acute Kidney Injury in Patients With Congestive Heart Failure
Peng, X., Li, L., Wang, X., & Zhang, H. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.842873 · Cited by 42
Potential of Coupling Metaheuristics-Optimized-XGBoost and SHAP in Revealing PAHs Environmental Fate
Jovanović, G., Perišić, M. D., Bačanin, N., Zivkovic, M. Z., Stanišić, S., Strumberger, I., Alimpić, F., & Stojić, A. (2023) · Toxics · doi:10.3390/toxics11040394 · Cited by 39
AI4Water v1.0: an open-source python package for modeling hydrological time series using data-driven methods
Abbas, A., Boithias, L., Pachepsky, Y. A., Kim, K., Chun, J. A., & Cho, K. H. (2022) · Geoscientific model development · doi:10.5194/gmd-15-3021-2022 · Cited by 38
Underlying conditions contributing to breathlessness in the population
Sandberg, J., Olsson, M., & Ekström, M. (2021) · Current Opinion in Supportive and Palliative Care · doi:10.1097/spc.0000000000000568 · Cited by 38
Emerging Trends in Deep Learning for Credit Scoring: A Review
Hayashi, Y. (2022) · Electronics · doi:10.3390/electronics11193181 · Cited by 46
Drug Repurposing against KRAS Mutant G12C: A Machine Learning, Molecular Docking, and Molecular Dynamics Study
Srisongkram, T., & Weerapreeyakul, N. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms24010669 · Cited by 37
Physics-Guided Machine Learning for Wind-Farm Power Prediction: Toward Interpretability and Generalizability
Zehtabiyan-Rezaie, N., Iosifidis, A., & Abkar, M. (2023) · PRX Energy · doi:10.1103/prxenergy.2.013009 · Cited by 38
Improved GNNs for Log D 7.4 Prediction by Transferring Knowledge from Low-Fidelity Data
Duan, Y., Fu, L., Zhang, X., Long, T.-Z., Yuan-Hang, H., Liu, Z., Lü, A., Deng, Y., Hsieh, C., Hou, T., et al. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.2c01564 · Cited by 40
Interpreting Highly Variable Indoor PM2.5 in Rural North China Using Machine Learning
Men, Y., Li, Y., Luo, Z., Jiang, K., Yi, F., Liu, X., Xing, R., Cheng, H., Shen, G., & Tao, S. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c02014 · Cited by 38
Prediction of biogas production in anaerobic digestion of a full‐scale wastewater treatment plant using ensembled machine learning models
Sun, J., Xu, Y., Nairat, S., Zhou, J., & He, Z. (2023) · Water Environment Research · doi:10.1002/wer.10893 · Cited by 40
A multi-scale map of protein assemblies in the DNA damage response
Kratz, A., Kim, M., Kelly, M. R., Zheng, F., Koczor, C. A., Li, J., Ono, K., Qin, Y., Churas, C., Chen, J., et al. (2023) · Cell Systems · doi:10.1016/j.cels.2023.04.007 · Cited by 36
Designing dynamic groundwater management strategies through a composite groundwater vulnerability model: Integrating human-related parameters into the DRASTIC model using LightGBM regression and SHAP analysis
Guo, X., Xiong, H., Li, H., Gui, X., Hu, X., Li, Y., Cui, H., Qiu, Y., Zhang, F., & Ma, C. (2023) · Environmental Research · doi:10.1016/j.envres.2023.116871 · Cited by 38
Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
Liu, J.-H., Shih, C., Huang, H., Peng, J., Cheng, S., Tsai, J., & Lai, F. (2023) · Journal of Medical Internet Research · doi:10.2196/47366 · Cited by 41
Concurrent prediction of metallic glasses’ global energy and internal structural heterogeneity by interpretable machine learning
Liu, C., Wang, Y., Wang, Y., Islam, M., Hwang, J., Wang, Y., & Fan, Y. (2023) · Acta Materialia · doi:10.1016/j.actamat.2023.119281 · Cited by 39
A historical perspective of biomedical explainable AI research
Malinverno, L., Barros, V., Ghisoni, F., Visonà, G., Kern, R., Nickel, P. J., Ventura, B. E., Šimić, I., Stryeck, S., Manni, F., et al. (2023) · Patterns · doi:10.1016/j.patter.2023.100830 · Cited by 46
Improved estimation of dark fermentation biohydrogen production utilizing a robust categorical boosting machine-learning algorithm
Bandpey, A. F., Abdi, J., & Firozjaee, T. T. (2023) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2023.11.137 · Cited by 38
Synergies or trade-offs between surface urban heat island and hot extreme: Distinct responses in urban environments
Yang, C., & Zhao, S. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.105093 · Cited by 39
Changing Climate Threatens Irrigation Benefits of Maize Gross Primary Productivity in China
Liao, D., Niu, J., Ciais, P., Du, T., Zhang, B., & Kang, S. (2024) · Earth s Future · doi:10.1029/2022ef003474 · Cited by 39
Improved Rate Capability for Dry Thick Electrodes through Finite Elements Method and Machine Learning Coupling
Chouchane, M., Yao, W., Cronk, A., Zhang, M., & Meng, Y. S. (2024) · ACS Energy Letters · doi:10.1021/acsenergylett.4c00203 · Cited by 38
Machine learning-driven QSAR models for predicting the cytotoxicity of five common microplastics
Liu, C., Zong, C., Chen, S., Chu, J., Yang, Y., Pan, Y. L., Yuan, B., & Zhang, H. (2024) · Toxicology · doi:10.1016/j.tox.2024.153918 · Cited by 41
Causality-based Explanation of Classification Outcomes
Bertossi, L., Li, J., Schleich, M., Suciu, D. M., & Vagena, Z. (2020) · doi:10.1145/3399579.3399865 · Cited by 43
Predicting Student Academic Performance by Means of Associative Classification
Cagliero, L., Canale, L., Farinetti, L., Baralis, E., & Venuto, E. (2021) · Applied Sciences · doi:10.3390/app11041420 · Cited by 38
HPC I/O Throughput Bottleneck Analysis with Explainable Local Models
Isakov, M., del Rosario, E., Madireddy, S., Balaprakash, P., Carns, P., Ross, R. B., & Kinsy, M. A. (2020) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41405.2020.00037 · Cited by 38
Machine Learning Applied to Clinical Laboratory Data in Spain for COVID-19 Outcome Prediction: Model Development and Validation
Domínguez-Olmedo, J. L., Gragera-Martínez, Á., Vázquez, J. M., & Pachón, V. (2021) · Journal of Medical Internet Research · doi:10.2196/26211 · Cited by 38
A vital sign-based prediction algorithm for differentiating COVID-19 versus seasonal influenza in hospitalized patients
Yanamala, N. V. K., Krishna, N. H., Hathaway, Q. A., Radhakrishnan, A., Sunkara, S., Patel, H., Farjo, P. D., Patel, B. D., & Sengupta, P. P. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00467-8 · Cited by 38
Brain Connectivity Studies on Structure‐Function Relationships: A Short Survey with an Emphasis on Machine Learning
Wein, S., Deco, G., Tomé, A. M., Goldhacker, M., Malloni, W. M., Greenlee, M. W., & Lang, E. W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/5573740 · Cited by 42
Prediction of in‐hospital mortality with machine learning for COVID‐19 patients treated with steroid and remdesivir
Kuno, T., Sahashi, Y., Kawahito, S., Takahashi, M., Iwagami, M., & Egorova, N. (2021) · Journal of Medical Virology · doi:10.1002/jmv.27393 · Cited by 38
Differentiation of intestinal tuberculosis and Crohn’s disease through an explainable machine learning method
Weng, F., Meng, Y., Lu, F., Wang, Y., Wang, W., Xu, L., Cheng, D., & Zhu, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-05571-7 · Cited by 38
Treatment With Multi-Species Probiotics Changes the Functions, Not the Composition of Gut Microbiota in Postmenopausal Women With Obesity: A Randomized, Double-Blind, Placebo-Controlled Study
Kaczmarczyk, M., Szulińska, M., Łoniewski, I., Kręgielska-Narożna, M., Skonieczna‐Żydecka, K., Kościółek, T., Bezshapkin, V., & Bogdański, P. (2022) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2022.815798 · Cited by 42
Forecasting the evolution of fast-changing transportation networks using machine learning
Lei, W., Alves, L. G. A., & Amaral, L. A. N. (2022) · Nature Communications · doi:10.1038/s41467-022-31911-2 · Cited by 38
Integrating Bio-Electrochemical Sensors and Machine Learning to Predict the Efficacy of Biological Nutrient Removal Processes at Water Resource Recovery Facilities
Emaminejad, S. A., Sparks, J., & Cusick, R. D. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c00352 · Cited by 38
Clinician-informed XAI evaluation checklist with metrics (CLIX-M) for AI-powered clinical decision support systems
Brankovic, A., Cook, D., Rahman, J., Delaforce, A., Li, J., Magrabi, F., Cabitza, F., Coiera, E., & Bradford, D. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01764-2 · Cited by 37
Identifying Modifiable Predictors of Long‐Term Survival in Liver Transplant Recipients with Diabetes Mellitus Using Machine Learning
Yasodhara, A., Dong, V., Azhie, A., Goldenberg, A., & Bhat, M. (2021) · Liver Transplantation · doi:10.1002/lt.25930 · Cited by 37
Machine learning integration of multimodal data identifies key features of blood pressure regulation
Louca, P., Tran, T. Q. B., Toit, C. D., Christofidou, P., Spector, T. D., Mangino, M., Suhre, K., Padmanabhan, S., & Menni, C. (2022) · EBioMedicine · doi:10.1016/j.ebiom.2022.104243 · Cited by 37
Using Machine Learning Algorithms to Estimate the Compressive Property of High Strength Fiber Reinforced Concrete
Li, D., Xu, W., Zhou, M., Ahmad, W., Ali, M., Sabri, M. M. S., Salmi, A., & Ewais, D. Y. Z. (2022) · Materials · doi:10.3390/ma15134450 · Cited by 37
Machine-learning prediction for hospital length of stay using a French medico-administrative database
Jaotombo, F. F., Pauly, V., Fond, G. B., Orléans, V., Auquier, P., Ghattas, B., & Boyer, L. (2022) · Journal of Market Access & Health Policy · doi:10.1080/20016689.2022.2149318 · Cited by 39
How causal machine learning can leverage marketing strategies: Assessing and improving the performance of a coupon campaign
Langen, H., & Huber, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0278937 · Cited by 37
Towards artificial intelligence-based learning health system for population-level mortality prediction using electrocardiograms
Sun, W., Kalmady, S. V., Sepehrvand, N., Salimi, A., Nademi, Y., Bainey, K. R., Ezekowitz, J. A., Greiner, R., Hindle, A., McAlister, F. A., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00765-3 · Cited by 35
Establishment and Validation of Predictive Model of Tophus in Gout Patients
Lei, T., Guo, J., Wang, P., Zhang, Z., Niu, S., Zhang, Q., & Qing, Y. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12051755 · Cited by 38
Travel impedance, the built environment, and customized-bus ridership: A stop-to-stop level analysis
Liu, X., Chen, X., Potoglou, D., Tian, M., & Fu, Y. (2023) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2023.103889 · Cited by 37
Identifying the factors affecting citizens' willingness to participate in urban forest governance: Evidence from the municipality of Palermo, Italy
Galati, A., Coticchio, A., & Peiró‐Signes, Á. (2023) · Forest Policy and Economics · doi:10.1016/j.forpol.2023.103054 · Cited by 46
Design of prime-editing guide RNAs with deep transfer learning
Liu, F., Huang, S., Hu, J., Chen, X., Song, Z., Dong, J., Liu, Y., Huang, X., Wang, S., Wang, X., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00739-w · Cited by 39
Predicting and analyzing the fill factor of non-fullerene organic solar cells based on material properties and interpretable machine-learning strategies
Lee, M. (2023) · Solar Energy · doi:10.1016/j.solener.2023.112191 · Cited by 37
A case study of resilient modulus prediction leveraging an explainable metaheuristic-based XGBoost
He, B., Armaghani, D. J., Tsoukalas, M. Z., Qi, C., Bhatawdekar, R. M., & Asteris, P. G. (2024) · Transportation Geotechnics · doi:10.1016/j.trgeo.2024.101216 · Cited by 37
The nonlinear influence of land conveyance on urban carbon emissions: An interpretable ensemble learning-based approach
Qiao, R., Wu, Z., Jiang, Q. M., Liu, X., Gao, S., Xia, L., & Yang, T. (2024) · Land Use Policy · doi:10.1016/j.landusepol.2024.107117 · Cited by 37

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks