Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 401–500 of 1,032

Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions
Chen, S., Yu, J., Chamouni, S., Wang, Y., & Li, Y. (2024) · BMC Medicine · doi:10.1186/s12916-024-03566-x · Cited by 73
Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
Hu, C., Li, L., Li, Y., Wang, F., Hu, B., & Peng, Z. (2022) · Infectious Diseases and Therapy · doi:10.1007/s40121-022-00671-3 · Cited by 63
Monitoring performance of clinical artificial intelligence in health care: a scoping review
Andersen, E. S., Birk-Korch, J. B., Hansen, R. S., Fly, L. H., Röttger, R., Arcani, D. M. C., Brasen, C. L., Brandslund, I., & Madsen, J. S. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00042 · Cited by 73
Predicting and interpreting oxide glass properties by machine learning using large datasets
Cassar, D. R., Mastelini, S. M., Botari, T., Alcobaça, E., de Carvalho, A. C. P. L. F., & Zanotto, E. D. (2021) · Ceramics International · doi:10.1016/j.ceramint.2021.05.105 · Cited by 73
Predicting Dynamic Riverine Nitrogen Export in Unmonitored Watersheds: Leveraging Insights of AI from Data-Rich Regions
Xiong, R., Zheng, Y., Chen, N., Tian, Q., Liu, W., Han, F., Jiang, S., Lu, M., & Zheng, Y. L. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.2c02232 · Cited by 78
The Explainable Potential of Coupling Metaheuristics-Optimized-XGBoost and SHAP in Revealing VOCs’ Environmental Fate
Jovanović, L., Jovanović, G., Perišić, M. D., Alimpić, F., Stanišić, S., Bačanin, N., Zivkovic, M. Z., & Stojić, A. (2023) · Atmosphere · doi:10.3390/atmos14010109 · Cited by 73
Evaluation and analysis of liquefaction potential of gravelly soils using explainable probabilistic machine learning model
Jas, K., Mangalathu, S., & Dodagoudar, G. R. (2024) · Computers and Geotechnics · doi:10.1016/j.compgeo.2023.106051 · Cited by 73
A comprehensive review on artificial intelligence driven predictive maintenance in vehicles: technologies, challenges and future research directions
Mahale, Y., Kolhar, S., & More, A. S. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-06681-3 · Cited by 101
Improvement of a prediction model for heart failure survival through explainable artificial intelligence
Moreno-Sánchez, P. A. (2023) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2023.1219586 · Cited by 86
Explainable Machine Learning for Real-Time Hypoglycemia and Hyperglycemia Prediction and Personalized Control Recommendations
Duckworth, C., Guy, M., Kumaran, A., O’Kane, A. A., Ayobi, A., Chapman, A. P., Marshall, P., & Boniface, M. (2022) · Journal of Diabetes Science and Technology · doi:10.1177/19322968221103561 · Cited by 76
Individualising intensive systolic blood pressure reduction in hypertension using computational trial phenomaps and machine learning: a post-hoc analysis of randomised clinical trials
Oikonomou, E. K., Spatz, E. S., Suchard, M. A., & Khera, R. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00170-4 · Cited by 69
Rapid estimation of battery state of health using partial electrochemical impedance spectra and interpretable machine learning
Xia, B., Qin, Z., & Fu, H. (2024) · Journal of Power Sources · doi:10.1016/j.jpowsour.2024.234413 · Cited by 73
Towards big industrial data mining through explainable automated machine learning
Garouani, M., Ahmad, A., Bouneffa, M., Hamlich, M., Bourguin, G., & Lewandowski, A. (2022) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-022-08761-9 · Cited by 79
Evaluating Explainable AI on a Multi-Modal Medical Imaging Task: Can Existing Algorithms Fulfill Clinical Requirements?
Jin, W., Li, X., & Hamarneh, G. (2022) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v36i11.21452 · Cited by 79
Exploring the Composition Space of High-Entropy Alloy Nanoparticles for the Electrocatalytic H 2 /CO Oxidation with Bayesian Optimization
Mints, V. A., Pedersen, J. K., Bagger, A., Quinson, J., Anker, A. S., Jensen, K. M. Ø., Rossmeisl, J., & Arenz, M. (2022) · ACS Catalysis · doi:10.1021/acscatal.2c02563 · Cited by 71
Explainable Anomaly Detection for Industrial Control System Cybersecurity
Ha, D. T., Hoang, N. X., Việt, N. H., Nguyen, H. D., Hương, T. T., & Tran, K. P. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.09.550 · Cited by 71
A hybrid approach of random forest and random parameters logit model of injury severity modeling of vulnerable road users involved crashes
Sun, Z., Wang, D., Gu, X., Abdel-Aty, M. A., Xing, Y., Wang, J., Lu, H., & Chen, Y. (2023) · Accident Analysis & Prevention · doi:10.1016/j.aap.2023.107235 · Cited by 71
Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making
Schoeffer, J., De‐Arteaga, M., & Kühl, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642621 · Cited by 105
Global hotspots of mycorrhizal fungal richness are poorly protected
Nuland, M. E. V., Averill, C., Stewart, J. D., Prylutskyi, O., Corrales, A., van Galen, L. G., Manley, B. F., Qin, C., Lauber, T., Mikryukov, V. S., et al. (2025) · Nature · doi:10.1038/s41586-025-09277-4 · Cited by 92
Sampling Permutations for Shapley Value EstimationPreprint
Mitchell, R., Cooper, J., Frank, E., & Holmes, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.12199 · Cited by 71
Verifying explainability of a deep learning tissue classifier trained on RNA-seq data
Yap, M., Johnston, R. L., Foley, H., MacDonald, S., Kondrashova, O., Tran, K. A., Nones, K., Koufariotis, L. T., Bean, C., Pearson, J. V., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-81773-9 · Cited by 76
A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
Chen, Y., Ouyang, L., Bao, F. S., Li, Q., Han, L., Zhang, H., Zhu, B., Ge, Y., Robinson, P. A., Xu, M. J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/23948 · Cited by 71
The Enlightening Role of Explainable Artificial Intelligence in Chronic Wound Classification
Sarp, S., Kuzlu, M., Wilson, E., Cali, Ü., & Güler, Ö. (2021) · Electronics · doi:10.3390/electronics10121406 · Cited by 75
Rapid Identification of Methicillin-Resistant Staphylococcus aureus Using MALDI-TOF MS and Machine Learning from over 20,000 Clinical Isolates
Yu, J., Tien, N., Liu, Y., Cho, D., Chen, J.-W., Tsai, Y.-T., Huang, Y.-C., Chao, H.-J., & Chen, C. (2022) · Microbiology Spectrum · doi:10.1128/spectrum.00483-22 · Cited by 70
Interpretable Machine Learning Modeling for Ischemic Stroke Outcome Prediction
Jabal, M. S., Joly, O., Kallmes, D. F., Harston, G., Rabinstein, A. A., Huynh, T. J., & Brinjikji, W. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.884693 · Cited by 74
Machine Learning–Based Prediction of Attention-Deficit/Hyperactivity Disorder and Sleep Problems With Wearable Data in Children
Kim, W.-P., Kim, H.-J., Pack, S. P., Lim, J., Cho, C., & Lee, H. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.3502 · Cited by 78
Optimisation and interpretation of machine and deep learning models for improved water quality management in Lake Loktak
Talukdar, S., Shahfahad, Bera, S., Naikoo, M. W., Ramana, G. V., Mallik, S., Kumar, P. A., & Rahman, A. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.119866 · Cited by 70
An integrated deep learning approach for assessing the visual qualities of built environments utilizing street view images
Zhao, X., Lu, Y., & Lin, G. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107805 · Cited by 70
Factors affecting injury severity in motorcycle crashes: Different age groups analysis using Catboost and SHAP techniques
Zahid, M., Habib, M. F., Ijaz, M., Ameer, I., Ullah, I., Ahmed, T., & He, Z. (2024) · Traffic Injury Prevention · doi:10.1080/15389588.2023.2297168 · Cited by 70
Rare earth modified carbon-based catalysts for oxygen electrode reactions: A machine learning assisted density functional theory investigation
Fu, Q., Xu, T., Wang, D., & Liu, C. (2024) · Carbon · doi:10.1016/j.carbon.2024.119045 · Cited by 70
An explainable XGBoost–based approach towards assessing the risk of cardiovascular disease in patients with Type 2 Diabetes Mellitus
Αθανασίου, Μ., Sfrintzeri, K., Zarkogianni, K., Thanopoulou, A. C., & Nikita, K. S. (2020) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe50027.2020.00146 · Cited by 69
Hyperbolic relational graph convolution networks plus: a simple but highly efficient QSAR-modeling method
Wu, Z., Jiang, D., Hsieh, C., Chen, G., Liao, B., Cao, D., & Hou, T. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab112 · Cited by 70
Interpretable machine learning for genomics
Watson, D. (2021) · Human Genetics · doi:10.1007/s00439-021-02387-9 · Cited by 87
Modelling of pavement performance evolution considering uncertainty and interpretability: a machine learning based framework
Yao, L., Leng, Z., Jiang, J., & Ni, F. (2021) · International Journal of Pavement Engineering · doi:10.1080/10298436.2021.2001814 · Cited by 69
Interpretable Machine‐Learning and Big Data Mining to Predict Gas Diffusivity in Metal‐Organic Frameworks
Guo, S., Huang, X., Situ, Y., Huang, Q., Guan, K., Huang, J., Wang, W., Bai, X., Liu, Z., Wu, Y., et al. (2023) · Advanced Science · doi:10.1002/advs.202301461 · Cited by 72
Bayesian-optimization-assisted discovery of stereoselective aluminum complexes for ring-opening polymerization of racemic lactide
Wang, X., Huang, Y., Xie, X., Liu, Y., Huo, Z., Lin, M., Xin, H., & Tong, R. (2023) · Nature Communications · doi:10.1038/s41467-023-39405-5 · Cited by 68
Highly Potent and Low‐Volume Concentration Additives for Durable Aqueous Zinc Batteries: Machine Learning‐Enabled Performance Rationalization
Shang, Y., Kundi, V., Pal, I., Kim, H. N., Zhong, H., Kumar, P. V., & Kundu, D. K. (2023) · Advanced Materials · doi:10.1002/adma.202309212 · Cited by 69
A critical moment in machine learning in medicine: on reproducible and interpretable learning
Ciobanu-Caraus, O., Aicher, A., Kernbach, J. M., Regli, L., Serra, C., & Staartjes, V. E. (2024) · Acta Neurochirurgica · doi:10.1007/s00701-024-05892-8 · Cited by 82
An interpretable model for landslide susceptibility assessment based on Optuna hyperparameter optimization and Random Forest
Xiao, X., Zou, Y., Huang, J., Luo, X., Yang, L., Li, M., Yang, P., Ji, X., & Li, Y. (2024) · Geomatics Natural Hazards and Risk · doi:10.1080/19475705.2024.2347421 · Cited by 69
Explainable machine learning for public policy: Use cases, gaps, and research directions
Amarasinghe, K., Rodolfa, K. T., Lamba, H., & Ghani, R. (2023) · Data & Policy · doi:10.1017/dap.2023.2 · Cited by 73
“Machine Learning (ML) systems are increasingly supporting high-stakes public policy decisions in areas such as criminal justice, education, healthcare, and social services Potash et al. [2020], Ye et al.”
BackgroundInfluential
Comprehensive prediction of robust synthetic lethality between paralog pairs in cancer cell lines
Kegel, B. D., Quinn, N., Thompson, N., Adams, D. J., & Ryan, C. J. (2021) · Cell Systems · doi:10.1016/j.cels.2021.08.006 · Cited by 67
Machine Learning Study of the Magnetic Ordering in 2D Materials
Acosta, C. M., Ogoshi, E., Souza, J. A., & Dalpian, G. M. (2022) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.1c21558 · Cited by 68
Artificial intelligence-based estimation of ultra-high-strength concrete's flexural property
Wang, Q., Hussain, A., Farooqi, M. U., & Deifalla, A. F. (2022) · Case Studies in Construction Materials · doi:10.1016/j.cscm.2022.e01243 · Cited by 68
Understanding the Compositional Control on Electrical, Mechanical, Optical, and Physical Properties of Inorganic Glasses with Interpretable Machine Learning
Bhattoo, R., Bishnoi, S., Zaki, M. F. M., & Krishnan, N. M. A. (2022) · Acta Materialia · doi:10.1016/j.actamat.2022.118439 · Cited by 80
Machine learning-driven assessment of relationship between activator properties in phase change solvent and its absorption performance for CO2 capture
Shen, Y., Gong, Y., Sun, L., Chen, P., Zhang, Q., Ye, J., Wang, L., & Zhang, S. (2023) · Separation and Purification Technology · doi:10.1016/j.seppur.2022.123092 · Cited by 68
AFP-MFL: accurate identification of antifungal peptides using multi-view feature learning
Fang, Y., Xu, F., Wei, L., Jiang, Y., Chen, J., Wei, D., & Wei, D. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbac606 · Cited by 71
Machine learning-driven predictive models for compressive strength of steel fiber reinforced concrete subjected to high temperatures
Alyousef, R., Rehman, M. F., Khan, M., Fawad, M., Khan, A. U., Hassan, A. M., & Ghamry, N. A. (2023) · Case Studies in Construction Materials · doi:10.1016/j.cscm.2023.e02418 · Cited by 68
A-SOiD, an active-learning platform for expert-guided, data-efficient discovery of behavior
Tillmann, J. F., Hsu, A. I., Schwarz, M. K., & Yttri, E. A. (2024) · Nature Methods · doi:10.1038/s41592-024-02200-1 · Cited by 77
Adopting yield-improving practices to meet maize demand in Sub-Saharan Africa without cropland expansion
Aramburu-Merlos, F., Tenorio, F. A., Mashingaidze, N., Sananka, A., Aston, S., Ojeda, J. J., & Grassini, P. (2024) · Nature Communications · doi:10.1038/s41467-024-48859-0 · Cited by 74
Revealing the synergistic spatial effects in soil heavy metal pollution with explainable machine learning models
Yan, Y., & Yang, Y. (2024) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2024.136578 · Cited by 68
Toward Interpretable Machine Learning: Transparent Deep Neural Networks and BeyondPreprint
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Müller, K. (2020) · arXiv (Cornell University) · Cited by 70
The rationality of explanation or human capacity? Understanding the impact of explainable artificial intelligence on human-AI trust and decision performance
Wang, P., & Ding, H. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103732 · Cited by 68
A Machine-Learning Approach for Dynamic Prediction of Sepsis-Induced Coagulopathy in Critically Ill Patients With Sepsis
Zhao, Q., Liu, L., Luo, J., Luo, Y., Wang, H., Zhang, Y., Gui, R., Tu, G.-W., & Luo, Z. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2020.637434 · Cited by 70
An Interpretable Machine Learning Model for Daily Global Solar Radiation Prediction
Chaibi, M., Benghoulam, E. M., Tarik, L., Berrada, M., & Hmaidi, A. E. (2021) · Energies · doi:10.3390/en14217367 · Cited by 69
An Empirical Survey on Explainable AI Technologies: Recent Trends, Use-Cases, and Categories from Technical and Application Perspectives
Nagahisarchoghaei, M., Nur, N., Cummins, L., Nur, N., Karimi, M. M., Nandanwar, S., Bhattacharyya, S., & Rahimi, S. (2023) · Electronics · doi:10.3390/electronics12051092 · Cited by 83
Urban dynamics through the lens of human mobility
Xu, Y., Olmos, L. E., Mateo, D., Hernando, A., Yang, X., & González, M. C. (2023) · Nature Computational Science · doi:10.1038/s43588-023-00484-5 · Cited by 68
Integration of dockless bike-sharing and metro: Prediction and explanation at origin-destination level
Fu, C., Huang, Z., Scheuer, B., Lin, J., & Zhang, Y. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104906 · Cited by 67
Deep learning and CRISPR-Cas13d ortholog discovery for optimized RNA targeting
Wei, J., Lotfy, P., Faizi, K., Baungaard, S., Gibson, E., Wang, E., Slabodkin, H., Kinnaman, E., Chandrasekaran, S. S., Kitano, H. C., et al. (2023) · Cell Systems · doi:10.1016/j.cels.2023.11.006 · Cited by 71
Physical Layer Authentication and Security Design in the Machine Learning Era
Hoang, T. M., Vahid, A., Tuan, H. D., & Hanzo, L. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3363639 · Cited by 73
Machine-Learning-Driven High-Throughput Screening of Transition-Metal Atom Intercalated g-C 3 N 4 /MX 2 (M = Mo, W; X = S, Se, Te) Heterostructures for the Hydrogen Evolution Reaction
Jyothirmai, M. V., Dantuluri, R., Sinha, P., Abraham, B. M., & Singh, J. K. (2024) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.3c17389 · Cited by 67
From bulk effective mass to 2D carrier mobility accurate prediction via adversarial transfer learning
Chen, X., Lu, S., Chen, Q., Zhou, Q., & Wang, J. (2024) · Nature Communications · doi:10.1038/s41467-024-49686-z · Cited by 69
Neuron Shapley: Discovering the Responsible NeuronsPreprint
Ghorbani, A., & Zou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09815 · Cited by 87
Explaining Individual and Collective Programming Students’ Behavior by Interpreting a Black-Box Predictive Model
Pereira, F. D., Fonseca, S. C., Oliveira, E. H. T., Cristea, A. I., Bellhauser, H., Rodrigues, L., Oliveira, D. B. F., Isotani, S., & Carvalho, L. S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3105956 · Cited by 63
The importance of antecedent vegetation and drought conditions as global drivers of burnt area
Kuhn-Régnier, A., Voulgarakis, A., Nowack, P. J., Forkel, M., Prentice, I. C., & Harrison, S. P. (2021) · Biogeosciences · doi:10.5194/bg-18-3861-2021 · Cited by 69
Explainable Anomaly Detection Framework for Maritime Main Engine Sensor Data
Kim, D., Antariksa, G., Handayani, M. P., Lee, S.-B., & Lee, J. (2021) · Sensors · doi:10.3390/s21155200 · Cited by 70
Self-citation
The nonlinear relationship between the active travel behavior of older adults and built environments: A comparison between an inner-city area and a suburban area
Guo, C., Jiang, Y., Qiao, R., Zhao, J., Weng, J., & Chen, Y. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104961 · Cited by 66
pAtbP-EnC: Identifying Anti-Tubercular Peptides Using Multi-Feature Representation and Genetic Algorithm-Based Deep Ensemble Model
Akbar, S., Raza, A., Shloul, T. A., Ahmad, A., Saeed, A., Ghadi, Y. Y., Mamyrbayev, O. J., & Eldin, S. M. (2023) · IEEE Access · doi:10.1109/access.2023.3321100 · Cited by 66
Profit-driven weighted classifier with interpretable ability for customer churn prediction
Jiang, P., Liu, Z., Abedin, M. Z., Wang, J., Yang, W., & Dong, Q. (2024) · Omega · doi:10.1016/j.omega.2024.103034 · Cited by 70
Short-term wind speed forecasting using an optimized three-phase convolutional neural network fused with bidirectional long short-term memory network model
Joseph, L. P., Deo, R. C., Casillas-Pérez, D., Prasad, R., Raj, N., & Salcedo‐Sanz, S. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.122624 · Cited by 67
Earlier spring greening in Northern Hemisphere terrestrial biomes enhanced net ecosystem productivity in summer
Ren, Y., Qiu, J., Zeng, Z., Liu, X., Sitch, S. A., Pilegaard, K., Yang, T., Wang, S., Yuan, W., & Jain, A. K. (2024) · Communications Earth & Environment · doi:10.1038/s43247-024-01270-5 · Cited by 68
The Integration of Radiomics and Artificial Intelligence in Modern Medicine
Maniaci, A., Lavalle, S., Gagliano, C., Lentini, M., Masiello, E., Parisi, F. M., Iannella, G., Cilia, N. D., Salerno, V. M., Cusumano, G., et al. (2024) · Life · doi:10.3390/life14101248 · Cited by 70
The impact of artificial intelligence on remote healthcare: Enhancing patient engagement, connectivity, and overcoming challenges
Chaturvedi, U., Chauhan, S. B., & Singh, I. (2025) · Intelligent Pharmacy · doi:10.1016/j.ipha.2024.12.003 · Cited by 104
Interpretable Memristive LSTM Network Design for Probabilistic Residential Load Forecasting
Li, C., Dong, Z. Y., Ding, L., Petersen, H., Qiu, Z., Chen, G., & Prasad, D. K. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3155443 · Cited by 68
Machine Learning Reveals a General Understanding of Printability in Formulations Based on Rheology Additives
Nadernezhad, A., & Gröll, J. (2022) · Advanced Science · doi:10.1002/advs.202202638 · Cited by 65
Explainable Machine Learning for Financial Distress Prediction: Evidence from Vietnam
Tran, K. L., Le, H. A., Nguyen, T., & Nguyen, D. T. (2022) · Data · doi:10.3390/data7110160 · Cited by 65
Shapley-NAS: Discovering Operation Contribution for Neural Architecture Search
Xiao, H., Wang, Z., Zhu, Z., Zhou, J., & Lu, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01159 · Cited by 69
Conserved Sites and Recognition Mechanisms of T1R1 and T2R14 Receptors Revealed by Ensemble Docking and Molecular Descriptors and Fingerprints Combined with Machine Learning
Cui, Z., Zhang, N., Zhou, T., Zhou, X., Meng, H., Yu, Y., Zhang, Z., Zhang, Y., Wang, W., & Liu, Y. (2023) · Journal of Agricultural and Food Chemistry · doi:10.1021/acs.jafc.3c00591 · Cited by 66
A SHAP-enhanced XGBoost model for interpretable prediction of coseismic landslides
Wen, H., Liu, B., Di, M., Li, J., & Zhou, X. (2024) · Advances in Space Research · doi:10.1016/j.asr.2024.07.013 · Cited by 65
Estimating surface NO2 concentrations over Europe using Sentinel-5P TROPOMI observations and Machine Learning
Shetty, S., Schneider, P., Stebel, K., Hamer, P., Kylling, A., & Berntsen, T. K. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2024.114321 · Cited by 80
SHAP-Driven Explainable Artificial Intelligence Framework for Wildfire Susceptibility Mapping Using MODIS Active Fire Pixels: An In-Depth Interpretation of Contributing Factors in Izmir, Türkiye
İban, M. C., & Aksu, O. (2024) · Remote Sensing · doi:10.3390/rs16152842 · Cited by 65
Leveraging AI for the diagnosis and treatment of autism spectrum disorder: Current trends and future prospects
Wankhede, N. L., Kale, M. B., Shukla, M., Nathiya, D., Roopashree, R., Kaur, P., Goyanka, B. K., Rahangdale, S. R., Taksande, B. G., Upaganlawar, A., et al. (2024) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2024.104241 · Cited by 78
A machine learning based framework to tailor properties of nanofiltration and reverse osmosis membranes for targeted removal of organic micropollutants
Hu, A., Liu, Y., Wang, X., Xia, S., & der Bruggen, B. V. (2024) · Water Research · doi:10.1016/j.watres.2024.122677 · Cited by 65
Exploring the influence of block environmental characteristics on land surface temperature and its spatial heterogeneity for a high-density city
Wan, Y., Du, H., Yuan, L., Xu, X., Tang, H., & Zhang, J. (2024) · Sustainable Cities and Society · doi:10.1016/j.scs.2024.105973 · Cited by 65
Mapping land-use intensity of grasslands in Germany with machine learning and Sentinel-2 time series
Lange, M., Feilhauer, H., Kühn, I., & Doktor, D. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2022.112888 · Cited by 64
Prediction of wildfire rate of spread in grasslands using machine learning methods
Khanmohammadi, S., Arashpour, M., Golafshani, E. M., Cruz, M. G., Rajabifard, A., & Bai, Y. (2022) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2022.105507 · Cited by 65
Investigation of the Binding Fraction of PFAS in Human Plasma and Underlying Mechanisms Based on Machine Learning and Molecular Dynamics Simulation
Cao, H., Peng, J., Zhou, Z., Yang, Z., Wang, L., Sun, Y., Wang, Y., & Liang, Y. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.2c04400 · Cited by 68
Exploring the Knowledge Attained by Machine Learning on Ion Transport across Polyamide Membranes Using Explainable Artificial Intelligence
Jeong, N., Epsztein, R., Wang, R., Park, S., Lin, S., & Tong, T. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.2c08384 · Cited by 68
Hybridized machine-learning for prompt prediction of rheology and filtration properties of water-based drilling fluids
Davoodi, S., Mehrad, M., Wood, D. A., Ghorbani, H., & Rukavishnikov, V. S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106459 · Cited by 64
Human movement and environmental barriers shape the emergence of dengue
Harish, V., Colón‐González, F. J., Moreira, F. R. R., Gibb, R., Kraemer, M. U. G., Davis, M., Reiner, R. C., Pigott, D. M., Perkins, T. A., Weiss, D. J., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-48465-0 · Cited by 64
Active Learning Guided Discovery of High Entropy Oxides Featuring High H 2 -production
Nie, S., Xiang, Y., Wu, L., Lin, G., Liu, Q., Chu, S., & Wang, X. (2024) · Journal of the American Chemical Society · doi:10.1021/jacs.4c06272 · Cited by 64
Cost-Sensitive Boosting Pruning Trees for Depression Detection on Twitter
Tong, L., Liu, Z., Jiang, Z., Zhou, F., Chen, L., Lyu, J., Zhang, X., Zhang, Q., Sadka, A. H., Wang, Y., et al. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3145634 · Cited by 69
Shopper intent prediction from clickstream e-commerce data with minimal browsing information
Requena, B., Cassani, G., Tagliabue, J., Greco, C., & Lacasa, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-73622-y · Cited by 70
Enhancing the Evaluation and Interpretability of Data-Driven Air Quality Models
Gu, J., Yang, B., Brauer, M. D., & Zhang, K. M. (2020) · Atmospheric Environment · doi:10.1016/j.atmosenv.2020.118125 · Cited by 63
Deep Entity Matching
Li, Y., Li, J., Suhara, Y., Wang, J., Hirota, W., & Tan, W.-C. (2021) · Journal of Data and Information Quality · doi:10.1145/3431816 · Cited by 73
Symbolic Transformer Accelerating Machine Learning Screening of Hydrogen and Deuterium Evolution Reaction Catalysts in MA2Z4 Materials
Zheng, J., Sun, X., Hu, J., Wang, S., Yao, Z., Deng, S., Pan, X., Pan, Z., & Wang, J. (2021) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.1c13236 · Cited by 63
Explainable AI reveals new hydroclimatic insights for ecosystem-centric groundwater management
Chakraborty, D., Başağaoğlu, H., Gutierrez, L., & Mirchi, A. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac2fde · Cited by 65
New SHapley Additive ExPlanations (SHAP) Approach to Evaluate the Raw Materials Interactions of Steel-Fiber-Reinforced Concrete
Anjum, M. R., Khan, K., Ahmad, W., Ahmad, A., Amin, M. N., & Nafees, A. (2022) · Materials · doi:10.3390/ma15186261 · Cited by 63
Relative Valuation with Machine Learning
Geertsema, P. G., & Lu, H. (2022) · Journal of Accounting Research · doi:10.1111/1475-679x.12464 · Cited by 78
An interpretable machine learning prognostic system for risk stratification in oropharyngeal cancer
Alabi, R. O., Almangush, A., Elmusrati, M. S., Leivo, I. V. V., & Mäkitie, A. A. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104896 · Cited by 65
A novel machine learning method for evaluating the impact of emission sources on ozone formation
Cheng, Y., Huang, X., Peng, Y., Tang, M., Zhu, B., Xia, S.-Y., & He, L. (2022) · Environmental Pollution · doi:10.1016/j.envpol.2022.120685 · Cited by 63

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks