Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 201–300 of 1,032

AI explainability and governance in smart energy systems: A review
Alsaigh, R., Mehmood, R., & Katib, I. (2023) · Frontiers in Energy Research · doi:10.3389/fenrg.2023.1071291 · Cited by 121
Predicting adverse outcomes due to diabetes complications with machine learning using administrative health data
Ravaut, M., Sadeghi, H., Leung, K. K., Volkovs, M., Kornas, K., Harish, V., Watson, T., Lewis, G. F., Weisman, A., Poutanen, T., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00394-8 · Cited by 121
Advancing sweetpotato quality assessment with hyperspectral imaging and explainable artificial intelligence
Ahmed, M. T., Wijewardane, N. K., Lu, Y., Jones, D., Kudenov, M. W., Williams, C., Villordon, A. Q., & Kamruzzaman, M. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108855 · Cited by 125
Embracing data science in catalysis research
Suvarna, M., & Pérez‐Ramírez, J. (2024) · Nature Catalysis · doi:10.1038/s41929-024-01150-3 · Cited by 137
Chemical hardness-driven interpretable machine learning approach for rapid search of photocatalysts
Kumar, R., & Singh, A. K. (2021) · npj Computational Materials · doi:10.1038/s41524-021-00669-4 · Cited by 119
Compressive Strength Evaluation of Ultra-High-Strength Concrete by Machine Learning
Shen, Z., Deifalla, A. F., Kamiński, P., & Dyczko, A. (2022) · Materials · doi:10.3390/ma15103523 · Cited by 132
Machine learning prediction of mechanical properties in metal additive manufacturing
Akbari, P., Zamani, M., & Mostafaei, A. (2024) · Additive manufacturing · doi:10.1016/j.addma.2024.104320 · Cited by 135
An Explainable Artificial Intelligence Predictor for Early Detection of Sepsis
Yang, M., Liu, C., Wang, X., Li, Y., Gao, H., Liu, X., & Li, J. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004550 · Cited by 122
Interpretability analysis for thermal sensation machine learning models: An exploration based on the SHAP approach
Yang, Y., Yuan, Y., Han, Z. Y., & Liu, G. (2022) · Indoor Air · doi:10.1111/ina.12984 · Cited by 123
Characterizing the structural complexity of the Earth’s forests with spaceborne lidar
de Conto, T., Armston, J. D., & Dubayah, R. (2024) · Nature Communications · doi:10.1038/s41467-024-52468-2 · Cited by 131
Rainfall and runoff time-series trend analysis using LSTM recurrent neural network and wavelet neural network with satellite-based meteorological data: case study of Nzoia hydrologic basin
Ouma, Y. O., Cheruyot, R., & Wachera, A. N. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00365-2 · Cited by 131
Natural-Anthropogenic Environment Interactively Drives Global Surface Urban Heat Island Effects
Yuan, Y., Li, C., Geng, X., Yu, Z., Fan, Z., & Wang, X. (2022) · Environment International · doi:10.1016/j.envint.2022.107574 · Cited by 118
Disease diagnostics using machine learning of B cell and T cell receptor sequences
Zaslavsky, M., Craig, E., Michuda, J., Sehgal, N., Ram-Mohan, N., Lee, J.-Y., Nguyen, K. D., Hoh, R. A., Pham, T. D., Röltgen, K., et al. (2025) · Science · doi:10.1126/science.adp2407 · Cited by 132
Importance of satellite observations for high-resolution mapping of near-surface NO2 by machine learning
Kim, M., Brunner, D., & Kuhlmann, G. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112573 · Cited by 124
An ensemble machine learning model for water quality estimation in coastal area based on remote sensing imagery
Zhu, X., Guo, H., Huang‬‬‬‬, J. J., Tian, S., Wang, X., & Mai, Y. (2022) · Journal of Environmental Management · doi:10.1016/j.jenvman.2022.116187 · Cited by 117
Cross-species analysis of enhancer logic using deep learning
Minnoye, L., Taskiran, I. I., Mauduit, D., Fazio, M., Van Aerschot, L., Hulselmans, G., Christiaens, V., Makhzami, S., Seltenhammer, M., Karras, P., et al. (2020) · Genome Research · doi:10.1101/gr.260844.120 · Cited by 116
Native diversity buffers against severity of non-native tree invasions
Delavaux, C. S., Crowther, T. W., Zohner, C. M., Robmann, N. M., Lauber, T., van den Hoogen, J., Kuebbing, S. E., Liang, J., de‐Miguel, S., Nabuurs, G. J., et al. (2023) · Nature · doi:10.1038/s41586-023-06440-7 · Cited by 120
Self-citation
Machine learning and fund characteristics help to select mutual funds with positive alpha
DeMiguel, V., Gil‐Bazo, J., Nogales, F. J., & Santos, A. A. P. (2023) · Journal of Financial Economics · doi:10.1016/j.jfineco.2023.103737 · Cited by 119
Torsion design of CFRP-CFST columns using a data-driven optimization approach
Huang, H., Xue, C., Zhang, W., & Guo, M. (2021) · Engineering Structures · doi:10.1016/j.engstruct.2021.113479 · Cited by 115
Enhancing trust and interpretability of complex machine learning models using local interpretable model agnostic shap explanations
Aditya, P. S. R., & Pal, M. (2023) · International Journal of Data Science and Analytics · doi:10.1007/s41060-023-00458-w · Cited by 139
AIPs-SnTCN: Predicting Anti-Inflammatory Peptides Using fastText and Transformer Encoder-Based Hybrid Word Embedding with Self-Normalized Temporal Convolutional Networks
Raza, A., Uddin, J., Almuhaimeed, A., Akbar, S., Zou, Q., & Ahmad, A. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01563 · Cited by 117
Exploring interactive and nonlinear effects of key factors on intercity travel mode choice using XGBoost
Li, X., Shi, L., Shi, Y., Tang, J., Zhao, P., Wang, Y., & Chen, J. (2024) · Applied Geography · doi:10.1016/j.apgeog.2024.103264 · Cited by 117
The integration of artificial intelligence into clinical medicine: Trends, challenges, and future directions
Aravazhi, P. S., Gunasekaran, P., Benjamin, N. Z. Y., Thai, A., Chandrasekar, K. K., Kolanu, N. D., Prajjwal, P., Tekuru, Y., Villacreses-Brito, L. C., & Inban, P. (2025) · Disease-a-Month · doi:10.1016/j.disamonth.2025.101882 · Cited by 141
Automated machine learning-based prediction of microplastics induced impacts on methane production in anaerobic digestion
Xu, R., Cao, J., Ye, T., Wang, S., Luo, J., Ni, B., & Fang, F. (2022) · Water Research · doi:10.1016/j.watres.2022.118975 · Cited by 117
How can I choose an explainer?: An Application-grounded Evaluation of Post-hoc Explanations
Jesus, S., Belém, C., Balayan, V., Bento, J., Saleiro, P., Bizarro, P., & Gama, J. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445941 · Cited by 112
Machine Learning in Oncology: Methods, Applications, and Challenges
Bertsimas, D., & Wiberg, H. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00072 · Cited by 121
GPUTreeShap: massively parallel exact calculation of SHAP scores for tree ensembles
Mitchell, R., Frank, E., & Holmes, G. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.880 · Cited by 117
Interpretable machine learning prediction of all-cause mortality
Qiu, W., Chen, H., Dincer, A. B., Lundberg, S., Kaeberlein, M. R., & Lee, S. (2022) · Communications Medicine · doi:10.1038/s43856-022-00180-x · Cited by 113
Self-citation
Machine-learning-based intelligent framework for discovering refractory high-entropy alloys with improved high-temperature yield strength
Giles, S. A., Sengupta, D., Broderick, S., & Rajan, K. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00926-0 · Cited by 112
Explainable multi-task learning for multi-modality biological data analysis
Tang, X., Zhang, J., He, Y., Zhang, X., Lin, Z., Partarrieu, S., Hanna, E. B., Ren, Z., Shen, H., Yang, Y., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37477-x · Cited by 122
Automation and machine learning augmented by large language models in a catalysis study
Su, Y., Wang, X., Ye, Y., Xie, Y., Xu, Y., Jiang, Y., & Wang, C. (2024) · Chemical Science · doi:10.1039/d3sc07012c · Cited by 122
Designing a feature selection method based on explainable artificial intelligence
Zacharias, J., von Zahn, M., Chen, J., & Hinz, O. (2022) · Electronic Markets · doi:10.1007/s12525-022-00608-1 · Cited by 109
Don’t dismiss logistic regression: the case for sensible extraction of interactions in the era of machine learning
Levy, J., & O’Malley, A. J. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01046-3 · Cited by 122
Artificial intelligence to predict West Nile virus outbreaks with eco-climatic drivers
Farooq, Z., Rocklöv, J., Wallin, J., Abiri, N., Sewe, M. O., Sjödin, H., & Semenza, J. C. (2022) · The Lancet Regional Health - Europe · doi:10.1016/j.lanepe.2022.100370 · Cited by 112
Machine Learning in Management Accounting Research: Literature Review and Pathways for the Future
Ranta, M., Ylinen, M., & Järvenpää, M. (2021) · European Accounting Review · doi:10.1080/09638180.2022.2137221 · Cited by 160
Local interpretable model-agnostic explanation approach for medical imaging analysis: A systematic literature review
Hassan, S. U., Abdulkadir, S. J., Zahid, M. S. M., & Al-Selwi, S. M. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109569 · Cited by 123
Explainable AI improves task performance in human–AI collaboration
Senoner, J., Schallmoser, S., Kratzwald, B., Feuerriegel, S., & Netland, T. H. (2024) · Scientific Reports · doi:10.1038/s41598-024-82501-9 · Cited by 157
Digital twins as global learning health and disease models for preventive and personalized medicine
Li, X., Loscalzo, J., Mahmud, A. K. M. F., Aly, D. M., Rzhetsky, A., Žitnik, M., & Benson, M. (2025) · Genome Medicine · doi:10.1186/s13073-025-01435-7 · Cited by 135
Using explainable machine learning to characterise data drift and detect emergent health risks for emergency department admissions during COVID-19
Duckworth, C., Chmiel, F. P., Burns, D. K., Zlatev, Z. D., White, N. M., Daniels, T. W. V., Kiuber, M., & Boniface, M. J. (2021) · Scientific Reports · doi:10.1038/s41598-021-02481-y · Cited by 109
iAFPs-Mv-BiTCN: Predicting antifungal peptides using self-attention transformer embedding and transform evolutionary based multi-view features with bidirectional temporal convolutional networks
Akbar, S., Zou, Q., Raza, A., & Alarfaj, F. K. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102860 · Cited by 111
Tree-based machine learning performed in-memory with memristive analog CAM
Pedretti, G., Graves, C. E., Serebryakov, S., Mao, R., Sheng, X., Foltín, M., Li, C., & Strachan, J. P. (2021) · Nature Communications · doi:10.1038/s41467-021-25873-0 · Cited by 120
Investigating the performance of machine learning models combined with different feature selection methods to estimate the energy consumption of buildings
Liu, X., Tang, H., Ding, Y., & Yan, D. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.112408 · Cited by 108
Machine learning can guide food security efforts when primary data are not available
Martini, G., Bracci, A., Riches, L., Jaiswal, S., Corea, M., Rivers, J., Husain, A., & Omodei, E. (2022) · Nature Food · doi:10.1038/s43016-022-00587-8 · Cited by 110
Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units
Zhao, Q., Wang, H., Luo, J., Luo, M.-H., Liu, L., Yu, S.-J., Liu, K., Zhang, Y., Sun, P., Tu, G.-W., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.676343 · Cited by 108
Streamlit-based enhancing crop recommendation systems with advanced explainable artificial intelligence for smart farming
Akkem, Y., Biswas, S. K., & Varanasi, A. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10208-z · Cited by 108
Explainable diabetes classification using hybrid Bayesian-optimized TabNet architecture
Joseph, L. P., Joseph, E. A., & Prasad, R. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106178 · Cited by 110
Trust and Acceptance Challenges in the Adoption of AI Applications in Health Care: Quantitative Survey Analysis
Kauttonen, J., Rousi, R. A., & Alamäki, A. V. (2025) · Journal of Medical Internet Research · doi:10.2196/65567 · Cited by 133
Machine learning combined with the PMF model reveal the synergistic effects of sources and meteorological factors on PM2.5 pollution
Zhang, Z., Xu, B., Xu, W., Wang, F., Gao, J., Li, Y., Li, M., Feng, Y., & Shi, G. (2022) · Environmental Research · doi:10.1016/j.envres.2022.113322 · Cited by 107
Interpreting complex relationships between urban and meteorological factors and street-level urban heat islands: Application of random forest and SHAP method
Hong, T., Yim, S. H. L., & Heo, Y. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106353 · Cited by 109
Land-surface parameters for spatial predictive mapping and modeling
Maxwell, A. E., & Shobe, C. M. (2022) · Earth-Science Reviews · doi:10.1016/j.earscirev.2022.103944 · Cited by 105
Facts and Figures on Materials Science and Nanotechnology Progress and Investment
Talebian, S., Rodrigues, T., das Neves, J., Sarmento, B. F. C. C., Langer, R., & Conde, J. (2021) · ACS Nano · doi:10.1021/acsnano.1c03992 · Cited by 113
EASY‐APP: An artificial intelligence model and application for early and easy prediction of severity in acute pancreatitis
Kui, B., Pintér, J., Molontay, R., Nagy, M., Farkas, N., Gede, N., Vincze, Á., Bajor, J., Gódi, S., Czimmer, J., et al. (2022) · Clinical and Translational Medicine · doi:10.1002/ctm2.842 · Cited by 109
From predictions to prescriptions: A data-driven response to COVID-19
Bertsimas, D., Boussioux, L., Cory-Wright, R., Delarue, A., Digalakis, V., Jacquillat, A., Kitane, D. L., Lukin, G., Li, M. L., Mingardi, L., et al. (2021) · Health Care Management Science · doi:10.1007/s10729-020-09542-0 · Cited by 108
Machine Learning for Real-Time Heart Disease Prediction
Bertsimas, D., Mingardi, L., & Stellato, B. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3066347 · Cited by 116
Explainable Robotics in Human-Robot Interactions
Setchi, R., Dehkordi, M. B., & Khan, J. S. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.198 · Cited by 99
Heterogeneous Treatment Effects of Therapeutic-Dose Heparin in Patients Hospitalized for COVID-19
Goligher, E. C., Lawler, P. R., Jensen, T. P., Talisa, V. B., Berry, L. R., Lorenzi, E., McVerry, B. J., Chang, C. H., Leifer, E., Bradbury, C. A., et al. (2023) · JAMA · doi:10.1001/jama.2023.3651 · Cited by 103
Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis
Calisto, F. M., Fernandes, J., Morais, M., Santiago, C., Abrantes, J., Nunes, N., & Nascimento, J. C. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580682 · Cited by 116
Robust Adversarial Attacks Detection Based on Explainable Deep Reinforcement Learning for UAV Guidance and Planning
Hickling, T., Aouf, N., & Spencer, P. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3296227 · Cited by 111
Intrusion Detection in Healthcare 4.0 Internet of Things Systems via Metaheuristics Optimized Machine Learning
Savanović, N., Toskovic, A., Petrović, A., Zivkovic, M. Z., Damaševičius, R., Jovanović, L., Bačanin, N., & Nikolić, B. (2023) · Sustainability · doi:10.3390/su151612563 · Cited by 105
An explainable model for the mass appraisal of residences: The application of tree-based Machine Learning algorithms and interpretation of value determinants
İban, M. C. (2022) · Habitat International · doi:10.1016/j.habitatint.2022.102660 · Cited by 106
Credit growth, the yield curve and financial crisis prediction: Evidence from a machine learning approach
Bluwstein, K., Buckmann, M., Joseph, A. C., Kapadia, S., & Şimşek, Ö. (2023) · Journal of International Economics · doi:10.1016/j.jinteco.2023.103773 · Cited by 113
Explainable AI in Deep Reinforcement Learning Models: A SHAP Method Applied in Power System Emergency Control
Zhang, K., Xu, P., & Zhang, J. J. (2020) · IEEE Conference on Energy Internet and Energy System Integration (EI2) · doi:10.1109/ei250167.2020.9347147 · Cited by 100
Machine Learning in Precision Agriculture: A Survey on Trends, Applications and Evaluations Over Two Decades
Condran, S., Bewong, M., Islam, M. Z., Maphosa, L., & Zheng, L. (2022) · IEEE Access · doi:10.1109/access.2022.3188649 · Cited by 99
Survey on Explainable AI: Techniques, challenges and open issues
Abusitta, A., Li, M. Q., & Fung, B. C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124710 · Cited by 98
Using Automated Machine Learning to Predict the Mortality of Patients With COVID-19: Prediction Model Development Study
Ikemura, K., Bellin, E. Y., Yagi, Y., Billett, H. H., Saada, M., Simone, K., Stahl, L., Szymanski, J. M., Goldstein, D. Y., & Gil, M. R. (2021) · Journal of Medical Internet Research · doi:10.2196/23458 · Cited by 99
Non-linear dimensionality reduction on extracellular waveforms reveals cell type diversity in premotor cortex
Lee, E., Balasubramanian, H., Tsolias, A., Anakwe, S. U., Medalla, M., Shenoy, K. V., & Chandrasekaran, C. (2021) · eLife · doi:10.7554/elife.67490 · Cited by 96
Assessment of solar radiation resource and photovoltaic power potential across China based on optimized interpretable machine learning model and GIS-based approaches
Song, Z., Cao, S., & Yang, H. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121005 · Cited by 98
Elucidating governing factors of PFAS removal by polyamide membranes using machine learning and molecular simulations
Jeong, N., Park, S., Mahajan, S., Zhou, J., Blotevogel, J., Li, Y., Tong, T., & Chen, Y. (2024) · Nature Communications · doi:10.1038/s41467-024-55320-9 · Cited by 98
Machine-Learning-Guided Cocrystal Prediction Based on Large Data Base
Wang, D., Yang, Z., Zhu, B., Mei, X., & Luo, X. (2020) · Crystal Growth & Design · doi:10.1021/acs.cgd.0c00767 · Cited by 98
Using machine learning to predict student retention from socio-demographic characteristics and app-based engagement metrics
Matz, S., Bukow, C. S., Peters, H., Deacons, C., Dinu, A., & Stachl, C. (2023) · Scientific Reports · doi:10.1038/s41598-023-32484-w · Cited by 123
Synthetic Data Generation by Artificial Intelligence to Accelerate Research and Precision Medicine in Hematology
D’Amico, S., Dall’Olio, D., Sala, C., Dall’Olio, L., Sauta, E., Zampini, M., Asti, G., Lanino, L., Maggioni, G., Campagna, A., et al. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.23.00021 · Cited by 118
A comparison of machine learning models versus clinical evaluation for mortality prediction in patients with sepsis
van Doorn, W. P. T. M., Stassen, P. M., Borggreve, H. F., Schalkwijk, M. J., Stoffers, J., Bekers, O., & Meex, S. J. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245157 · Cited by 104
Modeling dispositional and initial learned trust in automated vehicles with predictability and explainability
Ayoub, J., Yang, X. J., & Zhou, F. (2021) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.12.015 · Cited by 100
Explainable AI reveals changes in skin microbiome composition linked to phenotypic differences
Carrieri, A. P., Haiminen, N., Maudsley-Barton, S., Gardiner, L., Murphy, B., Mayes, A. E., Paterson, S., Grimshaw, S. G., Winn, M., Shand, C., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-83922-6 · Cited by 98
AVPIden: a new scheme for identification and functional prediction of antiviral peptides based on machine learning approaches
Pang, Y., Yao, L., Jhong, J.-H., Wang, Z., & Lee, T.-Y. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab263 · Cited by 97
Explainable AI for Industry 5.0: Vision, Architecture, and Potential Directions
Trivedi, C., Bhattacharya, P., Prasad, V. K., Patel, V., Singh, A., Tanwar, S., Sharma, R., Aluvala, S., Pau, G., & Sharma, G. (2024) · IEEE Open Journal of Industry Applications · doi:10.1109/ojia.2024.3399057 · Cited by 110
m6A sites in the coding region trigger translation-dependent mRNA decay
Zhou, Y., Ćorović, M., Hoch-Kraft, P., Meiser, N., Mesitov, M. V., Körtel, N., Back, H., Vries, I. S. N., Katti, K., Obrdlík, A., et al. (2024) · Molecular Cell · doi:10.1016/j.molcel.2024.10.033 · Cited by 104
A systematic review of explainable artificial intelligence for spectroscopic agricultural quality assessment
Ahmed, M. T., Ahmed, M. W., & Kamruzzaman, M. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110354 · Cited by 102
Coastal water quality prediction based on machine learning with feature interpretation and spatio-temporal analysis
Grbčić, L., Družeta, S., Mauša, G., Lipić, T., Lušić, D. V., Alvir, M., Lučin, I., Sikirica, A., Davidović, D., Travaš, V., et al. (2022) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2022.105458 · Cited by 96
Compounding effects in flood drivers challenge estimates of extreme river floods
Jiang, S., Tarasova, L., Yu, G., & Jakob Zscheischler, A. (2024) · Science Advances · doi:10.1126/sciadv.adl4005 · Cited by 102
Large-scale chemoproteomics expedites ligand discovery and predicts ligand behavior in cells
Offensperger, F., Tin, G., Duran‐Frigola, M., Hahn, E., Dobner, S., Ende, C. W. A., Strohbach, J. W., Rukavina, A., Brennsteiner, V., Ogilvie, K., et al. (2024) · Science · doi:10.1126/science.adk5864 · Cited by 102
Novel Machine Learning Can Predict Acute Asthma Exacerbation
Zein, J., Wu, C.-P., Attaway, A. H., Zhang, P., & Nazha, A. (2021) · CHEST Journal · doi:10.1016/j.chest.2020.12.051 · Cited by 93
An Explainable Machine Learning Pipeline for Stroke Prediction on Imbalanced Data
Kokkotis, C., Giarmatzis, G., Γιαννακού, Ε., Moustakidis, S., Tsatalas, T., Tsiptsios, D., Vadikolias, Κ., & Aggelousis, N. (2022) · Diagnostics · doi:10.3390/diagnostics12102392 · Cited by 103
Using AI to measure Parkinson’s disease severity at home
Islam, M. S., Rahman, W., Abdelkader, A., Lee, S., Yang, P. T., Purks, J. L., Adams, J. L., Schneider, R. B., Dorsey, E. R., & Hoque, M. E. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00905-9 · Cited by 99
Self-citation
On-the-fly interpretable machine learning for rapid discovery of two-dimensional ferromagnets with high Curie temperature
Lu, S., Zhou, Q., Guo, Y., & Wang, J. (2021) · Chem · doi:10.1016/j.chempr.2021.11.009 · Cited by 94
Feature importance: Opening a soil-transmitted helminth machine learning model via SHAP
Scavuzzo, C. M., Scavuzzo, J. M., Campero, M. N., Anegagrie, M., Amor, A., Benito, A., & Periago, V. (2022) · Infectious Disease Modelling · doi:10.1016/j.idm.2022.01.004 · Cited by 93
Prediction of organic contaminant rejection by nanofiltration and reverse osmosis membranes using interpretable machine learning models
Zhu, T., Zhang, Y., Tao, C., Chen, W., & Cheng, H. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.159348 · Cited by 92
Contributions of various driving factors to air pollution events: Interpretability analysis from Machine learning perspective
Li, T., Zhang, Q., Peng, Y., Guan, X., Li, L., Mu, J., Wang, X., Yin, X., & Wang, Q. (2023) · Environment International · doi:10.1016/j.envint.2023.107861 · Cited by 92
Predicting aqueous sorption of organic pollutants on microplastics with machine learning
Qiu, Y., Li, Z., Zhang, T., & Zhang, P. (2023) · Water Research · doi:10.1016/j.watres.2023.120503 · Cited by 94
Forecasting carbon price trends based on an interpretable light gradient boosting machine and Bayesian optimization
Deng, S., Su, J., Zhu, Y., Yu, Y., & Xiao, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122502 · Cited by 96
A large-scale machine learning analysis of inorganic nanoparticles in preclinical cancer research
Mendes, B. B., Zhang, Z., Conniot, J., Sousa, D. P., Ravasco, J. M. J. M., Onweller, L. A., Lorenc, A., Rodrigues, T., Reker, D., & Conde, J. (2024) · Nature Nanotechnology · doi:10.1038/s41565-024-01673-7 · Cited by 102
To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods
Amparore, E. G., Perotti, A., & Bajardi, P. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.479 · Cited by 103
An explainable supervised machine learning predictor of acute kidney injury after adult deceased donor liver transplantation
Zhang, Y., Yang, D. H., Liu, Z., Chen, C., Ge, M., Li, X., Luo, T., Wu, Z., Shi, C., Wang, B., et al. (2021) · Journal of Translational Medicine · doi:10.1186/s12967-021-02990-4 · Cited by 96
Improving recombinant protein production by yeast through genome-scale modeling using proteome constraints
Li, F., Chen, Y., Qi, Q., Wang, Y., Yuan, L., Huang, M., Elsemman, I. E., Feizi, A., Kerkhoven, E. J., & Nielsen, J. (2022) · Nature Communications · doi:10.1038/s41467-022-30689-7 · Cited by 91
Explainable Artificial Intelligence (XAI) in Insurance
Owens, E., Sheehan, B., Mullins, M., Cunneen, M., Ressel, J., & Castignani, G. (2022) · Risks · doi:10.3390/risks10120230 · Cited by 135
Data-driven prediction of neutralizer pH and valve position towards precise control of chemical dosage in a wastewater treatment plant
Xu, Y., Zeng, X., Bernard, S., & He, Z. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.131360 · Cited by 90
Prediction of Clinical Trials Outcomes Based on Target Choice and Clinical Trial Design with Multi‐Modal Artificial Intelligence
Aliper, A., Kudrin, R., Polykovskiy, D. A., Kamya, P. R. N., Tutubalina, E. V., Chen, S., Ren, F., & Zhavoronkov, A. A. (2023) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.3008 · Cited by 107
A blended TROPOMI+GOSAT satellite data product for atmospheric methane using machine learning to correct retrieval biases
Balasus, N., Jacob, D. J., Lorente, A., Maasakkers, J. D., Parker, R. J., Boesch, H., Chen, Z., Kelp, M., Nesser, H. O., & Varon, D. J. (2023) · Atmospheric measurement techniques · doi:10.5194/amt-16-3787-2023 · Cited by 90
SHapley Additive exPlanations (SHAP) for Efficient Feature Selection in Rolling Bearing Fault Diagnosis
Santos, M. R., Guedes, L. A., & Sánchez-Gendriz, I. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6010016 · Cited by 104
Machine Learning Approaches in Polymer Science: Progress and Fundamental for a New Paradigm
Xie, C., Qiu, H., Liu, L., You, Y., Li, H., Li, Y., Sun, Z., Lin, J., & An, L. (2025) · SmartMat · doi:10.1002/smm2.1320 · Cited by 96

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks