Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 601–700 of 1,032

BIM-based solution to enhance the performance of public-private partnership construction projects using copula bayesian network
Ghorbany, S., Noorzai, E., & Yousefi, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119501 · Cited by 59
Informing antimicrobial stewardship with explainable AI
Cavallaro, M., Moran, E., Collyer, B. S., McCarthy, N. D., Green, C., & Keeling, M. J. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000162 · Cited by 55
Integrative modeling of heterogeneous soil salinity using sparse ground samples and remote sensing images
Wang, L., Hu, P., Zheng, H., Liu, Y., Cao, X., Hellwich, O., Liu, T., Luo, G., Bao, A., & Chen, X. (2023) · Geoderma · doi:10.1016/j.geoderma.2022.116321 · Cited by 55
A high-precision and transparent step-wise diagnostic framework for hot-rolled strip crown
Ding, C.-Y., Sun, J., Li, X., Peng, W. J., & Zhang, D. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.09.007 · Cited by 59
Towards white box modeling of compressive strength of sustainable ternary cement concrete using explainable artificial intelligence (XAI)
Ibrahim, S. M., Ansari, S. S., & Hasan, S. D. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110997 · Cited by 60
Explainable AI-based Deep-SHAP for mapping the multivariate relationships between regional neuroimaging biomarkers and cognition
Bhattarai, P., Thakuri, D. S., Nie, Y., & Chand, G. B. (2024) · European Journal of Radiology · doi:10.1016/j.ejrad.2024.111403 · Cited by 58
Promoting solar energy utilization: Prediction, analysis and evaluation of solar radiation on building surfaces at city scale
Yue, Y., Yan, Z., Ni, P., Lei, F., & Qin, G. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.114561 · Cited by 55
COVID-19 Mortality Risk Assessment: An International Multi-Center StudyPreprint
Bertsimas, D., Lukin, G., Mingardi, L., Nohadani, O., Orfanoudaki, A., Stellato, B., Wiberg, H., González-García, S., Parra-Calderón, C. L., The Hellenic COVID-19 Study Group, et al. (2020) · medRxiv · doi:10.1101/2020.07.07.20148304 · Cited by 55
Multimodal risk prediction with physiological signals, medical images and clinical notes
Wang, Y., Yin, C., & Zhang, P. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26772 · Cited by 66
Real-time data analysis using a machine learning model significantly improves prediction of successful vaginal deliveries
Guedalia, J., Lipschuetz, M., Persky, M. N., Cohen, S. M., Rottenstreich, A., Levin, G., Yagel, S., Unger, R., & Sompolinsky, Y. (2020) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2020.05.025 · Cited by 58
Towards a More Reliable Interpretation of Machine Learning Outputs for Safety-Critical Systems Using Feature Importance Fusion
Rengasamy, D., Rothwell, B. C., & Figueredo, G. P. (2021) · Applied Sciences · doi:10.3390/app112411854 · Cited by 54
Machine learning model interpretability using SHAP values: Application to a seismic facies classification task
Lubo-Robles, D., Devegowda, D., Jayaram, V., Bedle, H., Marfurt, K. J., & Pranter, M. J. (2020) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/segam2020-3428275.1 · Cited by 54
The drivers and health risks of unexpected surface ozone enhancements over the Sichuan Basin, China, in 2020
Sun, Y., Yin, H., Lu, X. H., Notholt, J., Palm, M., Liu, C., Tian, Y., & Zheng, B. (2021) · Atmospheric chemistry and physics · doi:10.5194/acp-21-18589-2021 · Cited by 56
Enhanced understanding of osmotic membrane bioreactors through machine learning modeling of water flux and salinity
Chang, H., Xu, Y., Chen, S., & He, Z. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.156009 · Cited by 54
AP-1 transcription factor network explains diverse patterns of cellular plasticity in melanoma cells
Comandante-Lou, N., Baumann, D. G., & Fallahi‐Sichani, M. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.111147 · Cited by 55
Compressor geometric uncertainty quantification under conditions from near choke to near stall
Wang, J., Wang, B., Yang, H., Sun, Z., Zhou, K. F., & Zheng, X. (2022) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2022.10.012 · Cited by 54
PM2.5 and O3 concentration estimation based on interpretable machine learning
Wang, S., Ren, Y., & Xia, B. (2023) · Atmospheric Pollution Research · doi:10.1016/j.apr.2023.101866 · Cited by 54
ZeoSyn: A Comprehensive Zeolite Synthesis Dataset Enabling Machine-Learning Rationalization of Hydrothermal Parameters
Pan, E., Kwon, S., Jensen, Z., Xie, M., Gómez‐Bombarelli, R., Moliner, M., Román‐Leshkov, Y., & Olivetti, E. (2024) · ACS Central Science · doi:10.1021/acscentsci.3c01615 · Cited by 61
Predicting maximum pitting corrosion depth in buried transmission pipelines: Insights from tree-based machine learning and identification of influential factors
Mesghali, H., Akhlaghi, B., Gozalpour, N., Mohammadpour, J., Salehi, F., & Abbassi, R. (2024) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2024.05.014 · Cited by 54
Characterizing the seasonal relationships between urban heat island and surface energy balance fluxes considering the impact of three-dimensional urban morphology
Lin, Z., Xu, H., Hu, X., Liu, Z., Yao, X., & Zhu, Z. (2024) · Building and Environment · doi:10.1016/j.buildenv.2024.112017 · Cited by 55
City scale urban flooding risk assessment using multi-source data and machine learning approach
Qing, W., Zhang, H., Chen, Y., Xie, Y., Yin, H., & Zu-xin, X. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2024.132626 · Cited by 54
Learning Explainable Models Using Attribution Priors
Erion, G., Janizek, J. D., Sturmfels, P., Lundberg, S., & Lee, S. (2019) · Cited by 53
Self-citation
Evaluating and Optimizing Performance of Public-Private Partnership Projects Using Copula Bayesian Network
Ghorbany, S., Yousefi, S., & Noorzai, E. (2022) · Engineering Construction & Architectural Management · doi:10.1108/ecam-05-2022-0492 · Cited by 56
Fighting Money Laundering With Statistics and Machine Learning
Jensen, R. I. T., & Iosifidis, A. (2023) · IEEE Access · doi:10.1109/access.2023.3239549 · Cited by 68
Predicting biomass composition and operating conditions in fluidized bed biomass gasifiers: An automated machine learning approach combined with cooperative game theory
Kim, J. Y., Shin, U.-H., & Kim, K. (2023) · Energy · doi:10.1016/j.energy.2023.128138 · Cited by 53
Temporal variations of carbon and water fluxes in a subtropical mangrove forest: Insights from a decade-long eddy covariance measurement
Gou, R., Buchmann, N., Chi, J., Luo, Y., Mo, L., Shekhar, A., Feigenwinter, I., Hörtnagl, L. J., Lu, W., Cui, X., et al. (2023) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2023.109764 · Cited by 53
Anthropogenic disturbance exacerbates resilience loss in the Amazon rainforests
Wang, H., Ciais, P., Sitch, S. A., Green, J. K., Tao, S., Fu, Z., Albergel, C., Bastos, A., Wang, M., Fawcett, D., et al. (2023) · Global Change Biology · doi:10.1111/gcb.17006 · Cited by 61
Calculation of exact Shapley values for explaining support vector machine models using the radial basis function kernel
Mastropietro, A., Feldmann, C., & Bajorath, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-46930-2 · Cited by 58
Potential therapeutic implications of histidine catabolism by the gut microbiota in NAFLD patients with morbid obesity
Quesada‐Vázquez, S., Castells‐Nobau, A., Latorre, J., Oliveras‐Cañellas, N., Puig-Parnau, I., Tejera, N., Tobajas, Y., Baudin, J., Hildebrand, F., Beraza, N., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101341 · Cited by 57
SHAP-NET, a network based on Shapley values as a new tool to improve the explainability of the XGBoost-SHAP model for the problem of water quality
Kruk, M. (2025) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2025.106403 · Cited by 56
Examining human–AI collaboration in hybrid intelligence learning environments: insight from the Synergy Degree Model
Kong, X., Fang, H., Chen, W., Xiao, J., & Zhang, M. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05097-z · Cited by 81
Artificial Intelligence‐Driven Development in Rechargeable Battery Materials: Progress, Challenges, and Future Perspectives
Hu, Q., Lu, J., Hui, J., Rao, Z., Ren, Y., & Wang, H. (2025) · Advanced Functional Materials · doi:10.1002/adfm.202508438 · Cited by 60
Combining Machine Learning and Molecular Dynamics to Predict P‑Glycoprotein Substrates
Esposito, C., Wang, S., Lange, U. E. W., Oellien, F., & Riniker, S. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00525 · Cited by 55
Shapley Flow: A Graph-based Approach to Interpreting Model PredictionsPreprint
Wang, J., Wiens, J., & Lundberg, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14592 · Cited by 53
Self-citation
A prediction and interpretation framework of acute kidney injury in critical care
Gong, K., Lee, H. K., Yu, K., Xie, X., & Li, J. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103653 · Cited by 55
Assessing the functional relevance of splice isoforms
del Pozo, F. C., Gómez, L. M., Walsh, T., Rodrı́guez, J. M., Domenico, T. D., Abascal, F., Vázquez, J., & Tress, M. L. (2021) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqab044 · Cited by 46
Extremely Randomized Trees With Privacy Preservation for Distributed Structured Health Data
Aminifar, A., Shokri, M., Rabbi, F., Pun, K. I., & Lamo, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3141709 · Cited by 59
Effects of high-flow oxygen therapy on patients with hypoxemia after extubation and predictors of reintubation: a retrospective study based on the MIMIC-IV database
Liu, T., Zhao, Q., & Du, B. (2021) · BMC Pulmonary Medicine · doi:10.1186/s12890-021-01526-2 · Cited by 52
Precise DNA cleavage using CRISPR-SpRYgests
Christie, K. A., Guo, J. A., Silverstein, R. A., Doll, R. M., Mabuchi, M. Y., Stutzman, H. E., Lin, J., Ma, L., Walton, R. T., Pinello, L., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01492-y · Cited by 51
Towards explainable artificial intelligence in optical networks: the use case of lightpath QoT estimation
Ayoub, O., Troìa, S., Andreoletti, D., Bianco, A. G., Tornatore, M., Giordano, S., & Rottondi, C. (2022) · Journal of Optical Communications and Networking · doi:10.1364/jocn.470812 · Cited by 56
Prediction of hydrogen uptake of metal organic frameworks using explainable machine learning
Meduri, S., & Nandanavanam, J. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100230 · Cited by 53
On the forces of driver distraction: Explainable predictions for the visual demand of in-vehicle touchscreen interactions
Ebel, P., Lingenfelder, C., & Vogelsang, A. (2023) · Accident Analysis & Prevention · doi:10.1016/j.aap.2023.106956 · Cited by 53
Incorporating neighborhoods with explainable artificial intelligence for modeling fine-scale housing prices
Dou, M., Gu, Y., & Fan, H. M. (2023) · Applied Geography · doi:10.1016/j.apgeog.2023.103032 · Cited by 52
Machine learning for analysis of experimental scattering and spectroscopy data in materials chemistry
Anker, A. S., Butler, K. T., Selvan, R., & Jensen, K. M. Ø. (2023) · Chemical Science · doi:10.1039/d3sc05081e · Cited by 54
Analyzing the transition from two-vehicle collisions to chain reaction crashes: A hybrid approach using random parameters logit model, interpretable machine learning, and clustering
Samerei, S. A., & Aghabayk, K. (2024) · Accident Analysis & Prevention · doi:10.1016/j.aap.2024.107603 · Cited by 52
Large‐Language‐Model‐Based AI Agent for Organic Semiconductor Device Research
Zhang, Q., Hu, Y., Yan, J., Zhang, H., Xie, X., Zhu, J., Li, H., Niu, X., Li, L., Sun, Y., et al. (2024) · Advanced Materials · doi:10.1002/adma.202405163 · Cited by 53
The Nonlinear Relationship and Synergistic Effects between Built Environment and Urban Vitality at the Neighborhood Scale: A Case Study of Guangzhou’s Central Urban Area
Ling, Z., Zheng, X., Chen, Y., Qian, Q., Zheng, Z., Meng, X., Kuang, J., Chen, J., Yang, N., & Shi, X. (2024) · Remote Sensing · doi:10.3390/rs16152826 · Cited by 52
Challenging the Performance-Interpretability Trade-Off: An Evaluation of Interpretable Machine Learning Models
Kruschel, S., Hambauer, N., Weinzierl, S., Zilker, S., Kraus, M., & Zschech, P. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00922-2 · Cited by 50
Transparency of medical artificial intelligence systems
Kim, C., Gadgil, S. U., & Lee, S. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00363-w · Cited by 60
Self-citation
Machine learning model for predicting acute kidney injury progression in critically ill patients
Wei, C., Zhang, L., Feng, Y., Ma, A., & Kang, Y. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01740-2 · Cited by 51
How Validation Methodology Influences Human Activity Recognition Mobile Systems
Bragança, H. L. D. S., Colonna, J. G., Oliveira, H. A. B. F., & Souto, E. (2022) · Sensors · doi:10.3390/s22062360 · Cited by 55
Predicting the maximum absorption wavelength of azo dyes using an interpretable machine learning strategy
Mai, J., Tian, L., Xu, P., Lian, Z., Li, M., & Lu, W.-C. (2022) · Dyes and Pigments · doi:10.1016/j.dyepig.2022.110647 · Cited by 51
Machine learning for industrial processes: Forecasting amine emissions from a carbon capture plant
Jablonka, K. M., Charalambous, C., Fernández, E. S., Wiechers, G., Monteiro, J. G. M., Moser, P., Smit, B., & García, S. (2023) · Science Advances · doi:10.1126/sciadv.adc9576 · Cited by 55
Development of a machine learning-based clinical decision support system to predict clinical deterioration in patients visiting the emergency department
Choi, A., Choi, S. Y., Chung, K. S., Chung, H. S., Song, T., Choi, B., & Kim, J. H. (2023) · Scientific Reports · doi:10.1038/s41598-023-35617-3 · Cited by 58
A comprehensive approach combining positive matrix factorization modeling, meteorology, and machine learning for source apportionment of surface ozone precursors: Underlying factors contributing to ozone formation in Houston, Texas
Nelson, D. L., Choi, Y., Sadeghi, B., Yeganeh, A. K., Ghahremanloo, M., & Park, J. (2023) · Environmental Pollution · doi:10.1016/j.envpol.2023.122223 · Cited by 51
Exploring the Relationship between Small Peptides and the T1R1/T1R3 Umami Taste Receptor for Umami Peptide Prediction: A Combined Approach
Zhang, W., Guan, H., Wang, M., Wang, W., Pu, J., Zou, H. L., & Li, D. (2024) · Journal of Agricultural and Food Chemistry · doi:10.1021/acs.jafc.4c00187 · Cited by 51
A Review of Deep Learning for Biomedical Signals: Current Applications, Advancements, Future Prospects, Interpretation, and Challenges
Alqudah, A. M., & Moussavi, Z. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.063643 · Cited by 66
An interpretable hybrid model for predicting step-like landslide displacement: a case study in the Three Gorges Reservoir
Ma, T., Wu, L. Z., Zhou, J., Zhang, H., & Xiao, H. (2025) · Natural Hazards · doi:10.1007/s11069-025-07638-w · Cited by 51
Machine Learning-Based Identification of the Strongest Predictive Variables of Winning and Losing in Belgian Professional Soccer
Geurkink, Y., Boone, J., Verstockt, S., & Bourgois, J. (2021) · Applied Sciences · doi:10.3390/app11052378 · Cited by 48
Supplementary cementitious materials in blended cement concrete: Advancements in predicting compressive strength through machine learning
Aslam, F., & Shahab, M. Z. (2023) · Materials Today Communications · doi:10.1016/j.mtcomm.2023.107725 · Cited by 55
Using explainable machine learning forecasts to discover subseasonal drivers of high summer temperatures in Western and Central Europe
van Straaten, C., Whan, K., Coumou, D., van den Hurk, B., & Schmeits, M. (2022) · Monthly Weather Review · doi:10.1175/mwr-d-21-0201.1 · Cited by 50
Machine learning unveils composition-property relationships in chalcogenide glasses
Mastelini, S. M., Cassar, D. R., Alcobaça, E., Botari, T., de Carvalho, A. C. P. L. F., & Zanotto, E. D. (2022) · Acta Materialia · doi:10.1016/j.actamat.2022.118302 · Cited by 50
Analysis of sentiment in tweets addressed to a single domain-specific Twitter account: Comparison of model performance and explainability of predictions
Fiok, K., Karwowski, W., Gutiérrez-Franco, E., & Wilamowski, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115771 · Cited by 50
Detecting Parkinson Disease Using a Web-Based Speech Task: Observational Study
Rahman, W., Lee, S., Islam, M. S., Antony, V. N., Ratnu, H., Ali, M. R., Mamun, A. A., Wagner, E. S., Jensen-Roberts, S., Waddell, E. M., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/26305 · Cited by 57
Self-citation
An Explainable Machine Learning Approach Reveals Prognostic Significance of Right Ventricular Dysfunction in Nonischemic Cardiomyopathy
Fahmy, A. S., Csécs, I., Arafati, A., Assana, S., Yankama, T. T., Al-Otaibi, T. K., Rodriguez, J., Chen, Y.-Y., Ngo, L. H., Manning, W. J., et al. (2022) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2021.11.029 · Cited by 50
Computational methods, databases and tools for synthetic lethality prediction
Wang, J., Zhang, Q., Han, J., Zhao, Y., Zhao, C., Yan, B., Dai, C., Wu, L., Wen, Y., Zhang, Y., et al. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac106 · Cited by 52
EdgeSHAPer: Bond-centric Shapley value-based explanation method for graph neural networks
Mastropietro, A., Pasculli, G., Feldmann, C., Rodríguez-Pérez, R., & Bajorath, J. (2022) · iScience · doi:10.1016/j.isci.2022.105043 · Cited by 51
Influential Factors of Intercity Patient Mobility and its Network Structure in China
Ding, J., Yang, C., Wang, Y., Li, P., Wang, F., Kang, Y., Wang, H., Liang, Z., Zhang, J., Han, P., et al. (2022) · Cities · doi:10.1016/j.cities.2022.103975 · Cited by 50
Artificial Intelligence-Assisted Prediction of Effluent Phosphorus in a Full-Scale Wastewater Treatment Plant with Missing Phosphorus Input and Removal Data
Xu, Y., Wang, Z., Nairat, S., Zhou, J., & He, Z. (2023) · ACS ES&T Water · doi:10.1021/acsestwater.2c00517 · Cited by 50
Leveraging explanations in interactive machine learning: An overview
Teso, S., Alkan, Ö., Stammer, W., & Daly, E. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1066049 · Cited by 76
Predicting power conversion efficiency of binary organic solar cells based on Y6 acceptor by machine learning
Zhao, Q., Shan, Y., Xiang, C., Wang, J., Zou, Y., Zhang, G., & Liu, W. (2023) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2023.03.030 · Cited by 51
A novel four-dimensional prediction model of soil heavy metal pollution: Geographical explanations beyond artificial intelligence "black box"
Wang, Q., Li, C., Hao, D., Xu, Y., Shi, X., Liu, T., Sun, W., Zheng, Z., Liu, J., Li, W., et al. (2023) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2023.131900 · Cited by 50
In-mold condition-centered and explainable artificial intelligence-based (IMC-XAI) process optimization for injection molding
Gim, J., Lin, C., & Turng, L. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.11.013 · Cited by 50
Interpretable feature extraction and dimensionality reduction in ESM2 for protein localization prediction
Luo, Z., Wang, R., Sun, Y., Liu, J., Chen, Z., & Zhang, Y. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad534 · Cited by 51
Machine learning-based detection of acute psychosocial stress from body posture and movements
Richer, R., Koch, V., Abel, L., Hauck, F., Kurz, M., Ringgold, V., Müller, V., Küderle, A., Schindler‐Gmelch, L., Eskofier, B. M., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-59043-1 · Cited by 59
Automated Machine Learning and Explainable AI (AutoML-XAI) for Metabolomics: Improving Cancer Diagnostics
Bifarin, O. O., & Fernández, F. M. (2024) · Journal of the American Society for Mass Spectrometry · doi:10.1021/jasms.3c00403 · Cited by 50
Artificial intelligence in perinatal mental health research: A scoping review
Kwok, W. H., Zhang, Y., & Wang, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108685 · Cited by 53
First retrieval of 24-hourly 1-km-resolution gapless surface ozone (O3) from space in China using artificial intelligence: Diurnal variations and implications for air quality and phytotoxicity
Cheng, F., Li, Z., Yang, Z., Li, R., Wang, D., Jia, A., Li, K., Zhao, B., Wang, S., Yin, D., et al. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2024.114482 · Cited by 50
Automated biomarker candidate discovery in imaging mass spectrometry data through spatially localized Shapley additive explanations
Tideman, L. E. M., Migas, L. G., Djambazova, K. V., Patterson, N. H., Caprioli, R. M., Spraggins, J. M., & de Plas, R. V. (2021) · Analytica Chimica Acta · doi:10.1016/j.aca.2021.338522 · Cited by 50
Supporting digital content marketing and messaging through topic modelling and decision trees
Gregoriades, A., Pampaka, M., Herodotou, H., & Christodoulou, E. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115546 · Cited by 50
Evaluation of interpretability methods for multivariate time series forecasting
Ozyegen, O., Ilic, I., & Çevik, M. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02662-2 · Cited by 56
Uncovering Clinical Risk Factors and Predicting Severe COVID-19 Cases Using UK Biobank Data: Machine Learning Approach
Wong, K. C.-Y., Xiang, Y., Yin, L., & So, H. (2021) · JMIR Public Health and Surveillance · doi:10.2196/29544 · Cited by 49
Digital Biomarkers for Personalized Nutrition: Predicting Meal Moments and Interstitial Glucose with Non-Invasive, Wearable Technologies
van den Brink, W. J., van den Broek, T. J., Palmisano, S., Wopereis, S., & de Hoogh, I. M. (2022) · Nutrients · doi:10.3390/nu14214465 · Cited by 49
Age-specific risk factors for the prediction of obesity using a machine learning approach
Jeon, J., ‍Lee, S., & Oh, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2022.998782 · Cited by 49
Self-citation
Understanding electricity prices beyond the merit order principle using explainable AI
Trebbien, J., Gorjão, L. R., Praktiknjo, A., Schäfer, B., & Witthaut, D. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100250 · Cited by 49
XML-GBM lung: An explainable machine learning-based application for the diagnosis of lung cancer
Rikta, S. T., Uddin, K. M. M., Biswas, N., Mostafiz, R., Sharmin, F., & Dey, S. K. (2023) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2023.100307 · Cited by 51
Machine learning for the prediction of all-cause mortality in patients with sepsis-associated acute kidney injury during hospitalization
Zhou, H., Liu, L., Zhao, Q., Jin, X., Peng, Z., Wang, W., Huang, L., Xie, Y., Xu, H., Tao, L., et al. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1140755 · Cited by 49
An interpretable system for predicting the impact of COVID-19 government interventions on stock market sectors
Yang, C., Abedin, M. Z., Zhang, H., Weng, F., & Hájek, P. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05311-8 · Cited by 49
Dysbiosis signatures of gut microbiota and the progression of type 2 diabetes: a machine learning approach in a Mexican cohort
Neri-Rosario, D., Martínez-López, Y. E., Esquivel-Hernandez, D. A., Sánchez-Castañeda, J. P., Padrón-Manrique, C., Vázquez-Jiménez, A., Giron-Villalobos, D., & Reséndis-Antonio, O. (2023) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1170459 · Cited by 53
eXplainable artificial intelligence for automatic defect detection in additively manufactured parts using CT scan analysis
Bordekar, H., Cersullo, N., Brysch, M., Philipp, J., & Hühne, C. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02272-4 · Cited by 56
Predicting failure pressure of corroded gas pipelines: A data-driven approach using machine learning
Xiao, R., Zayed, T. M., Meguid, M. A., & Sushama, L. (2024) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2024.02.051 · Cited by 49
Comparative analysis of various machine learning algorithms to predict strength properties of sustainable green concrete containing waste foundry sand
Javed, M. F., Khan, M., Fawad, M., Alabduljabbar, H., Najeh, T., & Gamil, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-65255-2 · Cited by 53
A data-driven model for predicting fatigue performance of high-strength steel wires based on optimized XGBOOST
Wang, Q., Yao, G., Kong, G., Lei, W., Yu, X., Jianchuan, Z., Ran, C., & Luo, L. (2024) · Engineering Failure Analysis · doi:10.1016/j.engfailanal.2024.108710 · Cited by 49
Advanced automated machine learning framework for photovoltaic power output prediction using environmental parameters and SHAP interpretability
Bakht, M. P., Mohd, M. N. H., Ibrahim, B. S. K. K., Khan, N., Sheikh, U. U., & Rahman, A. A.-H. A. (2025) · Results in Engineering · doi:10.1016/j.rineng.2024.103838 · Cited by 49
Artificial Intelligence Models and Tools for the Assessment of Drug–Herb Interactions
Spanakis, M., Tzamali, E., Tzedakis, G., Koumpouzi, C., Pediaditis, M., Tsatsakis, A. M., & Sakkalis, V. (2025) · Pharmaceuticals · doi:10.3390/ph18030282 · Cited by 54
Harnessing Electronic Health Records and Artificial Intelligence for Enhanced Cardiovascular Risk Prediction: A Comprehensive Review
Tsai, M., Chen, K., & Chen, P. (2025) · Journal of the American Heart Association · doi:10.1161/jaha.124.036946 · Cited by 56
Data‐Driven Review on Aerogels and Polymeric Aerogels
Takeshita, S., Mine, S., & Ono, T. (2025) · Angewandte Chemie International Edition · doi:10.1002/anie.202504250 · Cited by 50
Tree Space Prototypes
Tan, S., Soloviev, M., Hooker, G., & Wells, M. T. (2020) · ACM-IMS Foundations of Data Science Conference (FODS) · doi:10.1145/3412815.3416893 · Cited by 54
Polycystic ovary syndrome: clinical and laboratory variables related to new phenotypes using machine-learning models
Silva, I. S., Ferreira, C. N., Costa, L. B. X., Sóter, M. O., Carvalho, L. M. L., Albuquerque, J. D. C., Sales, M. F., Cândido, A. L., dos Reis, F. M., Veloso, A., et al. (2021) · Journal of Endocrinological Investigation · doi:10.1007/s40618-021-01672-8 · Cited by 49
Insights on features' contribution to desalination dynamics and capacity of capacitive deionization through machine learning study
Saffarimiandoab, F., Mattesini, R., Fu, W., Kuruoğlu, E. E., & Zhang, X. (2021) · Desalination · doi:10.1016/j.desal.2021.115197 · Cited by 48

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks