Cited by 10,551Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareData Mining Algorithms and Applications

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

From local explanations to global understanding with explainable AI for trees

Open access

Lundberg, Scott M., Erion, Gabriel, Chen, Hugh, DeGrave, Alex, Prutkin, Jordan M., Nair, Bala, Katz, Ronit, Himmelfarb, Jonathan, Bansal, Nisha, Lee, Su-In·2020·Nature Machine Intelligence

DOI 10.1038/s42256-019-0138-9PMC PMC7326367

Open this paper in CoChat — free account

Abstract

Tree-based machine learning models such as random forests, decision trees, and gradient boosted trees are popular non-linear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here, we improve the interpretability of tree-based models through three main contributions: 1) The first polynomial time algorithm to compute optimal explanations based on game theory. 2) A new type of explanation that directly measures local feature interaction effects. 3) A new set of tools for understanding global model structure based on combining many local explanations of each prediction. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to i) identify high magnitude but low frequency non-linear mortality risk factors in the US population, ii) highlight distinct population sub-groups with shared risk characteristics, iii) identify non-linear interaction effects among risk factors for chronic kidney disease, and iv) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1038/s42256-019-0138-9

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citation
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
A Value for n-person Games
Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
The SPRINT Research Group (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1511939 · Cited by 6,325
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R. J., Parker, J. S., Hastie, T. J., Marron, J. S., Nobel, A. B., Deng, S., Johnsen, H., Pesich, R., Geisler, S. B., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,508

Show all 38 references

Sorted by citations

Items 501–600 of 1,032

Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer’s disease and neurodegeneration stratified by sex
Cumplido‐Mayoral, I., García-Prat, M., Operto, G., Falcón, C., Shekari, M., Cacciaglia, R., Milà‐Alomà, M., Lorenzini, L., Ingala, S., Wink, A. M., et al. (2023) · eLife · doi:10.7554/elife.81067 · Cited by 74
Landslide susceptibility assessment in multiple urban slope settings with a landslide inventory augmented by InSAR techniques
Chen, L., Ma, P., Yu, C., Zheng, Y., Zhu, Q., & Ding, Y. (2023) · Engineering Geology · doi:10.1016/j.enggeo.2023.107342 · Cited by 63
Augmenting interpretable models with large language models during training
Singh, C., Askari, A., Caruana, R., & Gao, J. (2023) · Nature Communications · doi:10.1038/s41467-023-43713-1 · Cited by 63
A review and benchmark of feature importance methods for neural networks
Mandler, H., & Weigand, B. (2024) · ACM Computing Surveys · doi:10.1145/3679012 · Cited by 65
Democratizing Financial Knowledge with ChatGPT by OpenAI: Unleashing the Power of TechnologyPreprint
Yue, T., Au, D., Au, C. C., & Iu, K. Y. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4346152 · Cited by 74
LightGBM Technique and Differential Evolution Algorithm-Based Multi-Objective Optimization Design of DS-APMM
Pan, Z., Fang, S., & Wang, H. (2020) · IEEE Transactions on Energy Conversion · doi:10.1109/tec.2020.3009480 · Cited by 62
Risk Prediction of Cardiovascular Events by Exploration of Molecular Data with Explainable Artificial Intelligence
Westerlund, A. M., Hawe, J. S., Heinig, M., & Schunkert, H. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms221910291 · Cited by 63
Quantum Kernels for Real-World Predictions Based on Electronic Health Records
Krunic, Z., Flöther, F. F., Seegan, G., Earnest-Noble, N., & Shehab, O. (2022) · IEEE Transactions on Quantum Engineering · doi:10.1109/tqe.2022.3176806 · Cited by 65
Explainable machine learning in image classification models: An uncertainty quantification perspective
Zhang, X., Chan, F. T. S., & Mahadevan, S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108418 · Cited by 71
A Comparison of Global Sensitivity Analysis Methods for Explainable AI With an Application in Genomic Prediction
van Stein, B., Raponi, E., Sadeghi, Z., Bouman, N. J., van Ham, R. C. H. J., & Bäck, T. (2022) · IEEE Access · doi:10.1109/access.2022.3210175 · Cited by 62
eXplainable AI Allows Predicting Upper Limb Rehabilitation Outcomes in Sub-Acute Stroke Patients
Gandolfi, M., Galazzo, I. B., Pavan, R., Cruciani, F., Valè, N., Picelli, A., Storti, S. F., Smania, N., & Menegaz, G. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3220179 · Cited by 64
Uncovering expression signatures of synergistic drug responses via ensembles of explainable machine-learning models
Janizek, J. D., Dincer, A. B., Çelik, S., Chen, H., Chen, W., Naxerova, K., & Lee, S. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01034-0 · Cited by 66
Self-citation
First Estimation of High-Resolution Solar Photovoltaic Resource Maps Over China with Fengyun-4a Satellite and Machine Learning
Shi, H., Yang, D., Wang, W., Fu, D., Gao, L., Zhang, J., Hu, B., Shan, Y., Zhang, Y., Bian, Y., et al. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.113549 · Cited by 62
Self-citation
Interpretable Machine Learning‐Assisted High‐Throughput Screening for Understanding NRR Electrocatalyst Performance Modulation between Active Center and C‐N Coordination
Sun, J., Chen, A., Guan, J., Han, Y. M., Liu, Y., Niu, X., He, M., Shi, L., Wang, J., & Zhang, X. (2023) · Energy & environment materials · doi:10.1002/eem2.12693 · Cited by 62
Application of Artificial Intelligence at All Stages of Bone Tissue Engineering
Kolomenskaya, E. R., Butova, V. V., Poltavskiy, A. V., Soldatov, A. V., & Butakova, M. A. (2023) · Biomedicines · doi:10.3390/biomedicines12010076 · Cited by 62
The many Shapley values for explainable artificial intelligence: A sensitivity analysis perspective
Borgonovo, E., Plischke, E., & Rabitti, G. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.06.023 · Cited by 71
METASPACE-ML: Context-specific metabolite annotation for imaging mass spectrometry using machine learning
Wadie, B., Stuart, L., Rath, C. M. B., Drotleff, B., Mamedov, S. R., & Alexandrov, T. (2024) · Nature Communications · doi:10.1038/s41467-024-52213-9 · Cited by 62
DeepAIPs-Pred: Predicting Anti-Inflammatory Peptides Using Local Evolutionary Transformation Images and Structural Embedding-Based Optimal Descriptors with Self-Normalized BiTCNs
Akbar, S., Ullah, M., Raza, A., Zou, Q., & Alghamdi, W. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01758 · Cited by 62
State of the Art in Electric Batteries’ State-of-Health (SoH) Estimation with Machine Learning: A Review
Sylvestrin, G. R., Maciel, J. N., Amorim, M. L. M., Carmo, J. P., Afonso, J. A., Lopes, S. F., & Ando, O. H. (2025) · Energies · doi:10.3390/en18030746 · Cited by 68
A geological timescale for bacterial evolution and oxygen adaptation
Davín, A., Woodcroft, B. J., Soo, R. M., Morel, B., Murali, R., Schrempf, D., Clark, J., Álvarez-Carretero, S., Boussau, B., Moody, E. R. R., et al. (2025) · Science · doi:10.1126/science.adp1853 · Cited by 72
Integrating and formatting biomedical data as pre-calculated knowledge graph embeddings in the Bioteque
Fernández-Torras, A., Duran-Frigola, M., Bertoni, M., Locatelli, M., & Aloy, P. (2022) · Nature Communications · doi:10.1038/s41467-022-33026-0 · Cited by 59
Why to Buy Insurance? An Explainable Artificial Intelligence Approach
Gramegna, A., & Giudici, P. (2020) · Risks · doi:10.3390/risks8040137 · Cited by 61
A Machine Learning-based DSS for mid and long-term company crisis prediction
Perboli, G., & Arabnezhad, E. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114758 · Cited by 61
FastSHAP: Real-Time Shapley Value Estimation
Jethani, N., Sudarshan, M., Covert, I., Lee, S., & Ranganath, R. (2021) · PubMed · doi:10.48550/arxiv.2107.07436 · Cited by 83
Self-citation
The Framing of machine learning risk prediction models illustrated by evaluation of sepsis in general wards
Lauritsen, S. M., Thiesson, B., Jørgensen, M. J., Riis, A. H., Espelund, U. S., Weile, J. B., & Lange, J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00529-x · Cited by 74
Flexible Bayesian Ensemble Machine Learning Framework for Predicting Local Ozone Concentrations
Ren, X., Mi, Z., Cai, T., Nolte, C. G., & Georgopoulos, P. G. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c04076 · Cited by 61
Twelve key challenges in medical machine learning and solutions
Ellis, R. J., Sander, R. M., & Limon, A. (2022) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2022.100068 · Cited by 61
Explainable machine learning for project management control
Santos, J. I., Pereda, M., Ahedo, V., & Galán, J. M. (2023) · Computers & Industrial Engineering · doi:10.1016/j.cie.2023.109261 · Cited by 89
Precipitation and vegetation transpiration variations dominate the dynamics of agricultural drought characteristics in China
Guo, W., Huang, S., Huang, Q., She, D., Shi, H., Leng, G., Li, J., Cheng, L., Gao, Y., & Peng, J. X. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.165480 · Cited by 61
Discovery of direct band gap perovskites for light harvesting by using machine learning
Rath, S., Sudha Priyanga, G., Nagappan, N., & Thomas, T. (2022) · Computational Materials Science · doi:10.1016/j.commatsci.2022.111476 · Cited by 60
Pediatric ECG-Based Deep Learning to Predict Left Ventricular Dysfunction and Remodeling
Mayourian, J., La Cava, W. G., Vaid, A., Nadkarni, G. N., Ghelani, S. J., Mannix, R., Geva, T., Dionne, A., Alexander, M. E., Duong, S. Q., et al. (2024) · Circulation · doi:10.1161/circulationaha.123.067750 · Cited by 59
Survey of Explainable Machine Learning with Visual and Granular Methods Beyond Quasi-Explanations
Kovalerchuk, B., Ahmad, M. A., & Teredesai, A. M. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-64949-4_8 · Cited by 63
A new method for exploring gene–gene and gene–environment interactions in GWAS with tree ensemble methods and SHAP values
Johnsen, P. V., Riemer–Sørensen, S., DeWan, A. T., Cahill, M. E., & Langaas, M. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04041-7 · Cited by 64
A reliable intelligent diagnostic assistant for nuclear power plants using explainable artificial intelligence of GRU-AE, LightGBM and SHAP
Park, J. H., Jo, H. S., Lee, S. H., Oh, S. W., & Na, M. G. (2021) · Nuclear Engineering and Technology · doi:10.1016/j.net.2021.10.024 · Cited by 65
Self-citation
XAI for myo-controlled prosthesis: Explaining EMG data for hand gesture classification
Gozzi, N., Malandri, L., Mercorio, F., & Pedrocchi, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.108053 · Cited by 65
Global sea surface salinity via the synergistic use of SMAP satellite and HYCOM data based on machine learning
Jang, E., Kim, Y. J., Im, J., Park, Y., & Sung, T. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2022.112980 · Cited by 60
A Machine Learning and Computer Vision Study of the Environmental Characteristics of Streetscapes That Affect Pedestrian Satisfaction
Lee, J., Kim, D., & Park, J. (2022) · Sustainability · doi:10.3390/su14095730 · Cited by 60
Compressive Strength Estimation of Steel-Fiber-Reinforced Concrete and Raw Material Interactions Using Advanced Algorithms
Khan, K., Ahmad, W., Amin, M. N., Ahmad, A., Nazar, S., & Alabdullah, A. A. (2022) · Polymers · doi:10.3390/polym14153065 · Cited by 64
Toward explainable electrical load forecasting of buildings: A comparative study of tree-based ensemble methods with Shapley values
Moon, J., Rho, S., & Baik, S. W. (2022) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2022.102888 · Cited by 60
Integration of shapley additive explanations with random forest model for quantitative precipitation estimation of mesoscale convective systems
He, Z., Yang, Y., Fang, R., Zhou, S., Zhao, W., Bai, Y., Li, J., & Wang, B. (2023) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.1057081 · Cited by 67
Explainability and white box in drug discovery
Kırboğa, K. K., Abbasi, S. W., & Küçüksille, E. U. (2023) · Chemical Biology & Drug Design · doi:10.1111/cbdd.14262 · Cited by 62
Machine learning-assisted crystal engineering of a zeolite
Li, X., Han, H., Evangelou, N., Wichrowski, N. J., Lü, P., Xu, W., Hwang, S., Zhao, W., Song, C., Guo, X., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-38738-5 · Cited by 73
A user-centered explainable artificial intelligence approach for financial fraud detection
Zhou, Y. J., Li, H., Xiao, Z., & Qiu, J. L. (2023) · Finance research letters · doi:10.1016/j.frl.2023.104309 · Cited by 61
Examining active travel behavior through explainable machine learning: Insights from Beijing, China
Yin, G., Huang, Z., Fu, C., Ren, S., Bao, Y., & Ma, X. (2024) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2023.104038 · Cited by 60
Relationship between feature importance and building characteristics for heating load predictions
Neubauer, A., Brandt, S., & Kriegel, M. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.122668 · Cited by 60
Machine learning development to predict the electrical efficiency of photovoltaic-thermal (PVT) collector systems
Gharaee, H., Erfanimatin, M., & Bahman, A. M. (2024) · Energy Conversion and Management · doi:10.1016/j.enconman.2024.118808 · Cited by 60
Predicting the performance of lithium adsorption and recovery from unconventional water sources with machine learning
Xu, Z., Ding, Y., Han, S. C., & Zhang, C. (2024) · Water Research · doi:10.1016/j.watres.2024.122374 · Cited by 64
A perception-powered urban digital twin to support human-centered urban planning and sustainable city development
Luo, J., Liu, P., Xu, W., Zhao, T., & Biljecki, F. (2024) · Cities · doi:10.1016/j.cities.2024.105473 · Cited by 60
Hyperspectral imaging and explainable deep-learning for non-destructive quality prediction of sweetpotato
Ahmed, M. T., Villordon, A. Q., & Kamruzzaman, M. (2024) · Postharvest Biology and Technology · doi:10.1016/j.postharvbio.2024.113379 · Cited by 60
33 Unresolved Questions in Nanoscience and Nanotechnology
Mirkin, C. A., Petrosko, S. H., Artzi, N., Aydın, K., Biaggne, A., Brinker, C. J., Bujold, K. E., Cao, Y. C., Chan, R. R., Chen, C., et al. (2025) · ACS Nano · doi:10.1021/acsnano.5c12854 · Cited by 64
Interpretable generalized additive neural networks
Kraus, M., Tschernutter, D., Weinzierl, S., & Zschech, P. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.06.032 · Cited by 59
Robust building energy consumption forecasting using an online learning approach with R ranger
Moon, J., Park, S., Rho, S., & Hwang, E. (2021) · Journal of Building Engineering · doi:10.1016/j.jobe.2021.103851 · Cited by 59
On Tackling Explanation Redundancy in Decision Trees
Izza, Y., Ignatiev, A., & Marques-Silva, J. P. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13575 · Cited by 74
Discovering injury severity risk factors in automobile crashes: A hybrid explainable AI framework for decision support
Amini, M., Bagheri, A., & Delen, D. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108720 · Cited by 64
Environment Features-Based Model for Path Loss Prediction
Sun, Y., Zhang, J., Zhang, Y., Yu, L., Yuan, Z., Liu, G., & Wang, Q. (2022) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2022.3192516 · Cited by 59
Real-time prediction of intradialytic hypotension using machine learning and cloud computing infrastructure
Zhang, H., Wang, L., Chaudhuri, S., Pickering, A., Usvyat, L. A., Larkin, J. W., Waguespack, P., Kuang, Z., Kooman, J. P., Maddux, F. W., et al. (2023) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfad070 · Cited by 59
Data-driven based estimation of waste-derived ceramic concrete from experimental results with its environmental assessment
Chang, Q., Liu, L., Farooqi, M. U., Thomas, B. S., & Özkılıç, Y. O. (2023) · Journal of Materials Research and Technology · doi:10.1016/j.jmrt.2023.04.223 · Cited by 59
The nonlinear relationships between built environment features and urban street vitality: A data-driven exploration
Han, Y., Qin, C., Xiao, L., & Ye, Y. (2023) · Environment and Planning B Urban Analytics and City Science · doi:10.1177/23998083231172985 · Cited by 59
AI explainability framework for environmental management research
Arashpour, M. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.118149 · Cited by 59
A Review of the Applications of Explainable Machine Learning for Lithium–Ion Batteries: From Production to State and Performance Estimation
Niri, M. F., Aslansefat, K., Haghi, S., Hashemian, M., Daub, R., & Marco, J. (2023) · Energies · doi:10.3390/en16176360 · Cited by 62
VenomPred 2.0: A Novel In Silico Platform for an Extended and Human Interpretable Toxicological Profiling of Small Molecules
Stefano, M. D., Galati, S., Piazza, L., Granchi, C., Mancini, S., Fratini, F., Macchia, M., Poli, G., & Tuccinardi, T. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00692 · Cited by 59
Beyond the merit order effect: Impact of the rapid expansion of renewable energy on electricity market price
Shimomura, M., Keeley, A. R., Matsumoto, K., Tanaka, K., & Managi, S. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.114037 · Cited by 70
Causal-inference machine learning reveals the drivers of China's 2022 ozone rebound
Wang, L., Chen, B., Ouyang, J., Mu, Y., Zhen, L., Yang, L., Xu, W., & Tang, L. (2025) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2025.100524 · Cited by 59
Genome-wide CRISPR screen reveals host genes that regulate SARS-CoV-2 infectionPreprint
Wei, J., Alfajaro, M. M., Hanna, R. E., DeWeirdt, P. C., Strine, M. S., Lu-Culligan, W. J., Zhang, S., Graziano, V. R., Schmitz, C. O., Chen, J., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.16.155101 · Cited by 59
Self-citation
Individual variation underlying brain age estimates in typical development
Ball, G., Kelly, C. E., Beare, R. J., & Seal, M. L. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118036 · Cited by 62
Unraveling the Correlation between Raman and Photoluminescence in Monolayer MoS 2 through Machine‐Learning Models
Lu, A., Martins, L. G. P., Shen, P., Chen, Z., Park, J. H., Xue, M., Han, J., Mao, N., Chiu, M., Palacios, T., et al. (2022) · Advanced Materials · doi:10.1002/adma.202202911 · Cited by 58
Machine learning for corporate default risk: Multi-period prediction, frailty correlation, loan portfolios, and tail probabilities
Sigrist, F., & Leuenberger, N. (2022) · European Journal of Operational Research · doi:10.1016/j.ejor.2022.06.035 · Cited by 59
Spatiotemporal analysis of built environment restrained traffic carbon emissions and policy implications
Wu, J., Jia, P., Feng, T., Li, H., & Kuang, H. (2023) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2023.103839 · Cited by 58
Incremental permutation feature importance (iPFI): towards online explanations on data streams
Fumagalli, F., Muschalik, M., Hüllermeier, E., & Hammer, B. (2023) · Machine Learning · doi:10.1007/s10994-023-06385-y · Cited by 70
Predicting Coastal Harmful Algal Blooms Using Integrated Data-Driven Analysis of Environmental Factors
Yan, Z., Kamanmalek, S., & Alamdari, N. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.169253 · Cited by 56
Artificial intelligence-derived risk score for mortality in secondary mitral regurgitation treated by transcatheter edge-to-edge repair: the EuroSMR risk score
Hausleiter, J., Lachmann, M., Stolz, L., Bedogni, F., Rubbio, A. P., Estévez‐Loureiro, R., Raposeiras‐Roubín, S., Boekstegers, P., Karam, N., Rudolph, V., et al. (2024) · European Heart Journal · doi:10.1093/eurheartj/ehad871 · Cited by 58
Machine learning-based health environmental-clinical risk scores in European children
Guimbaud, J.-B., Siskos, A., Sakhi, A. K., Heude, B., Sabidó, E., Borràs, E., Keun, H. C., Wright, J., Júlvez, J., Urquiza, J., et al. (2024) · Communications Medicine · doi:10.1038/s43856-024-00513-y · Cited by 61
Application of interpretable machine learning for early prediction of prognosis in acute kidney injury
Hu, C., Tan, Q., Zhang, Q., Li, Y., Wang, F., Zou, X., & Peng, Z. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.06.003 · Cited by 57
Predicting Antimicrobial Activity of Conjugated Oligoelectrolyte Molecules via Machine Learning
Tiihonen, A., Cox‐Vázquez, S. J., Liang, Q., Ragab, M., Ren, Z., Hartono, N. T. P., Liu, Z., Sun, S., Zhou, C. Y., Incandela, N. C., et al. (2021) · Journal of the American Chemical Society · doi:10.1021/jacs.1c05055 · Cited by 56
A bi-level machine learning method for fault diagnosis of oil-immersed transformers with feature explainability
Zhang, D., Li, C., Shahidehpour, M., Wu, Q., Zhou, B., Zhang, C., & Huang, W. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107356 · Cited by 57
Hydrogen Adsorption on Defective Nitrogen-Doped Carbon Nanotubes Explained via Machine Learning Augmented DFT Calculations and Game-Theoretic Feature Attributions
Kronberg, R., Lappalainen, H., & Laasonen, K. E. (2021) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.1c03858 · Cited by 58
Random forest-based modeling of stream nutrients at national level in a data-scarce region
Virro, H., Kmoch, A., Vainu, M., & Uuemaa, E. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.156613 · Cited by 61
Signal Peptide Efficiency: From High-Throughput Data to Prediction and Explanation
Grasso, S., Dabene, V., Hendriks, M. M. W. B., Zwartjens, P., Pellaux, R., Held, M., Panke, S., van Dijl, J. M., Meyer, A., & van Rij, T. (2023) · ACS Synthetic Biology · doi:10.1021/acssynbio.2c00328 · Cited by 58
Potential Antihuman Epidermal Growth Factor Receptor 2 Target Therapy Beneficiaries: The Role of MRI ‐Based Radiomics in Distinguishing Human Epidermal Growth Factor Receptor 2‐Low Status of Breast Cancer
Bian, X., Du, S., Yue, Z., Si, G., Zhao, R., Huang, G., Guo, L., Peng, C., & Zhang, L. (2023) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.28628 · Cited by 57
Understanding the nonlinear effects of the street canyon characteristics on human perceptions with street view images
Xu, J., Xiong, Q., Jing, Y., Xing, L., An, R., Tong, Z., Liu, Y., & Liu, Y. (2023) · Ecological Indicators · doi:10.1016/j.ecolind.2023.110756 · Cited by 59
An explainable machine learning model for prediction of high-risk nonalcoholic steatohepatitis
Njei, B. M., Osta, E., Njei, N., Al‐Ajlouni, Y. A., & Lim, J. K. (2024) · Scientific Reports · doi:10.1038/s41598-024-59183-4 · Cited by 61
Machine Learning Algorithms for Predicting and Risk Profiling of Cardiac Surgery-Associated Acute Kidney Injury
Penny‐Dimri, J. C., Bergmeir, C., Reid, C. M., Williams‐Spence, J., Cochrane, A. D., & Smith, J. A. (2020) · Seminars in Thoracic and Cardiovascular Surgery · doi:10.1053/j.semtcvs.2020.09.028 · Cited by 56
A 1-km hourly air-temperature model for 13 northeastern U.S. states using remotely sensed and ground-based measurements
Carrión, D., Arfer, K. B., Rush, J., Dorman, M., Rowland, S. T., Kioumourtzoglou, M., Kloog, I., & Just, A. C. (2021) · Environmental Research · doi:10.1016/j.envres.2021.111477 · Cited by 57
What Factors Are Most Closely Associated With Mood Disorders in Adolescents During the COVID-19 Pandemic? A Cross-Sectional Study Based on 1,771 Adolescents in Shandong Province, China
Ren, Z., Xin, Y., Wang, Z., Liu, D., Ho, R., & Ho, C. S. H. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.728278 · Cited by 56
Designing clinically translatable artificial intelligence systems for high-dimensional medical imaging
Shad, R., Cunningham, J. P., Ashley, E. A., Langlotz, C. P., & Hiesinger, W. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00399-8 · Cited by 59
Explanations of Machine Learning Models in Repeated Nested Cross-Validation: An Application in Age Prediction Using Brain Complexity Features
Scheda, R., & Diciotti, S. (2022) · Applied Sciences · doi:10.3390/app12136681 · Cited by 60
A comparative assessment of tree-based predictive models to estimate geopolymer concrete compressive strength
Nguyen, M. H., Mai, H.-V. T., Trinh, S. H., & Ly, H. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-08042-2 · Cited by 56
Multivariate probabilistic forecasting of intraday electricity prices using normalizing flows
Cramer, E., Witthaut, D., Mitsos, A., & Dahmen, M. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121370 · Cited by 57
Machine-learned kinetic Façade: Construction and artificial intelligence enabled predictive control for visual comfort
Takhmasib, M., Lee, H. J., & Yi, H. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105093 · Cited by 56
Multiparameter imaging reveals clinically relevant cancer cell-stroma interaction dynamics in head and neck cancer
Punovuori, K., Bertillot, F., Miroshnikova, Y. A., Binner, M., Myllymäki, S.-M., Follain, G., Kruse, K., Routila, J., Huusko, T., Pellinen, T. S., et al. (2024) · Cell · doi:10.1016/j.cell.2024.09.046 · Cited by 65
Spatiotemporal dynamics and nonlinear landscape-driven mechanisms of urban heat islands in a winter city: A case study of Harbin, China
An, Q., Dong, Y., Dong, W., & Xiao, S. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106842 · Cited by 56
Identifying anti-coronavirus peptides by incorporating different negative datasets and imbalanced learning strategies
Pang, Y., Wang, Z., Jhong, J.-H., & Lee, T.-Y. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa423 · Cited by 56
Decomposing MRI phenotypic heterogeneity in epilepsy: a step towards personalized classification
Lee, H. M., Fadaie, F., Gill, R. S., Caldairou, B., Sziklas, V., Crane, J., Hong, S., Bernhardt, B. C., Bernasconi, A., & Bernasconi, N. (2021) · Brain · doi:10.1093/brain/awab425 · Cited by 55
Spatial-temporal behavior of precipitation driven karst spring discharge in a mountain terrain
Song, X., Hao, H., Liu, W., Wang, Q., An, L., Yeh, T. J., & Hao, Y. (2022) · Journal of Hydrology · doi:10.1016/j.jhydrol.2022.128116 · Cited by 56
Understanding Sources and Drivers of Size-Resolved Aerosol in the High Arctic Islands of Svalbard Using a Receptor Model Coupled with Machine Learning
Song, C., Becagli, S., Beddows, D. C. S., Brean, J., Browse, J., Dai, Q., Dall’Osto, M., Ferracci, V., Harrison, R. M., Harris, N., et al. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c07796 · Cited by 55
Adoption of Machine Learning in Pharmacometrics: An Overview of Recent Implementations and Their Considerations
Janßen, A., Bennis, F. C., & Mathôt, R. A. A. (2022) · Pharmaceutics · doi:10.3390/pharmaceutics14091814 · Cited by 57
Drivers of Spatiotemporal Variability in Drinking Water Quality in the United States
Scanlon, B. R., Fakhreddine, S., Reedy, R. C., Yang, Q., & Malito, J. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c08697 · Cited by 55
An Optimized Approach for Predicting Water Quality Features Based on Machine Learning
Suwadi, N. A., Derbali, M., Sani, N. S., Lam, M. C., Arshad, H., Khan, I., & Kim, K. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/3397972 · Cited by 55
Retrieval of Chlorophyll-a Concentrations Using Sentinel-2 MSI Imagery in Lake Chagan Based on Assessments with Machine Learning Models
Shi, X., Gu, L., Jiang, T., Zheng, X., Dong, W., & Tao, Z. (2022) · Remote Sensing · doi:10.3390/rs14194924 · Cited by 57
Tree-based local explanations of machine learning model predictions, AraucanaXAI
Parimbelli, E., Buonocore, T. M., Nicora, G., Michalowski, W., Wilk, S., & Bellazzi, R. (2021) · Artif. Intell. Medicine · doi:10.1016/j.artmed.2022.102471 · Cited by 46

Authors: Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I.
Affiliations: Microsoft (United States) (US)
University of Washington (US)
Corresponding author: Lee, Su-In
ORCID: Lundberg, Scott M.
Erion, Gabriel
Chen, Hugh
DeGrave, Alex
Prutkin, Jordan M.
Nair, Bala
Katz, Ronit
Himmelfarb, Jonathan
Bansal, Nisha
Lee, Su-In
Venue: Nature Machine Intelligence
Publisher: Springer Science and Business Media LLC
Published: 2020-01-17
Volume: 2
Issue: 1
Pages: 56-67
ISSN: 2522-5839 (ISSN-L)
DOI: 10.1038/s42256-019-0138-9
PMC: PMC7326367
OpenAlex: W2999615587
Cited by: 10,551
References: 38
Citations by year: 2026: 3607 · 2025: 2330 · 2024: 1650 · 2023: 1197 · 2022: 959 · 2021: 614 · 2020: 187
FWCI: 291.51
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature Machine Intelligence (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Science Foundation (DGE-1256082, DBI-1759487, DBI-1552309, DBI-1355899)
American Cancer Society (127332-RSG-15-097-01-TBG)
U.S. Department of Health & Human Services | National Institutes of Health (R35 GM 128638, R01 NIA AG 061132)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
Keywords: explainable AI, tree-based models, local explanations, mortality risk, chronic kidney disease, model monitoring, machine learning in medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

From local explanations to global understanding with explainable AI for trees

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks