The Shapley Value in Machine Learning
Open accessAbstract
Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning. In this paper, we first discuss fundamental concepts of cooperative game theory and axiomatic properties of the Shapley value. Then we give an overview of the most important applications of the Shapley value in machine learning: feature selection, explainability, multi-agent reinforcement learning, ensemble pruning, and data valuation. We examine the most crucial limitations of the Shapley value and point out directions for future research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Shapley value measures the contribution of features in a machine-learning model and is widely used in algorithms such as deep learning, graphical models and reinforcement learning.
“The Shapley value measures the contribution of features in a machine-learning model and is widely used in algorithms such as deep learning, graphical models and reinforcement learning85.”
From Inferring gene regulatory networks from single-cell multiome data using atlas-scale external data (2025) · cites this paper as [85]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,843 · see citing works
Simulation and the Monte Carlo Method
Rubinstein, R. Y., & Kroese, D. P. (2016) · Wiley Series in Probability and Statistics · doi:10.1002/9781118631980 · Cited by 3,356 · see citing works
Detection of Influential Observation in Linear Regression
Cook, R. D. (1977) · Technometrics · doi:10.1080/00401706.1977.10489493 · Cited by 2,284 · see citing works
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514 · see citing works
Polynomial calculation of the Shapley value based on sampling
Castro, J., Gómez, D., & Tejada, J. (2009) · Computers & Operations Research · doi:10.1016/j.cor.2008.04.004 · Cited by 601 · see citing works
Values of Games with a Priori Unions
Owen, G. (1977) · Lecture notes in economics and mathematical systems · doi:10.1007/978-3-642-45494-3_7 · Cited by 453 · see citing works
Data Shapley: Equitable Valuation of Data for Machine LearningPreprint
Ghorbani, A., & Zou, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02868 · Cited by 434 · see citing works
Multilinear Extensions of Games
Owen, G. (1972) · Management Science · doi:10.1287/mnsc.18.5.64 · Cited by 425 · see citing works
The many Shapley values for model explanationPreprint
Sundararajan, M., & Najmi, A. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1908.08474 · Cited by 415 · see citing works
Computational Aspects of Cooperative Game Theory
Chalkiadakis, G., Elkind, E., & Wooldridge, M. (2012) · Synthesis lectures on artificial intelligence and machine learning · doi:10.1007/978-3-031-01558-8 · Cited by 357 · see citing works
Shapley values for feature selection: the good, the bad, and the axioms
Fryer, D., Strumke, I., & Nguyen, H. (2021) · IEEE Access · doi:10.1109/access.2021.3119110 · Cited by 347 · see citing works
Towards Efficient Data Valuation Based on the Shapley ValuePreprint
Jia, R., Dao, D., Wang, B., Hubis, F. A., Hynes, N., Gürel, N. M., Li, B., Zhang, C., Song, D. X., & Spanos, C. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10275 · Cited by 270 · see citing works
Heskes, T., Sijben, E., Bucur, I. G., & Claassen, T. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2011.01625 · Cited by 242 · see citing works
Problems with Shapley-value-based explanations as feature importance measures
Kumar, I. E., Venkatasubramanian, S., Scheidegger, C., & Friedler, S. (2020) · arXiv · doi:10.48550/arxiv.2002.11097 · Cited by 228 · see citing works
A linear approximation method for the Shapley value
Fatima, S. S., Wooldridge, M., & Jennings, N. R. (2008) · Artificial Intelligence · doi:10.1016/j.artint.2008.05.003 · Cited by 224 · see citing works
Online Class-Incremental Continual Learning with Adversarial Shapley Value
Shim, D., Mai, Z., Jeong, J., Sanner, S., Kim, H., & Jang, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17159 · Cited by 203 · see citing works
A Principled Approach to Data Valuation for Federated Learning
Wang, T., Rausch, J., Zhang, C., Jia, R., & Song, D. X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63076-8_11 · Cited by 192 · see citing works
On Explainability of Graph Neural Networks via Subgraph ExplorationsPreprint
Yuan, H., Yu, H., Wang, J., Li, K., & Ji, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05152 · Cited by 188 · see citing works
GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning
Liu, Z., Chen, Y., Yu, H., Liu, Y., & Cui, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3501811 · Cited by 149 · see citing works
Feature Selection via Coalitional Game Theory
Cohen, S., Dror, G., & Ruppin, E. (2007) · Neural Computation · doi:10.1162/neco.2007.19.7.1939 · Cited by 144 · see citing works
A Value for cooperative games with levels structure of cooperation
Winter, E. (1989) · International Journal of Game Theory · doi:10.1007/bf01268161 · Cited by 113 · see citing works
Computational Aspects of Cooperative Game Theory
Wooldridge, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22000-5_1 · Cited by 112 · see citing works
Sampling Algorithms and Coresets for $\ell_p$ Regression
Dasgupta, A., Petros Drineas, B., Harb, B., Kumar, R., & Mahoney, M. W. (2009) · SIAM Journal on Computing · doi:10.1137/070696507 · Cited by 112 · see citing works
L-Shapley and C-Shapley: Efficient Model Interpretation for Structured DataPreprint
Chen, J., Song, L., Wainwright, M. J., & Jordan, M. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.02610 · Cited by 108 · see citing works
Shapley Counterfactual Credits for Multi-Agent Reinforcement Learning
Li, J., Kuang, K., Wang, B.-X., Liu, F.-R., Chen, L., Wu, F., & Xiao, J. (2021) · Knowledge Discovery and Data Mining · doi:10.1145/3447548.3467420 · Cited by 101 · see citing works
Castro, J., Gómez, D., Molina, E., & Tejada, J. (2017) · Computers & Operations Research · doi:10.1016/j.cor.2017.01.019 · Cited by 100 · see citing works
Feature evaluation and selection with cooperative game theory
Sun, X., Liu, Y., Li, J., Zhu, J., Chen, H., & Liu, X. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.02.001 · Cited by 93 · see citing works
GraphSVX: Shapley Value Explanations for Graph Neural Networks
Duval, A., & Malliaros, F. D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86520-7_19 · Cited by 91 · see citing works
Neuron Shapley: Discovering the Responsible NeuronsPreprint
Ghorbani, A., & Zou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09815 · Cited by 77 · see citing works
Improving KernelSHAP: Practical Shapley Value Estimation Using Linear Regression
Covert, I., & Lee, S. (2021) · International Conference on Artificial Intelligence and Statistics · Cited by 73 · see citing works
Sampling Permutations for Shapley Value EstimationPreprint
Mitchell, R., Cooper, J., Frank, E., & Holmes, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.12199 · Cited by 71 · see citing works
Bounding the Estimation Error of Sampling-based Shapley Value ApproximationPreprint
Maleki, S., Tran-Thanh, L., Hines, G., Rahwan, T., & Rogers, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.4265 · Cited by 62 · see citing works
CGA: a new feature selection model for visual human action recognition
Guha, R., Khan, A. H., Singh, P. K., Sarkar, R., & Bhattacharjee, D. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05297-5 · Cited by 61 · see citing works
Self-citationConfiguration values: Extensions of the coalitional Owen value
Albizuri, M. J., Aurrecoechea, J., & Zarzuelo, J. M. (2005) · Games and Economic Behavior · doi:10.1016/j.geb.2005.08.016 · Cited by 54 · see citing works
Shapley Flow: A Graph-based Approach to Interpreting Model PredictionsPreprint
Wang, J., Wiens, J., & Lundberg, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14592 · Cited by 53 · see citing works
Interpreting Multivariate Shapley Interactions in DNNs
Zhang, H., Xie, Y., Zheng, L., Zhang, D., & Zhang, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17299 · Cited by 45 · see citing works
A Distributional Framework for Data ValuationPreprint
Ghorbani, A., Kim, M. P., & Zou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12334 · Cited by 44 · see citing works
A Multilinear Sampling Algorithm to Estimate Shapley Values
Okhrati, R., & Lipani, A. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412511 · Cited by 43 · see citing works
The Shapley Taylor Interaction IndexPreprint
Dhamdhere, K., Agarwal, A., & Sundararajan, M. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1902.05622 · Cited by 36 · see citing works
Efficient nonparametric statistical inference on population feature importance using Shapley values
Williamson, B. D., & Feng, J. (2020) · PubMed · doi:10.48550/arxiv.2006.09481 · Cited by 34 · see citing works
Touati, S., Radjef, M. S., & Saïs, L. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2020.105094 · Cited by 33 · see citing works
Interpretable feature subset selection: A Shapley value based approach
Tripathi, S., Hemachandra, N., & Trivedi, P. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9378102 · Cited by 26 · see citing works
Approximating the Shapley Value Using Stratified Empirical Bernstein Sampling
Burgess, M. A., & Chapman, A. C. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/11 · Cited by 25 · see citing works
Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine LearningPreprint
Kwon, Y., & Zou, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14049 · Cited by 20 · see citing works
Efficient computation and analysis of distributional Shapley valuesPreprint
Kwon, Y., Rivas, M. A., & Zou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01357 · Cited by 18 · see citing works
Explanations for Data Repair Through Shapley Values
Deutch, D., Frost, N., Gilad, A., & Sheffer, O. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482341 · Cited by 15 · see citing works
Antithetic and Monte Carlo kernel estimators for partial rankings
Lomelí, M., Rowland, M., Gretton, A., & Zoubin Ghahramani, A. (2019) · Statistics and Computing · doi:10.1007/s11222-019-09859-z · Cited by 13 · see citing works
The Shapley Value of Classifiers in Ensemble Games
Rózemberczki, B., & Sarkar, R. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482302 · Cited by 12 · see citing works
Self-citationGame-theoretic Vocabulary Selection via the Shapley Value and Banzhaf Index
Patel, R., Garnelo, M., Gemp, I., Dyer, C., & Bachrach, Y. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.223 · Cited by 9 · see citing works
Flow-Based Attribution in Graphical Models: A Recursive Shapley ApproachPreprint
Singal, R., Michailidis, G. C., & Ng, H. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3845526 · Cited by 7 · see citing works
Estimation of the Shapley value by ergodic sampling
Illés, F., & Kerényi, P. (2026) · OR Spectrum · doi:10.1007/s00291-026-00863-0 · Cited by 5 · see citing works
Shapley Values and Meta-Explanations for Probabilistic Graphical Model Inference
Liu, Y., Chen, C., Liu, Y., Zhang, X., & Xie, S. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411881 · Cited by 4 · see citing works
Improving Fairness for Data Valuation in Federated Learning.Preprint
Fan, Z., Huang, F., Zhou, Z., Pei, J., Friedlander, M. P., Liu, C., & Zhang, Y. (2021) · arXiv (Cornell University) · Cited by 4 · see citing works
SHAQ: Incorporating Shapley Value Theory into Q-Learning for Multi-Agent Reinforcement Learning.Preprint
Wang, J., Wang, J., Zhang, Y., Gu, Y., & Kim, T. (2021) · arXiv (Cornell University) · Cited by 2 · see citing works
Flagged first, then by citations
10 of the 65 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Marco Ancona, Cengiz Oztireli, and Markus Gross. Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Value Approxima- tion. In International Conference on Machine Learning, pages 272-281, 2019.
- Frye et al., 2020a] Christopher Frye, Damien de Mijolla, Tom Begley, et al. Shapley Explainability on the Data Manifold. In International Conference on Learning Representations, 2020.
- Frye et al., 2020b] Christopher Frye, Colin Rowat, and Ilya Feige. Asymmetric Shapley Values: Incorporating Causal Knowledge Into Model-Agnostic Explainability. Advances in Neural Information Processing Systems, 33, 2020.
- Pintér, 2011] Miklós Pintér. Regression games. Annals of Operations Research, 186(1):263-274, 2011.
- Lloyd Shapley. A Value for N-Person Games. Contributions to the Theory of Games, pages 307-317, 1953.
- Yan et al., 2021] Tom Yan and Ariel Procaccia. If You Like Shapley Then You Will Love the Core. Proceedings of the AAAI Conference, pages 5751-5759, 2021.
Cited by
Sorted by citations
Obtaining genetics insights from deep learning via explainable artificial intelligence
Novakovsky, G., Dexter, N., Libbrecht, M. W., Wasserman, W. W., & Mostafavi, S. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00532-2 · Cited by 387 · see citing works
Shapley value: from cooperative game to explainable artificial intelligence
Li, M., Sun, H., Huang, Y., & Chen, H. (2024) · Autonomous Intelligent Systems · doi:10.1007/s43684-023-00060-8 · Cited by 242 · see citing works
Challenges and opportunities for artificial intelligence in auditing: Evidence from the field
Kokina, J., Blanchette, S., Davenport, T. H., & Pachamanova, D. (2025) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100734 · Cited by 177 · see citing works
On the failings of Shapley values for explainability
Huang, X., & Marques-Silva, J. P. (2024) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2023.109112 · Cited by 186 · see citing works
Interpretable and explainable machine learning: A methods‐centric overview with concrete examples
Marcinkevičs, R., & Vogt, J. E. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1493 · Cited by 180 · see citing works
Ayano, Y. M., Schwenker, F., Dufera, B. D., & Debelee, T. G. (2022) · Diagnostics · doi:10.3390/diagnostics13010111 · Cited by 132 · see citing works
Inferring gene regulatory networks from single-cell multiome data using atlas-scale external data
Yuan, Q., & Duren, Z. (2025) · Nature Biotechnology · doi:10.1038/s41587-024-02182-7 · Cited by 118 · see citing works
A Survey of Data Marketplaces and Their Business Models
Azcoitia, S. A., & Nikolaos Laoutaris, B. (2022) · ACM SIGMOD Record · doi:10.1145/3572751.3572755 · Cited by 97 · see citing works
Shapley Values for Explaining the Black Box Nature of Machine Learning Model Clustering
Louhichi, M., Nesmaoui, R., Marwan, M., & Lazaar, M. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.03.107 · Cited by 85 · see citing works
Zhan, S., Huang, L., Luo, G., Zheng, S., Gao, Z., & Chao, H.-C. (2025) · Electronics · doi:10.3390/electronics14132512 · Cited by 82 · see citing works
Application of ANN, XGBoost, and Other ML Methods to Forecast Air Quality in Macau
Lei, T. M. T., Ng, S. C. W., & Siu, S. W. I. (2023) · Sustainability · doi:10.3390/su15065341 · Cited by 72 · see citing works
Training data influence analysis and estimation: a survey
Hammoudeh, Z., & Lowd, D. (2024) · Machine Learning · doi:10.1007/s10994-023-06495-7 · Cited by 80 · see citing works
Ronco, M., Tárraga, J. M., Muñoz-Marı́, J., Piles, M., Marco, E. S., Wang, Q., Espinosa, M. T. M., Ponserre, S., & Camps‐Valls, G. (2023) · Nature Communications · doi:10.1038/s41467-023-43809-8 · Cited by 64 · see citing works
Data-driven strategies to improve nitrogen use efficiency of rice farming in South Asia
Coggins, S., McDonald, A. J., Silva, . V., Urfels, A., Nayak, H. S., Sherpa, S. R., Jat, M. L., Jat, H. S., Krupnik, T. J., Kumar, V., et al. (2025) · Nature Sustainability · doi:10.1038/s41893-024-01496-3 · Cited by 62 · see citing works
Eghtesad, A., Luo, Q., Shang, S., Lebensohn, R. A., Knežević, M., Liu, Z., & Beese, A. M. (2023) · International Journal of Plasticity · doi:10.1016/j.ijplas.2023.103646 · Cited by 55 · see citing works
When and where soil dryness matters to ecosystem photosynthesis
Liu, J., Wang, Q., Zhan, W., Xu, L., & Gentine, P. (2025) · Nature Plants · doi:10.1038/s41477-025-02024-7 · Cited by 54 · see citing works
Yang, G., Qiu, H., Wang, N., Yang, D., & Liu, Y. (2025) · Remote Sensing of Environment · doi:10.1016/j.rse.2025.114786 · Cited by 50 · see citing works
Weng, F., Zhu, J., Yang, C., Gao, W., & Zhang, H. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118482 · Cited by 42 · see citing works
Ergün, S. (2023) · New Trends in Computer Sciences · doi:10.3846/ntcs.2023.17901 · Cited by 40 · see citing works
Genetic risk factor clustering within and across neurodegenerative diseases
Koretsky, M. J., Alvarado, C. X., Makarious, M. B., Vitale, D., Levine, K. S., Bandrés‐Ciga, S., Dadu, A., Scholz, S. W., Sargent, L. J., Faghri, F., et al. (2023) · Brain · doi:10.1093/brain/awad161 · Cited by 34 · see citing works
Pelekis, S., Seisopoulos, I.-K., Spiliotis, E., Pountridis, T., Karakolis, E., Mouzakitis, S., & Askounis, D. (2023) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2023.101171 · Cited by 33 · see citing works
Explaining quantum circuits with Shapley values: towards explainable quantum machine learning
Heese, R., Gerlach, T., Mücke, S., Müller, S., Jakobs, M., & Piatkowski, N. (2025) · Quantum Machine Intelligence · doi:10.1007/s42484-025-00254-8 · Cited by 39 · see citing works
Quality Inference in Federated Learning With Secure Aggregation
Pejó, B., & Biczók, G. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3280406 · Cited by 34 · see citing works
Approximating the Shapley Value without Marginal Contributions
Kolpaczki, P., Bengs, V., Muschalik, M., & Hüllermeier, E. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29225 · Cited by 28 · see citing works
Gao, H., Guan, F.-F., Luo, B.-Y., Zhang, D., Liu, W., Shen, Y., Fan, L., Xu, G.-Q., Wang, Y., Tu, T., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-64378-y · Cited by 26 · see citing works
Exact Shapley Values for Local and Model-True Explanations of Decision Tree Ensembles
Campbell, T. W., Roder, H., Georgantas, R., & Roder, J. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100345 · Cited by 33 · see citing works
Beyond group additivity: Transfer learning for molecular thermochemistry prediction
Ureel, Y., Vermeire, F. H., Sabbe, M. K., & Geem, K. M. V. (2023) · Chemical Engineering Journal · doi:10.1016/j.cej.2023.144874 · Cited by 26 · see citing works
Interpretable Machine Learning Techniques for an Advanced Crop Recommendation Model
Bouni, M., Hssina, B., Douzi, K., & Douzi, S. (2024) · Journal of Electrical and Computer Engineering · doi:10.1155/2024/7405217 · Cited by 25 · see citing works
Kasim, S. S., Malek, S., Song, C., Ahmad, W. A. W., Fong, A. Y. Y., Ibrahim, K. S., Kassim, M. S. S., Aziz, F., Hiew, J. H., & Ibrahim, N. (2022) · PLoS ONE · doi:10.1371/journal.pone.0278944 · Cited by 25 · see citing works
Interpretable machine learning model to predict survival days of malignant brain tumor patients
Rajput, S., Kapdi, R., Raval, M. S., & Roy, M. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acd5a9 · Cited by 25 · see citing works
A review of the transition from Shapley values and SHAP values to RGE
Wu, L. (2025) · Statistics · doi:10.1080/02331888.2025.2487853 · Cited by 27 · see citing works
Oeding, J. F., Lu, Y., Pareek, A., Marigi, E. M., Okoroha, K. R., Barlow, J. D., Camp, C. L., & Sánchez‐Sotelo, J. (2023) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2023.03.001 · Cited by 24 · see citing works
Interpretable machine learning for microstructure-dependent models of fatigue indicator parameters
Hansen, C. K., Whelan, G. F., & Hochhalter, J. D. (2023) · International Journal of Fatigue · doi:10.1016/j.ijfatigue.2023.108019 · Cited by 24 · see citing works
Constable, P. A., Pinzon-Arenas, J. O., Díaz, L. R. M., Lee, I., Marmolejo‐Ramos, F., Loh, L., Zhdanov, A. E., Kulyabin, M., Brabec, M., Skuse, D., et al. (2024) · Bioengineering · doi:10.3390/bioengineering12010015 · Cited by 21 · see citing works
Intelligent games meeting with multi-agent deep reinforcement learning: a comprehensive review
Wang, Y., Wang, Y., Tian, F., Ma, J., & Jin, Q. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11166-1 · Cited by 21 · see citing works
Altini, N., Puro, E., Taccogna, M. G., Marino, F., Summa, S. D., Saponaro, C., Mattioli, E., Zito, F. A., & Bevilacqua, V. (2023) · Bioengineering · doi:10.3390/bioengineering10040396 · Cited by 21 · see citing works
Maleki, M., & Smith‐Colin, J. (2025) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2025.101345 · Cited by 20 · see citing works
Kassani, P. H., Ehwerhemuepha, L., Martin-King, C., Kassab, R., Gibbs, E., Morgan, G. A., & Pachman, L. M. (2023) · Pediatric Research · doi:10.1038/s41390-023-02894-7 · Cited by 20 · see citing works
Gupte, S., & Paparrizos, J. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3725420 · Cited by 19 · see citing works
Oeding, J. F., Boos, A. M., Kalk, J. R., Sorenson, D., Verhooven, F. M., Moatshe, G., & Camp, C. L. (2024) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671241264260 · Cited by 17 · see citing works
Applications and Computation of the Shapley Value in Databases and Machine Learning
Luo, X., & Pei, J. (2024) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3626246.3654680 · Cited by 17 · see citing works
Breast Cancer Prediction Using Shapely and Game Theory in Federated Learning Environment
Supriya, Y., & Chengoden, R. (2024) · IEEE Access · doi:10.1109/access.2024.3424934 · Cited by 20 · see citing works
Saxena, A., Salvato, M., Roster, W., Shirley, R. A., Büchner, J., Wolf, J., Kohl, C., Starck, H., Dwelly, T., Comparat, J., et al. (2024) · Astronomy and Astrophysics · doi:10.1051/0004-6361/202450886 · Cited by 17 · see citing works
An intelligent multi-agent system for last-mile logistics
Kahalimoghadam, M., Thompson, R. G., & Rajabifard, A. (2025) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2025.104191 · Cited by 16 · see citing works
Navidi, S., Bajarunas, K., Chao, M. A., & Hu, C. K. (2025) · eTransportation · doi:10.1016/j.etran.2025.100432 · Cited by 16 · see citing works
Raufi, B., & Luca, L. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4010048 · Cited by 18 · see citing works
Hartmann, D., Oueslati, A., Staufer, D., Pohlmann, L., Munzert, S., & Heuer, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713998 · Cited by 21 · see citing works
An, H., Li, Q., Lv, X., Li, G., Qian, Q., Zhou, G., Nie, G., Zhang, L., & Zhu, L. (2023) · Weather and Climate Extremes · doi:10.1016/j.wace.2023.100621 · Cited by 15 · see citing works
Belaid, M. K., Bornemann, R., Rabus, M., Krestel, R., & Hüllermeier, E. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_5 · Cited by 15 · see citing works
Examining effects of air pollution on photovoltaic systems via interpretable random forest model
Dudáš, A., Udriștioiu, M. T., Alkharusi, T., Yıldızhan, H., & Sampath, S. K. (2024) · Renewable Energy · doi:10.1016/j.renene.2024.121066 · Cited by 15 · see citing works
Robust Stochastic Neural Ensemble Learning With Noisy Labels for Thoracic Disease Classification
Wang, H., Jiang, H., Cui, H., Yuan, B., & Xia, Y. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3357986 · Cited by 14 · see citing works
Optimizing Data Acquisition to Enhance Machine Learning Performance
Wang, T., Huang, S., Bao, Z., Culpepper, J. S., Dedeoglu, V., & Arablouei, R. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3648160.3648172 · Cited by 13 · see citing works
Zhang, K., Lu, H., & Wang, B. (2024) · Sustainability · doi:10.3390/su16166729 · Cited by 13 · see citing works
Explainable post hoc portfolio management financial policy of a Deep Reinforcement Learning agent
Escudero, A. D. L. R., Garrido‐Merchán, E. C., & Vaca, M. C. (2025) · PLoS ONE · doi:10.1371/journal.pone.0315528 · Cited by 13 · see citing works
Aishwarya, S., Siddalingaswamy, P. C., & Chadaga, K. (2025) · Scientific Reports · doi:10.1038/s41598-025-09409-w · Cited by 12 · see citing works
Wang, H., Pei, J., Yan, F., Wang, W., Yuan, S., Wang, K., Fu, W. H., Gan, X., & Chen, J. (2025) · Energy · doi:10.1016/j.energy.2025.138399 · Cited by 12 · see citing works
Explainable AI for Audio and Visual Affective Computing: A Scoping Review
Johnson, D. S., Hakobyan, O., Paletschek, J., & Drimalla, H. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3505269 · Cited by 12 · see citing works
Predicting sorption of organic pollutants on soils with interpretable machine learning
Wang, Q., Bian, J., Ma, E., & Zhang, J.-W. (2025) · Environmental Pollution · doi:10.1016/j.envpol.2025.126665 · Cited by 12 · see citing works
Fair-CO2: Fair Attribution for Cloud Carbon Emissions
Han, L., Kakadia, J., Lee, B. C., & Gupta, U. (2025) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3695053.3731023 · Cited by 12 · see citing works
A Novel Real-Time Battery State Estimation Using Data-Driven Prognostics and Health Management
Pimentel, J., McEwan, A. A., & Yu, H. Q. (2025) · Applied Sciences · doi:10.3390/app15158538 · Cited by 11 · see citing works
Yang, X., Chen, S. H. A., Liu, T., Luo, J., & Tang, Y. (2025) · Sustainability · doi:10.3390/su17219916 · Cited by 17 · see citing works
Dubey, A., Lyons, N., Santra, A., & Pandey, A. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00205 · Cited by 11 · see citing works
Prasertsoong, N., & Puttanapong, N. (2024) · Progress in Disaster Science · doi:10.1016/j.pdisas.2024.100393 · Cited by 11 · see citing works
A heart failure classification model from radial artery pulse wave using LSTM neural networks
Lyu, Y., Huang, W.-Y., Wu, H.-M., Hong, J., Wang, Y., Yan, H., & Xu, J. W. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03167-5 · Cited by 11 · see citing works
Nancy Ambritta, P., Mahalle, P. N., Bhapkar, H. R., Shinde, G. R., & Sable, N. P. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02444-w · Cited by 10 · see citing works
Mohammed, B., & Cheniti, H. (2025) · Mining Metallurgy & Exploration · doi:10.1007/s42461-025-01267-4 · Cited by 10 · see citing works
Kavargyris, D. C., Georgiou, K., Papaioannou, E., Moysiadis, T., Mittas, N., & Angelis, L. (2025) · Algorithms · doi:10.3390/a18090554 · Cited by 16 · see citing works
Mahato, S., Gurao, N. P., & Biswas, K. (2024) · Modelling and Simulation in Materials Science and Engineering · doi:10.1088/1361-651x/ad269f · Cited by 10 · see citing works
Azcoitia, S. A., & Nikolaos Laoutaris, B. (2022) · doi:10.1145/3565011.3569054 · Cited by 9 · see citing works
Performance Evaluation and Explainability of Last-Mile Delivery
Brochado, Â. F., Rocha, E. M., Addo, E., & Silva, S. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.02.067 · Cited by 9 · see citing works
Lim, K. Y. T., Thien, M. T. N., Duc, M. A. N., & Posada-Quintero, H. F. (2024) · Bioengineering · doi:10.3390/bioengineering11030291 · Cited by 9 · see citing works
Interpretable Machine Learning for TabPFN
Rundel, D., Kobialka, J., von Crailsheim, C., Feurer, M., Nagler, T., & Rügamer, D. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63797-1_23 · Cited by 9 · see citing works
Tegaw, E. M., & Asfaw, B. B. (2025) · Seminars in Oncology · doi:10.1016/j.seminoncol.2025.152364 · Cited by 9 · see citing works
A Root Cause Analysis Framework for IoT Based on Dynamic Causal Graphs Assisted by LLMs
Tang, L., Kou, E., Wang, W., & Chen, Q. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3578512 · Cited by 11 · see citing works
Fuentes, G., & Munim, Z. H. (2025) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2025.104319 · Cited by 9 · see citing works
Huber, F., & Steinhage, V. (2024) · Geomatics · doi:10.3390/geomatics4030016 · Cited by 8 · see citing works
Li, W., Li, H., Liu, C., & Min, K. (2024) · Buildings · doi:10.3390/buildings14113627 · Cited by 8 · see citing works
Shapley value-based class activation mapping for improved explainability in neural networks
Cai, H., Yang, Y., Tang, Y., Sun, Z., & Zhang, W. (2025) · The Visual Computer · doi:10.1007/s00371-025-03803-1 · Cited by 8 · see citing works
Bhardwaj, H. K., & Shukla, M. (2025) · Journal of Materials Engineering and Performance · doi:10.1007/s11665-025-11330-2 · Cited by 8 · see citing works
Liu, J., Neogi, S., & Lai, D. Y. F. (2025) · Earth s Future · doi:10.1029/2024ef005277 · Cited by 8 · see citing works
Trivedi, M. R., Joshi, A. M., Shah, J., Readhead, B. P., Wilson, M. A., Su, Y., Reiman, E. M., Wu, T., & Wang, Q. (2025) · npj Aging · doi:10.1038/s41514-025-00258-5 · Cited by 8 · see citing works
Qiu, Y., Shi, X., & He, X. (2025) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2025.108130 · Cited by 8 · see citing works
Machine Learning for Basketball Game Outcomes: NBA and WNBA Leagues
Alves, J. M., & Barbosa, R. S. (2025) · Computation · doi:10.3390/computation13100230 · Cited by 8 · see citing works
Zhang, H., Liu, C., Ma, J., & Sun, H. Z. (2024) · Infrared Physics & Technology · doi:10.1016/j.infrared.2024.105168 · Cited by 8 · see citing works
Explainable Adaptive Tree-based Model Selection for Time-Series Forecasting
Jakobs, M., & Saadallah, A. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00027 · Cited by 8 · see citing works
Why Shapley Value and Its Variants Are Useful in Machine Learning (and in Other Applications)
Bokati, L., Kosheleva, O. M., Крейнович, В., & Thạch, N. N. (2024) · Studies in systems, decision and control · doi:10.1007/978-3-031-43601-7_10 · Cited by 8 · see citing works
Zhou, N., Qin, W., Zhang, J.-J., Wang, Y., Wen, J.-S., & Lim, Y. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-63653-0 · Cited by 8 · see citing works
Automated Machine Learning in Critical Energy Infrastructure for Net Zero Carbon Emissions
Moraliyage, H., Haputhanthri, D., Samarajeewa, C., Mills, N., Silva, D. D., Manic, M., & Jennings, A. (2023) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie51358.2023.10227985 · Cited by 8 · see citing works
Relaxed Class-consensus Consistency for Semi-supervised Semantic Segmentation
Mai, H., Sun, R., & Wu, F. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i6.32646 · Cited by 7 · see citing works
Yan, Q., Pei, Y., Xue, L., Sun, H., Wang, R., & Ran, X. (2025) · Ore Geology Reviews · doi:10.1016/j.oregeorev.2025.106758 · Cited by 7 · see citing works
On rank graduation metrics for high–dimensional ordinal data
Auricchio, G., Bernardelli, A. E., Giudici, P., & Toscani, G. (2026) · Mathematical Models and Methods in Applied Sciences · doi:10.1142/s0218202526420030 · Cited by 7 · see citing works
Kuhl, U., Artelt, A., & Hammer, B. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44070-0_14 · Cited by 8 · see citing works
Using Stratified Sampling to Improve LIME Image Explanations
Rashid, M., Amparore, E. G., Ferrari, E., & Verda, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29397 · Cited by 7 · see citing works
Quantifying Device Flexibility With Shapley Values in Demand Side Management
Varenhorst, I. A. M., Hurink, J. L., & Gerards, M. E. T. (2024) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3632775.3661950 · Cited by 7 · see citing works
Probably Approximate Shapley Fairness with Applications in Machine Learning
Zhou, Z., Xu, X., Sim, R. H. L., Foo, C.-S., & Low, B. K. H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i5.25732 · Cited by 7 · see citing works
Machine learning for zombie hunting: predicting distress from firms’ accounts and missing values
Bargagli-Stoffi, F. J., Incerti, F., Riccaboni, M., & Rungi, A. (2023) · Industrial and Corporate Change · doi:10.1093/icc/dtad049 · Cited by 7 · see citing works
Generating Explanations to Understand and Repair Embedding-Based Entity Alignment
Tian, X., Sun, Z., & Hu, W. P. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00175 · Cited by 7 · see citing works
Baibordy, A., & Yekrangnia, M. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.105287 · Cited by 6 · see citing works
Yonekura, K., Miyazaki, S., Aichi, M., Nishizu, T., Hasegawa, M., & Suzuki, K. (2025) · Artificial Intelligence in Geosciences · doi:10.1016/j.aiig.2025.100148 · Cited by 6 · see citing works
Explainable Machine Learning Approach with Augmentation for Mortality Prediction
Ketata, F., Masry, Z. A., Noureddine Zerhouni, A., & Yacoub, S. (2023) · IEEE International Conference on Advanced Systems and Emergent Technologies (IC_ASET) · doi:10.1109/ic_aset58101.2023.10150509 · Cited by 6 · see citing works
- Authors
- Rozemberczki, B., Watson, L., Bayer, P., Yang, H.-T., Kiss, O., Nilsson, S., & Sarkar, R.
- Affiliations
- University of Edinburgh (GB)
- Toulouse School of Economics (FR)
- Central European University (AT)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 5572-5579
- arXiv
- 2202.05594
- OpenAlex
- W4285606919
- Cited by
- 312
- References
- 65
- Citations by year
- 2026: 61 · 2025: 109 · 2024: 68 · 2023: 57 · 2022: 17
- FWCI
- 230.30
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Joint Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Research Centre (EP/V011189/1)
- UK Research and Innovation (EP/V011189/1)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Game Theory and Voting Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Decision Sciences › Management Science and Operations Research › Game Theory and Applications
- Keywords
- Shapley value, cooperative game theory, axiomatic properties, feature selection, explainable AI, multi-agent reinforcement learning, ensemble pruning, data valuation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review