CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models
Open accessAbstract
Concerns within the machine learning community and external pressures from regulators over the vulnerabilities of machine learning algorithms have spurred on the fields of explainability, robustness, and fairness. Often, issues in explainability, robustness, and fairness are confined to their specific sub-fields and few tools exist for model developers to use to simultaneously build their modeling pipelines in a transparent, accountable, and fair way. This can lead to a bottleneck on the model developer's side as they must juggle multiple methods to evaluate their algorithms. In this paper, we present a single framework for analyzing the robustness, fairness, and explainability of a classifier. The framework, which is based on the generation of counterfactual explanations through a custom genetic algorithm, is flexible, model-agnostic, and does not require access to model internals. The framework allows the user to calculate robustness and fairness scores for individual models and generate explanations for individual predictions which provide a means for actionable recourse (changes to an input to help get a desired outcome). This is the first time that a unified tool has been developed to address three key issues pertaining towards building a responsible artificial intelligence system.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Counterfactual reasoning is claimed to be a key mechanism for explaining adaptive behavior in a changing environment.
“In addition, counterfactual reasoning is claimed to be a key mechanism for explaining adaptive behavior in a changing environment [25], [26].”
From A Survey of Contrastive and Counterfactual Explanation Generation Methods for Explainable Artificial Intelligence (2021) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
Towards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859 · see citing works
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · see citing works
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258 · see citing works
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
Akhtar, N., & Mian, A. (2018) · IEEE Access · doi:10.1109/access.2018.2807385 · Cited by 2,021 · see citing works
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061 · see citing works
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501 · see citing works
Efficient Search for Diverse Coherent Explanations
Russell, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287569 · Cited by 218 · see citing works
Flagged first, then by citations
Research works printed but not linked: 7
- [Binns, 2017] Reuben Binns. Fairness in machine learning: Lessons from political philosophy. arXiv preprint arXiv:1712.03586 , 2017. · arXiv
- [Guidotti et al. , 2018a] Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Dino Pedreschi, Franco Turini, and Fosca Giannotti. Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820 , 2018. · arXiv
- [Guidotti et al. , 2018b] Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. A survey of methods for explaining black box models. ACM computing surveys (CSUR) , 51(5):93, 2018.
- [Harik et al. , 1999] Georges R Harik, Fernando G Lobo, and David E Goldberg. The compact genetic algorithm. IEEE transactions on evolutionary computation , 3(4):287-297, 1999.
- [Howard et al. , 2017] Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 , 2017. · arXiv
- [Madry et al. , 2017] Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. Towards deep learning models resistant to adversarial attacks. arXiv preprint arXiv:1706.06083 , 2017. · arXiv
- [Weng et al. , 2018] Tsui-Wei Weng, Huan Zhang, Pin-Yu Chen, Jinfeng Yi, Dong Su, Yupeng Gao, Cho-Jui Hsieh, and Luca Daniel. Evaluating the robustness of neural networks: An extreme value theory approach. arXiv preprint arXiv:1801.10578 , 2018. · arXiv
Cited by
Sorted by citations
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629 · see citing works
Explainable machine learning in deployment
Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633 · see citing works
Self-citationCounterfactual explanations and how to find them: literature review and benchmarking
Guidotti, R. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00831-6 · Cited by 497 · see citing works
Stepin, I., Alonso, J. M., Catala, A., & Pereira-Farina, M. (2021) · IEEE Access · doi:10.1109/access.2021.3051315 · Cited by 376 · see citing works
“…[159], gradient boosted decision trees [147], support vector machines [131], [138], [146], random forests [81], [86], [142]–[144], neural networks [6], [48], [49], [91], [129], [130], [133], [135], [139], [141], [145], [148], [151], or combinations of these [100], [105], [134], [152], [154], [160].”
Data-centric Artificial Intelligence: A Survey
Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., Jiang, Z., Zhong, S., & Hu, X. (2025) · ACM Computing Surveys · doi:10.1145/3711118 · Cited by 508 · see citing works
Chou, Y.-L., Moreira, C., Bruza, P., Ouyang, C., & Jorge, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.003 · Cited by 302 · see citing works
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K., Dickerson, J. P., & Shah, C. S. (2024) · ACM Computing Surveys · doi:10.1145/3677119 · Cited by 456 · see citing works
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K. E., Dickerson, J. P., & Shah, C. (2020) · arXiv · doi:10.48550/arxiv.2010.10596 · Cited by 267 · see citing works
Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations
Mökander, J., Morley, J., Taddeo, M., & Floridi, L. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00319-4 · Cited by 198 · see citing works
Counterfactual Explanations for Machine Learning: A Review.Preprint
Verma, S., Dickerson, J. P., & Hines, K. (2020) · arXiv (Cornell University) · Cited by 223 · see citing works
Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset
Meng, C., Trinh, L., Xu, N., Enouen, J., & Liu, Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-11012-2 · Cited by 199 · see citing works
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301 · see citing works
Explainable AI for 6G Use Cases: Technical Aspects and Research Challenges
Wang, S., Qureshi, M. A., Miralles-Pechuán, L., Huynh-The, T., Gadekallu, T. R., & Liyanage, M. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3386872 · Cited by 170 · see citing works
Dai, E., Zhao, T., Zhu, H., Xu, J., Guo, Z., Liu, H., Tang, J., & Wang, S. (2024) · Machine Intelligence Research · doi:10.1007/s11633-024-1510-8 · Cited by 211 · see citing works
Artificial intelligence explainability: the technical and ethical dimensions
McDermid, J. A., Jia, Y., Porter, Z., & Habli, I. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0363 · Cited by 136 · see citing works
Explainable Artificial Intelligence for Tabular Data: A Survey
Sahakyan, M., Aung, Z., & Rahwan, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116481 · Cited by 135 · see citing works
Algorithmic fairness datasets: the story so far
Fabris, A., Messina, S., Silvello, G., & Susto, G. A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00854-z · Cited by 128 · see citing works
Koshiyama, A., Kazim, E., Treleaven, P., Rai, P., Szpruch, L., Pavey, G., Ahamat, G., Leutner, F., Goebel, R., Knight, A., et al. (2024) · Royal Society Open Science · doi:10.1098/rsos.230859 · Cited by 110 · see citing works
Mothilal, R. K., Mahajan, D., Tan, C., & Sharma, A. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462597 · Cited by 95 · see citing works
An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists
Krafft, P. M., Young, M., Katell, M. A., Lee, J. E., Narayan, S., Epstein, M., Dailey, D., Herman, B., Tam, A., Guetler, V., et al. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445938 · Cited by 87 · see citing works
Fairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 91 · see citing works
Why model why? Assessing the strengths and limitations of LIMEPreprint
Dieber, J., & Kirrane, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00093 · Cited by 153 · see citing works
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76 · see citing works
A survey of algorithmic recourse: definitions, formulations, solutions, and prospectsPreprint
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04050 · Cited by 74 · see citing works
The Role of Explainability in Assuring Safety of Machine Learning in Healthcare
Jia, Y., McDermid, J. A., Lawton, T., & Habli, I. (2022) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2022.3171314 · Cited by 82 · see citing works
Counterfactual Shapley Additive Explanations
Albini, E., Long, J., Dervovic, D., & Magazzeni, D. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533168 · Cited by 74 · see citing works
Zhang, X., Chan, F. T. S., & Mahadevan, S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108418 · Cited by 63 · see citing works
Schleich, M., Geng, Z., Zhang, Y., & Suciu, D. M. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3461535.3461555 · Cited by 62 · see citing works
Ferrario, A., Sedlakova, J., & Trachsel, M. (2024) · JMIR Mental Health · doi:10.2196/56569 · Cited by 61 · see citing works
Establishing and evaluating trustworthy AI: overview and research challenges
Kowald, D., Scher, S., Pammer-Schindler, V., Müllner, P., Waxnegger, K., Demelius, L., Fessl, A., Toller, M., Mendoza Estrada, I. G., Šimić, I., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1467222 · Cited by 59 · see citing works
The Intriguing Relation Between Counterfactual Explanations and Adversarial Examples
Freiesleben, T. (2021) · Minds and Machines · doi:10.1007/s11023-021-09580-9 · Cited by 58 · see citing works
Hu, Y., Zhang, X., Slavin, V., Belsti, Y., Tiruneh, S. A., Callander, E. J., & Enticott, J. (2025) · Journal of Medical Internet Research · doi:10.2196/77721 · Cited by 68 · see citing works
On the Fairness of Causal Algorithmic Recourse
Kügelgen, J. V., Karimi, A.-H., Bhatt, U., Valera, I., Weller, A., & Schölkopf, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21192 · Cited by 58 · see citing works
The intersection of evolutionary computation and explainable AI
Bacardit, J., Brownlee, A. E. I., Cagnoni, S., Iacca, G., McCall, J., & Walker, D. J. (2022) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3520304.3533974 · Cited by 56 · see citing works
Interpretability of deep neural networks: A review of methods, classification and hardware
Antamis, T., Drosou, A., Vafeiadis, T., Nizamis, A., Ioannidis, D., & Tzovaras, D. K. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128204 · Cited by 55 · see citing works
Mitigating Bias in Algorithmic Systems—A Fish-eye View
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2022) · ACM Computing Surveys · doi:10.1145/3527152 · Cited by 54 · see citing works
A Critical Survey on Fairness Benefits of Explainable AI
Deck, L., Schoeffer, J., De‐Arteaga, M., & Kühl, N. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658990 · Cited by 86 · see citing works
Counterfactual Explanations Can Be ManipulatedPreprint
Slack, D., Hilgard, S., Lakkaraju, H., & Singh, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02666 · Cited by 55 · see citing works
Agarwal, A., Agarwal, H., & Agarwal, N. (2022) · AI and Ethics · doi:10.1007/s43681-022-00147-7 · Cited by 49 · see citing works
Bueff, A., Cytryński, M., Calabrese, R., Jones, M., Roberts, J., Moore, J., & Brown, I. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117271 · Cited by 49 · see citing works
Getting a CLUE: A Method for Explaining Uncertainty Estimates
Antorán, J., Bhatt, U., Adel, T., Weller, A., & Hernández-Lobato, J. M. (2021) · Apollo - University of Cambridge Repository · doi:10.17863/cam.69929 · Cited by 49 · see citing works
A novel model usability evaluation framework (MUsE) for explainable artificial intelligence
Dieber, J., & Kirrane, S. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.017 · Cited by 48 · see citing works
Directive Explanations for Actionable Explainability in Machine Learning Applications
Singh, R., Miller, T., Lyons, H., Sonenberg, L., Velloso, E., Vetere, F., Howe, P. D. L., & Dourish, P. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3579363 · Cited by 50 · see citing works
Model-Agnostic Counterfactual Explanations in Credit Scoring
Dastile, X., Çelik, T., & Vandierendonck, H. (2022) · IEEE Access · doi:10.1109/access.2022.3177783 · Cited by 41 · see citing works
Modeling and Guiding the Creation of Ethical Human-AI Teams
Flathmann, C., Schelble, B. G., Zhang, R., & McNeese, N. J. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462573 · Cited by 43 · see citing works
Pawlicki, M., Pawlicka, A., Kozik, R., & Choraś, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127759 · Cited by 40 · see citing works
Stable and actionable explanations of black-box models through factual and counterfactual rules
Guidotti, R., Monreale, A., Ruggieri, S., Naretto, F., Turini, F., Pedreschi, D., & Giannotti, F. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00878-5 · Cited by 39 · see citing works
Causality Learning: A New Perspective for Interpretable Machine LearningPreprint
Xu, G., Duong, T. D., Li, Q., Liu, S., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16789 · Cited by 37 · see citing works
CASTLE: Cluster-aided space transformation for local explanations
Gatta, V. L., Moscato, V., Postiglione, M., & Sperlí, G. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115045 · Cited by 36 · see citing works
A Systematic Review of Fairness in Artificial Intelligence Algorithms
Xivuri, K., & Twinomurinzi, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85447-8_24 · Cited by 36 · see citing works
Salimparsa, M., Sedig, K., Lizotte, D. J., Abdullah, S. S., Chalabianloo, N., & Muanda, F. T. (2025) · Informatics · doi:10.3390/informatics12040119 · Cited by 39 · see citing works
Ariöz, U., Smrke, U., Plohl, N., & Mlakar, I. (2022) · Diagnostics · doi:10.3390/diagnostics12112683 · Cited by 34 · see citing works
Counterfactual Explanations for Oblique Decision Trees:Exact, Efficient Algorithms
Carreira-Perpiñán, M. Á., & Hada, S. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16851 · Cited by 34 · see citing works
A multi-perspective approach to support collaborative cost management in supplier-buyer dyads
Bodendorf, F., Xie, Q. L., Merkl, P., & Franke, J. E. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108380 · Cited by 36 · see citing works
An external stability audit framework to test the validity of personality prediction in AI hiring
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., Khan, F. A., & Stoyanovich, J. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00861-0 · Cited by 39 · see citing works
PreCoF: counterfactual explanations for fairness
Goethals, S., Martens, D., & Calders, T. (2023) · Machine Learning · doi:10.1007/s10994-023-06319-8 · Cited by 31 · see citing works
A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular Data
Oliveira, R., & Martens, D. (2021) · Applied Sciences · doi:10.3390/app11167274 · Cited by 34 · see citing works
Ethical Design of Conversational Agents: Towards Principles for a Value-Sensitive Design
Wambsganß, T., Höch, A., Zierau, N., & Söllner, M. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86790-4_37 · Cited by 31 · see citing works
CARE: coherent actionable recourse based on sound counterfactual explanations
Rasouli, P., & Yu, I. C. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00365-6 · Cited by 30 · see citing works
Explainable AI: To Reveal the Logic of Black-Box Models
Chinu, & Bansal, U. (2023) · New Generation Computing · doi:10.1007/s00354-022-00201-2 · Cited by 32 · see citing works
Mathematical optimization modelling for group counterfactual explanations
Carrizosa, E., Ramírez-Ayerbe, J., & Morales, D. R. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.01.002 · Cited by 29 · see citing works
On the computation of counterfactual explanations -- A surveyPreprint
Artelt, A., & Hammer, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07749 · Cited by 29 · see citing works
Pradeep, P., Caro-Martínez, M., & Wijekoon, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124733 · Cited by 28 · see citing works
Explainable AI for Sensor Signal Interpretation to Revolutionize Human Health Monitoring: A Review
Alharthi, A. S., Alqurashi, A., Alharbi, T. E. A., Alammar, M. M., Aldosari, N., Bouchekara, H. R. E. H., Sha’aban, Y. A., Shahriar, M. S., & Ayidh, A. A. (2025) · IEEE Access · doi:10.1109/access.2025.3585764 · Cited by 35 · see citing works
Politik in der digitalen Gesellschaft
Hofmann, J., Kersting, N., Ritzi, C., & Schünemann, W. J. (2019) · Politik in der digitalen Gesellschaft · doi:10.14361/9783839448649 · Cited by 29 · see citing works
How Well do Feature Visualizations Support Causal Understanding of CNN Activations?Preprint
Zimmermann, R. S., Borowski, J., Geirhos, R., Bethge, M., Wallis, T. S. A., & Brendel, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12447 · Cited by 25 · see citing works
Gajcin, J., & Dusparić, I. (2024) · ACM Computing Surveys · doi:10.1145/3648472 · Cited by 24 · see citing works
Capturing Users’ Reality: A Novel Approach to Generate Coherent Counterfactual Explanations
Förster, M., Hühn, P., Klier, M., & Kluge, K. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.155 · Cited by 24 · see citing works
Counterfactual Explanation of Machine Learning Survival Models
Kovalev, M., Utkin, L., Coolen, F. P. A., & Konstantinov, A. (2020) · Informatica · doi:10.15388/21-infor468 · Cited by 27 · see citing works
Counterfactual explanations as interventions in latent space
Crupi, R., Castelnovo, A., Regoli, D., & González, B. S. M. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00889-2 · Cited by 23 · see citing works
Nadizar, G., Rovito, L., Lorenzo, A. D., Medvet, E., & Virgolin, M. (2024) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3643688 · Cited by 22 · see citing works
MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Dataset
Meng, C., Trinh, L., Xu, N., & Liu, Y. (2021) · doi:10.21203/rs.3.rs-402058/v1 · Cited by 21 · see citing works
Ethical Guidelines and Principles in the Context of Artificial Intelligence
de Cerqueira, J. A. S., Tives, H. A., & Canedo, E. D. (2021) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.1145/3466933.3466969 · Cited by 21 · see citing works
Black, E., Naidu, R. C. A., Ghani, R., Rodolfa, K. T., Ho, D. E., & Heidari, H. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623259 · Cited by 19 · see citing works
Rethinking Certification for Trustworthy Machine-Learning-Based Applications
Anisetti, M., Ardagna, C. A., Bena, N., & Damiani, E. (2023) · IEEE Internet Computing · doi:10.1109/mic.2023.3322327 · Cited by 19 · see citing works
Causality-based counterfactual explanation for classification models
Duong, T. D., Li, Q., & Xu, G. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112200 · Cited by 18 · see citing works
Achieving Diversity in Counterfactual Explanations: a Review and Discussion
Laugel, T., Jeyasothy, A., Lesot, M., Marsala, C., & Detyniecki, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594122 · Cited by 17 · see citing works
FaiR-N: Fair and Robust Neural Networks for Structured Data
Sharma, S., Gee, A. H., Paydarfar, D., & Ghosh, J. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462559 · Cited by 17 · see citing works
Self-citationMachine Learning post-hoc interpretability: a systematic mapping study
Vieira, C. P. R., & Digiampietri, L. A. (2022) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.1145/3535511.3535512 · Cited by 17 · see citing works
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., & Stoyanovich, J. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534189 · Cited by 17 · see citing works
Integration of Generative AI and Mobile Networking: A Comprehensive Survey
Li, J., He, M., Zhou, C., Huang, X., Liu, Z., Zhao, L. Y., Wang, C., & Wu, H. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3639401 · Cited by 19 · see citing works
Evolutionary Approaches to Explainable Machine Learning
Zhou, R., & Hu, T. (2023) · Genetic and evolutionary computation · doi:10.1007/978-981-99-3814-8_16 · Cited by 16 · see citing works
Manifestations of xenophobia in AI systems
Tomašev, N., Maynard, J. L., & Gabriel, I. (2024) · AI & Society · doi:10.1007/s00146-024-01893-4 · Cited by 20 · see citing works
FairXAI - A Taxonomy and Framework for Fairness and Explainability Synergy in Machine Learning
Ramachandranpillai, R., Baeza-Yates, R. A., & Heintz, F. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3528321 · Cited by 15 · see citing works
FIMAP: Feature Importance by Minimal Adversarial Perturbation
Chapman-Rounds, M., Bhatt, U., Pazos, E., Schulz, M.-A., & Georgatzis, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17362 · Cited by 17 · see citing works
Artelt, A., & Hammer, B. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.129 · Cited by 29 · see citing works
FACET: Robust Counterfactual Explanation Analytics
VanNostrand, P. M., Zhang, H., Hofmann, D. M., & Rundensteiner, E. A. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3626729 · Cited by 14 · see citing works
SAFE: Saliency-Aware Counterfactual Explanations for DNN-based Automated Driving Systems
Samadi, A., Shirian, A., Koufos, K., Debattista, K., & Dianati, M. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422102 · Cited by 14 · see citing works
Counterfactual Explanations With Multiple Properties in Credit Scoring
Dastile, X., & Çelik, T. (2024) · IEEE Access · doi:10.1109/access.2024.3441037 · Cited by 14 · see citing works
Explainable Artificial Intelligence for Energy-Efficient Radio Resource Management
Marcu, A.-D., Peesapati, S. K. G., Cortes, J. M., Imtiaz, S., & Gross, J. (2023) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc55385.2023.10119130 · Cited by 15 · see citing works
On Explaining Unfairness: An Overview
Fragkathoulas, C., Papanikou, V., Karidi, D. P., & Pitoura, E. (2024) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew61823.2024.00035 · Cited by 13 · see citing works
GeCo: Quality Counterfactual Explanations in Real TimePreprint
Schleich, M., Geng, Z., Zhang, Y., & Suciu, D. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01292 · Cited by 13 · see citing works
A Multi-Criteria Decision-Making Approach for the Selection of Explainable AI Methods
Matejová, M., & Paralič, J. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7040158 · Cited by 15 · see citing works
Opacity, Machine Learning and Explainable AI
Fernández, A. (2023) · The International library of ethics, law and technology · doi:10.1007/978-3-031-48135-2_3 · Cited by 12 · see citing works
MLHOps: Machine Learning Health Operations
Khattak, F. K., Subasri, V., Krishnan, A., Pou-Prom, C., Koçak, S. A., Dolatabadi, E., Pandya, D., Seyyed-Kalantari, L., & Rudzicz, F. (2024) · IEEE Access · doi:10.1109/access.2024.3521279 · Cited by 24 · see citing works
PASTLE: Pivot-aided space transformation for local explanations
Gatta, V. L., Moscato, V., Postiglione, M., & Sperlí, G. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.05.018 · Cited by 12 · see citing works
Förster, M., Hühn, P., Klier, M., & Kluge, K. (2022) · Journal of Decision System · doi:10.1080/12460125.2022.2119707 · Cited by 12 · see citing works
Efficient computation of counterfactual explanations of LVQ modelsPreprint
Artelt, A., & Hammer, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.00735 · Cited by 12 · see citing works
Measuring the Burden of (Un)fairness Using Counterfactuals
Kuratomi, A., Pitoura, E., Papapetrou, P., Lindgren, T., & Tsaparas, P. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-23618-1_27 · Cited by 11 · see citing works
- Authors
- Sharma, S., Henderson, J., & Ghosh, J.
- Affiliations
- The University of Texas at Austin (US)
- CognitiveScale, Austin, TX, USA
- Venue
- Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2020-02-07
- Pages
- 166-172
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W2945151003
- Cited by
- 226
- References
- 9
- Citations by year
- 2026: 15 · 2025: 27 · 2024: 46 · 2023: 42 · 2022: 35 · 2021: 43 · 2020: 14 · 2019: 4
- FWCI
- 12.78
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, robustness, algorithmic fairness, counterfactual explanations, genetic algorithm, classifier evaluation, model-agnostic evaluation, recourse, responsible AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
