Cited by 226Explainable Artificial Intelligence (XAI)Ethics and Social Impacts of AIAdversarial Robustness in Machine Learning

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models

Open access

Sharma, Shubham, Henderson, Jette, Ghosh, Joydeep·2020·Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society

DOI 10.1145/3375627.3375812

Open this paper in CoChat — free account Open PDF

Abstract

Concerns within the machine learning community and external pressures from regulators over the vulnerabilities of machine learning algorithms have spurred on the fields of explainability, robustness, and fairness. Often, issues in explainability, robustness, and fairness are confined to their specific sub-fields and few tools exist for model developers to use to simultaneously build their modeling pipelines in a transparent, accountable, and fair way. This can lead to a bottleneck on the model developer's side as they must juggle multiple methods to evaluate their algorithms. In this paper, we present a single framework for analyzing the robustness, fairness, and explainability of a classifier. The framework, which is based on the generation of counterfactual explanations through a custom genetic algorithm, is flexible, model-agnostic, and does not require access to model internals. The framework allows the user to calculate robustness and fairness scores for individual models and generate explanations for individual predictions which provide a means for actionable recourse (changes to an input to help get a desired outcome). This is the first time that a unified tool has been developed to address three key issues pertaining towards building a responsible artificial intelligence system.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1145/3375627.3375812

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Towards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
Akhtar, N., & Mian, A. (2018) · IEEE Access · doi:10.1109/access.2018.2807385 · Cited by 2,021
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501
Efficient Search for Diverse Coherent Explanations
Russell, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287569 · Cited by 218

Flagged first, then by citations

Show all 9 references

Research works printed but not linked: 8

Rachel KE Bellamy Kuntal Dey Michael Hind Samuel C Hoffman Stephanie Houde Kalapriya Kannan Pranay Lohia Jacquelyn Martino Sameep Mehta Aleksandra Mojsilovic et al. 2018. Ai fairness 360: An extensible toolkit for detecting understanding and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018). · arXiv
Rachel K. E. Bellamy, Kuntal Dey, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Kalapriya Kannan, Pranay Lohia, Jacquelyn Martino, Sameep Mehta, Aleksandra Mojsilovic, Seema Nagar, Karthikeyan Natesan Ramamurthy, John Richards, Diptikalyan Saha, Prasanna Sattigeri, Moninder Singh, Kush R. Varshney, and Yunfeng Zhang. 2018. AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias. https: //arxiv.org/abs/1810.01943
Reuben Binns. 2017. Fairness in machine learning: Lessons from political philosophy. arXiv preprint arXiv:1712.03586 (2017). · arXiv
Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Dino Pedreschi, Franco Turini, and Fosca Giannotti. 2018. Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820 (2018). · arXiv
Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 93.
ZhouWang, Alan C Bovik, and Ligang Lu. 2002. Why is image quality assessment so difficult?. In Proceedings of International Conference on Acoustics, Speech and Signal Processing (CASSP. IEEE, IV--3313.
ZhouWang, Eero P Simoncelli, and Alan C Bovik. 2003. Multiscale structural similarity for image quality assessment. In The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, Vol. 2. Ieee, 1398--1402.
Tsui-Wei Weng, Huan Zhang, Pin-Yu Chen, Jinfeng Yi, Dong Su, Yupeng Gao, Cho-Jui Hsieh, and Luca Daniel. 2018. Evaluating the robustness of neural networks: An extreme value theory approach. arXiv preprint arXiv:1801.10578 (2018). · arXiv

Sorted by citations

Items 101–200 of 225

Feature-based Learning for Diverse and Privacy-Preserving Counterfactual Explanations
Vo, V., Le, T., Nguyen, V., Zhao, H., Bonilla, E. V., Haffari, G., & Phung, D. Q. (2022) · Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599343 · Cited by 22
Counterfactual Explanation of AI Models Using an Adaptive Genetic Algorithm With Embedded Feature Weights
AlJalaud, E., & Hosny, M. (2024) · IEEE Access · doi:10.1109/access.2024.3404043 · Cited by 15
Fairness Under Feature Exemptions: Counterfactual and Observational Measures
Dutta, S., Venkatesh, P., Mardziel, P., Datta, A., & Grover, P. (2021) · IEEE Transactions on Information Theory · doi:10.1109/tit.2021.3103206 · Cited by 14
Model-agnostic and Scalable Counterfactual Explanations via Reinforcement LearningPreprint
Samoilescu, R.-F., Looveren, A. V., & Klaise, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02597 · Cited by 30
Consistent Counterfactuals for Deep ModelsPreprint
Black, E., Wang, Z., Fredrikson, M., & Datta, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03109 · Cited by 15
FairCaipi: A Combination of Explanatory Interactive and Fair Machine Learning for Human and Machine Bias Reduction
Heidrich, L., Slany, E., Scheele, S., & Schmid, U. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5040076 · Cited by 14
Manipulation Risks in Explainable AI: The Implications of the Disagreement Problem
Goethals, S., Martens, D., & Evgeniou, T. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-74633-8_12 · Cited by 10
Evaluation of Instance-Based Explanations: An In-Depth Analysis of Counterfactual Evaluation Metrics, Challenges, and the CEval Toolkit
Bayrak, B., & Bach, K. (2024) · IEEE Access · doi:10.1109/access.2024.3410540 · Cited by 11
Counterfactual Explanations & Adversarial Examples - Common Grounds, Essential Differences, and Potential Transfers.Preprint
Freiesleben, T. (2020) · arXiv (Cornell University) · Cited by 10
Fair Normalizing FlowsPreprint
Balunović, M., Ruoss, A., & Vechev, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05937 · Cited by 10
Explainable Artificial Intelligence 101: Techniques, Applications and Challenges
Kurek, W., Pawlicki, M., Pawlicka, A., Kozik, R., & Choraś, M. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-4752-2_26 · Cited by 8
Data preprocessing to improve fairness in machine learning models: An application to the reintegration process of demobilized members of armed groups in Colombia
Gómez, A. A. R., Calderón-Benavides, L., & Espinosa, O. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.111193 · Cited by 8
Understanding the User Perception and Experience of Interactive Algorithmic Recourse Customization
Koh, S., Kim, B. H., & Jo, S. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3674503 · Cited by 8
Explainable AI (XAI)
Bialkova, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-56471-0_11 · Cited by 8
Automated Counterfactual Generation in Financial Model Risk Management
Gan, J., Zhang, S., Zhang, C., & Li, A. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671561 · Cited by 8
Towards causal algorithmic recourse
Karimi, A.-H., von Kügelgen, J., Schölkopf, B., & Valera, I. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_8 · Cited by 11
May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainability
Zhang, T., Yang, X. J., & Li, B. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2364986 · Cited by 12
Fair XIDS: Ensuring fairness and transparency in intrusion detection models
Chinu, & Bansal, U. (2024) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.8268 · Cited by 7
The disagreement dilemma in explainable AI: can bias reduction bridge the gap
Bhardwaj, N., & Parashar, G. (2025) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-025-02712-9 · Cited by 7
Artificial Intelligence, Machine Learning, and Natural Language Processing
Shoenbill, K. A., Kasthurirathne, S. N., & Mendonça, E. A. (2023) · Springer eBooks · doi:10.1007/978-3-031-29171-5_36 · Cited by 9
For Better or Worse: The Impact of Counterfactual Explanations’ Directionality on User Behavior in xAI
Kuhl, U., Artelt, A., & Hammer, B. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44070-0_14 · Cited by 9
SAC-FACT: Soft Actor-Critic Reinforcement Learning for Counterfactual Explanations
Ezzeddine, F., Ayoub, O., Andreoletti, D., & Giordano, S. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_12 · Cited by 7
Integrating Structural Causal Model Ontologies with LIME for Fair Machine Learning Explanations in Educational Admissions
Igoche, B. I., Matthew, O., Bednár, P., & GEGOV, A. E. (2024) · Journal of Computing Theories and Applications · doi:10.62411/jcta.10501 · Cited by 7
Transparent Latent Space Counterfactual Explanations for Tabular Data
Bodria, F., Guidotti, R., Giannotti, F., & Pedreschi, D. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032407 · Cited by 7
CeFlow: A Robust and Efficient Counterfactual Explanation Framework for Tabular Data Using Normalizing Flows
Duong, T. D., Li, Q., & Xu, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33377-4_11 · Cited by 7
On the Connection between Game-Theoretic Feature Attributions and Counterfactual Explanations
Albini, E., Sharma, S., Mishra, S., Dervovic, D., & Magazzeni, D. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604676 · Cited by 8
Self-citation
AP-GRIP evaluation framework for data-driven train delay prediction models: systematic literature review
Tiong, K. Y., Ma, Z., & Palmqvist, C.-W. (2025) · European Transport Research Review · doi:10.1186/s12544-024-00704-7 · Cited by 6
Taming the Triangle: On the Interplays Between Fairness, Interpretability, and Privacy in Machine Learning
Ferry, J., Aïvodji, U., Gambs, S., Huguet, M., & Siala, M. (2025) · Computational Intelligence · doi:10.1111/coin.70113 · Cited by 22
CARMA: A practical framework to generate recommendations for causal algorithmic recourse at scale
Majumdar, A., & Valera, I. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659003 · Cited by 7
Tooling for Developing Data-Driven Applications: Overview and Outlook
Weber, T., & Hußmann, H. (2022) · Mensch und Computer (MuC) · doi:10.1145/3543758.3543779 · Cited by 6
The Generation of Visually Credible Adversarial Examples with Genetic Algorithms
Bradley, J. R., & Blossom, A. P. (2023) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3582276 · Cited by 8
Robust Explanations for Human-Neural Multi-agent Systems with Formal Verification
Leofante, F., & Lomuscio, A. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43264-4_16 · Cited by 5
The Importance of Time in Causal Algorithmic Recourse
Beretta, I., & Cinquini, M. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_16 · Cited by 6
Efficient computation of contrastive explanations
Artelt, A., & Hammer, B. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534454 · Cited by 8
Improving Algorithmic Decision–Making in the Presence of Untrustworthy Training Data
Qi, W., & Chelmis, C. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671677 · Cited by 6
Counterfactual Explanations as Interventions in Latent SpacePreprint
Crupi, R., Castelnovo, A., Regoli, D., & González, B. S. M. (2021) · Research Square · doi:10.21203/rs.3.rs-626875/v1 · Cited by 6
Evolving Counterfactual Explanations with Particle Swarm Optimization and Differential Evolution
Andersen, H., Lensen, A., Browne, W. N., & Mei, Y. (2022) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec55065.2022.9870283 · Cited by 5
Explainability Metrics and Properties for Counterfactual Explanation Methods
Singh, V., Čyras, K., & Inam, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-15565-9_10 · Cited by 5
Sustainability for Artificial Intelligence Products and Services – Initial How-to for IT Practitioners
Lammert, D., Abdullai, L., Betz, S., & Porras, J. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.794 · Cited by 6
Counterfactual Contrastive Learning for Fine Grained Image Classification
Yin, C., Wang, J., Zhang, H., Feng, K., Shi, L., & Ma, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72341-4_12 · Cited by 5
Enhancing Explainable Artificial Intelligence: Using Adaptive Feature Weight Genetic Explanation (AFWGE) with Pearson Correlation to Identify Crucial Feature Groups
AlJalaud, E., & Hosny, M. (2024) · Mathematics · doi:10.3390/math12233727 · Cited by 6
Generating Counterfactual Explanations for Clustering Models Based on Their Equivalence to Classification Models
Karra, A., Vardakas, G., Pitoura, E., & Likas, A. C. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-96239-4_7 · Cited by 5
Producing Diverse Rashomon Sets of Counterfactual Explanations with Niching Particle Swarm Optimization Algorithms
Andersen, H., Lensen, A., Browne, W. N., & Mei, Y. (2023) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3583131.3590444 · Cited by 5
Counterfactuals in explainable artificial intelligence: Theory, algorithms, and applications
Chou, Y.-L. (. (2024) · Queensland University of Technology · doi:10.5204/thesis.eprints.248281 · Cited by 5
A Survey of Counterfactual Explanations: Definition, Evaluation, Algorithms, and Applications
Zhang, X., Dai, L., Peng, Q., Tang, R., & Li, X. (2023) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-20738-9_99 · Cited by 4
Framing Algorithmic Recourse for Anomaly Detection
Datta, D., Chen, F., & Ramakrishnan, N. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539344 · Cited by 7
Robust Algorithmic Recourse Under Model Multiplicity With Probabilistic Guarantees
Hamman, F., Noorani, E., Mishra, S., Magazzeni, D., & Dutta, S. (2024) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2024.3401407 · Cited by 4
Counterfactual and Prototypical Explanations for Tabular Data via Interpretable Latent Space
Piaggesi, S., Bodria, F., Guidotti, R., Giannotti, F., & Pedreschi, D. (2024) · IEEE Access · doi:10.1109/access.2024.3496114 · Cited by 4
A Functionally-Grounded Benchmark Framework for XAI Methods: Insights and Foundations from a Systematic Literature Review
Canha, D., Sylvain Kubler, A., Främling, K., & Fagherazzi, G. (2025) · ACM Computing Surveys · doi:10.1145/3737445 · Cited by 6
FASTER-CE: Fast, Sparse, Transparent, and Robust Counterfactual Explanations
Sharma, S. S. K., Gee, A. H., Henderson, J., & Ghosh, J. (2024) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-63223-5_14 · Cited by 4
Self-citation
Explainable artificial intelligence (XAI) for healthcare decision-making
Zeng, Z. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/155849 · Cited by 4
Propose and Review: Practical Bias Mitigation for Machine ClassificationPreprint
Li, T., Tang, Z., Lu, T., & Zhang, X. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4139244 · Cited by 5
Counterfactual ensembles for interpretable churn prediction: from real-world to privacy-preserving synthetic data
Tonati, S., Vece, M. D., Giannotti, F., & Pellungrini, R. (2025) · Machine Learning · doi:10.1007/s10994-025-06880-4 · Cited by 3
Ijuice: integer JUstIfied counterfactual explanations
Kuratomi, A., Miliou, I., Lee, Z., Lindgren, T., & Papapetrou, P. (2024) · Machine Learning · doi:10.1007/s10994-024-06530-1 · Cited by 3
Certifai: A Toolkit for Building Trust in AI Systems
Henderson, J., Sharma, S., Gee, A. H., Alexiev, V., Draper, S., Marin, C., Hinojosa, Y., Draper, C., Perng, M., Aguirre, L., et al. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/759 · Cited by 3
Self-citation
Explainable Global Fairness Verification of Tree-Based Classifiers
Calzavara, S., Cazzaro, L., Lucchese, C., & Marcuzzi, F. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00011 · Cited by 3
Flexible and Robust Counterfactual Explanations with Minimal Satisfiable Perturbations
Wang, Y., Qian, H., Liu, Y., Guo, W., & Miao, C. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614885 · Cited by 3
Counterfactual and Causal Analysis for AI-Based Modulation and Coding Scheme Selection
Hao, K., Moysen, J., & Özger, M. (2023) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps58843.2023.10464475 · Cited by 3
CounterFair: Group Counterfactuals for Bias Detection, Mitigation and Subgroup Identification
Kuratomi, A., Lee, Z., Tsaparas, P., Dinis, G., Pitoura, E., Lindgren, T., & Papapetrou, P. (2024) · Proceedings · doi:10.1109/icdm59182.2024.00025 · Cited by 3
FACEGroup: Feasible and Actionable Counterfactual Explanations for Group Fairness
Fragkathoulas, C., Papanikou, V., Pitoura, E., & Terzi, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06078-5_3 · Cited by 3
On Frank-Wolfe Optimization for Adversarial Robustness and Interpretability.Preprint
Tsiligkaridis, T., & Roberts, J. (2020) · arXiv (Cornell University) · Cited by 3
Amortized Generation of Sequential Counterfactual Explanations for Black-box Models.Preprint
Verma, S., Hines, K., & Dickerson, J. P. (2021) · arXiv (Cornell University) · Cited by 3
Counterfactual Generation Through Multi-objective Constrained OptimisationPreprint
Monteiro, W. R., & Reynoso-Meza, G. (2022) · Research Square · doi:10.21203/rs.3.rs-1325730/v1 · Cited by 3
The Role of Humanization and Robustness of Large Language Models in Conversational Artificial Intelligence for Individuals with Depression: A Critical Analysis (Preprint)Preprint
Ferrario, A., Sedláková, J., & Trachsel, M. (2024) · doi:10.2196/preprints.56569 · Cited by 3
Discrimination Induced by Algorithmic Recourse Objectives
Perello, N., Cousins, C., Zick, Y., & Grabowicz, P. A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732110 · Cited by 2
Using the K-associated Optimal Graph to Provide Counterfactual Explanations
da Silva, A. T., & Bertini, J. R. (2022) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee55066.2022.9882751 · Cited by 2
Model Transparency: Why Do We Care?
Papantonis, I., & Belle, V. (2023) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0011726300003393 · Cited by 2
Long-Short Term Memory Networks and Synthetic Data for Heavy Vehicle Rollover Prevention
Perboli, G., Tota, A., & Velardocchia, F. (2025) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2025.3579653 · Cited by 2
Quality‐Diversity Methods for the Modern Data Scientist
Stock, M., Hauwermeiren, D. V., Bernard De Baets, C., Taelman, S., Marzougui, D., & Haeverbeke, M. V. (2025) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.70047 · Cited by 3
Объяснительный искусственный интеллект в моделях поддержки принятия решений для Здравоохранения 5.0
Averkin, A. N., & Yarushev, S. (2023) · Computer Tools in Education · doi:10.32603/2071-2340-2023-2-41-61 · Cited by 3
Understanding Frank-Wolfe Adversarial Training
Tsiligkaridis, T., & Roberts, J. (2020) · Cited by 2
Dealing with Data Bias in Classification: Can Generated Data Ensure Representation and Fairness?
Duong, M. K., & Conrad, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39831-5_17 · Cited by 2
Semantic Meaningfulness: Evaluating Counterfactual Approaches for Real-World Plausibility and Feasibility
Höllig, J., Markus, A. F., de Slegte, J., & Bagave, P. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_32 · Cited by 2
XAI-Assisted Radio Resource Management: Feature Selection and SHAP Enhancement
Ruiz, N. S., Peesapati, S. K. G., & Moysen, J. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10279520 · Cited by 2
Explaining the Behavior of Black-Box Prediction Algorithms with Causal LearningPreprint
Sani, N., Malinsky, D., & Shpitser, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02482 · Cited by 16
Prototype-based Counterfactual Explanation for Causal Classification.Preprint
Duong, T. D., Li, Q., & Xu, G. (2021) · arXiv (Cornell University) · Cited by 2
FinTech, Regulation, and Cybercrime: Opportunities Arising From New TechnologiesPreprint
Achim, M. V., Pisoni, G., Mare, C., Moloney, M., Korba, S., Molnár, B., Będowska-Sójka, B., & Coita, I.-F. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4620106 · Cited by 2
Evolutionary Supervised Machine Learning
Miikkulainen, R. P. (2023) · Genetic and evolutionary computation · doi:10.1007/978-981-99-3814-8_2 · Cited by 1
FALE: Fairness-Aware ALE Plots for Auditing Bias in Subgroups
Giannopoulos, G., Sacharidis, D., Theologitis, N., Kavouras, L., & Emiris, I. Z. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-74627-7_37 · Cited by 1
Beyond Binary Boundaries—Exploring the Potential of Categorical Variables in Counterfactual Explanations
Hühn, P., & Hofer, S. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80122-8_11 · Cited by 1
Evolutionary Bias Identification with Embeddings
Buzelin, A., Aquino, Y., Estanislau, V., Bento, P., Dayrell, L., Malaquias, S., Santana, C., Evangelista, G. H. G., Grossi, C. S., Rigueira, P. B., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90065-5_21 · Cited by 1
Evolutionary Computation for Explainable Deep Learning
Zhou, R., & Hu, T. (2025) · Natural computing series · doi:10.1007/978-981-96-2540-6_4 · Cited by 1
Subgroup fairness based on shared counterfactuals
Kuratomi, A., Lee, Z., Tsaparas, P., Pitoura, E., Lindgren, T., Dinis, G., & Papapetrou, P. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02555-7 · Cited by 1
How Much Does Cluster Fairness Cost? A Counterfactual-Based Approach
Karra, A., Vardakas, G., Pitoura, E., & Likas, A. C. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19096-3_20 · Cited by 1
Explaining a Staff Rostering Problem by Mining Trajectory Variance Structures
Fyvie, M., McCall, J., Christie, L. A., Zăvoianu, A.-C., Brownlee, A. E. I., & Ainslie, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47994-6_27 · Cited by 1
Metaheuristic and Evolutionary Algorithms in Explainable Artificial Intelligence
Prabhu, H., Sane, A., Dhadwal, R., Siarry, P., & Valadi, J. K. (2024) · Computational intelligence methods and applications · doi:10.1007/978-981-99-9718-3_2 · Cited by 1
A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular DataPreprint
Oliveira, R., & Martens, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.04680 · Cited by 1
Counterfactual explanations for machine learning models on heterogeneous data
Wang, Y. (2023) · doi:10.32657/10356/169968 · Cited by 1
Influence-Driven Explanations for Bayesian Network ClassifiersPreprint
Rago, A., Albini, E., Baroni, P., & Toni, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05773
Nested Conceptual Graphs for Information Fusion Traceability
Laudy, C., & de Naurois, C. J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86982-3_2
Post-discovery Analysis of Anomalous SubsetsPreprint
Mulang, I. O., Ogallo, W., Tadesse, G. A., & Walcott-Bryant, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.14622
Handling Traceability in Graph Fusion for a Trustworthy Framework
de Naurois, C. J., & Laudy, C. (2021) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion49465.2021.9627035
Artificial Intelligence Accountability in Emergent Applications
Zini, J. E. (2023) · Advances in computer and electrical engineering book series · doi:10.4018/978-1-6684-6937-8.ch002
Evaluating the effectiveness of the Burden fairness metric
Challur, G., Tammana, P. B., Ramesh, S. V. N., & Dattathreya, K. G. (2022) · International Conference on Emerging Research in Electronics, Computer Science and Technology (ICERECT) · doi:10.1109/icerect56837.2022.10059682
The Importance of Time in Causal Algorithmic RecoursePreprint
Beretta, I., & Cinquini, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05082
Uso de agrupamento para alcançar explicabilidade global de modelos de aprendizado de máquina
Vieira, C. P. R. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.100.2023.tde-22052023-205242
LSTM Noise Robustness: A Case Study for Heavy Vehicles
Bruni, M. E., Perboli, G., & Velardocchia, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53966-4_23
Drawing Attributions From Evolved Counterfactuals
Jakubík, J., & Kwaśnicka, H. (2024) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3638530.3664122
Quantifying the Trade-Offs Between Dimensions of Trustworthy AI - An Empirical Study on Fairness, Explainability, Privacy, and Robustness
Kemmerzell, N., & Schreiner, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70893-0_10
Reasoning With and About Bias
Manganini, C., & Primiero, G. (2024) · Logic, argumentation & reasoning · doi:10.1007/978-3-031-77892-6_7

Authors: Sharma, S., Henderson, J., & Ghosh, J.
Affiliations: The University of Texas at Austin (US)
CognitiveScale, Austin, TX, USA
Venue: Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
Publisher: ACM
Published: 2020-02-07
Pages: 166-172
ISSN: 3065-8365 (ISSN-L)
DOI: 10.1145/3375627.3375812
OpenAlex: W2945151003
Cited by: 226
References: 9
Citations by year: 2026: 15 · 2025: 27 · 2024: 46 · 2023: 42 · 2022: 35 · 2021: 43 · 2020: 14
FWCI: 12.78
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations: Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
arXiv (Cornell University) (submittedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords: explainable AI, robustness, algorithmic fairness, counterfactual explanations, genetic algorithm, classifier evaluation, model-agnostic evaluation, recourse, responsible AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks