The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models
Open accessAbstract
Concerns within the machine learning community and external pressures from regulators over the vulnerabilities of machine learning algorithms have spurred on the fields of explainability, robustness, and fairness. Often, issues in explainability, robustness, and fairness are confined to their specific sub-fields and few tools exist for model developers to use to simultaneously build their modeling pipelines in a transparent, accountable, and fair way. This can lead to a bottleneck on the model developer's side as they must juggle multiple methods to evaluate their algorithms. In this paper, we present a single framework for analyzing the robustness, fairness, and explainability of a classifier. The framework, which is based on the generation of counterfactual explanations through a custom genetic algorithm, is flexible, model-agnostic, and does not require access to model internals. The framework allows the user to calculate robustness and fairness scores for individual models and generate explanations for individual predictions which provide a means for actionable recourse (changes to an input to help get a desired outcome). This is the first time that a unified tool has been developed to address three key issues pertaining towards building a responsible artificial intelligence system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, counterfactual reasoning is claimed to be a key mechanism for explaining adaptive behavior in a changing environment [25], [26].”
From A Survey of Contrastive and Counterfactual Explanation Generation Methods for Explainable Artificial Intelligence (2021) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Towards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
Akhtar, N., & Mian, A. (2018) · IEEE Access · doi:10.1109/access.2018.2807385 · Cited by 2,021
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501
Efficient Search for Diverse Coherent Explanations
Russell, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287569 · Cited by 218
Research works printed but not linked: 8
- Rachel KE Bellamy Kuntal Dey Michael Hind Samuel C Hoffman Stephanie Houde Kalapriya Kannan Pranay Lohia Jacquelyn Martino Sameep Mehta Aleksandra Mojsilovic et al. 2018. Ai fairness 360: An extensible toolkit for detecting understanding and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018). · arXiv
- Rachel K. E. Bellamy, Kuntal Dey, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Kalapriya Kannan, Pranay Lohia, Jacquelyn Martino, Sameep Mehta, Aleksandra Mojsilovic, Seema Nagar, Karthikeyan Natesan Ramamurthy, John Richards, Diptikalyan Saha, Prasanna Sattigeri, Moninder Singh, Kush R. Varshney, and Yunfeng Zhang. 2018. AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias. https: //arxiv.org/abs/1810.01943
- Reuben Binns. 2017. Fairness in machine learning: Lessons from political philosophy. arXiv preprint arXiv:1712.03586 (2017). · arXiv
- Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Dino Pedreschi, Franco Turini, and Fosca Giannotti. 2018. Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820 (2018). · arXiv
- Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 93.
- ZhouWang, Alan C Bovik, and Ligang Lu. 2002. Why is image quality assessment so difficult?. In Proceedings of International Conference on Acoustics, Speech and Signal Processing (CASSP. IEEE, IV--3313.
- ZhouWang, Eero P Simoncelli, and Alan C Bovik. 2003. Multiscale structural similarity for image quality assessment. In The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, Vol. 2. Ieee, 1398--1402.
- Tsui-Wei Weng, Huan Zhang, Pin-Yu Chen, Jinfeng Yi, Dong Su, Yupeng Gao, Cho-Jui Hsieh, and Luca Daniel. 2018. Evaluating the robustness of neural networks: An extreme value theory approach. arXiv preprint arXiv:1801.10578 (2018). · arXiv
Cited by
Sorted by citations
Items 201–225 of 225
Ensemble Counterfactual Explanations for Churn Analysis
Tonati, S., Vece, M. D., Pellungrini, R., & Giannotti, F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-78980-9_21
Zuin, G. L., & Veloso, A. (2024) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom63139.2024.00359
Fyvie, M., McCall, J., & Christie, L. A. (2025) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3731456
CausalBioCF: Causal Counterfactuals for Machine Learning Interpretability
Furlanetto, G. C., Baldassin, A., & Manacero, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96997-3_13
GraCo: Towards GRammar Assisted COunterfactuals
Singh, D. K., de Lima, A., de Bulnes, D. R. F., & Ryan, C. (2025) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3712255.3726604
Why Are You Wrong? Counterfactual Explanations for Language Grounding with 3D Objects
Preintner, T., Yuan, W., Huang, Q., König, A., Bäck, T., Raponi, E., & van Stein, B. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227256
UGCE: User-Guided Incremental Counterfactual Exploration
Fragkathoulas, C., & Pitoura, E. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229277
TWEEF: Trustworthiness Estimation and Enhancement Framework for Machine Learning Models
Ugalde, J., Salas, R., Torres, R., Velandia, D., Bariviera, A. F., Estévez, P. A., & Godoy, M. P. (2026) · Applied Sciences · doi:10.3390/app16021077
Counterfactual Training: Teaching Models Plausible and Actionable Explanations
Altmeyer, P., Buszydlik, A., Arie Van Deursen, A., & Liem, C. C. S. (2026) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00018
Cognitive Meta-Learning-Based AI Models for Multimodal Signals
Bose, A., Das, B., Das, C., & Mandal, A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-40379-8.00011-9
Actionable counterfactual explanation generation via multi-objective optimization
Adedigba, A. P., Ajani, O. S., & Mallipeddi, R. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114355
Bourgeade, T. (2022) · theses.fr (ABES) · doi:10.70675/6610d333zd0eez4db5z8c67zfa30bac6acf3
A Neural-Symbolic learning framework to produce interpretable predictions for image classification
Bennetot, A. (2022) · theses.fr (ABES) · doi:10.70675/2b59f598z2028z49afz8a20z29b21f19f394
Towards Reliable Post Hoc Explanations for Machine Learning on Tabular Data and their Applications
Ayad, C. W. (2024) · theses.fr (ABES) · doi:10.70675/9e4de1adz26e2z41d1z9451z80421221b06d
Campbell, F. S., & Moskovitch, Y. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3802081
Out of Order: On the Importance of Word Positions in Explaining Text Classification
Stockdiek, J. L., Britta, G., Griesbach, M., & Grimme, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21477-5_29
A hybrid explainable intrusion detection system for fair and trustworthy cybersecurity
Chinu, & Urvashi (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111218
Ezzeddine, F., Giordano, S., & Ayoub, O. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1746910 · Cited by 5
On the Interplay of Explainability and Fairness in AI: A Survey
Fragkathoulas, C., Papanikou, V., Karidi, D. P., & Pitoura, E. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3706635
Predictive discovery of sustainable biopolymers for circularity by design
Shrestha, S., Li, Y., Le, N. U. T., & Chen, P. (2026) · Chem Circularity · doi:10.1016/j.checir.2026.100070
Kawazura, Y., & Saitou, D. (2026) · IEEE Access · doi:10.1109/access.2026.3727143
ESTI: Evolutionary Signal and Time-Series Inspection for Auditing ECG Classifiers
Aquino, Y., Bento, P., Buzelin, A., Chagas, A., Malaquias, S., Estanislau, V., Meira, W., & Pappa, G. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36226-1_24
Expert-Guided Counterfactual Explanations for Credit Risk
Benassi, R., Paganelli, M., Aloe, G., Bagli, E., Carducci, M. C., Giuffrida, P., Lavecchia, N., Squadrani, M., Oliva, E. M. R., Vincini, M., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39820-8_25
Evaluation of Plausibility and Robustness in Counterfactual Explanations
Benavides, G. M., Bequer, E. D. S., Lorenzo, M. M. G., & Bello, R. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-29288-9_2
Metadata
- Authors
- Sharma, S., Henderson, J., & Ghosh, J.
- Affiliations
- The University of Texas at Austin (US)
- CognitiveScale, Austin, TX, USA
- Venue
- Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2020-02-07
- Pages
- 166-172
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W2945151003
- Cited by
- 226
- References
- 9
- Citations by year
- 2026: 15 · 2025: 27 · 2024: 46 · 2023: 42 · 2022: 35 · 2021: 43 · 2020: 14
- FWCI
- 12.78
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, robustness, algorithmic fairness, counterfactual explanations, genetic algorithm, classifier evaluation, model-agnostic evaluation, recourse, responsible AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
