The DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
GANterfactual—Counterfactual Explanations for Medical Non-experts Using Generative Adversarial Learning
Open accessAbstract
With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art tools to explain such classifiers rely on visual highlighting of important areas of the input data. Contrary, counterfactual explanation systems try to enable a counterfactual reasoning by modifying the input image in a way such that the classifier would have made a different prediction. By doing so, the users of counterfactual explanation systems are equipped with a completely different kind of explanatory information. However, methods for generating realistic counterfactual explanations for image classifiers are still rare. Especially in medical contexts, where relevant information often consists of textural and structural information, high-quality counterfactual images have the potential to give meaningful insights into decision processes. In this work, we present GANterfactual , an approach to generate such counterfactual image explanations based on adversarial image-to-image translation techniques. Additionally, we conduct a user study to evaluate our approach in an exemplary medical use case. Our results show that, in the chosen medical use-case, counterfactual explanations lead to significantly better results regarding mental models, explanation satisfaction, trust, emotions, and self-efficacy than two state-of-the art systems that work with saliency maps, namely LIME and LRP.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, a limitation of this method is its lack of flexibility and strong model-specificity since a slight change in the task would require the acquisition of a new dataset alongside another training of the CycleGAN and the binary classifier.”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [32]
In the citing paper
“The authors stated that counterfactual explanations led to significantly better results regarding mental models, explanation satisfaction, and trust.”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [32]
In the citing paper
“Dependence on binary classifier”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [32]
In the citing paper
“Intuitive explainability by contrastive setting, even for non-experts”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [32]
In the citing paper
“Lack of flexibility”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Proceedings of IEEE International Conference on Computer Vision
(1995) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466933 · Cited by 13,117
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Flagged first, then by citations
1 of the 53 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Hall, 2018, Introduction to Machine Learning Interpretability
- Stone, 2016, Artificial Intelligence and Life in 2030. One Hundred Year Study on Artificial Intelligence: Report of the 2015-2016 Study Panel
Cited by
Sorted by citations
Items 101–118 of 118
Asl, M. M. B., & Spiotta, A. M. (2026) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2026.03.011
Developping and exploring the interest of deep learning approaches in the field of multi-omics data
Beaude, A. (2024) · theses.fr (ABES) · doi:10.70675/717fb1ffz8eaaz47d6z88c4zec38f96c9ae2
Towards explainable and interpretable deep neural networks
Jeanneret, G. (2024) · theses.fr (ABES) · doi:10.70675/ed07566bze7a3z4daazb9d7z03fd028f66ce
Eing, L., Stippler, A., Conati, C., Künzell, S., André, E., & Mertes, S. (2026) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3811427.3811437
Self-citationThieu, V. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106555
Plausible Visual Counterfactual Explanations in Latent Space with Normalizing Flows
Lenkiewicz, Ł., Musiałek, M., Furman, O., & Zięba, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29924-6_25
Towards HCXAI: Explainability Preferences of Healthcare Professionals
Cadena-Yanez, M., Bernardini, A., & Gómez, M. (2026) · AI · doi:10.3390/ai7070247
COLLECT: A Counterfactual Oral Lesion Library for Trustworthy AI Evaluation
Tafti, K. T., D’Souza, Z., Ajam, A., Chauvin, P., Magalhães, M. A. O., Fuoco, J., Sperandio, F. F., Al-Shehri, M. Y., Tichý, A., Tamimi, F., et al. (2026) · Journal of Dental Research · doi:10.1177/00220345261466240
Challenges in Evaluating Explanation Methods for Static and Evolving Data
Stefanowski, J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-36806-5_1
Discovering knowledge in panoramic radiographs with XAI: a Thai youth study (aged 7–25)
Hirunchavarod, N., Sributsayakarn, N., Pornprasertsuk‐Damrongsri, S., Jirarattanasopha, V., & Intharah, T. (2026) · Scientific Reports · doi:10.1038/s41598-026-66852-z
Kaushik, P., Meena, A. K., Chythanya, K. R., Haldorai, A., Kumar, R., & Kumar, J. D. (2026) · International Conference on Sustainable Computing and Integrated Communication in Changing Landscape of AI (ICSCAI) · doi:10.1109/icscai68849.2026.11648702
Salahuddin, Z., Kuang, S., Ibrahim, A., Widaatalla, Y., Miclea, R. L., Morin, O., Behr, M. S., Kop, M. P. M., Marcelissen, T. A. T., Zondervan, P. J., et al. (2026) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2026.103518
UbiQVision: Spatial Dempster–Shafer fusion of XAI attributions for reliable deep vision ensembles
Dubey, A., Anžel, A., İlgen, B., & Hattab, G. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101000
BeeCF: Artificial bee colony based counterfactual explanations for healthcare recommendation systems
Muyanlı, Ö., Okay, F. Y., Kök, İ., & Özdemi̇r, S. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116444
Ji, C. (2026) · Neuroscience Informatics · doi:10.1016/j.neuri.2026.100296
Counterfactual Reasoning to Executable Clinical Guidelines: A DMN-Based Framework
Maleki, C., Bertrand, Y., & Gailly, F. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00100
Automatic Diagnostic Tools in Dermatology: Current State and Future Directions
Han, S. S., & Cho, S. I. (2026) · Springer eBooks · doi:10.1007/978-3-032-37598-8_11
Metadata
- Authors
- Mertes, S., Huber, T., Weitz, K., Heimerl, A., & André, E.
- Affiliations
- University of Augsburg (DE)
- Corresponding author
- Mertes, Silvan
- Venue
- Frontiers in Artificial Intelligence
- Publisher
- Frontiers Media SA
- Published
- 2022-04-08
- Volume
- 5
- Pages
- 825565-825565
- ISSN
- 2624-8212 (ISSN-L)
- PMC
- PMC9024220
- OpenAlex
- W3187709298
- Cited by
- 119
- References
- 53
- Citations by year
- 2026: 32 · 2025: 34 · 2024: 31 · 2023: 16 · 2022: 6
- FWCI
- 7.13
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Artificial Intelligence (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- OPUS (Augsburg University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft
- Bayerisches Staatsministerium für Wissenschaft, Forschung und Kunst
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- counterfactual explanations, generative adversarial networks, image-to-image translation, medical image classification, explainable AI, adversarial perturbation generation, non-expert users, user study, mental models, trust in AI, self-efficacy, saliency maps, lime, LRP
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
