CoChat

From Black Boxes to Glass Boxes: Explainable AI for Trustworthy Deepfake Forensics

Open access
Qian, Hanwei, Xia, Lingling, Ge, Ruihao, Fan, Yiming, Wang, Qun, Jing, Zhengjun · 2025 · Cryptography

The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index; 11 of the 32 sources its claims cite were checked for support.

Abstract

Systematic review of explainable deepfake detection methods, categorizing forensic, model-centric, multimodal, and natural-language explanation approaches and emphasizing trustworthy forensics.

Overview

CoChat Summary

## TL;DR

This is a survey paper on explainable AI for deepfake forensics, arguing that high detection accuracy alone is not enough for high-stakes use because detectors must also provide trustworthy, human-understandable explanations. It organizes the field into forensic-analysis methods, model-centric explainability, and multimodal/natural-language explanations, and also reviews evaluation metrics and specialized datasets.

## Key findings

  • The paper categorizes explainable deepfake detection into three main approaches: forensic analysis, model-centric methods, and multimodal/natural-language explanations.
  • It argues that the field has evolved from physical/algorithmic artifact detection (e.g., PRNU, convolutional traces, residuals) toward model-centric explanations and then to large multimodal models that generate human-readable reasoning.
  • For evaluation, it highlights quantitative explainability metrics proposed by Baldassarre et al. that assess visual quality (smoothness, spatial locality, sparsity) and informativeness, and notes that standard deepfake metrics like Accuracy, AUC, and EER do not measure interpretability.
  • On data, it notes that newer explainability-oriented datasets such as DDL contain 1.8 million samples, 75 manipulation types, and fine-grained annotations, while ExDDV adds clicks and textual descriptions.

## Methods

  • The paper is a systematic review/survey of explainable deepfake detection methods, not an experimental study.
  • It synthesizes prior work across forensic traces, post hoc XAI, interpretable architectures, multimodal frameworks, metrics, and datasets.
  • Its main analysis is a taxonomy and conceptual comparison of methods, discussing strengths, limitations, and research directions grounded in the cited literature.

## Limitations

  • The paper does not report original experiments or new benchmark results; this is evident from the text because it is a review and does not present a study sample or empirical protocol.
  • It explicitly states that many existing explanations are still evaluated subjectively or with metrics not tailored to deepfake forensics, and that explanation fidelity remains a concern.
  • It also states that generalization to unseen forgery techniques and robustness against anti-forensic/adversarial attacks remain open problems.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/cryptography9040061

Cites

66 of 66 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

9 Valid · 5 Not valid · 19 Not checked · 58 Own results and interpretations

32 more claims · 1 with their cited sources checked

Create a free account to see all 91 claims and to verify the 13 references still open.

See all claims — free account
  • Probably not a substantial claim. 33
  • It may state two separate claims as one. 35

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 66 references

Research works printed but not linked: 6

  1. Koopman, M., Rodriguez, A.M., and Geradts, Z. (2018, January 29–31). Detection of deepfake video manipulation. Proceedings of the 20th Irish Machine Vision and Image Processing Conference (IMVIP), Belfast, UK.
  2. Cozzolino, D., Poggi, G., and Verdoliva, L. (2019, January 16–20). Extracting camera-based fingerprints for video forensics. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.
  3. Khan, S. (2022). Explainable Deepfake Detection Using Deep Learning. [Master’s Thesis, NED University of Engineering and Technology].
  4. Pellcier, A.L., Li, Y., and Angelov, P. (2023, January 18–24). PUDD: Prototype-based Unified Framework for Deepfake Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.
  5. Jia, S., Kundu, R., Balachandran, A., Moreira, D., and Roy-Chowdhury, A.K. (2024). Common Sense Reasoning for Deepfake Detection. arXiv.
  6. Yan, H., Han, J., Jiang, Y., Yan, B., Liu, J., Wang, X., and Lyu, S. (2024). X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection. arXiv.

Cited by

See all 10

Metadata

Authors
Qian, H., Xia, L., Ge, R., Fan, Y., Wang, Q., & Jing, Z.
Affiliations
  • Department of Computer Information and Cybersecurity, Jiangsu Police Institute, Nanjing 210031, China
  • College of Information Science and Technology & Artificial Intelligence, Nanjing Forestry University, Nanjing 210037, China
  • Jiangsu University of Technology (CN)
Corresponding author
Xia, Lingling
Venue
Cryptography
Publisher
MDPI AG
Published
2025-09-26
Volume
9
Issue
4
Pages
61
ISSN
2410-387X (ISSN-L)
OpenAlex
W4414554223
Cited by
10
References
36
Citations by year
2026: 10
FWCI
3.47
Type
journal article
Language
en
Open access
Locations
  • Cryptography (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • MOE Industry-University Collaborative Education Project
  • Philosophy and Social Sciences Research Project of Universities in Jiangsu Province (2024SJYB0345, 2023SJYB0464, 2023SJYB0468)
  • “Cyberspace Security” construction project of key disciplines in Jiangsu Province during the “14th Five-Year Plan”
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, explainable AI, deepfake forensics, model interpretability, post-hoc explanation, multimodal explanations, natural language explanations, online misinformation, trustworthy AI, forensic analysis, evaluation dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: From Black Boxes to Glass Boxes: Explainable AI for Trustworthy Deepfake Forensics. https://app.cochat.ai/papers/10.3390/cryptography9040061
The paper
Qian, H., Xia, L., Ge, R., Fan, Y., Wang, Q., & Jing, Z. (2025). From Black Boxes to Glass Boxes: Explainable AI for Trustworthy Deepfake Forensics. Cryptography. https://doi.org/10.3390/cryptography9040061

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.