CoChat

WaveConViT: Wavelet-Based Convolutional Vision Transformer for Cross-Manipulation Deepfake Video Detection

Open access
Atamna, Mehdi, Tkachenko, Iuliia, Miguet, Serge · 2025 · Lecture Notes in Computer Science

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 8 of the 12 sources its claims cite were checked for support.

Overview

CoChat Summary

TL;DR

WaveConViT is a spatio-temporal deepfake video detector that combines an ImageNet-initialized ConvNeXt-T, a ViT, and a DWT-based high-frequency branch with cross-attention. On FaceForensics++, it reaches 97.12% accuracy and 96.46 AUC with 10-frame sequences and a frame skip of 2, and it also outperforms baselines in cross-dataset generalization.

Key findings

  • In the known-manipulation setting on FF++, WaveConViT 10f, s = 2 achieves 97.12% accuracy and 96.46 AUC, beating the best listed baseline accuracy (ConvNeXt-T at 96.79%) and AUC (Convolutional Cross ViT at 94.23).
  • In cross-manipulation testing after training on FF++, WaveConViT reaches 71.33% accuracy / 73.29 AUC on Celeb-DF with 10f, s = 1, and 84.40% accuracy / 79.37 AUC on DF-1.0 with 20f, s = 2.
  • The paper reports that adding the cross-attention module improves generalization accuracy by 0.73% on Celeb-DF and 1.6% on DF-1.0.
  • The DWT-based high-frequency branch is reported to outperform the SRM-based alternative for cross-dataset performance, and the RGB branch alone outperforms the high-frequency branch when each is used by itself.

Methods

  • The model has two spatio-temporal branches: an RGB branch using an ImageNet-1K-initialized ConvNeXt-T followed by a 2-layer, 4-head ViT, and a high-frequency branch that applies a single-level 2D Haar DWT before the same kind of feature extractor.
  • A cross-attention module fuses the RGB and high-frequency streams after the ConvNeXt-T feature extraction stage; the two ViT outputs are concatenated and passed to a 2-layer MLP classification head for binary classification.
  • Experiments use FaceForensics++ (1,000 real / 5,000 fake), Celeb-DF (590 real / 5,639 fake), and DeeperForensics-1.0 std (1,000 fake); videos are preprocessed by taking the first 120 frames, detecting/cropping faces with MTCNN, resizing to 224×224, and sampling sequences of 10, 20, or 60 frames with optional frame skipping.

Limitations

  • The paper does not report a separate external validation on datasets beyond FF++, Celeb-DF, and DF-1.0, so broader real-world generalization remains untested in the text.
  • The authors note that performance in cross-manipulation depends heavily on the target dataset and sequence configuration; this makes the best setting dataset-specific rather than universal.
  • The paper itself notes that longer sequences may contain richer temporal information but yield fewer training/test data points; this is a trade-off that can limit performance, especially for the ViT-based approach.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/978-3-031-88223-4_16

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

8 Valid · 1 Not valid · 5 Not checked · 40 Own results and interpretations

21 more claims

Create a free account to see all 54 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 17
  • The quote only partly states this claim. 2
  • It may state two separate claims as one. 12

Create a free account to see these claims.

Citations

Cites

Show all 37 references

Research works printed but not linked: 2

  1. Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. In: International Conference on Learning Representations (2019)
  2. Luo, Y., Zhang, Y., Yan, J., Liu, W.: Generalizing face forgery detection with high-frequency features. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 16317–16326, June 2021 · DOI · Paper page

Cited by

See all 1

Metadata

Authors
Atamna, M., Tkachenko, I., & Miguet, S.
Affiliations
Lyon 1 Université (FR)
Corresponding author
Atamna, Mehdi
Venue
Lecture Notes in Computer Science
Published
2025
Pages
211-225
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W4406779112
Cited by
1
References
31
Citations by year
2026: 1
FWCI
0.78
Type
conference paper
Language
en
Open access
Licence
Locations
  • Lecture notes in computer science (publishedVersion)
  • HAL (Le Centre pour la Communication Scientifique Directe) (submittedVersion, other-oa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
Keywords
deepfake detection, face manipulation, vision transformer, discrete wavelet transform, frame skipping, temporal sampling, high-frequency characteristics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: WaveConViT: Wavelet-Based Convolutional Vision Transformer for Cross-Manipulation Deepfake Video Detection. https://app.cochat.ai/papers/10.1007/978-3-031-88223-4_16
The paper
Atamna, M., Tkachenko, I., & Miguet, S. (2025). WaveConViT: Wavelet-Based Convolutional Vision Transformer for Cross-Manipulation Deepfake Video Detection. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-031-88223-4_16

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.