Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 7 of the 14 sources its claims cite were checked for support.

CLFormer: a cross-lingual transformer framework for temporal forgery localization

Open access
Cheng, Haonan, Liu, Hanyue, Cai, Juanjuan, Ye, Long · 2025 · Visual Intelligence

Abstract

Abstract Temporal forgery localization (TFL) is crucial in deepfake detection. It focuses on identifying subtle temporal manipulations within video content. However, the generalization capabilities of current TFL methods are limited, especially across different languages, which limits their performance in diverse environments. This limitation stems from two key factors. First, most existing datasets are English-centric. Second, there is inadequate learning from multi-modal information, where visual features are often prioritized over audio features. To address this gap, we created the Chinese audio-visual deepfake (CHAV-DF) dataset, which is the first dataset designed for the TFL in the Chinese context. This dataset provides a valuable benchmark for evaluating the TFL methods in cross-lingual settings. Additionally, we introduced a cross-lingual transformer framework (CLFormer), which prioritizes audio features and utilizes a pre-trained multi-lingual Wav2Vec2 to enhance cross-lingual generalization, while incorporating visual features to further refine TFL. Moreover, we incorporated a refinement module into CLFormer to enhance the accuracy of forgery localization. Experiments on the LAV-DF, CHAV-DF, and AV-Deepfake1M datasets demonstrate that CLFormer performs well in both same-language and cross-language settings. Specifically, CLFormer achieves an average precision (AP) of 57.68% at temporal intersection over union (tIoU) of 0.50 when trained on CHAV-DF and tested on LAV-DF, surpassing the state-of-the-art method by 47.59%, and validating its cross-language generalization capability.

Overview

CoChat Summary

## TL;DR

The paper introduces CHAV-DF, a Chinese audio-visual deepfake dataset for temporal forgery localization, and CLFormer, a cross-lingual transformer framework that emphasizes audio features via Wav2Vec2 plus a refinement module. The authors report strong same-language and cross-language results, including 57.68% AP at tIoU 0.50 when trained on CHAV-DF and tested on LAV-DF, which they say is 47.59% above the state of the art.

## Key findings

  • CHAV-DF contains 12,951 videos: 1,080 authentic and 11,871 with one manipulated segment, totaling 27.78 h; it is split into 9,099 training, 1,920 validation, and 1,932 test videos.
  • On LAV-DF, CLFormer reaches 99.33% AP at tIoU 0.50 and 70.07% AP at tIoU 0.95, outperforming the second-best method (VIGO) by 2.71% at 0.50 and 5.03% at 0.95, and improving average AR by 3.51%.
  • On AV-Deepfake1M, CLFormer improves over UMMAFormer by 14.42% in AP at tIoU 0.95 and by 6.71% in average AP.
  • In cross-language testing, training on CHAV-DF and testing on LAV-DF yields 57.68% AP at tIoU 0.50, surpassing the state of the art by 47.59%; the paper also reports 13.06% average AP and 56.72% average AR when trained on LAV-DF and tested on CHAV-DF.

## Methods

  • The paper constructs CHAV-DF from CUC-RED real videos (12 broadcasting/hosting students, 90 sentences each) and generates manipulations by modifying text, synthesizing fake audio with three Chinese TTS systems, and creating local fake visuals with Wav2Lip.
  • CLFormer extracts visual features with TSN and audio features with pre-trained Wav2Vec2, concatenates them, applies a multi-level transformer-based TFL detector, and then refines boundaries with a refinement module inspired by RefineTAD.
  • Experiments evaluate CLFormer on LAV-DF, AV-Deepfake1M, and CHAV-DF using AP and AR at tIoU thresholds 0.50, 0.75, and 0.95, with training at 25 fps and audio sampled at 16 kHz.

## Limitations

  • The paper states that current TFL methods still struggle with high-precision temporal localization and increasingly sophisticated forgery scenarios.
  • The authors note that CHAV-DF is Chinese-only and say future work should expand the dataset to more languages from different linguistic families.
  • Evident from the text: many reported tables are partially garbled in the provided excerpt, but the paper itself still clearly states the headline results and dataset statistics.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s44267-025-00084-z

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 1 Not valid · 7 Not checked · 51 Own results and interpretations

26 more claims

Create a free account to see all 62 claims and to verify the 4 references still open.

See all claims — free account
  • Probably not a substantial claim. 10
  • It may state two separate claims as one. 25

Create a free account to see these claims.

Citations

Cites

Show all 33 references

Cited by

See all 2

Metadata

Authors
Cheng, H., Liu, H., Cai, J., & Ye, L.
Affiliations
  • State Key Laboratory of Media Convergence and Communication (CN)
  • Communication University of China (CN)
Corresponding author
Cai, Juanjuan
Venue
Visual Intelligence
Published
2025-07-11
Volume
3
Issue
1
ISSN
  • 2731-9008 (ISSN-L)
  • 2097-3330
OpenAlex
W4412193028
Cited by
2
References
33
Citations by year
2026: 2
FWCI
0.70
Type
journal article
Language
en
Open access
Licence
Locations
  • Visual Intelligence (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Natural Science Foundation of China (62201524)
  • Beijing Natural Science Foundation (4252011)
  • Fundamental Research Funds for the Central Universities (CUC25CGJ01)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords
deepfake detection, cross-lingual generalization, wav2vec 2.0, audiovisual integration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CLFormer: a cross-lingual transformer framework for temporal forgery localization. https://app.cochat.ai/papers/10.1007/s44267-025-00084-z
The paper
Cheng, H., Liu, H., Cai, J., & Ye, L. (2025). CLFormer: a cross-lingual transformer framework for temporal forgery localization. Visual Intelligence. https://doi.org/10.1007/s44267-025-00084-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.