CoChat

Locate and Verify: A Two-Stream Network for Improved Deepfake Detection

Open access
Shuai, Chao, Zhong, Jieming, Wu, Shuang, Lin, Feng, Wang, Zhibo, Ba, Zhongjie, Liu, Zhenguang, Cavallaro, Lorenzo, Ren, Kui · 2023 · Proceedings of the 31st ACM International Conference on Multimedia

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Abstract

Deepfake has taken the world by storm, triggering a trust crisis. Current deepfake detection methods are typically inadequate in generalizability, with a tendency to overfit to image contents such as the background, which are frequently occurring but relatively unimportant in the training dataset. Furthermore, current methods heavily rely on a few dominant forgery regions and may ignore other equally important regions, leading to inadequate uncovering of forgery cues.

Overview

Integrity signals

Registry

Crossref · 10.1145/3581783.3612386

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 46 references

Research works printed but not linked: 12

  1. Brian Dolhansky, Russ Howes, Ben Pflaum, Nicole Baram, and Cristian Canton Ferrer. 2019. The deepfake detection challenge (dfdc) preview dataset. arXiv preprint arXiv:1910.08854 (2019). · arXiv
  2. Shichao Dong, Jin Wang, Renhe Ji, Jiajun Liang, Haoqiang Fan, and Zheng Ge. 2022b. Towards A Robust Deepfake Detector: Common Artifact Deepfake Detection Model. arXiv preprint arXiv:2210.14457 (2022). · arXiv
  3. Shichao Dong, Jin Wang, Jiajun Liang, Haoqiang Fan, and Renhe Ji. 2022c. Explaining Deepfake Detection by Analysing Image Matching. In Computer Vision-ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XIV. Springer, 18--35.
  4. Joel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer, Dorothea Kolossa, and Thorsten Holz. 2020. Leveraging frequency analysis for deep fake image recognition. In International conference on machine learning. PMLR, 3247--3258.
  5. Jiazhi Guan, Hang Zhou, Zhibin Hong, Errui Ding, Jingdong Wang, Chengbin Quan, and Youjian Zhao. 2022. Delving into sequential patches for DeepFake detection. arXiv preprint arXiv:2207.02803 (2022). · arXiv
  6. R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, and Yoshua Bengio. 2018. Learning deep representations by mutual information estimation and maximization. arXiv preprint arXiv:1808.06670 (2018). · arXiv
  7. Jin-Hwa Kim, Kyoung-Woon On, Woosang Lim, Jeonghee Kim, Jung-Woo Ha, and Byoung-Tak Zhang. 2016. Hadamard product for low-rank bilinear pooling. arXiv preprint arXiv:1610.04325 (2016). · arXiv
  8. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
  9. Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. 2019. Celeb-df (v2): a new dataset for deepfake forensics. arXiv preprint arXiv:1909.12962, Vol. 4 (2019). · arXiv
  10. Zihan Liu, Hanyi Wang, and Shilin Wang. 2022a. Cross-Domain Local Characteristic Enhanced Deepfake Video Detection. In Proceedings of the Asian Conference on Computer Vision. 3412--3429.
  11. Zhenguang Liu, Sifan Wu, Chejian Xu, Xiang Wang, Lei Zhu, Shuang Wu, and Fuli Feng. 2022b. Copy Motion From One to Another: Fake Motion Video Generation. arXiv preprint arXiv:2205.01373 (2022). · arXiv
  12. Wanyi Zhuang, Qi Chu, Zhentao Tan, Qiankun Liu, Haojie Yuan, Changtao Miao, Zixiang Luo, and Nenghai Yu. 2022. UIA-ViT: Unsupervised inconsistency-aware method based on vision transformer for face forgery detection. In Computer Vision-ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part V. Springer, 391--407.

Cited by

See all 57

Metadata

Authors
Shuai, C., Zhong, J., Wu, S., Lin, F., Wang, Z., Ba, Z., Liu, Z., Cavallaro, L., & Ren, K.
Affiliations
  • Zhejiang University (CN)
  • Black Sesame Technologies, Singapore, Singapore
  • University College London (GB)
Venue
Proceedings of the 31st ACM International Conference on Multimedia
Publisher
ACM
Published
2023-10-26
Pages
7131-7142
OpenAlex
W4387968020
Cited by
55
References
44
Citations by year
2026: 14 · 2025: 22 · 2024: 19
FWCI
5.89
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Multimedia (ACM MM) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • the National Natural Science Foundation of China (62172359)
  • the National Key R\&D Program of China (2020AAA0107700)
  • the Key R\&D Program of Zhejiang Province (No. 2023C01217)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, two-stream network, generalizability, video forgery detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Locate and Verify: A Two-Stream Network for Improved Deepfake Detection. https://app.cochat.ai/papers/10.1145/3581783.3612386
The paper
Shuai, C., Zhong, J., Wu, S., Lin, F., Wang, Z., Ba, Z., Liu, Z., Cavallaro, L., & Ren, K. (2023). Locate and Verify: A Two-Stream Network for Improved Deepfake Detection. Proceedings of the 31st ACM International Conference on Multimedia. https://doi.org/10.1145/3581783.3612386

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.