Locate and Verify: A Two-Stream Network for Improved Deepfake Detection
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Deepfake has taken the world by storm, triggering a trust crisis. Current deepfake detection methods are typically inadequate in generalizability, with a tendency to overfit to image contents such as the background, which are frequently occurring but relatively unimportant in the training dataset. Furthermore, current methods heavily rely on a few dominant forgery regions and may ignore other equally important regions, leading to inadequate uncovering of forgery cues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · cited 7×
“Xception-Reg [9] utilizes an attention mechanism to highlight informative regions, thereby improving the binary classification.”
MethodInfluentialFaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 9×
“, FaceForensics++ [41], two versions of CelebDF [30, 31], DeepFakeDetection [2], Deepfake Detection Challenge preview [11] and DeeperForensics 1.”
MethodInfluentialRich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144 · cited 8×
“• We propose three functional modules in our model to take full advantage of RGB images and SRM noise residuals, by combining multi-modal features and multi-scale patch features.”
MethodInfluentialCeleb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 6×
“, FaceForensics++ [41], two versions of CelebDF [30, 31], DeepFakeDetection [2], Deepfake Detection Challenge preview [11] and DeeperForensics 1.”
MethodInfluentialFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Research works printed but not linked: 12
- Brian Dolhansky, Russ Howes, Ben Pflaum, Nicole Baram, and Cristian Canton Ferrer. 2019. The deepfake detection challenge (dfdc) preview dataset. arXiv preprint arXiv:1910.08854 (2019). · arXiv
- Shichao Dong, Jin Wang, Renhe Ji, Jiajun Liang, Haoqiang Fan, and Zheng Ge. 2022b. Towards A Robust Deepfake Detector: Common Artifact Deepfake Detection Model. arXiv preprint arXiv:2210.14457 (2022). · arXiv
- Shichao Dong, Jin Wang, Jiajun Liang, Haoqiang Fan, and Renhe Ji. 2022c. Explaining Deepfake Detection by Analysing Image Matching. In Computer Vision-ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XIV. Springer, 18--35.
- Joel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer, Dorothea Kolossa, and Thorsten Holz. 2020. Leveraging frequency analysis for deep fake image recognition. In International conference on machine learning. PMLR, 3247--3258.
- Jiazhi Guan, Hang Zhou, Zhibin Hong, Errui Ding, Jingdong Wang, Chengbin Quan, and Youjian Zhao. 2022. Delving into sequential patches for DeepFake detection. arXiv preprint arXiv:2207.02803 (2022). · arXiv
- R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, and Yoshua Bengio. 2018. Learning deep representations by mutual information estimation and maximization. arXiv preprint arXiv:1808.06670 (2018). · arXiv
- Jin-Hwa Kim, Kyoung-Woon On, Woosang Lim, Jeonghee Kim, Jung-Woo Ha, and Byoung-Tak Zhang. 2016. Hadamard product for low-rank bilinear pooling. arXiv preprint arXiv:1610.04325 (2016). · arXiv
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. 2019. Celeb-df (v2): a new dataset for deepfake forensics. arXiv preprint arXiv:1909.12962, Vol. 4 (2019). · arXiv
- Zihan Liu, Hanyi Wang, and Shilin Wang. 2022a. Cross-Domain Local Characteristic Enhanced Deepfake Video Detection. In Proceedings of the Asian Conference on Computer Vision. 3412--3429.
- Zhenguang Liu, Sifan Wu, Chejian Xu, Xiang Wang, Lei Zhu, Shuang Wu, and Fuli Feng. 2022b. Copy Motion From One to Another: Fake Motion Video Generation. arXiv preprint arXiv:2205.01373 (2022). · arXiv
- Wanyi Zhuang, Qi Chu, Zhentao Tan, Qiankun Liu, Haojie Yuan, Changtao Miao, Zixiang Luo, and Nenghai Yu. 2022. UIA-ViT: Unsupervised inconsistency-aware method based on vision transformer for face forgery detection. In Computer Vision-ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part V. Springer, 391--407.
Cited by
Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection
Ba, Z., Liu, Q., Liu, Z., Wu, S., Lin, F., Lü, L., & Ren, K. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27829 · Cited by 174
“Deepfake detection (Ying et al. 2023; Ba et al. 2023; Hua et al. 2023; Wu et al. 2023; Pan et al. 2023; Shuai et al. 2023) faces a significant challenge posed by the sophistication of deepfake technology that can create highly realistic content that is barely distinguishable from real ones.”
BackgroundSelf-citationPrivacyAsst: Safeguarding User Privacy in Tool-Using Large Language Model Agents
Zhang, X., Xu, H., Ba, Z., Wang, Z., Hong, Y., Liu, J., Qin, Z., & Ren, K. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3372777 · Cited by 116
Self-citationSpatial-frequency feature fusion based deepfake detection through knowledge distillation
Wang, B., Wu, X., Wang, F., Zhang, Y., Wei, F., & Song, Z. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108341 · Cited by 44
Deepfake Detection and Localization Using Multi-View Inconsistency Measurement
Zhang, B., Yin, Q., Lu, W., & Luo, X. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3472064 · Cited by 35
“[36], [37], [38] introduce noise features into the two-stream branch and combine them with multiscale featurestoaccomplishdetection.”
LGDF-Net: Local and Global Feature-Based Dual-Branch Fusion Networks for Deepfake Detection
Long, M., Liu, Z., Zhang, L., & Peng, F. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3530402 · Cited by 22
“Shaui et al. [40] expanded the Deepfake detection range of the network by a two-stream network instead of limiting it to a few dominant detection regions, thereby capturing a broader array of Deepfake detection cues.”
Self-citation
Metadata
- Authors
- Shuai, C., Zhong, J., Wu, S., Lin, F., Wang, Z., Ba, Z., Liu, Z., Cavallaro, L., & Ren, K.
- Affiliations
- Zhejiang University (CN)
- Black Sesame Technologies, Singapore, Singapore
- University College London (GB)
- ORCID
- Venue
- Proceedings of the 31st ACM International Conference on Multimedia
- Publisher
- ACM
- Published
- 2023-10-26
- Pages
- 7131-7142
- OpenAlex
- W4387968020
- Cited by
- 55
- References
- 44
- Citations by year
- 2026: 14 · 2025: 22 · 2024: 19
- FWCI
- 5.89
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM International Conference on Multimedia (ACM MM) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- the National Natural Science Foundation of China (62172359)
- the National Key R\&D Program of China (2020AAA0107700)
- the Key R\&D Program of Zhejiang Province (No. 2023C01217)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, two-stream network, generalizability, video forgery detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Locate and Verify: A Two-Stream Network for Improved Deepfake Detection. https://app.cochat.ai/papers/10.1145/3581783.3612386
- The paper
- Shuai, C., Zhong, J., Wu, S., Lin, F., Wang, Z., Ba, Z., Liu, Z., Cavallaro, L., & Ren, K. (2023). Locate and Verify: A Two-Stream Network for Improved Deepfake Detection. Proceedings of the 31st ACM International Conference on Multimedia. https://doi.org/10.1145/3581783.3612386
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.