Inconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Current face forgery techniques can generate high-fidelity fake faces with extremely low labor and time costs. As a result, face forgery detection becomes an important research topic to prevent technology abuse. In this paper, we present an inconsistency-aware wavelet dual-branch network for face forgery detection. This model is mainly based on two kinds of forgery clues called inter-image and intra-image inconsistencies. To fully utilize them, we firstly enhance the forgery features by using additional inputs based on stationary wavelet decomposition (SWD). Then, considering the different properties of the two inconsistencies, we design a dual-branch network that predicts image-level and pixel-level forgery labels respectively. The segmentation branch aims to recognize real and fake local regions, which is crucial for discovering intra-image inconsistency. The classification branch learns to discriminate the real and fake images globally, thus can extract inter-image inconsistency. Finally, bilinear pooling is employed to fuse the features from the two branches. We find that the bilinear pooling is a kind of spatial attentive pooling. It effectively utilizes the rich spatial features learned by the segmentation branch. Experimental results show that the proposed method surpasses the state-of-the-art face forgery detection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
Deep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Research works printed but not linked: 37
- 10.1006/jbin.2001.1010 · doi:10.1006/jbin.2001.1010
- 10.1109/CVPR42600.2020.00473 · DOI · Paper page
- 10.1109/CVPR.2017.195 · DOI · Paper page
- dzanic, 2020, Fourier spectrum discrepancies in deep network generated images, Proc Adv Neural Inf Process Syst, 33
- agarwal, 2019, Protecting world leaders against deep fakes, Proc IEEE Int Conf Comput Vis Workshops, 38
- 10.1109/TIFS.2009.2033749 · DOI · Paper page
- fu, 2012, Forgery authentication in extreme wide-angle lens using distortion CUE and fake saliency map, IEEE Trans Inf Forensics Security, 7, 1301, 10.1109/TIFS.2012.2195492 · DOI
- 2020, Faceswap
- 2020, Deepfake
- 10.1109/CVPR42600.2020.00791 · DOI · Paper page
- 10.1109/TPAMI.2017.2723400 · DOI · Paper page
- 10.1109/WIFS.2017.8267647 · DOI · Paper page
- 10.1145/3306346.3323035 · DOI · Paper page
- 10.1145/2929464.2929475 · DOI · Paper page
- kingma, 2014, Auto-encoding variational Bayes, Proc Int Conf Learn Represent, 1
- 10.1109/TIFS.2021.3050065 · DOI
- 10.1109/CVPRW.2018.00121 · DOI · Paper page
- fu, 2019, Dual variational generation for low shot heterogeneous face recognition, Proc Adv Neural Inf Process Syst, 2670
- 10.1109/TPAMI.2021.3052549 · DOI
- ma, 2020, Free-form image inpainting via contrastive attention network, Proc Int Conf Pattern Recognit, 1
- 10.1007/s11263-019-01154-8 · DOI
- 10.1007/s11263-019-01267-0 · DOI
- 10.1109/ICCV.2017.244 · DOI · Paper page
- 10.1007/s11263-013-0688-y · DOI · Paper page
- 10.1109/TIFS.2012.2202227 · DOI · Paper page
- fan, 2003, Identification of bitmap compression history: JPEG detection and quantizer estimation, IEEE Trans Image Process, 12, 230, 10.1109/TIP.2002.807361 · DOI · Paper page
- 10.1109/TIFS.2010.2074194 · DOI · Paper page
- 10.1109/CVPR.2018.00116 · DOI · Paper page
- 10.1109/TIFS.2008.2012215 · DOI · Paper page
- 10.1109/CVPR42600.2020.00181 · DOI · Paper page
- goodfellow, 2014, Generative adversarial nets, Proc Adv Neural Inf Process Syst, 2672
- 10.1109/TPAMI.2016.2644615 · DOI · Paper page
- liu, 2015, Parsenet Looking wider to see better
- 10.1109/ICCV.2019.00317 · DOI
- 10.1109/ICCV.2019.00913 · DOI · Paper page
- 10.1109/ITNG.2012.13 · DOI
- 10.1109/ICDSP.2011.6004974 · DOI
Cited by
F 2 Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172
TALL: Thumbnail Layout for Deepfake Video Detection
Xu, Y., Liang, J., Jia, G., Yang, Z., Zhang, Y., & He, R. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02071 · Cited by 109
Self-citationTI 2 Net: Temporal Identity Inconsistency Network for Deepfake Detection
Liu, B., Liu, B., Ding, M., Zhu, T., & Yu, X. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00467 · Cited by 50
“Some detectors also transform spatial information to the frequency domain and capture artifacts in frequency domain [8], [9], [14].”
BackgroundGeneralization of Forgery Detection With Meta Deepfake Detection Model
Tran, V.-N., Kwon, S.-G., Lee, S.-H., Le, H.-S., & Kwon, K.-R. (2023) · IEEE Access · doi:10.1109/access.2022.3232290 · Cited by 47
“Furthermore, the work in [31] designed an inconsistency-aware wavelet dual-branch network to recognize real and fake images.”
BackgroundVisual-Semantic Transformer for Face Forgery Detection
Xu, Y., Jia, G., Huang, H., Duan, J., & He, R. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484407 · Cited by 24
Self-citation
Metadata
- Authors
- Jia, G., Zheng, M., Hu, C., Ma, X., Xu, Y., Liu, L., Deng, Y., & He, R.
- Venue
- IEEE Transactions on Biometrics, Behavior, and Identity Science
- Published
- 2021-07
- Volume
- 3
- Issue
- 3
- Pages
- 308-319
- ISSN
- 2637-6407 (ISSN-L)
- OpenAlex
- W3166873596
- Cited by
- 62
- References
- 24
- FWCI
- 3.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Beijing Natural Science Foundation (JQ18017)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Inconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection. https://app.cochat.ai/papers/10.1109/tbiom.2021.3086109
- The paper
- Jia, G., Zheng, M., Hu, C., Ma, X., Xu, Y., Liu, L., Deng, Y., & He, R. (2021). Inconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection. IEEE Transactions on Biometrics, Behavior, and Identity Science. https://doi.org/10.1109/tbiom.2021.3086109
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.