MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
The DOI matches its Crossref record; 60 of the 61 references it cites were found in a registry or an index.
Abstract
With the rapid development of face manipulation technology, it is difficult for human eyes to distinguish fake face images. On the contrary, Convolutional Neural Network (CNN) discriminators can quickly reach high accuracy in identifying fake/real face images. In this study, we explore the behavior of CNN models in distinguish fake/real faces. We find multi-scale texture difference information plays an important role in face forgery detection. Motivated by the above observation, we propose a new Multi-scale Texture Difference model coined as MTD-Net for robust face forgery detection, which leverages central difference convolution (CDC) and atrous spatial pyramid pooling (ASPP). CDC combines the pixel intensity information and the pixel gradient information to give a stationary description of texture difference information. Simultaneously, based on the ASPP, multi-scale information fusion can keep the texture features from being destroyed. Experimental results on several databases, Faceforensics++, DeeperForensics-1.0, Celeb-DF and DFDC prove that our MTD-Net outperforms existing approaches. The MTD-Net is more robust to image distortion, e.g., JPEG compression and blur, which is urgently needed in the wild world.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
Research works printed but not linked: 3
- 2019, Deepfake
- 2019, Deepfake
- tolosana, 2020, DeepFakes evolution: Analysis of facial regions and fake detection performance, arXiv 2004 07532
Cited by
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
“In [103] a multi-scale texture difference network is introduced for face manipulation detection.”
BackgroundF 2 Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172
“We fairly compare against others methods and achieve better results than Xception [75], Add-Net [85], F3-Net [28], DCL [81], MTD-Net [65], and LiSiam [21].”
BackgroundMethodResultInfluentialA survey of few-shot learning in smart agriculture: developments, applications, and challenges
Yang, J., Guo, X., Li, Y., Marinello, F., Erċışlı, S., & Zhang, Z. (2022) · Plant Methods · doi:10.1186/s13007-022-00866-2 · Cited by 166
“With the continuous improvement of deep learning technology and hardware capabilities, artificial intelligence has developed more and more rapidly, and remarkable achievements have been made in many fields such as smart agriculture [2–5], medical treatment, finance, driverless, and so on [6–12].”
BackgroundSelf-citationTask-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems
Kang, X., Song, B., Guo, J., Qin, Z., & Yu, F. R. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3182325 · Cited by 158
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
“First, the MTD-Net model [169] emphasises the value of multiscale texture differences in identifying deepfake images.”
BackgroundMethod
Metadata
- Authors
- Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X.
- Affiliations
- Tianjin University (CN)
- Xidian University (CN)
- Chongqing University of Posts and Telecommunications (CN)
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2021
- Volume
- 16
- Pages
- 4234-4245
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W3191630110
- Cited by
- 184
- References
- 61
- Citations by year
- 2026: 22 · 2025: 37 · 2024: 44 · 2023: 41 · 2022: 38 · 2021: 2
- FWCI
- 11.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Information Forensics and Security (publishedVersion)
- Funders
- National Natural Science Foundation of China (61871283)
- Foundation of Pre-Research on Equipment of China (61400010304)
- Major Civil-Military Integration Project in Tianjin, China (18ZXJMTG00170)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfake detection, face forgery detection, atrous spatial pyramid pooling, image distortion robustness, JPEG compression robustness, blur robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference. https://app.cochat.ai/papers/10.1109/tifs.2021.3102487
- The paper
- Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021). MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference. IEEE Transactions on Information Forensics and Security. https://doi.org/10.1109/tifs.2021.3102487
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.