The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Deep Fake Image Detection Based on Pairwise Learning
Open accessAbstract
Generative adversarial networks (GANs) can be used to generate a photo-realistic image from a low-dimension random noise. Such a synthesized (fake) image with inappropriate content can be used on social media networks, which can cause severe problems. With the aim to successfully detect fake images, an effective and efficient image forgery detector is necessary. However, conventional image forgery detectors fail to recognize fake images generated by the GAN-based generator since these images are generated and manipulated from the source image. Therefore, in this paper, we propose a deep learning-based approach for detecting the fake images by using the contrastive loss. First, several state-of-the-art GANs are employed to generate the fake–real image pairs. Next, the reduced DenseNet is developed to a two-streamed network structure to allow pairwise information as the input. Then, the proposed common fake feature network is trained using the pairwise learning to distinguish the features between the fake and real images. Finally, a classification layer is concatenated to the proposed common fake feature network to detect whether the input image is fake or real. The experimental results demonstrated that the proposed method significantly outperformed other state-of-the-art fake image detectors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The findings showed that their technique beat other stateof-the-art methods in terms of precision and recall rate.”
From Deepfake detection using deep learning methods: A systematic and comprehensive review (2024) · cites this paper as Hsu et al. (2020)
The cited source says what the claim attributes to it.
In the citing paper
“Their paired learning system permits fake feature learning, allowing the trained fake image detector to recognize the false picture created by a new GAN even though it was not included in the training phase.”
From Deepfake detection using deep learning methods: A systematic and comprehensive review (2024) · cites this paper as Hsu et al. (2020)
The cited source says what the claim attributes to it.
In the citing paper
“Recent meth- ods, e.g., [72, 73], have commonly applied deep learn- ing to automatically extract salient and discriminative features to detect deepfakes.”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2016) · Cited by 31,590
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
(2017) · International Conference on Machine Learning · Cited by 6,382
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
(2013) · Cited by 3,740
(1989) · neural information processing systems · Cited by 3,736
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Farid, H. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.931079 · Cited by 925
Is object localization for free? - Weakly-supervised learning with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298668 · Cited by 886
Detection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399 · cited 6×
“In [10], the performance of the fake face image 45 detection can be further improved by adopting the most advanced CNN–Xception network [11].”
BackgroundMethodInfluentialVideo forgery detection using correlation of noise residue
Hsu, C.-C., Hung, T.-Y., Lin, C.-W., & Hsu, C.-T. (2008) · 2008 IEEE 10th Workshop on Multimedia Signal Processing · doi:10.1109/mmsp.2008.4665069 · Cited by 175
Self-citationFake Faces Identification via Convolutional Neural Network
Mo, H., Chen, B., & Luo, W. (2018) · Proceedings of the 6th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3206004.3206009 · Cited by 175
Learning to Detect Fake Face Images in the Wild
Hsu, C.-C., Lee, C.-Y., & Zhuang, Y.-X. (2018) · 2018 International Symposium on Computer, Consumer and Control (IS3C) · doi:10.1109/is3c.2018.00104 · Cited by 148
Self-citationFace image manipulation detection based on a convolutional neural network
Dang, L. M., Hassan, S. I., Im, S., & Moon, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.005 · Cited by 123
Deep Learning Based Computer Generated Face Identification Using Convolutional Neural Network
Dang, L. M., Hassan, S. I., Im, S., Lee, J., Lee, S., & Moon, H. (2018) · Applied Sciences · doi:10.3390/app8122610 · Cited by 76
Image authentication with tampering localization based on watermark embedding in wavelet domain
Chang, H. T., Hsu, C., Yeh, C.-H., & Shen, D.-F. (2009) · Optical Engineering · doi:10.1117/1.3127192 · Cited by 13
Self-citation
Research works printed but not linked: 1
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
Cited by
A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild
Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413532 · Cited by 897
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
“In [69], the authors train the CNN as a Siamese network using contrasting examples of real and fake images.”
BackgroundThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
Generative adversarial network: An overview of theory and applications
Aggarwal, A., Mittal, M., & Battineni, G. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2020.100004 · Cited by 783
Deep learning in computer vision: A critical review of emerging techniques and application scenarios
Chai, J., Zeng, H., Li, A., & Ngai, E. W. T. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100134 · Cited by 754
Metadata
- Authors
- Hsu, C.-C., Zhuang, Y.-X., & Lee, C.-Y.
- Affiliations
- National Pingtung University of Science and Technology (TW)
- National United University (TW)
- Corresponding author
- Lee, Chia-Yen
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2020-01-03
- Volume
- 10
- Issue
- 1
- Pages
- 370
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2970868842
- Cited by
- 304
- References
- 27
- Citations by year
- 2026: 29 · 2025: 66 · 2024: 57 · 2023: 60 · 2022: 48 · 2021: 24 · 2020: 19
- FWCI
- 14.66
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Science and Technology, Taiwan (108-2634-F-007-009, 107-2218-E-020-002-MY3, 108-2218-E-006 -052)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Keywords
- deepfake detection, image forgery detection, generative adversarial networks, pairwise learning, contrastive loss, two-stream network, DenseNet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.