Cited by 70Digital Media Forensic DetectionMisinformation and Its ImpactsGenerative Adversarial Networks and Image Synthesis

iCaps-Dfake: An Integrated Capsule-Based Model for Deepfake Image and Video Detection

Open access
Khalil, Samar Samir, Youssef, Sherin M., Saleh, Sherine Nagy·2021·Future Internet

Abstract

Fake media is spreading like wildfire all over the internet as a result of the great advancement in deepfake creation tools and the huge interest researchers and corporations are showing to explore its limits. Now anyone can create manipulated unethical media forensics, defame, humiliate others or even scam them out of their money with a click of a button. In this research a new deepfake detection approach, iCaps-Dfake, is proposed that competes with state-of-the-art techniques of deepfake video detection and addresses their low generalization problem. Two feature extraction methods are combined, texture-based Local Binary Patterns (LBP) and Convolutional Neural Networks (CNN) based modified High-Resolution Network (HRNet), along with an application of capsule neural networks (CapsNets) implementing a concurrent routing technique. Experiments have been conducted on large benchmark datasets to evaluate the performance of the proposed model. Several performance metrics are applied and experimental results are analyzed. The proposed model was primarily trained and tested on the DeepFakeDetectionChallenge-Preview (DFDC-P) dataset then tested on Celeb-DF to examine its generalization capability. Experiments achieved an Area-Under Curve (AUC) score improvement of 20.25% over state-of-the-art models.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/fi13040093

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The use of YOLO-v3 as a face detector in Khalil et al. (2021)'s model resulted in a significant decrease in false-positive predictions, eliminating the requirement for additional preprocessing steps.

    “The use of You Only Look Once (YOLO-v3) as a face detector resulted in a significant decrease in falsepositive predictions, eliminating the requirement for additional preprocessing steps.”

    From Deepfake detection using deep learning methods: A systematic and comprehensive review (2024) · cites this paper as Khalil et al. (2021)

    The Discussion (Section 5) says YOLO-v3 greatly reduced false-positive face detections, but says this reduced the need for further preprocessing—not that it eliminated it. The Preprocessing section explicitly describes normalization, cropping, and augmentation of detected faces. (LLM, conf=0.90)

    Experimental — accuracy not yet measured
  • Khalil et al. (2021)'s approach combines texture feature extraction with an HRNet-based strategy for training a capsule network to enhance classification accuracy.

    “Khalil et al. (2021) presented a deepfake detection approach that combines texture feature extraction with a High-Resolution Network (HRNet)-based strategy for training a capsule network to enhance classification accuracy.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 7

  1. Li, L.; Bao, J.; Yang, H.; Chen, D.; Wen, F. Faceshifter: Towards high fidelity and occlusion aware face swapping. arXiv 2019, arXiv:1912.13457. · arXiv
  2. Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS); MIT Press: Cambridge, MA, USA, 2014.
  3. Thies, J.; Zollhöfer, M.; Theobalt, C.; Stamminger, M.; Nießner, M. Headon: Real-Time Reenactment of Human Portrait Videos; ACM Transactions on Graphics (TOG): New York, NY, USA, 2018; Volume 37, pp. 1-13.
  4. Kumar, R.; Sotelo, J.; Kumar, K.; de Brébisson, A.; Bengio, Y. Obamanet: Photo-realistic lip-sync from text. arXiv 2017, arXiv:1801.01442. (preprint). · arXiv
  5. Koopman, M.; Rodriguez, A.M.; Geradts, Z. Detection of deepfake video manipulation. In Proceedings of the 20th Irish Machine Vision and Image Processing Conference (IMVIP), Belfast, UK, 29-31 August 2018.
  6. Ba, J.L.; Kiros, J.R.; Hinton, G.E. Layer normalization. arXiv 2016, arXiv:1607.06450. · arXiv
  7. Tan, P.N.; Steinbach, M.; Kumar, V. Alternative Metrics. In Introduction to Data Mining; Pearson Education India: Tamil Nadu, India, 2019; pp. 289-292.

Cited by

Sorted by citations

Authors
Khalil, S. S., Youssef, S. M., & Saleh, S. N.
Affiliations
Arab Academy for Science, Technology, and Maritime Transport (EG)
Corresponding author
Saleh, Sherine Nagy
Venue
Future Internet
Publisher
MDPI AG
Published
2021-04-05
Volume
13
Issue
4
Pages
93
ISSN
1999-5903 (ISSN-L)
OpenAlex
W3152384838
Cited by
67
References
56
Citations by year
2026: 11 · 2025: 17 · 2024: 8 · 2023: 16 · 2022: 10 · 2021: 5
FWCI
3.51
Type
journal article
Language
en
Open access
Locations
  • Future Internet (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
Keywords
deepfake detection, capsule networks, local binary pattern, HRNet, fake media, generalization, Celeb-DF

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review