A video is worth more than 1000 lies. Comparing 3DCNN approaches for detecting deepfakes
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Manipulated images and videos have become increasingly realistic due to the tremendous progress of deep convolutional neural networks (CNNs). While technically intriguing, such progress raises a number of social concerns related to the advent and spread of fake information and fake news. Such concerns necessitate the introduction of robust and reliable methods for fake image and video detection. Towards this in this work, we study the ability of state of the art video CNNs including 3D ResNet, 3D ResNeXt, and I3D in detecting manipulated videos. We present related experimental results on videos tampered by four manipulation techniques, as included in the FaceForensics++ dataset. We investigate three scenarios, where the networks are trained to detect (a) all manipulated videos, as well as (b) separately each manipulation technique individually. Finally and deviating from previous works, we conduct cross-manipulation results, where we (c) detect the veracity of videos pertaining to manipulation-techniques not included in the train set. Our findings clearly indicate the need for a better understanding of manipulation methods and the importance of designing algorithms that can successfully generalize onto unknown manipulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 9×
“The highest score was obtained by XceptionNet [34].”
BackgroundMethodInfluentialRich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144 · cited 2×
“Our intuition is that current state of the art forgery detection techniques [13], [14], [15], [16], [17], [18] omit a pertinent clue, namely motion , by investigating only spatial information.”
BackgroundMethodMesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464 · cited 1×
“We detect and crop the face region based on facial landmarks, which we detect in each frame using the method from Bulat and Tzimiropoulos [38].”
MethodDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Research works printed but not linked: 25
- 10.23919/BIOSIG.2018.8553251 · DOI · Paper page
- 10.23919/EUSIPCO.2018.8553270 · DOI · Paper page
- 10.1109/CVPR.2018.00685 · DOI · Paper page
- 10.1109/CVPR.2017.502 · DOI · Paper page
- thies, 2019, Deferred neural rendering: Image synthesis using neural textures, arXiv preprint arXiv 1904 12848
- 10.1109/CVPR.2017.195 · DOI · Paper page
- 10.1109/WIFS.2017.8267647 · DOI · Paper page
- 10.1109/CVPR42600.2020.00531 · DOI · Paper page
- 10.1016/j.neucom.2019.05.003 · DOI
- averbuch-elor, 2017, Bringing portraits to life, ACM Transactions on Graphics (TOG), 36, 196, 10.1145/3130800.3130818 · DOI · Paper page
- 10.23919/BIOSIG.2018.8553377 · DOI
- kim, 2018, Deep video portraits, ACM Transactions on Graphics (TOG), 37, 163, 10.1145/3197517.3201283 · DOI · Paper page
- silbey, 2018, The upside of deep fakes, Md L Rev, 78, 960
- suwajanakorn, 2017, Synthesizing obama: learning lip sync from audio, ACM Transactions on Graphics (TOG), 36, 95, 10.1145/3072959.3073640 · DOI · Paper page
- eichensehr, 2018, Don’t believe it if you see it: Deep fakes and distrust, Jotwell J Things We Like, 1
- chesney, 2018, Deep fakes: A looming challenge for privacy, democracy, and national security. 107 california law review (2019, forthcoming); u of texas law, Public Law Research Paper, 2018
- 10.1145/2929464.2929475 · DOI · Paper page
- agarwal, 2019, Protecting world leaders against deep fakes, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 38
- farid, 2011, Photo tampering throughout history
- wang, 2019, G3AN: This video does not exist. disentangling motion and appearance for video generation, arXiv preprint arXiv 1912 05523
- 10.1109/WACV45572.2020.9093492 · DOI · Paper page
- goodfellow, 2014, Generative adversarial nets, Advances in neural information processing systems, 2672
- xu, 2019, Adversarial attacks and defenses in images, graphs and text: A review, arXiv preprint arXiv 1909 08072
- majumdar, 2019, Evading face recognition via partial tampering of faces, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 0
- 10.1109/CVPR.2019.00453 · DOI · Paper page
Cited by
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Deep fake detection and classification using error-level analysis and deep learning
Rafique, R., Gantassi, R., Amin, R., Frnda, J., Mustapha, A., & Alshehri, A. H. (2023) · Scientific Reports · doi:10.1038/s41598-023-34629-3 · Cited by 155
A review of deep learning‐based approaches for deepfake content detection
(2024) · doi:10.1111/exsy.13570 · Cited by 116
Deepfakes generation and detection: a short survey
Akhtar, Z. (2023) · Journal of Imaging · doi:10.3390/jimaging9010018 · Cited by 106
“…Matern et al. [89] using visual features with logistic regression and MLP; Rossler et al. [90] using mesoscopic, steganalysis, and CNN features; Sabir et al. [91] using RNN; Amerini et al. [65] using Optical Flow + CNNs; Kumar et al. [92] using multistream CNNs; and Wang et al. [93] using 3DCNN. .”
MethodA lightweight 3D convolutional neural network for deepfake detection
Liu, J., Zhu, K., Lu, W., Luo, X., & Zhao, X. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22499 · Cited by 57
Metadata
- Authors
- Wang, Y., & Dantcheva, A.
- Venue
- 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
- Publisher
- IEEE
- Published
- 2020-11
- Pages
- 515-519
- ISSN
- 1541-5058 (ISSN-L)
- OpenAlex
- W3034785167
- Cited by
- 59
- References
- 14
- FWCI
- 3.41
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A video is worth more than 1000 lies. Comparing 3DCNN approaches for detecting deepfakes. https://app.cochat.ai/papers/10.1109/fg47880.2020.00089
- The paper
- Wang, Y., & Dantcheva, A. (2020). A video is worth more than 1000 lies. Comparing 3DCNN approaches for detecting deepfakes. 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020). https://doi.org/10.1109/fg47880.2020.00089
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.