MesoNet: a Compact Facial Video Forgery Detection Network
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
This paper presents a method to automatically and efficiently detect face tampering in videos, and particularly focuses on two recent techniques used to generate hyper-realistic forged videos: Deepfake and Face2Face. Traditional image forensics techniques are usually not well suited to videos due to the compression that strongly degrades the data. Thus, this paper follows a deep learning approach and presents two networks, both with a low number of layers to focus on the mesoscopic properties of images. We evaluate those fast networks on both an existing dataset and a dataset we have constituted from online videos. The tests demonstrate a very successful detection rate with more than 98% for Deepfake and 95% for Face2Face.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early deepfake detection methods primarily relied on conventional CNNs to identify low-level visual inconsistencies and blending artifacts in manipulated frames.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“According to the study by Afchar etal. (2018), video and image manipulation are becoming more prevalent, primarily due to technological advancements in machine learning and deep learning.”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Afchar et al. (2018)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most existing deepfake detection algorithms are based on DNN because of their capability in feature extraction and selection processes (Afchar et al. 2018; Li et al. 2018; Rossler etal. 2019).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Afchar et al. 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“MesoNet Deepfake dataset (Afchar et al., 2018): This dataset includes 19,457 face images,27 including 7,948 deepfake images generated from 175 forged videos collected online and 11,509 real face images collected from various online sources.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Afchar et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“MesoNet is a compact convolutional neural network developed to identify manipulated facial expressions. It can detect deepfakes and other facial modifications with high accuracy.”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Afchar et al. 2018
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Farid, H. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.931079 · Cited by 925
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Demo of Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2016) · ACM SIGGRAPH 2016 Emerging Technologies · doi:10.1145/2929464.2929475 · Cited by 589
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Digital image forensics: a booklet for beginners
Redi, J. A., Taktak, W., & Dugelay, J.-L. (2011) · Multimedia Tools and Applications · doi:10.1007/s11042-010-0620-1 · Cited by 367
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Distinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · 2017 IEEE Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2017.8267647 · Cited by 318
Self-citationExposing digital forgeries in video by detecting double MPEG compression
Wang, W., & Farid, H. (2006) · Proceedings of the 8th workshop on Multimedia and security · doi:10.1145/1161366.1161375 · Cited by 269
An overview on video forensics
Milani, S., Fontani, M., Bestagini, P., Barni, M., Piva, A., Tagliasacchi, M., & Tubaro, S. (2012) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2012.2 · Cited by 254
Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2018) · Communications of the ACM · doi:10.1145/3292039 · Cited by 244
Aligned and non-aligned double JPEG detection using convolutional neural networks
Barni, M., Bondi, L., Bonettini, N., Bestagini, P., Costanzo, A., Maggini, M., Tondi, B., & Tubaro, S. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.09.003 · Cited by 221
Garrido, P., Valgaerts, L., Rehmsen, O., Thormaehlen, T., Perez, P., & Theobalt, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.537 · Cited by 172
Shi, W., Jiang, F., & Zhao, D. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296427 · Cited by 89
Humans are easily fooled by digital images
Schetinger, V., Oliveira, M. M., da Silva, R., & Carvalho, T. (2017) · Computers & Graphics · doi:10.1016/j.cag.2017.08.010 · Cited by 73
Image Noise and Digital Image Forensics
Julliand, T., Nozick, V., & Talbot, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31960-5_1 · Cited by 51
Self-citationFace Animacy is Not All in the Eyes: Evidence from Contrast Chimeras
Balas, B., & Tonsager, C. (2014) · Perception · doi:10.1068/p7696 · Cited by 37
Human Perception of Visual Realism for Photo and Computer-Generated Face Images
Fan, S., Wang, R., Ng, T.-T., Tan, C., Herberg, J. S., & Koenig, B. L. (2014) · ACM Transactions on Applied Perception · doi:10.1145/2620030 · Cited by 36
Wang, W., & Farid, H. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88961-8_6 · Cited by 34
Screenshot identification using combing artifact from interlaced video
Lee, J., Lee, M.-J., Oh, T., Ryu, S., & Lee, H.-K. (2010) · ACM workshop on Multimedia and security · doi:10.1145/1854229.1854240 · Cited by 17
Shi, W., Jiang, F., & Zhao, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07128 · Cited by 10
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
- chollet, 2015, Keras
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“, [6, 17, 35, 36]) are data-driven, which directly employ various types of DNNs trained on real and DeepFake videos, not relying on any specific artifact.”
MethodInfluentialDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
Metadata
- Authors
- Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I.
- Affiliations
- École nationale des ponts et chaussées (FR)
- Laboratoire d'Informatique Gaspard-Monge (FR)
- National Institute of Informatics (JP)
- Venue
- 2018 IEEE International Workshop on Information Forensics and Security (WIFS)
- Publisher
- IEEE
- Published
- 2018-12
- Pages
- 1-7
- ISSN
- 2157-4774 (ISSN-L)
- OpenAlex
- W2891145043
- Semantic Scholar
- 4258fd74a8bbb03b0997e76ba8ab6684b161f9d3
- Cited by
- 1,872
- References
- 32
- Citations by year
- 2026: 246 · 2025: 395 · 2024: 316 · 2023: 296 · 2022: 243 · 2021: 212 · 2020: 129 · 2019: 30 · 2018: 5
- FWCI
- 28.34
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE International Workshop on Information Forensics and Security (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- video forgery detection, deepfake detection, Face2Face, image forensics, lightweight neural networks, video compression artifacts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.