CoChat

Exploiting Prediction Error Inconsistencies through LSTM-based Classifiers to Detect Deepfake Videos

Amerini, Irene, Caldelli, Roberto · 2020 · Proceedings of the 2020 ACM Workshop on Information Hiding and Multimedia Security

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

The ability of artificial intelligence techniques to build synthesized brand new videos or to alter the facial expression of already existing ones has been efficiently demonstrated in the literature. The identification of such new threat generally known as Deepfake, but consisting of different techniques, is fundamental in multimedia forensics. In fact this kind of manipulated information could undermine and easily distort the public opinion on a certain person or about a specific event. Thus, in this paper, a new technique able to distinguish synthetic generated portrait videos from natural ones is introduced by exploiting inconsistencies due to the prediction error in the re-encoding phase. In particular, features based on inter-frame prediction error have been investigated jointly with a Long Short-Term Memory (LSTM) model network able to learn the temporal correlation among consecutive frames. Preliminary results have demonstrated that such sequence-based approach, used to distinguish between original and manipulated videos, highlights promising performances.

Overview

Integrity signals

Registry

Crossref · 10.1145/3369412.3395070

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 7

  1. Darius Afchar Vincent Nozick Junichi Yamagishi and I Echizen. 2018. MesoNet: a Compact Facial Video Forgery Detection Network. 1--7. https://doi.org/10.1109/WIFS.2018.8630761 · DOI · Paper page
  2. Shruti Agarwal , Hany Farid , Yuming Gu , Mingming He , Koki Nagano , and Hao Li . 2019 . Protecting World Leaders Against Deep Fakes. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. Shruti Agarwal, Hany Farid, Yuming Gu, Mingming He, Koki Nagano, and Hao Li. 2019. Protecting World Leaders Against Deep Fakes. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
  3. Francois Chollet . 2016 . Xception: Deep Learning with Depthwise Separable Convolutions. arxiv: cs.CV/1610.02357 Francois Chollet. 2016. Xception: Deep Learning with Depthwise Separable Convolutions. arxiv: cs.CV/1610.02357
  4. D. Dang-Nguyen , G. Boato , and F. G. B. De Natale . 2012 . Discrimination between computer generated and natural human faces based on asymmetry information . In 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO). 1234--1238 . D. Dang-Nguyen, G. Boato, and F. G. B. De Natale. 2012. Discrimination between computer generated and natural human faces based on asymmetry information. In 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO). 1234--1238.
  5. N. Khanna , G. T.-C. Chiu , J. P. Allebach , and E. J. Delp . 2008. Forensic techniques for classifying scanner, computer generated and digital camera images . In Proc. of IEEE ICASSP . Las Vegas, USA. N. Khanna, G. T.-C. Chiu, J. P. Allebach, and E. J. Delp. 2008. Forensic techniques for classifying scanner, computer generated and digital camera images. In Proc. of IEEE ICASSP. Las Vegas, USA.
  6. Andreas Rö ssler, Davide Cozzolino , Luisa Verdoliva , Christian Riess , Justus Thies , and Matthias Nießner . 2018. FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces. CoRR , Vol. abs/ 1803 .09179 ( 2018 ). arxiv: 1803.09179 http://arxiv.org/abs/1803.09179 Andreas Rö ssler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Nießner. 2018. FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces. CoRR, Vol. abs/1803.09179 (2018). arxiv: 1803.09179 http://arxiv.org/abs/1803.09179 · arXiv
  7. Sheng-Yu Wang , Oliver Wang , Richard Zhang , Andrew Owens , and Alexei A . Efros . 2019 . CNN-generated images are surprisingly easy to spot... for now. arxiv: cs.CV/1912.11035 Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei A. Efros. 2019. CNN-generated images are surprisingly easy to spot... for now. arxiv: cs.CV/1912.11035

Cited by

See all 68

Metadata

Authors
Amerini, I., & Caldelli, R.
Affiliations
  • Sapienza University of Rome (IT)
  • Consorzio Nazionale Interuniversitario per le Telecomunicazioni (IT)
Venue
Proceedings of the 2020 ACM Workshop on Information Hiding and Multimedia Security
Publisher
ACM
Published
2020-06-22
Pages
97-102
OpenAlex
W3037675456
Cited by
64
References
26
Citations by year
2026: 3 · 2025: 6 · 2024: 12 · 2023: 11 · 2022: 23 · 2021: 7 · 2020: 2
FWCI
3.32
Type
conference paper
Language
en
Open access
closed
Locations
  • ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) (publishedVersion)
  • IRIS Research product catalog (Sapienza University of Rome) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
Keywords
deepfake detection, video forensics, prediction error, synthetic video, LSTM classifier, temporal correlation, video manipulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exploiting Prediction Error Inconsistencies through LSTM-based Classifiers to Detect Deepfake Videos. https://app.cochat.ai/papers/10.1145/3369412.3395070
The paper
Amerini, I., & Caldelli, R. (2020). Exploiting Prediction Error Inconsistencies through LSTM-based Classifiers to Detect Deepfake Videos. Proceedings of the 2020 ACM Workshop on Information Hiding and Multimedia Security. https://doi.org/10.1145/3369412.3395070

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.