CoChat

Dynamic texture analysis for detecting fake faces in video sequences

Open access
Bonomi, Mattia, Pasquini, Cecilia, Boato, Giulia · 2021 · Journal of Visual Communication and Image Representation
Cited by 50

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

The creation of manipulated multimedia content involving human characters has reached in the last years unprecedented realism, calling for automated techniques to expose synthetically generated faces in images and videos.This work explores the analysis of spatio-temporal texture dynamics of the video signal, with the goal of characterizing and distinguishing real and fake sequences.We propose to build a binary decision on the joint analysis of multiple temporal segments and, in contrast to previous approaches, to exploit the textural dynamics of both the spatial and temporal dimensions.This is achieved through the use of Local Derivative Patterns on Three Orthogonal Planes (LDP-TOP), a compact feature representation known to be an important asset for the detection of face spoofing attacks.Experimental analyses on state-of-the-art datasets of manipulated videos show the discriminative power of such descriptors in separating real and fake sequences, and also identifying the creation method used.Linear Support Vector Machines (SVMs) are used which, despite the lower complexity, yield comparable performance to previously proposed deep models for fake content detection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jvcir.2021.103239

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 19

  1. Souza, 2018, How far did we get in face spoofing detection?, Eng. Appl. Artif. Intell., 72, 368?381
  2. Pan, 2009, Discriminating between photorealistic computer graphics and natural images using fractal geometry, Sci. China Ser. F: Inf. Sci., 329
  3. Ke, 2013, Detecting the composite of photographic image and computer generated image combining with color, texture and shape feature, J. Theoret. Appl. Inf. Technol., 844
  4. Lyu, 2005, How realistic is photorealistic?, IEEE Trans. Signal Process., 845, 10.1109/TSP.2004.839896 · DOI · Paper page
  5. Peng, 2016, Discrimination of natural images and computer generated graphics based on multi-fractal and regression analysis, AEU - Int. J. Electron. Commun.
  6. Bayar, 2018, Constrained convolutional neural networks: A new approach towards general purpose image manipulation detection, IEEE Trans. Inf. Forensics Secur., 13, 2691, 10.1109/TIFS.2018.2825953 · DOI · Paper page
  7. Xiao, 2019, Video-based evidence analysis and extraction in digital forensic investigation, IEEE Access, 55432, 10.1109/ACCESS.2019.2913648 · DOI
  8. Dang-Nguyen, 2015, 3d-model-based video analysis for computer generated faces identification, IEEE Trans. Inf. Forensics Secur., 746
  9. Wu, 2012, EulerIan video magnification for revealing subtle changes in the world, ACM Trans. Graph., 65:1
  10. Bonomi, 2020, Digital human face detection in video sequences via a physiological signal analysis, J. Electron. Imaging, 29, 1, 10.1117/1.JEI.29.1.013009 · DOI
  11. Savitzky, 1964, Smoothing and differentiation of data by simplified least squares procedures., Anal. Chem., 1627, 10.1021/ac60214a047 · DOI · Paper page
  12. Jabid, 2010, Local directional pattern (ldp) for face recognition, Int. J. Innovative Comput. Inf. Control, 329
  13. Zhang, 2010, Local derivative pattern versus local binary pattern: Face recognition with high-order local pattern descriptor, IEEE Trans. Image Process., 533, 10.1109/TIP.2009.2035882 · DOI · Paper page
  14. Freitas Pereira, 2014, Face liveness detection using dynamic texture, EURASIP J. Image Video Process., 10.1186/1687-5281-2014-2 · DOI · Paper page
  15. Thies, 2018, Face2face: Real-time face capture and reenactment of RGB videos, Commun. ACM, 96, 10.1145/3292039 · DOI · Paper page
  16. Zhao, 2007, Dynamic texture recognition using local binary patterns with an application to facial expressions, IEEE Trans. Pattern Anal. Mach. Intell., 915, 10.1109/TPAMI.2007.1110 · DOI · Paper page
  17. Laptev, 2005, On space–time interest points, Int. J. Comput. Vis., 64, 107, 10.1007/s11263-005-1838-7 · DOI · Paper page
  18. Moreira, 2016, Pornography classification: The hidden clues in video space–time, Forensic Sci. Int., 268, 46, 10.1016/j.forsciint.2016.09.010 · DOI
  19. Uijlings, 2015, Video classification with densely extracted hog/hof/mbh features: an evaluation of the accuracy/computational efficiency trade-off, Int. J. Multimedia Inf. Retr., 4

Cited by

See all 50

Metadata

Authors
Bonomi, M., Pasquini, C., & Boato, G.
Venue
Journal of Visual Communication and Image Representation
Publisher
Elsevier BV
Published
2021-08
Volume
79
Pages
103239
ISSN
1047-3203
OpenAlex
W3183175034
Cited by
50
References
22
FWCI
3.09
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.