Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.

Recurrent Convolutional Structures for Audio Spoof and Video Deepfake Detection

Chintha, Akash, Thai, Bao, Sohrawardi, Saniat Javid, Bhatt, Kartavya, Hickerson, Andrea, Wright, Matthew, Ptucha, Raymond · 2020 · IEEE Journal of Selected Topics in Signal Processing

Abstract

Deepfakes, or artificially generated audiovisual renderings, can be used to defame a public figure or influence public opinion. With the recent discovery of generative adversarial networks, an attacker using a normal desktop computer fitted with an off-the-shelf graphics processing unit can make renditions realistic enough to easily fool a human observer. Detecting deepfakes is thus becoming important for reporters, social media platforms, and the general public. In this work, we introduce simple, yet surprisingly efficient digital forensic methods for audio spoof and visual deepfake detection. Our methods combine convolutional latent representations with bidirectional recurrent structures and entropy-based cost functions. The latent representations for both audio and video are carefully chosen to extract semantically rich information from the recordings. By feeding these into a recurrent framework, we can detect both spatial and temporal signatures of deepfake renditions. The entropy-based cost functions work well in isolation as well as in context with traditional cost functions. We demonstrate our methods on the FaceForensics++ and Celeb-DF video datasets and the ASVSpoof 2019 Logical Access audio datasets, achieving new benchmarks in all categories. We also perform extensive studies to demonstrate generalization to new domains and gain further insight into the effectiveness of the new architectures.

Overview

Integrity signals

Registry

Crossref · 10.1109/jstsp.2020.2999185

Cites

79 of 79 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 77 references

Research works printed but not linked: 1

  1. 10.1109/iccv.2017.244 · DOI · Paper page

Cited by

See all 234

Metadata

Authors
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R.
Affiliations
  • Rochester Institute of Technology (US)
  • University of South Carolina (US)
Venue
IEEE Journal of Selected Topics in Signal Processing
Published
2020-08
Volume
14
Issue
5
Pages
1024-1037
ISSN
  • 1932-4553 (ISSN-L)
  • 1941-0484
OpenAlex
W3033711348
Cited by
226
References
77
Citations by year
2026: 36 · 2025: 40 · 2024: 51 · 2023: 49 · 2022: 30 · 2021: 17 · 2020: 3
FWCI
9.62
Type
journal article
Language
en
Open access
closed
Locations
IEEE Journal of Selected Topics in Signal Processing (publishedVersion)
Funders
The Ethics and Governance of Artificial Intelligence Initiative (006409-002)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
Keywords
deepfake detection, recurrent convolutional networks, latent representations, generative adversarial networks, digital forensics, FaceForensics++, Celeb-DF, ASVspoof 2019

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Recurrent Convolutional Structures for Audio Spoof and Video Deepfake Detection. https://app.cochat.ai/papers/10.1109/jstsp.2020.2999185
The paper
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020). Recurrent Convolutional Structures for Audio Spoof and Video Deepfake Detection. IEEE Journal of Selected Topics in Signal Processing. https://doi.org/10.1109/jstsp.2020.2999185

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.