Seeing is Believing: Exploring Perceptual Differences in DeepFake Videos
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
With AI on the boom, DeepFakes have emerged as a tool with a massive potential for abuse. The hyper-realistic imagery of these manipulated videos coupled with the expedited delivery models of social media platforms gives deception, propaganda, and disinformation an entirely new meaning. Hence, raising awareness about DeepFakes and how to accurately flag them has become imperative. However, given differences in human cognition and perception, this is not straightforward. In this paper, we perform an investigative user study and also analyze existing AI detection algorithms from the literature to demystify the unknowns that are at play behind the scenes when detecting DeepFakes. Based on our findings, we design a customized training program to improve detection and evaluate on a treatment group of low-literate population, which is most vulnerable to DeepFakes. Our results suggest that, while DeepFakes are becoming imperceptible, contextualized education and training can help raise awareness and improve detection.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There is no improvement when evaluating videos either [24–26].”
From Warning: Humans cannot reliably detect speech deepfakes (2023) · cites this paper as [26]
In the citing paper
“Tahir et al. [26] produced educational material containing indicators of bogus images with the assistance of ML interpretability tools. The authors found detection performance improved compared to the initial control group.”
From Warning: Humans cannot reliably detect speech deepfakes (2023) · cites this paper as [26]
In the citing paper
“Thus, the recent introduction of deepfakes makes marketplace deception even more damaging, as hyper-realistic videos and other multimedia deepfakes are extremely difficult to differentiate from reality (Boush et al., 2015; Giansiracusa, 2021; Tahir et al., 2021; Zhao et al., 2020).”
From Deepfakes: Deceptions, mitigations, and opportunities (2023) · cites this paper as Tahir et al., 2021
In the citing paper
“In another experiment with 25 deepfake videos and 4 real videos but only 94 participants, researchers found that the overall discernment accuracy is 51%, and media literacy training increases discernment accuracy by 24 percentage points for participants assigned to the training relative to the control group52.”
From Human detection of political speech deepfakes across transcripts, audio, and video (2024) · cites this paper as [52]
In the citing paper
“Overall, deepfake detection does not seem to vary based on gender, education, income, or profession [7, 32, 37].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [37]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · cited 1×
“The result is fed into a learned classifcation network that outputs the prediction using an XceptionNet architecture [7].”
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 12×
“Popular techniques use facial features and landmarks [24, 38, 49], video inconsistencies [15, 25], image processing [22], and even video metadata [13] to identify DeepFakes.”
InfluentialCeleb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 8×
“While they have been around in some form since at least 1997 [6], recent advancements in deep learning have led to the creation of extremely high quality DeepFake generators [11, 26, 30, 35, 38, 50].”
InfluentialDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
The Emergence of Deepfake Technology: A Review
Westerlund, M. (2019) · Technology Innovation Management Review · doi:10.22215/timreview/1282 · Cited by 1,138
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
MoCoGAN: Decomposing Motion and Content for Video Generation
Tulyakov, S., Liu, M.-Y., Yang, X., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00165 · Cited by 1,076
Research works printed but not linked: 10
- C.R. Barnes and T. Barraclough. 2019. Perception Inception: Preparing for Deepfakes and the Synthetic Media of Tomorrow. Brainbox, New Zealand. https://books.google.com.pk/books?id=rCGnzQEACAAJ
- D. Güera and E. J. Delp. 2018. Deepfake Video Detection Using Recurrent Neural Networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE Computer Society, Los Alamitos, CA, USA, 1–6.
- 10.1016/j.bushor.2019.11.006 · DOI · Paper page
- H. Li and Deepfake. 2019. The Emergence of Deepfake Technology: A Review.
- Yuezun Li and Siwei Lyu. 2019. Exposing DeepFake Videos By Detecting Face Warping Artifacts. In IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2019, June 16-20. Computer Vision Foundation / IEEE, Long Beach, CA, USA, 46–52. http://openaccess.thecvf.com/content_CVPRW_2019/html/Media_Forensics/Li_Exposing_DeepFake_Videos_By_Detecting_Face_Warping_Artifacts_CVPRW_2019_paper.html
- Ivan Perov Daiheng Gao Nikolay Chervoniy Kunlin Liu Sugasa Marangonda Chris Umé Mr. Dpfks Carl Shift Facenheim Luis RP Jian Jiang Sheng Zhang Pingyu Wu Bo Zhou and Weiming Zhang. 2020. DeepFaceLab: A simple flexible and extensible face swapping framework. https://arxiv.org/abs/2005.05535 · arXiv
- Ivan Perov Daiheng Gao Nikolay Chervoniy Kunlin Liu Sugasa Marangonda Chris Umé Mr. Dpfks Carl Shift Facenheim Luis RP Jian Jiang Sheng Zhang Pingyu Wu Bo Zhou and Weiming Zhang. 2020. DeepFaceLab: A simple flexible and extensible face swapping framework. arxiv:2005.05535 [cs.CV] · arXiv
- 10.1177/2056305120903408 · DOI · Paper page
- Cristian Vaccari and Andrew Chadwick. 2020. Deepfakes and disinformation: exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media+ Society 6, 1 (2020), 2056305120903408.
- Han Zhang, Ian Goodfellow, Dimitris Metaxas, and Augustus Odena. 2019. Self-attention generative adversarial networks. In International Conference on Machine Learning. PMLR, PMLR, Long Beach, California, USA, 7354–7363.
Cited by
Deepfakes: Deceptions, mitigations, and opportunities
Mustak, M., Salminen, J., Mäntymäki, M., Rahman, A., & Dwivedi, Y. K. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113368 · Cited by 209
Large-scale Text-to-Image Generation Models for Visual Artists’ Creative Works
Ko, H.-K., Park, G., Jeon, H., Jo, J., Kim, J., & Seo, J. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584078 · Cited by 189
Warning: Humans cannot reliably detect speech deepfakes
Mai, K. T., Bray, S., Davies, T., & Griffin, L. D. (2023) · PLOS ONE · doi:10.1371/journal.pone.0285333 · Cited by 98
Impact of Deepfake Technology on Social Media: Detection, Misinformation and Societal Implications
AL-KHAZRAJI, S. H., SALEH, H. H., KHALID, A. I., & MISHKHAL, I. A. (2023) · The Eurasia Proceedings of Science Technology Engineering and Mathematics · doi:10.55549/epstem.1371792 · Cited by 98
“Deepfake creators can employ sophisticated techniques to minimize or disguise forensic traces, making it challenging to detect manipulations (Tahir et al., 2021).”
The potential effects of deepfakes on news media and entertainment
Lundberg, E., & Mozelius, P. (2024) · AI & Society · doi:10.1007/s00146-024-02072-1 · Cited by 98
Metadata
- Authors
- Tahir, R., Batool, B., Jamshed, H., Jameel, M., Anwar, M., Ahmed, F., Zaffar, M. A., & Zaffar, M. F.
- Affiliations
- Cyber Security and Forensic Computing Department University of Prince Mugrin, Saudi Arabia
- Lahore University of Management Sciences (PK)
- Meta (United States) (US)
- ORCID
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-16
- OpenAlex
- W3162906949
- Cited by
- 79
- References
- 29
- Citations by year
- 2026: 16 · 2025: 16 · 2024: 26 · 2023: 12 · 2022: 8 · 2021: 1
- FWCI
- 3.84
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- deepfakes, deepfake detection, perceptual differences, human perception, disinformation, misinformation, low-literacy users, user study, awareness raising
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Seeing is Believing: Exploring Perceptual Differences in DeepFake Videos. https://app.cochat.ai/papers/10.1145/3411764.3445699
- The paper
- Tahir, R., Batool, B., Jamshed, H., Jameel, M., Anwar, M., Ahmed, F., Zaffar, M. A., & Zaffar, M. F. (2021). Seeing is Believing: Exploring Perceptual Differences in DeepFake Videos. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445699
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.