Countering Spoof: Towards Detecting Deepfake with Multidimensional Biological Signals
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
The deepfake technology is conveniently abused with the low technology threshold, which may bring the huge social security risks. As GAN-based synthesis technology is becoming stronger, various methods are difficult to classify the fake content effectively. However, although the fake content generated by GANs can deceive the human eyes, it ignores the biological signals hidden in the face video. In this paper, we proposed a novel video forensics method with multidimensional biological signals, which extracting the difference of the biological signal between real and fake videos from three dimensions. The experimental results show that our method achieves 98% accuracy on the main public dataset. Compared with other technologies, the proposed method only extracts fake video information and is not limited to a specific generation method, so it is not affected by synthetic methods and has good adaptability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, methods based on hard-to-find biological signals, such as heart rate, would be far less accurate due to video compression and other processing [39].”
From Multisemantic Path Neural Network for Deepfake Detection (2022) · cites this paper as [39]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Cited by
A Review of Image Processing Techniques for Deepfakes
Shahzad, H. F., Rustam, F., Flores, E. S., Luís Vidal Mazón, J., de la Torre Diez, I., & Ashraf, I. (2022) · Sensors · doi:10.3390/s22124556 · Cited by 79
“Intuitively, computer experts have designed algorithms that can measure biological signals using features from the video data such as changes in color, motion, subtle head movements, etc. [82].”
BackgroundA systematic literature review on the effectiveness of deepfake detection techniques
Stroebel, L., Llewellyn, M., Hartley, T., Ip, T. S., & Ahmed, M. (2023) · Journal of Cyber Security Technology · doi:10.1080/23742917.2023.2192888 · Cited by 66
Deepfakes: evolution and trends
Gil, R., Virgili‐Gomà, J., López, J. M., & García, R. (2023) · Soft Computing · doi:10.1007/s00500-023-08605-y · Cited by 50
“…Lu et al. (2021), Su et al. (2021), Luo et al. (2021), Biswas et al. (2021), Jiang et al. (2021), Korshunov and Marcel (2021), Chen and Tan (2021), Jin et al. (2021), Khalil et al. (2021), Gu et al. (2021), Yang et al. (2021c), Chintha et al. (2020a), Younus and Hasan (2020b), Korshunov and…”
Multimodal Neurosymbolic Approach for Explainable Deepfake Detection
Haq, I. U., Malik, K. M., & Muhammad, K. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3624748 · Cited by 37
“For instance, Jin et al. [ 18 ] used a multidimensional feature space from the RGB, Y U V, and chromatic dimensions to extract heart rate from a visual modality.”
Video authentication detection using deep learning: a systematic literature review
Alrawahneh, A. A.-M., Abdullah, S. N. H. S., Abdullah, S. N. H. S., Kamarudin, N. H., & Taylor, S. K. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05997-8 · Cited by 31
“C) of 98.07% for Xcep‑ tionNet and 99.83% for MesoNet in detecting deepfakes However, [45] used a DNN to analyze biological sig‑ nals for deepfake detection.”
InfluentialAn Improved DeepFake Detection Approach with NASNetLarge CNN
İlhan, İ., Bali, E., & Karaköse, M. (2022) · International Conference on Data Analytics for Business and Industry (ICDABI) · doi:10.1109/icdabi56818.2022.10041558 · Cited by 22
“FF++, DFD, UADFV datasets were used for training the method [11].”
MethodMultisemantic Path Neural Network for Deepfake Detection
Wu, N., Jin, X., Jiang, Q., Wang, P., Zhang, Y., Yao, S., & Zhou, W. (2022) · Security and Communication Networks · doi:10.1155/2022/4976848 · Cited by 9
“Besides, methods based on hard-to-find biological signals, such as heart rate, would be far less accurate due to video compression and other processing [39].”
MethodSelf-citationLearning domain-invariant representation for generalizing face forgery detection
Wu, Y., Wo, Y., Li, C., & Han, G. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103280 · Cited by 13
Aguilar, D., Martínez-Cruz, A., Ramírez-Gutiérrez, K. A., & Morales‐Sandoval, M. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.11.006 · Cited by 6
Exploring Deepfake Detection: Techniques, Datasets and Challenges
Rana, P., & Bansal, S. R. (2024) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/160156 · Cited by 12
A Method for Deepfake Detection Using Convolutional Neural Networks
Volkova, S. (2023) · Scientific and Technical Information Processing · doi:10.3103/s0147688223050143 · Cited by 9
Image Feature Detectors for Deepfake Image Detection Using Transfer Learning
Alheeti, K. M. A., Al-Rawi, S. S., Khalaf, H. A., & Dosary, D. A. (2021) · International Conference on Developments in eSystems Engineering (DeSE) · doi:10.1109/dese54285.2021.9719332 · Cited by 9
Artifact Based Deepfake Detection Methods
Preeti, P., & Bansal, S. R. (2023) · International Conference on Informatics (ICI) · doi:10.1109/ici60088.2023.10421629 · Cited by 7
“In Biological signals-based methods [18] biological signals are extracted from this observation to detect deepfake videos.”
MethodA Review on Deepfake Image Detection Approaches, Techniques and Methods
Ng, J., Jasser, M. B., Issa, B., Ajibade, S.-S. M., & Chua, H. N. (2025) · IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS) · doi:10.1109/i2cacis65476.2025.11100461 · Cited by 3
“The projects that involved Biological Analysis are [28], [18], [17], [16], [23].”
Addressing Deepfake Technologies Through Detection and Regulation: A Systematic Survey
Ibrahim, R. (2025) · East Journal of Applied Science · doi:10.63496/ejas.vol1.iss4.104 · Cited by 1
“For example: Study (Jin, Ye, and Chen 2021b) achieved 98% accuracy using biological signals.”
InfluentialRana, P., Bansal, S., Nagar, S., & Malik, A. (2025) · International Conference on Sustainability, Innovation & Technology (ICSIT) · doi:10.1109/icsit65336.2025.11294796 · Cited by 1
“Methods like optical flow analysis [18] are mainly used to detect such media.”
Wang, J., & Wang, Q. (2022) · International Conference on Smart Systems and Inventive Technology (ICSSIT) · doi:10.1109/icssit53264.2022.9716439
“Among them, the feature matching based on epipolar geometry uses the RANSAC algorithm to calcu late the basic matrix and eliminate most false matches [1-3].”
MethodDeep Ensemble Learning Approach for Face Anti-Spoofing Detection based on Pre-trained Models
Vannurswamy, K., Shekar, B. H., Pilar, B., Karunakar, A. K., & Jiang, F. (2024) · IEEE International Conference on Computer Vision and Machine Intelligence (CVMI) · doi:10.1109/cvmi61877.2024.10782399
Metadata
- Authors
- Jin, X., Ye, D., & Chen, C.
- Affiliations
- Wuhan University (CN)
- Corresponding author
- Ye, Dengpan
- Venue
- Security and Communication Networks
- Publisher
- Wiley
- Published
- 2021-04-22
- Volume
- 2021
- Pages
- 1-8
- ISSN
- 1939-0114 (ISSN-L)
- 1939-0122
- OpenAlex
- W3155922523
- Cited by
- 17
- References
- 32
- Citations by year
- 2025: 3 · 2024: 3 · 2023: 6 · 2022: 4 · 2021: 1
- FWCI
- 1.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Security and Communication Networks (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Key Research Development Program of China (2019QY(Y)0206, 62072343, U1736211)
- National Natural Science Foundation of China (2019QY(Y)0206, 62072343, U1736211)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, video forensics, biological signals, facial video, anti-spoofing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.