ABC-CapsNet: Attention based Cascaded Capsule Network for Audio Deepfake Detection
Open accessAbstract
In response to the escalating challenge of audio deepfake detection, this study introduces ABC-CapsNet (Attention-Based Cascaded Capsule Network), a novel architecture that merges the perceptual strengths of Mel spectrograms with the robust feature extraction capabilities of VGG18, enhanced by a strategically placed attention mechanism. This architecture pioneers the use of cascaded capsule networks to delve deeper into complex audio data patterns, setting a new standard in the precision of identifying manipulated audio content. Distinctively, ABC-CapsNet not only addresses the inherent limitations found in traditional CNN models but also showcases remarkable effectiveness across diverse datasets. The proposed method achieved an equal error rate EER of 0.06% on the ASVspoof2019 dataset and an EER of 0.04% on the FoR dataset, underscoring the superior accuracy and reliability of the proposed system in combating the sophisticated threat of audio deepfakes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Combining state-of-the-art backend models with traditional handcrafted features can outperform systems utilising learning-based features alone.
“Studies by Wani et al. [105] and Ulutas et al. [142] have further demonstrated that combining SOTA backend models with traditional handcrafted features can outperform systems utilising learning-based features alone, underscoring the importance of a well-chosen backend in achieving optimal performance.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [105]
The Contributions and Benchmarking sections describe a system that combines Mel spectrograms with VGG18 and capsule networks and reports better results than the cited prior systems. They do not compare that combination with a system using learning-based features alone, so the specific outperformance claim is not demonstrated by this paper. (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe MelSpec+ABC-CapsNet system achieved state-of-the-art performance on the ASVspoof 2019 LA dataset without employing any data augmentation.
“Notably, the MelSpec+ABC-CapsNet system proposed by Wani et al. [105] achieved SOTA performance on the ASVspoof 2019 LA dataset without employing any DA.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [105]
Section 4.3 reports results on ASVspoof 2019 LA, and Table 1 compares the method’s 0.06% EER with higher EERs for the listed state-of-the-art methods. The paper describes ABC-CapsNet as using Mel spectrograms, but our copy does not state that its training used no data augmentation; its mentions of augmentation in Related Works concern other systems. (LLM, conf=0.86)
Experimental — accuracy not yet measuredWani et al. used an Attention-Based Cascaded Capsule Network as a backend model, achieving exceptional results that surpassed other SOTA methods.
“Wani et al. [105] utilised an Attention-Based Cascaded Capsule Network (ABC-CapsNet) as a backend model, achieving exceptional results that surpassed other SOTA methods.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167 · see citing works
One Pixel Attack for Fooling Deep Neural Networks
Su, J., Vargas, D. V., & Sakurai, K. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2890858 · Cited by 2,406 · see citing works
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918 · see citing works
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688 · see citing works
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687 · see citing works
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535 · see citing works
Does Audio Deepfake Detection Generalize?Preprint
Müller, N. M., Czempin, P., Dieckmann, F., et al. (2022) · Interspeech · doi:10.48550/arxiv.2203.16263 · Cited by 401 · see citing works
Mensah, P. K., Adekoya, A. F., Ayidzoe, M. A., & Baagyere, E. Y. (2019) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.09.014 · Cited by 291 · see citing works
Deepfake Audio Detection via MFCC features using Machine Learning
Hamza, A., Javed, A. R. R., Iqbal, F., Kryvinska, N., Almadhor, A. S., Jalil, Z., & Borghol, R. (2022) · IEEE Access · doi:10.1109/access.2022.3231480 · Cited by 264 · see citing works
Does Audio Deepfake Detection Generalize?
Müller, N., Czempin, P., Diekmann, F., Froghyar, A., & Böttinger, K. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-108 · Cited by 258 · see citing works
FoR: A Dataset for Synthetic Speech Detection
Reimao, R., & Tzerpos, V. (2019) · 2019 International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped.2019.8906599 · Cited by 193 · see citing works
A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions
Almutairi, Z., & Elgibreen, H. (2022) · Algorithms · doi:10.3390/a15050155 · Cited by 187 · see citing works
A deep learning framework for audio deepfake detection
Khochare, J., Joshi, C., Yenarkar, B., Suratkar, S., & Kazi, F. (2022) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-06297-w · Cited by 135 · see citing works
ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plan
Delgado, H., Evans, N., Kinnunen, T., Lee, K. A., Liu, X., Nautsch, A., Patino, J., Sahidullah, M., Todisco, M., Wang, X., et al. (2021) · arXiv · doi:10.48550/arxiv.2109.00535 · Cited by 129 · see citing works
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121 · see citing works
The effect of deep learning methods on deepfake audio detection for digital investigation
Mcuba, M., Singh, A., Ikuesan, R. A., & Venter, H. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.01.283 · Cited by 117 · see citing works
A Capsule Network Based Approach for Detection of Audio Spoofing Attacks
Luo, A., Li, E., Liu, Y., Kang, X., & Wang, Z. J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414670 · Cited by 84 · see citing works
Mel spectrogram-based audio forgery detection using CNN
Üstübıoğlu, A., Üstübioğlu, B., & Ulutaş, G. (2022) · Signal Image and Video Processing · doi:10.1007/s11760-022-02436-4 · Cited by 83 · see citing works
Attacking convolutional neural network using differential evolution
Su, J., Vargas, D. V., & Sakurai, K. (2019) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-019-0053-3 · Cited by 66 · see citing works
An Initial Investigation for Detecting Partially Spoofed Audio
Zhang, L., Wang, X., Cooper, E., Yamagishi, J., Patino, J., & Evans, N. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-738 · Cited by 43 · see citing works
Xue, J., Fan, C., Lv, Z., Tao, J., Yi, J., Zheng, C., Wen, Z., Yuan, M., & Shao, S. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556526 · Cited by 40 · see citing works
Audio Deepfake Detection System with Neural Stitching for ADD 2022
Yan, R., Cheng, W. M., Zhou, S., Guo, T., Zou, W., & Li, X. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746820 · Cited by 27 · see citing works
Deepfakes Audio Detection Leveraging Audio Spectrogram and Convolutional Neural Networks
Wani, T. M., & Amerini, I. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43153-1_14 · Cited by 20 · see citing works
Self-citationPT-CapsNet: A Novel Prediction-Tuning Capsule Network Suitable for Deeper Architectures
Pan, C., & Velipasalar, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01178 · Cited by 16 · see citing works
ASVspoof 2015: Automatic speaker verification spoofing and countermeasures challenge evaluation plan
Wu, Z. K. (2014) · Graduate School and Research Center in Digital Science (EURECOM) · Cited by 12 · see citing works
Learning with Capsules: A SurveyPreprint
Ribeiro, F. D. S., Duarte, K., Everett, M., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.02664 · Cited by 6 · see citing works
ConvNeXt Based Neural Network for Audio Anti-SpoofingPreprint
Ma, Q., Zhong, J., Yang, Y., Liu, W., Gao, Y., & Ng, W. W. Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.06434 · Cited by 4 · see citing works
Identification of Synthetic Spoofed Speech with Deep Capsule Network
Mao, T., Yan, D., Gong, Y., & Wang, R. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-0523-0_17 · Cited by 2 · see citing works
An Initial Investigation for Detecting Partially Spoofed AudioPreprint
Zhang, L., Wang, X., Cooper, E., Yamagishi, J., Patino, J., & Evans, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.02518 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [16]16. Sara Sabour, Nicholas Frosst, and Geoffrey E Hinton. Dy- namic routing between capsules. Advances in neural infor- mation processing systems, 30, 2017.
- [21]21. Kishan Vyas, Preksha Pareek, Ruchi Jayaswal, and Shruti Patil. Analysing the landscape of deep fake detection: A survey. International Journal of Intelligent Systems and Ap- plications in Engineering, 12(11s):40-55, 2024.
- [22]22. Taiba Majid Wani and Irene Amerini. Deepfakes audio de- tection leveraging audio spectrogram and convolutional neu- ral networks. In International Conference on Image Analysis and Processing, pages 156-167. Springer, 2023.
Cited by
Sorted by citations
Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead
Zhang, B., Cui, H., Nguyen, V., & Whitty, M. (2025) · Sensors · doi:10.3390/s25071989 · Cited by 72 · see citing works
Audio Deepfake Detection via a Fuzzy Dual-Path Time-Frequency Attention Network
Li, J., Wang, H., Xie, F., Feng, X., Chen, J., Liu, J., & Wang, J. (2025) · Sensors · doi:10.3390/s25247608 · Cited by 4 · see citing works
Review of AIGC passive detection and proactive protection
Liu, X.-L., Liu, H.-C., Zhao, Y., Ni, R.-R., Li, X.-L., & Guo, M.-Z. (2025) · Scientia Sinica Informationis · doi:10.1360/ssi-2025-0043 · Cited by 3 · see citing works
Nguyen-Le, H.-H., Tran, V.-T., Nguyen, D.-T., & Le-Khac, N.-A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11608-4 · Cited by 1 · see citing works
Capsule Networks and LSTM Models for Robust Deepfake Detection in Audio and Video
Abisha, M. B., Kathrine, G. J. W., & Kushmitha, S. (2024) · International Conference on IoT Based Control Networks and Intelligent Systems (ICICNIS) · doi:10.1109/icicnis64247.2024.10823109 · Cited by 2 · see citing works
STC-CapsNet: Detecting Audio Deepfakes with Spatio-Temporal Convolutions and Capsule Networks
Wani, T. M., Qadri, S. A. A., & Amerini, I. (2025) · doi:10.1109/cism64958.2025.11060861 · Cited by 1 · see citing works
Self-citationASTDT: an Interpretable Adaptive Spectro-Temporal Diffusion Transformer for audio deepfake detection
Wani, T. M., Qadri, S. A. A., Ashraf, A., & Amerini, I. (2025) · EURASIP Journal on Information Security · doi:10.1186/s13635-025-00217-3 · Cited by 2 · see citing works
Self-citationJahan, F., Shifat, S. M., Morol, M. K., Fahad, N., Goh, K. O. M., Nandi, D., Abdullah-Al-Jubair, M., & Hossen, M. J. (2026) · Discover Applied Sciences · doi:10.1007/s42452-026-08402-w · Cited by 2 · see citing works
Predictive Techniques for Identifying and Classifying Real and Ai-Generated VoicesPreprint
Shukla, M., Saraswat, A., Mallick, S., & Mishra, M. S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5035352 · Cited by 1 · see citing works
Awodiji, T. O., & Owoyemi, J. (2024) · IARJSET · doi:10.17148/iarjset.2024.114109
SoundVerify: Transformer-Based Detection and Profiling of Hindi Voice Impersonations
Furiya, P., Nair, A., Munshi, A., & Kulkarni, V. H. (2025) · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct65861.2025.11306677
Tri-View Collaborative Graph Learning for Robust Deepfake Speech Detection
Zhang, K., Zhao, Y., Hua, Z., Zhang, Y., Liao, Q., & Jiang, W. Y. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3660668
Uddin, K., Khan, A. A., Farooq, M. U., & Malik, K. M. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00161 · Cited by 1 · see citing works
AdaParse: Personalized Fingerprinting for Visual Generative Model Reverse Engineering
Zheng, Y., Li, Z., Yu, B., Zhou, J., & Lu, J. (2026) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2026.3671095
Annaram, S. S., & Gopichand, G. (2026) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-026-01367-z
- Authors
- Wani, T. M., Gulzar, R., & Amerini, I.
- Affiliations
- Sapienza University of Rome (IT)
- Venue
- 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
- Publisher
- IEEE
- Published
- 2024-06-17
- Pages
- 2464-2472
- OpenAlex
- W4402916306
- Cited by
- 14
- References
- 24
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 3
- FWCI
- 4.04
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (publishedVersion)
- IRIS Research product catalog (Sapienza University of Rome) (submittedVersion, other-oa)
- Funders
- European Commission (PE00000014)
- Sapienza Università di Roma
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- audio deepfake detection, attention mechanism, Mel spectrogram, ASVspoof 2019
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review