The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Open accessAbstract
Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained from a social network. Although numerous methods have been developed for detecting forged images and videos, they are generally targeted at certain domains and quickly become obsolete as new kinds of attacks appear. The method introduced in this paper uses a capsule network to detect various kinds of spoofs, from replay attacks using printed images or recorded videos to computer-generated videos using deep convolutional neural networks. It extends the application of capsule networks beyond their original intention to the solving of inverse graphics problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Self-citationFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
(2012) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 826
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Demo of Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2016) · ACM SIGGRAPH 2016 Emerging Technologies · doi:10.1145/2929464.2929475 · Cited by 589
Deep Representations for Iris, Face, and Fingerprint Spoofing Detection
Menotti, D., Chiachia, G., Pinto, A., Robson Schwartz, W., Pedrini, H., Xavier Falcao, A., & Rocha, A. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2398817 · Cited by 485
Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Niessner, M., Pérez, P., Richardt, C., Zollhöfer, M., & Theobalt, C. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201283 · Cited by 475
Learn Convolutional Neural Network for Face Anti-Spoofing
Yang, J., Lei, Z., & Li, S. Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5601 · Cited by 356
1Deep Representations for Iris, Face, and Fingerprint Spoofing DetectionPreprint
Menottiy, D., Chiachia, G., Pinto, A. D. S., Member, S., Schwartz, W. R., Pedrini, H., Falcão, R. X., & Rocha, A. D. R. (2016) · Cited by 353
Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Distinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · 2017 IEEE Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2017.8267647 · Cited by 318
Self-citationCan face anti-spoofing countermeasures work in a real world scenario?
de Freitas Pereira, T., Anjos, A., De Martino, J. M., & Marcel, S. (2013) · 2013 International Conference on Biometrics (ICB) · doi:10.1109/icb.2013.6612981 · Cited by 271
Transferable Deep-CNN Features for Detecting Digital and Print-Scanned Morphed Face Images
Raghavendra, R., Raja, K. B., Venkatesh, S., & Busch, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.228 · Cited by 204
Averbuch-Elor, H., Cohen-Or, D., Kopf, J., & Cohen, M. F. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130818 · Cited by 187
In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking
Li, Y., Chang, M., & Lyu, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02877 · Cited by 169
You said that?Preprint
Chung, J. S., Jamaludin, A., & Zisserman, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02966 · Cited by 152
Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks
Quan, W., Wang, K., Dong-ming Yan, A., & Zhang, X. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2834147 · Cited by 123
Face Liveness Detection From a Single Image via Diffusion Speed Model
Kim, W., Suh, S., & Han, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2422574 · Cited by 119
Deep face liveness detection based on nonlinear diffusion using convolution neural network
Alotaibi, A., & Mahmood, A. (2016) · Signal Image and Video Processing · doi:10.1007/s11760-016-1014-2 · Cited by 111
Nguyen, H. H., Tieu, T. N.-D., Nguyen-Son, H.-Q., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3230833.3230863 · Cited by 51
Self-citation
Research works printed but not linked: 1
- ito, 2017, Recent advances in biometrics security: A case study of liveness detection in face recognition, APSIPA ASC
Cited by
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“With the escalated concerns over the DeepFakes, there is a surge of interest in developing DeepFakes detection meth-ods recently [6, 17, 27, 53, 33, 28, 41, 40, 35, 34, 36], with an upcoming dedicated global DeepFake Detection Challenge 1 .”
BackgroundMethodDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
“…83.00 53.60 FWA[24] 80.10 56.90 Xception-raw[25] 99.70 48.20 Xception-c23[25] 99.70 65.30 Xception-c40[25] 95.50 65.50 Multi-task[29] 76.30 54.30 Capsule[30] 96.60 57.50 DSP-FWA[24] 93.00 64.60 Two Branch[26] 93.18 73.41 F 3 -Net[33] 98.10 65.17 EfficientNet-B4[39] 99.70 64.29 Ours 99.80 67.44”
InfluentialMedia Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Metadata
- Authors
- Nguyen, H. H., Yamagishi, J., & Echizen, I.
- Affiliations
- The Graduate University for Advanced Studies, SOKENDAI (JP)
- National Institute of Informatics (JP)
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 2307-2311
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2963720850
- Cited by
- 951
- References
- 29
- Citations by year
- 2026: 113 · 2025: 196 · 2024: 168 · 2023: 156 · 2022: 136 · 2021: 116 · 2020: 57 · 2019: 9
- FWCI
- 25.92
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Japan Society for the Promotion of Science
- Core Research for Evolutional Science and Technology
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Keywords
- image forgery detection, video forgery detection, capsule networks, deepfakes, replay attacks, inverse graphics, multimedia forensics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.