A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
When creating a forgery, a forger can modify an image using many different image editing operations. Since a forensic examiner must test for each of these, significant interest has arisen in the development of universal forensic algorithms capable of detecting many different image editing operations and manipulations. In this paper, we propose a universal forensic approach to performing manipulation detection using deep learning. Specifically, we propose a new convolutional network architecture capable of automatically learning manipulation detection features directly from training data. In their current form, convolutional neural networks will learn features that capture an image's content as opposed to manipulation detection features. To overcome this issue, we develop a new form of convolutional layer that is specifically designed to suppress an image's content and adaptively learn manipulation detection features. Through a series of experiments, we demonstrate that our proposed approach can automatically learn how to detect multiple image manipulations without relying on pre-selected features or any preprocessing. The results of these experiments show that our proposed approach can automatically detect several different manipulations with an average accuracy of 99.10%.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is threatening to world se- curity when deepfake methods can be employed to cre- ate videos of world leaders with fake speeches for falsi- fication purposes [10–12].”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [10]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2010) · International Conference on Machine Learning · Cited by 13,995
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
(1989) · neural information processing systems · Cited by 3,736
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
Research works printed but not linked: 2
- Le Cun B. B., 1990, Citeseer
- Nair V., 2010, International Conference on Machine Learning, 807
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
Learning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Wu, Y., AbdAlmageed, W., & Natarajan, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00977 · Cited by 647
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Bayar, B., & Stamm, M. C. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2825953 · Cited by 599
Self-citationMulti-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499
Hybrid LSTM and Encoder–Decoder Architecture for Detection of Image Forgeries
Bappy, J. H., Simons, C., Nataraj, L., Manjunath, B. S., & Roy-Chowdhury, A. K. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2895466 · Cited by 477
Two-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L., & Fritz, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 437
Zhang, R., Zhu, F., Liu, J., & Liu, G. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2936913 · Cited by 420
Detection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399
Image Splicing Localization using a Multi-task Fully Convolutional Network (MFCN)
Salloum, R., Ren, Y., & Jay Kuo, C.-C. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.01.010 · Cited by 395
Leveraging Frequency Analysis for Deep Fake Image Recognition
Frank, J., Eisenhofer, T., Schönherr, L., Fischer, A., Kolossa, D., & Holz, T. (2020) · arXiv · doi:10.48550/arxiv.2003.08685 · Cited by 390
DeepFake Detection by Analyzing Convolutional Traces
Guarnera, L., Giudice, O., & Battiato, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00341 · Cited by 374
What Makes Fake Images Detectable? Understanding Properties that Generalize
Chai, L., Bau, D., Lim, S.-N., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_7 · Cited by 357
Li, J., Xie, H., Li, J., Wang, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00639 · Cited by 357
Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349
“Much larger improvements are observed for the network proposed in [2], which closes almost always the performance gap and sometimes outperforms slightly the proposed CNN.”
BackgroundMethodInfluentialFaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Local Relation Learning for Face Forgery Detection
Chen, S., Yao, T., Chen, Y., Ding, S., Li, J., & Ji, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16193 · Cited by 334
Detecting GAN generated Fake Images using Co-occurrence Matrices
Nataraj, L., Mohammed, T. M., Manjunath, B. S., Chandrasekaran, S., Flenner, A., Bappy, J. H., & Roy-Chowdhury, A. K. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.5.mwsf-532 · Cited by 331
DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern
Jung, T., Kim, S., & Kim, K. (2020) · IEEE Access · doi:10.1109/access.2020.2988660 · Cited by 326
Exploring Temporal Coherence for More General Video Face Forgery Detection
Zheng, Y., Bao, J., Chen, D., Zeng, M., & Wen, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01477 · Cited by 320
DeepFake Detection Based on Discrepancies Between Faces and Their Context
Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3093446 · Cited by 312
DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.07634 · Cited by 280
TruFor: Leveraging All-Round Clues for Trustworthy Image Forgery Detection and Localization
Guillaro, F., Cozzolino, D., Sud, A., Dufour, N., & Verdoliva, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01974 · Cited by 275
“In [35] a set of around 30 fixed high-pass filters are used, instead in [3] the high-pass filters are learnt during training.”
BackgroundFirst Steps Toward Camera Model Identification With Convolutional Neural Networks
Bondi, L., Baroffio, L., Guera, D., Bestagini, P., Delp, E. J., & Tubaro, S. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2641006 · Cited by 271
Exploiting Spatial Structure for Localizing Manipulated Image Regions
Bappy, J. H., Roy-Chowdhury, A. K., Bunk, J., Nataraj, L., & Manjunath, B. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.532 · Cited by 262
SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization
Hu, X., Zhang, Z., Jiang, Z., Chaudhuri, S., Yang, Z., & Nevatia, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_19 · Cited by 261
IMD2020: A Large-Scale Annotated Dataset Tailored for Detecting Manipulated Images
Novozamsky, A., Mahdian, B., & Saic, S. (2020) · 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw50321.2020.9096940 · Cited by 248
Sharp Multiple Instance Learning for DeepFake Video Detection
Li, X., Lang, Y., Chen, Y., Mao, X., He, Y., Wang, S., Xue, H., & Lu, Q. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414034 · Cited by 234
Large-Scale JPEG Image Steganalysis Using Hybrid Deep-Learning Framework
Zeng, J., Tan, S., Li, B., & Huang, J. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2779446 · Cited by 226
DEFACTO: Image and Face Manipulation Dataset
Mahfoudi, G., Tajini, B., Retraint, F., Morain-Nicolier, F., Dugelay, J., & Pic, M. M. (2019) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2019.8903181 · Cited by 223
Use of a Capsule Network to Detect Fake Images and VideosPreprint
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12467 · Cited by 222
ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
Cozzolino, D., Thies, J., Rössler, A., Riess, C., Nießner, M., & Verdoliva, L. (2018) · arXiv · doi:10.48550/arxiv.1812.02510 · Cited by 221
Aligned and non-aligned double JPEG detection using convolutional neural networks
Barni, M., Bondi, L., Bonettini, N., Bestagini, P., Costanzo, A., Maggini, M., Tondi, B., & Tubaro, S. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.09.003 · Cited by 221
DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413707 · Cited by 220
Implicit identity leakage: The stumbling block to improving deepfake detection generalization
Dong, S., Wang, J., Ji, R., Liang, J., Fan, H., & Ge, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00389 · Cited by 220
Camera model identification with the use of deep convolutional neural networks
Tuama, A., Comby, F., & Chaumont, M. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823908 · Cited by 220
Imran, M., Ofli, F., Caragea, D., & Torralba, A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102261 · Cited by 217
Forensic Similarity for Digital Images
Mayer, O., & Stamm, M. C. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2924552 · Cited by 209
Self-citationTampering Detection and Localization Through Clustering of Camera-Based CNN Features
Bondi, L., Lameri, S., Guera, D., Bestagini, P., Delp, E. J., & Tubaro, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.232 · Cited by 206
Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images Detection
Tan, C., Zhao, Y., Wei, S., Gu, G., & Wei, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01165 · Cited by 203
Detection and Localization of Image Forgeries Using Resampling Features and Deep Learning
Bunk, J., Bappy, J. H., Mohammed, T. M., Nataraj, L., Flenner, A., Manjunath, B. S., Chandrasekaran, S., Roy-Chowdhury, A. K., & Peterson, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.235 · Cited by 195
Predicting image credibility in fake news over social media using multi-modal approach
Singh, B., & Sharma, D. K. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06086-4 · Cited by 187
Intelligent Machine Vision Model for Defective Product Inspection Based on Machine Learning
Benbarrad, T., Salhaoui, M., Kenitar, S. B., & Arioua, M. (2021) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan10010007 · Cited by 186
Masked Relation Learning for DeepFake Detection
Yang, Z., Liang, J., Xu, Y., Zhang, X., & He, R. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3249566 · Cited by 185
On the Generalization of GAN Image Forensics
Xuan, X., Peng, B., Wang, W., & Dong, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-31456-9_15 · Cited by 184
A deep learning approach to patch-based image inpainting forensics
Zhu, X., Qian, Y., Zhao, X., Sun, B., & Sun, Y. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.05.015 · Cited by 182
Scene Classification Based on Multiscale Convolutional Neural Network
Liu, Y., Zhong, Y., & Qin, Q. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2848473 · Cited by 181
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180
Perceptual hashing for image authentication: A survey
Du, L., Ho, A. T. S., & Cong, R. (2019) · Signal Processing Image Communication · doi:10.1016/j.image.2019.115713 · Cited by 178
Deepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176
JPEG-Phase-Aware Convolutional Neural Network for Steganalysis of JPEG Images
Chen, M., Sedighi, V., Boroumand, M., & Fridrich, J. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083248 · Cited by 176
Fake Faces Identification via Convolutional Neural Network
Mo, H., Chen, B., & Luo, W. (2018) · Proceedings of the 6th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3206004.3206009 · Cited by 175
Robust Detection of Image Operator Chain With Two-Stream Convolutional Neural Network
Liao, X., Li, K., Zhu, X., & Liu, K. J. R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002391 · Cited by 175
A survey on image tampering and its detection in real-world photos
Zheng, L., Zhang, Y., & Thing, V. L. L. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.12.022 · Cited by 174
F 2 Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172
Finding robust domain from attacks: A learning framework for blind watermarking
Mun, S.-M., Nam, S.-H., Jang, H., Kim, D., & Lee, H.-K. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.067 · Cited by 166
MARLIN: Masked Autoencoder for facial video Representation LearnINg
Cai, Z., Ghosh, S., Stefanov, K., Dhall, A., Cai, J., Rezatofighi, H., Haffari, R., & Hayat, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00150 · Cited by 165
Exploiting Fine-Grained Face Forgery Clues via Progressive Enhancement Learning
Gu, Q., Chen, S., Yao, T., Chen, Y., Ding, S., & Yi, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19954 · Cited by 158
Localization of JPEG Double Compression Through Multi-domain Convolutional Neural Networks
Amerini, I., Uricchio, T., Ballan, L., & Caldelli, R. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.233 · Cited by 157
A Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detection
Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G. (2020) · IEEE Access · doi:10.1109/access.2020.3009877 · Cited by 156
Du, X., Hargreaves, C. J., Sheppard, J., Anda, F., Sayakkara, A., Le‐Khac, N., & Scanlon, M. (2020) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3407023.3407068 · Cited by 152
Recent advances in digital image manipulation detection techniques: A brief review
Thakur, R., & Rohilla, R. (2020) · Forensic Science International · doi:10.1016/j.forsciint.2020.110311 · Cited by 149
Detection of Face Morphing Attacks by Deep Learning
Seibold, C., Samek, W., Hilsmann, A., & Eisert, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-64185-0_9 · Cited by 140
Fact-Checking Meets Fauxtography: Verifying Claims About Images
Zlatkova, D., Nakov, P., & Koychev, I. K. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1216 · Cited by 139
Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection
Miao, C., Tan, Z., Chu, Q., Yu, N., & Guo, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3198275 · Cited by 138
A Convolutional LSTM based Residual Network for Deepfake Video DetectionPreprint
Tariq, S., Lee, S., & Woo, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07480 · Cited by 138
AltFreezing for More General Video Face Forgery Detection
Wang, Z., Bao, J., Zhou, W., Wang, W., & Li, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00402 · Cited by 137
“Earlier works [8, 10, 11] mostly focus on searching spatial artifacts.”
BackgroundMethodFrePGAN: Robust Deepfake Detection Using Frequency-Level Perturbations
Jeong, Y., Kim, D., Ro, Y., & Choi, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19990 · Cited by 137
Deep learning in steganography and steganalysis
Chaumont, M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819438-6.00022-0 · Cited by 137
TransForensics: Image Forgery Localization with Dense Self-Attention
Hao, J., Zhang, Z., Yang, S., Xie, D., & Pu, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01478 · Cited by 137
CORE: Consistent Representation Learning for Face Forgery Detection
Ni, Y., Meng, D., Yu, C., Quan, C., Ren, D., & Zhao, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00011 · Cited by 136
A Survey of Deep Learning-Based Source Image Forensics
Yang, P., Baracchi, D., Ni, R., Zhao, Y., Argenti, F., & Piva, A. (2020) · Journal of Imaging · doi:10.3390/jimaging6030009 · Cited by 133
Deep Learning-Based Digital Image Forgery Detection System
Qazi, E.-U.-H., Zia, T. A., & Almorjan, A. (2022) · Applied Sciences · doi:10.3390/app12062851 · Cited by 132
Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks
Quan, W., Wang, K., Dong-ming Yan, A., & Zhang, X. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2834147 · Cited by 128
Making Images Real Again: A Comprehensive Survey on Deep Image CompositionPreprint
Niu, L., Cong, W., Liu, L., Hong, Y., Zhang, B., Liang, J., & Zhang, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14490 · Cited by 127
RETRACTED ARTICLE: Deepfake detection using rationale-augmented convolutional neural network
Ahmed, S. R., & Sonuç, E. (2021) · Applied Nanoscience · doi:10.1007/s13204-021-02072-3 · Cited by 125
RetractedClassification and Analysis of Pistachio Species with Pre-Trained Deep Learning Models
Singh, D., Taşpınar, Y. S., Kursun, R., Çınar, İ., Köklü, M., Özkan, İ. A., & Lee, H.-N. (2022) · Electronics · doi:10.3390/electronics11070981 · Cited by 125
Deep Learning for Deepfakes Creation and Detection.Preprint
Nguyen, T. T., Nguyen, C. M., Nguyen, D. T., Nguyen, T. T., & Nahavandi, S. (2019) · arXiv (Cornell University) · Cited by 125
Deep Learning for Deepfakes Creation and Detection: A SurveyPreprint
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · arXiv (Cornell University) · doi:10.6084/m9.figshare.12731039.v1 · Cited by 124
Detect and locate: Exposing face manipulation by semantic-and noise-level telltales
Kong, C., Chen, B., Li, H., Wang, S., Rocha, A., & Kwong, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3169921 · Cited by 120
Design Principles of Convolutional Neural Networks for Multimedia Forensics
Bayar, B., & Stamm, M. C. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-328 · Cited by 120
Self-citationPRRNet: Pixel-Region relation network for face forgery detection
Shang, Z., Xie, H., Zha, Z.-J., Yu, L., Li, Y., & Zhang, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107950 · Cited by 117
Ganguly, S., Ganguly, A., Mohiuddin, S., Malakar, S., & Sarkar, R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118423 · Cited by 115
Towards Generalizable Deepfake Detection with Locality-aware AutoEncoder
Du, M., Pentyala, S., Li, Y., & Hu, X. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411892 · Cited by 114
Metadata
- Authors
- Bayar, B., & Stamm, M. C.
- Affiliations
- Drexel University (US)
- Venue
- Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security
- Publisher
- ACM
- Published
- 2016-06-20
- Pages
- 5-10
- OpenAlex
- W2412509443
- Cited by
- 838
- References
- 24
- Citations by year
- 2026: 43 · 2025: 94 · 2024: 91 · 2023: 117 · 2022: 136 · 2021: 93 · 2020: 106 · 2019: 56 · 2018: 66 · 2017: 31 · 2016: 5
- FWCI
- 18.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Keywords
- image forgery detection, image forensics, convolutional neural networks, image tampering, deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.