A Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detection
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Due to limited computational and memory resources, current deep learning models accept only rather small images in input, calling for preliminary image resizing. This is not a problem for high-level vision problems, where discriminative features are barely affected by resizing. On the contrary, in image forensics, resizing tends to destroy precious high-frequency details, impacting heavily on performance. One can avoid resizing by means of patch-wise processing, at the cost of renouncing whole-image analysis. In this work, we propose a CNN-based image forgery detection framework which makes decisions based on full-resolution information gathered from the whole image. Thanks to gradient checkpointing, the framework is trainable end-to-end with limited memory resources and weak (image-level) supervision, allowing for the joint optimization of all parameters. Experiments on widespread image forensics datasets prove the good performance of the proposed approach, which largely outperforms all baselines and all reference methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Self-citationRich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
An Evaluation of Popular Copy-Move Forgery Detection Approaches
Christlein, V., Riess, C., Jordan, J., Riess, C., & Angelopoulou, E. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2218597 · Cited by 802
Training Deep Nets with Sublinear Memory Cost
Chen, T., Xu, B., Zhang, C., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1604.06174 · Cited by 561
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499
Self-citationDetection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399
Self-citationCozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349
Self-citationMFC Datasets: Large-Scale Benchmark Datasets for Media Forensic Challenge Evaluation
Guan, H., Kozak, M., Robertson, E., Lee, Y., Yates, A. N., Delgado, A., Zhou, D., Kheyrkhah, T., Smith, J., & Fiscus, J. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00018 · Cited by 329
Research works printed but not linked: 36
- 10.1117/12.525375 · DOI · Paper page
- 10.1186/s13635-017-0067-2 · DOI · Paper page
- cozzolino, 2018, ForensicTransfer: Weakly-supervised domain adaptation for forgery detection, arXiv 1812 02510
- 10.1109/TIP.2019.2895466 · DOI · Paper page
- 10.1016/j.jvcir.2018.01.010 · DOI · Paper page
- huh, 2018, Fighting fake news: Image splice detection via learned self-consistency, Proc Eur Conf Comput Vis, 101
- 10.23919/EUSIPCO.2018.8553581 · DOI
- 10.1109/CVPRW.2017.232 · DOI · Paper page
- 10.1109/WIFS.2016.7823921 · DOI · Paper page
- 10.1109/TIFS.2012.2202227 · DOI · Paper page
- 10.1109/ICME.2007.4284574 · DOI · Paper page
- 10.1109/TIFS.2012.2187516 · DOI · Paper page
- 10.1109/TIFS.2007.916285 · DOI · Paper page
- 10.1109/TIFS.2014.2302078 · DOI · Paper page
- kirchner, 2010, On detection of median filtering in digital images, Proc SPIE Electronic Imaging Media Forensics and Security XI, 7541, 101
- 10.1109/ICIP.2014.7026072 · DOI · Paper page
- 10.1109/TCSVT.2014.2347513 · DOI
- 10.1109/WIFS.2015.7368565 · DOI · Paper page
- 10.1109/TCSVT.2016.2599849 · DOI · Paper page
- 10.1109/CVPR.2018.00116 · DOI · Paper page
- 10.1109/ICPR.2018.8545647 · doi:10.1109/icpr.2018.8545647
- 10.1109/TIFS.2014.2300937 · DOI · Paper page
- 10.1109/TIFS.2015.2455334 · DOI · Paper page
- 10.1007/s11042-018-6922-4 · DOI
- 10.1007/s11042-016-4276-3 · DOI
- 10.1016/j.imavis.2009.02.001 · DOI · Paper page
- 10.1109/WIFS.2016.7823898 · DOI
- 10.1109/TSP.2004.839896 · DOI · Paper page
- 10.1109/TIFS.2013.2265677 · DOI · Paper page
- 10.1016/j.patcog.2012.05.014 · DOI · Paper page
- 10.1007/978-3-540-92238-4_13 · DOI
- 10.1109/WIFS.2016.7823911 · DOI · Paper page
- 10.1145/1774088.1774427 · DOI · Paper page
- 10.1109/CVPR.2019.00977 · DOI · Paper page
- szegedy, 2017, Inception-v4, inception-resnet and the impact of residual connections on learning, Proc 31st AAAI Conf Artif Intell, 4278
- 10.1145/3206004.3206010 · DOI · Paper page
Cited by
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Self-citationTruFor: Leveraging All-Round Clues for Trustworthy Image Forgery Detection and Localization
Guillaro, F., Cozzolino, D., Sud, A., Dufour, N., & Verdoliva, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01974 · Cited by 275
Self-citationAre GAN Generated Images Easy to Detect? A Critical Analysis of the State-Of-The-Art
Gragnaniello, D., Cozzolino, D., Marra, F., Poggi, G., & Verdoliva, L. (2021) · 2021 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428429 · Cited by 212
Self-citationCountering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
“P represents the method simply employs peer works for comparison, T indicates the method simply adopts some simple CNN models for comparison, B denotes the method leverages both peer works and conventional CNN models for comparison.”
BackgroundMethodInfluentialA detailed analysis of image and video forgery detection techniques
Tyagi, S., & Yadav, D. (2023) · The Visual Computer · doi:10.1007/s00371-021-02347-4 · Cited by 109
Metadata
- Authors
- Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 133488-133502
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2973188965
- Cited by
- 135
- References
- 12
- FWCI
- 7.98
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Google Faculty Research Award
- Air Force Research Laboratory
- Defense Advanced Research Projects Agency (FA8750-16-2-0204)
- PREMIER project
- Italian Ministry of Education, University, and Research within the Progetti di Ricerca di Interesse Nazionale (PRIN) 2017 Program
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.