The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features
Abstract
To fight against real-life image forgery, which commonly involves different types and combined manipulations, we propose a unified deep neural architecture called ManTraNet. Unlike many existing solutions, ManTra-Net is an end-to-end network that performs both detection and localization without extra preprocessing and postprocessing. ManTra-Net is a fully convolutional network and handles images of arbitrary sizes and many known forgery types such splicing, copy-move, removal, enhancement, and even unknown types. This paper has three salient contributions. We design a simple yet effective self-supervised learning task to learn robust image manipulation traces from classifying 385 image manipulation types. Further, we formulate the forgery localization problem as a local anomaly detection problem, design a Z-score feature to capture local anomaly, and propose a novel long short-term memory solution to assess local anomalies. Finally, we carefully conduct ablation experiments to systematically optimize the proposed network design. Our extensive experimental results demonstrate the generalizability, robustness and superiority of ManTra-Net, not only in single types of manipulations/forgeries, but also in their complicated combinations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Image Inpainting for Irregular Holes Using Partial Convolutions
Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_6 · Cited by 2,419 · cited 3×
“More precisely, we synthesize an enhanced sample by (1) introducing a random structured binary mask M (see [31]), (2) composing a forged image by using Z = P · (1 − M )+ y ( P ) · M , where P and y ( · ) are a pristine patch and a random manipulation, respectively.”
BackgroundMethodInfluentialA Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Learning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Bayar, B., & Stamm, M. C. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2825953 · Cited by 599
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
Ferrara, P., Bianchi, T., De Rosa, A., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2202227 · Cited by 492
Efficient Dense-Field Copy–Move Forgery Detection
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2455334 · Cited by 451
Fighting Fake News: Image Splice Detection via Learned Self-Consistency
Huh, M., Liu, A., Owens, A., & Efros, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_7 · Cited by 442
COVERAGE — A novel database for copy-move forgery detection
Wen, B., Zhu, Y., Subramanian, R., Ng, T.-T., Shen, X., & Winkler, S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532339 · Cited by 440
Median Filtering Forensics Based on Convolutional Neural Networks
Chen, J., Kang, X., Liu, Y., & Wang, Z. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2438008 · Cited by 425
Using noise inconsistencies for blind image forensics
Mahdian, B., & Saic, S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.02.001 · Cited by 415
Image Splicing Localization using a Multi-task Fully Convolutional Network (MFCN)
Salloum, R., Ren, Y., & Jay Kuo, C.-C. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.01.010 · Cited by 395
The 'Dresden Image Database' for benchmarking digital image forensics
Gloe, T., & Böhme, R. (2010) · Proceedings of the 2010 ACM Symposium on Applied Computing · doi:10.1145/1774088.1774427 · Cited by 388
The Dresden Image Database for Benchmarking Digital Image Forensics
Gloe, T., & Böhme, R. (2010) · Journal of Digital Forensic Practice · doi:10.1080/15567281.2010.531500 · Cited by 378
BusterNet: Detecting Copy-Move Image Forgery with Source/Target Localization
Wu, Y., Abd-Almageed, W., & Natarajan, P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_11 · Cited by 334
Self-citationThe Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287 · cited 1×
“Columns from left to right are: pristine donor image, forged image (also the input of ManTra-Net), and the ManTra-Net’s prediction. deliberate manipulation [12].”
BackgroundOn Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tran Tuan, A., Hassner, T., & Medioni, G. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00024 · Cited by 285
Splicebuster: A new blind image splicing detector
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · 2015 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2015.7368565 · Cited by 283
First Steps Toward Camera Model Identification With Convolutional Neural Networks
Bondi, L., Baroffio, L., Guera, D., Bestagini, P., Delp, E. J., & Tubaro, S. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2641006 · Cited by 271
Exploiting Spatial Structure for Localizing Manipulated Image Regions
Bappy, J. H., Roy-Chowdhury, A. K., Bunk, J., Nataraj, L., & Manjunath, B. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.532 · Cited by 262
Exposing Region Splicing Forgeries with Blind Local Noise Estimation
Lyu, S., Pan, X., & Zhang, X. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0688-y · Cited by 230
Tampering Detection and Localization Through Clustering of Camera-Based CNN Features
Bondi, L., Lameri, S., Guera, D., Bestagini, P., Delp, E. J., & Tubaro, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.232 · Cited by 206
Financial costs and personal consequences of research misconduct resulting in retracted publications
Stern, A. M., Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · eLife · doi:10.7554/elife.02956 · Cited by 189 · cited 1×
“In 2014, Stern et al. [41] estimate that each of the retracted articles could account for a mean of $ 392,582 in direct costs , implying much higher indirect costs caused by misled research—and this is only in the biomedical field and these numbers are five years out-dated.”
BackgroundLarge-scale evaluation of splicing localization algorithms for web images
Zampoglou, M., Papadopoulos, S., & Kompatsiaris, Y. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3795-2 · Cited by 168
A deep learning approach to patch-based image inpainting forensics
Zhu, X., Qian, Y., Zhao, X., Sun, B., & Sun, Y. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.05.015 · Cited by 158
Localization of JPEG Double Compression Through Multi-domain Convolutional Neural Networks
Amerini, I., Uricchio, T., Ballan, L., & Caldelli, R. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.233 · Cited by 145
Image Copy-Move Forgery Detection via an End-to-End Deep Neural Network
Wu, Y., AbdAlmageed, W., & Natarajan, P. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00211 · Cited by 135
Self-citationWu, Y., AbdAlmageed, W., & Natarajan, P. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123411 · Cited by 125
Self-citationCopy-move and splicing image forgery detection and localization techniques: a review
Asghar, K., Habib, Z., & Hussain, M. (2016) · Australian Journal of Forensic Sciences · doi:10.1080/00450618.2016.1153711 · Cited by 117
Self-Organized Text Detection with Minimal Post-processing via Border Learning
Wu, Y., & Natarajan, P. (2017) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.535 · Cited by 113
Self-citationImage splicing detection based on Markov features in QDCT domain
Li, C., Ma, Q., Xiao, L., Li, M., & Zhang, A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.04.068 · Cited by 106
Image Forgery Localization based on Multi-Scale Convolutional Neural Networks
Liu, Y., Guan, Q., Zhao, X., & Cao, Y. (2018) · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) · doi:10.1145/3206004.3206010 · Cited by 106
Learned Forensic Source Similarity for Unknown Camera Models
Mayer, O., & Stamm, M. C. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462585 · Cited by 70
Cnn-Based Detection of Generic Contrast Adjustment with Jpeg Post-Processing
Barni, M., Costanzo, A., Nowroozi, E., & Tondi, B. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451698 · Cited by 57
Image Splicing Detection via Camera Response Function Analysis
Chen, C., McCloskey, S., & Jingyi Yu, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.203 · Cited by 54
A novel contrast enhancement forensics based on convolutional neural networks
Sun, J.-Y., Kim, S., Lee, S., & Ko, S.-J. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.02.001 · Cited by 51
Boundary-based Image Forgery Detection by Fast Shallow CNN
Zhang, Z., Zhang, Y., Zhou, Z., & Luo, J. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545074 · Cited by 45
Image splicing detection with local illumination estimation
Fan, Y., Carré, P., & Fernández-Maloigne, C. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351341 · Cited by 35
Detecting composite image manipulation based on deep neural networks
Choi, H.-Y., Jang, H., Kim, D., Son, J., Mun, S.-M., Choi, S., & Lee, H.-K. (2017) · International Conference on Systems, Signals and Image Processing · doi:10.1109/iwssip.2017.7965621 · Cited by 31
Bad teacher or unruly student: Can deep learning say something in Image Forensics analysis?
Rota, P., Sangineto, E., Conotter, V., & Pramerdorfer, C. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7900012 · Cited by 29
The PS-Battles Dataset - an Image Collection for Image Manipulation DetectionPreprint
Heller, S., Rossetto, L., & Schuldt, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04866 · Cited by 19
The PS-Battles Dataset - an Image Collection for Image Manipulation Detection
Heller, S., Rossetto, L., & Schuldt, H. (2018) · edoc (University of Basel) · doi:10.5281/zenodo.7467932 · Cited by 17
Research works printed but not linked: 9
- krawetz, 2007, A pictures worth., Hacker Factor Solutions, 6
- 2012, CASIA Tampered Image Detection Evaluation Database
- 2004, Image splicing detection evaluation dataset
- 10.1117/1.JEI.25.2.023031 · doi:10.1117/1.jei.25.2.023031
- 10.1109/CVPR.2018.00116 · DOI · Paper page
- 10.1007/s11042-016-3964-3 · doi:10.1007/s11042-016-3964-3
- 2018, IEEE’s Signal Processing Society - Camera Model Identification
- 2016, NIST manipulation evaluation dataset
- 10.1007/s11042-015-3079-2 · doi:10.1007/s11042-015-3079-2
Cited by
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Recurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443
Self-citationLiu, X., Liu, Y., Chen, J., & Liu, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3189545 · Cited by 417
MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection
Dong, C., Chen, X., Hu, R., Cao, J., & Li, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3180556 · Cited by 357
Metadata
- Authors
- Wu, Y., AbdAlmageed, W., & Natarajan, P.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Volume
- 2019
- Pages
- 9535-9544
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2948407537
- Cited by
- 647
- References
- 51
- FWCI
- 15.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.