The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Learning Rich Features for Image Manipulation Detection
Open accessAbstract
Image manipulation detection is different from traditional semantic object detection because it pays more attention to tampering artifacts than to image content, which suggests that richer features need to be learned. We propose a two-stream Faster R-CNN network and train it end-to-end to detect the tampered regions given a manipulated image. One of the two streams is an RGB stream whose purpose is to extract features from the RGB image input to find tampering artifacts like strong contrast difference, unnatural tampered boundaries, and so on. The other is a noise stream that leverages the noise features extracted from a steganalysis rich model filter layer to discover the noise inconsistency between authentic and tampered regions. We then fuse features from the two streams through a bilinear pooling layer to further incorporate spatial co-occurrence of these two modalities. Experiments on four standard image manipulation datasets demonstrate that our two-stream framework outperforms each individual stream, and also achieves state-of-the-art performance compared to alternative methods with robustness to resizing and compression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
Bilinear CNN Models for Fine-Grained Visual Recognition
Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.170 · Cited by 2,135
Gao, Y., Beijbom, O., Zhang, N., & Darrell, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.41 · Cited by 871
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
CASIA Image Tampering Detection Evaluation Database
Dong, J., Wang, W., & Tan, T. (2013) · 2013 IEEE China Summit and International Conference on Signal and Information Processing · doi:10.1109/chinasip.2013.6625374 · Cited by 813
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Self-citationA deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
Ferrara, P., Bianchi, T., De Rosa, A., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2202227 · Cited by 492
COVERAGE — A novel database for copy-move forgery detection
Wen, B., Zhu, Y., Subramanian, R., Ng, T.-T., Shen, X., & Winkler, S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532339 · Cited by 440
Median Filtering Forensics Based on Convolutional Neural Networks
Chen, J., Kang, X., Liu, Y., & Wang, Z. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2438008 · Cited by 425
Using noise inconsistencies for blind image forensics
Mahdian, B., & Saic, S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.02.001 · Cited by 415
Exposing Digital Image Forgeries by Illumination Color Classification
de Carvalho, T. J., Riess, C., Angelopoulou, E., Pedrini, H., & de Rezende Rocha, A. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2265677 · Cited by 406
Image Splicing Localization using a Multi-task Fully Convolutional Network (MFCN)
Salloum, R., Ren, Y., & Jay Kuo, C.-C. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.01.010 · Cited by 395
A Picture's Worth: Partner Photographs Reduce Experimentally Induced Pain
Master, S. L., Eisenberger, N. I., Taylor, S. E., Naliboff, B. D., Shirinyan, D., & Lieberman, M. D. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02444.x · Cited by 391
Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349
Splicebuster: A new blind image splicing detector
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · 2015 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2015.7368565 · Cited by 283
Exploiting Spatial Structure for Localizing Manipulated Image Regions
Bappy, J. H., Roy-Chowdhury, A. K., Bunk, J., Nataraj, L., & Manjunath, B. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.532 · Cited by 262
Improved DCT coefficient analysis for forgery localization in JPEG images
Bianchi, T., De Rosa, A., & Piva, A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5946978 · Cited by 182
Large-scale evaluation of splicing localization algorithms for web images
Zampoglou, M., Papadopoulos, S., & Kompatsiaris, Y. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3795-2 · Cited by 168
Image Region Forgery Detection: A Deep Learning Approach
Ying, Z., Goh, J., Lei, W. L., & Thing, V. L. L. (2016) · IOS Press eBooks · doi:10.3233/978-1-61499-617-0-1 · Cited by 156
Dynamic Zoom-in Network for Fast Object Detection in Large Images
Gao, M., Yu, R., Li, A., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00724 · Cited by 148
Self-citationSingle-image splicing localization through autoencoder-based anomaly detection
Cozzolino, D., & Verdoliva, L. (2016) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2016.7823921 · Cited by 122
Exposing image splicing with inconsistent local noise variances
Pan, X., Zhang, X., & Lyu, S. (2012) · 2012 IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215223 · Cited by 120
Cozzolino, D., Gragnaniello, D., & Verdoliva, L. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026073 · Cited by 114
Deep Regionlets for Object Detection
Xu, H., Lv, X., Wang, X., Ren, Z., Bodla, N., & Chellappa, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_49 · Cited by 75
CFA-aware features for steganalysis of color images
Goljan, M., & Fridrich, J. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2078399 · Cited by 61
The Role of Context Selection in Object Detection
Yu, R., Chen, X., Morariu, V. I., & Davis, L. S. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.133 · Cited by 40
Self-citation
Research works printed but not linked: 5
- wen, 2016, Coveragea novel database for copy-move forgery detection, ICIP
- dong, 0, Casia image tampering detection evaluation database 2010
- 0, NIST Nimble 2016 Datasets
- krawetz, 2007, A picture's worth … Hacker Factor Solutions
- ng, 2009, Columbia Image Splicing Detection Evaluation Dataset
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“, [54, 55, 30, 8], can be applied.”
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Metadata
- Authors
- Zhou, P., Han, X., Morariu, V. I., & Davis, L. S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 1053-1061
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964146055
- Cited by
- 778
- References
- 33
- FWCI
- 16.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.