The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Exploiting Spatial Structure for Localizing Manipulated Image Regions
Open accessAbstract
The advent of high-tech journaling tools facilitates an image to be manipulated in a way that can easily evade state-of-the-art image tampering detection approaches. The recent success of the deep learning approaches in different recognition tasks inspires us to develop a high confidence detection framework which can localize manipulated regions in an image. Unlike semantic object segmentation where all meaningful regions (objects) are segmented, the localization of image manipulation focuses only the possible tampered region which makes the problem even more challenging. In order to formulate the framework, we employ a hybrid CNN-LSTM model to capture discriminative features between manipulated and non-manipulated regions. One of the key properties of manipulated regions is that they exhibit discriminative features in boundaries shared with neighboring non-manipulated pixels. Our motivation is to learn the boundary discrepancy, i.e., the spatial structure, between manipulated and non-manipulated regions with the combination of LSTM and convolution layers. We perform end-to-end training of the network to learn the parameters through back-propagation given ground-truth mask information. The overall framework is capable of detecting different types of image manipulations, including copy-move, removal and splicing. Our model shows promising results in localizing manipulated regions, which is demonstrated through rigorous experimentation on three diverse datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 4×
“Deep learning based segmentation method [60] is not able to segment removed objects, whereas our model is capable of localizing removed objects.”
BackgroundMethodInfluentialA SIFT-Based Forensic Method for Copy–Move Attack Detection and Transformation Recovery
Amerini, I., Ballan, L., Caldelli, R., Del Bimbo, A., & Serra, G. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2129512 · Cited by 1,044
Object Detectors Emerge in Deep Scene CNNs
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2014) · arXiv · doi:10.48550/arxiv.1412.6856 · Cited by 971
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Segmentation-Based Image Copy-Move Forgery Detection Scheme
Li, J., Li, X., Yang, B., & Sun, X. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2381872 · Cited by 810
Recurrent Convolutional Neural Networks for Scene Labeling
Pinheiro, P. O., & Collobert, R. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 621
Image Inpainting : Overview and Recent Advances
Guillemot, C., & Le Meur, O. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2273004 · Cited by 608
Deep learning for steganalysis via convolutional neural networks
Qian, Y., Dong, J., Wang, W., & Tan, T. (2015) · SPIE Proceedings · doi:10.1117/12.2083479 · Cited by 537
Object Detectors Emerge in Deep Scene CNNsPreprint
Zhou, B., Khosla, A., Lapedriza, À., Oliva, A., & Torralba, A. B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 523
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
Ferrara, P., Bianchi, T., De Rosa, A., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2202227 · Cited by 492
Image Forgery Localization via Block-Grained Analysis of JPEG Artifacts
Bianchi, T., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2187516 · Cited by 459
Efficient Dense-Field Copy–Move Forgery Detection
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2455334 · Cited by 451
Exposing Digital Forgeries From JPEG Ghosts
Farid, H. (2009) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2008.2012215 · Cited by 449
COVERAGE — A novel database for copy-move forgery detection
Wen, B., Zhu, Y., Subramanian, R., Ng, T.-T., Shen, X., & Winkler, S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532339 · Cited by 440
Median Filtering Forensics Based on Convolutional Neural Networks
Chen, J., Kang, X., Liu, Y., & Wang, Z. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2438008 · Cited by 425
Using noise inconsistencies for blind image forensics
Mahdian, B., & Saic, S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.02.001 · Cited by 415
Detection of copy–move forgery using a method based on blur moment invariants
Mahdian, B., & Saic, S. (2007) · Forensic Science International · doi:10.1016/j.forsciint.2006.11.002 · Cited by 414
Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis
Lin, Z., He, J., Tang, X., & Tang, C.-K. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.03.019 · Cited by 395
Scene labeling with LSTM recurrent neural networks
Byeon, W., Breuel, T. M., Raue, F., & Liwicki, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298977 · Cited by 375
Li, G., Wu, Q., Tu, D., & Sun, S. (2007) · Multimedia and Expo, 2007 IEEE International Conference on · doi:10.1109/icme.2007.4285009 · Cited by 307
Robust Detection of Region-Duplication Forgery in Digital Image
Luo, W., Huang, J., & Qiu, G. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.1003 · Cited by 299
JPEG Error Analysis and Its Applications to Digital Image Forensics
Luo, W., Huang, J., & Qiu, G. (2010) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2010.2051426 · Cited by 292
ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 281
Rotation Invariant Localization of Duplicated Image Regions Based on Zernike Moments
Ryu, S.-J., Kirchner, M., Lee, M.-J., & Lee, H.-K. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2272377 · Cited by 275
Detection and Localization of Image Forgeries Using Resampling Features and Deep Learning
Bunk, J., Bappy, J. H., Mohammed, T. M., Nataraj, L., Flenner, A., Manjunath, B. S., Chandrasekaran, S., Roy-Chowdhury, A. K., & Peterson, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.235 · Cited by 195
Self-citationImage forgery detection using steerable pyramid transform and local binary pattern
Muhammad, G., Al-Hammadi, M. H., Hussain, M., & Bebis, G. (2014) · Machine Vision and Applications · doi:10.1007/s00138-013-0547-4 · Cited by 192
Passive detection of doctored JPEG image via block artifact grid extraction
Li, W., Yuan, Y., & Yu, N. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.03.025 · Cited by 185
Improved DCT coefficient analysis for forgery localization in JPEG images
Bianchi, T., De Rosa, A., & Piva, A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5946978 · Cited by 182
Passive detection of copy-move forgery in digital images: State-of-the-art
Al-Qershi, O. M., & Khoo, B. E. (2013) · Forensic Science International · doi:10.1016/j.forsciint.2013.05.027 · Cited by 177
Image Region Forgery Detection: A Deep Learning Approach
Ying, Z., Goh, J., Lei, W. L., & Thing, V. L. L. (2016) · IOS Press eBooks · doi:10.3233/978-1-61499-617-0-1 · Cited by 156
Detecting Facial Retouching Using Supervised Deep Learning
Bharati, A., Singh, R., Mayank Vatsa, A., & Bowyer, K. W. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2561898 · Cited by 140
Pixel-Based Image Forgery Detection: A Review
Ansari, M. D., Ghrera, S. P., & Tyagi, V. (2014) · IETE Journal of Education · doi:10.1080/09747338.2014.921415 · Cited by 130
Exposing Postprocessed Copy–Paste Forgeries Through Transform-Invariant Features
Kakar, P., & Sudha, N. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2188390 · Cited by 124
Normalized Energy Density-Based Forensic Detection of Resampled Images
Feng, X., Cox, I. J., & Doërr, G. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2191946 · Cited by 115
Design Principles of Convolutional Neural Networks for Multimedia Forensics
Bayar, B., & Stamm, M. C. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-328 · Cited by 115
A forgery detection algorithm for exemplar-based inpainting images using multi-region relation
Chang, I., Yu, J.-W., & Chang, C.-C. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.09.002 · Cited by 91
An efficient forgery detection algorithm for object removal by exemplar-based image inpainting
Liang, Z., Yang, G., Ding, X., & Li, L. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.03.004 · Cited by 89
Exploring DCT Coefficient Quantization Effects for Local Tampering Detection
Wang, W., Dong, J., & Tan, T. N. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2345479 · Cited by 86
A feature-based approach for image tampering detection and localization
Verdoliva, L., Cozzolino, D., & Poggi, G. (2014) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2014.7084319 · Cited by 79
Bayar, B., & Stamm, M. C. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952537 · Cited by 75
Hashmi, M. F., Anand, V., & Keskar, A. G. (2014) · AASRI Procedia · doi:10.1016/j.aasri.2014.09.015 · Cited by 72
Accurate and robust localization of duplicated region in copy–move image forgery
Jaberi, M., Bebis, G. N., Hussain, M., & Muhammad, G. (2013) · Machine Vision and Applications · doi:10.1007/s00138-013-0522-0 · Cited by 69
Liu, Q., & Chen, Z. (2014) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2560365 · Cited by 65
Kwon, Y., Kim, K. I., Tompkin, J., et al. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389797 · Cited by 64
Detecting content adaptive scaling of images for forensic applications
Fillion, C., & Gaurav Sharma, A. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.838647 · Cited by 62
CNN based region proposals for efficient object detection
Bappy, J. H., & Roy–Chowdhury, A. K. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7533042 · Cited by 52
Self-citationAlgorithm for JPEG artifact reduction via local edge regeneration
Golestaneh, S. A., & Chandler, D. M. (2014) · Journal of Electronic Imaging · doi:10.1117/1.jei.23.1.013018 · Cited by 35
An energy-based method for the forensic detection of Re-sampled images
Feng, X., Cox, I. J., & Doërr, G. (2011) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2011.6011984 · Cited by 23
Visual artifacts based image splicing detection in uncompressed images
Manu, V. T., & Mehtre, B. M. (2015) · IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS) · doi:10.1109/cgvis.2015.7449911 · Cited by 11
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Learning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778
Wu, Y., AbdAlmageed, W., & Natarajan, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00977 · Cited by 647
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
Metadata
- Authors
- Bappy, J. H., Roy-Chowdhury, A. K., Bunk, J., Nataraj, L., & Manjunath, B. S.
- Venue
- 2017 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 4980-4989
- OpenAlex
- W2777769595
- Cited by
- 262
- References
- 55
- FWCI
- 5.26
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.