The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Hybrid LSTM and Encoder–Decoder Architecture for Detection of Image Forgeries
Open accessAbstract
With advanced image journaling tools, one can easily alter the semantic meaning of an image by exploiting certain manipulation techniques such as copy clone, object splicing, and removal, which mislead the viewers. In contrast, the identification of these manipulations becomes a very challenging task as manipulated regions are not visually apparent. This paper proposes a high-confidence manipulation localization architecture that utilizes resampling features, long short-term memory (LSTM) cells, and an encoder-decoder network to segment out manipulated regions from non-manipulated ones. Resampling features are used to capture artifacts, such as JPEG quality loss, upsampling, downsampling, rotation, and shearing. The proposed network exploits larger receptive fields (spatial maps) and frequency-domain correlation to analyze the discriminative characteristics between the manipulated and non-manipulated regions by incorporating the encoder and LSTM network. Finally, the decoder network learns the mapping from low-resolution feature maps to pixel-wise predictions for image tamper localization. With the predicted mask provided by the final layer (softmax) of the proposed architecture, end-to-end training is performed to learn the network parameters through back-propagation using the ground-truth masks. Furthermore, a large image splicing dataset is introduced to guide the training process. The proposed method is capable of localizing image manipulations at the pixel level with high precision, which is demonstrated through rigorous experimentation on three diverse datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
(2010) · International Conference on Machine Learning · Cited by 13,995
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 4×
“In [89], a fully convolutional network is utilized to analyze the content of the objects and shape of a region by extracting the hierarchical features at different levels.”
BackgroundMethodResultInfluentialA SIFT-Based Forensic Method for Copy–Move Attack Detection and Transformation Recovery
Amerini, I., Ballan, L., Caldelli, R., Del Bimbo, A., & Serra, G. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2129512 · Cited by 1,044
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Segmentation-Based Image Copy-Move Forgery Detection Scheme
Li, J., Li, X., Yang, B., & Sun, X. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2381872 · Cited by 810
An Evaluation of Popular Copy-Move Forgery Detection Approaches
Christlein, V., Riess, C., Jordan, J., Riess, C., & Angelopoulou, E. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2218597 · Cited by 802
Exposing digital forgeries by detecting traces of resampling
Popescu, A. C., & Farid, H. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2004.839932 · Cited by 795
Learning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778
Analysis of the clustering properties of the Hilbert space-filling curve
Moon, B., Jagadish, H. V., Faloutsos, C., & Saltz, J. H. (2001) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.908985 · Cited by 736
Learning to Refine Object Segments
Pinheiro, P. O., Lin, T.-Y., Collobert, R., & Dollár, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_5 · Cited by 731
Recurrent Convolutional Neural Networks for Scene Labeling
Pinheiro, P. O., & Collobert, R. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 621
Image Inpainting : Overview and Recent Advances
Guillemot, C., & Le Meur, O. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2273004 · Cited by 608
Deep learning for steganalysis via convolutional neural networks
Qian, Y., Dong, J., Wang, W., & Tan, T. (2015) · SPIE Proceedings · doi:10.1117/12.2083479 · Cited by 537
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · 2016 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2016.7823911 · Cited by 516
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
Ferrara, P., Bianchi, T., De Rosa, A., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2202227 · Cited by 492
Image Forgery Localization via Block-Grained Analysis of JPEG Artifacts
Bianchi, T., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2187516 · Cited by 459
Efficient Dense-Field Copy–Move Forgery Detection
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2455334 · Cited by 451
Exposing Digital Forgeries From JPEG Ghosts
Farid, H. (2009) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2008.2012215 · Cited by 449
COVERAGE — A novel database for copy-move forgery detection
Wen, B., Zhu, Y., Subramanian, R., Ng, T.-T., Shen, X., & Winkler, S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532339 · Cited by 440
Median Filtering Forensics Based on Convolutional Neural Networks
Chen, J., Kang, X., Liu, Y., & Wang, Z. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2438008 · Cited by 425
Using noise inconsistencies for blind image forensics
Mahdian, B., & Saic, S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.02.001 · Cited by 415
Detection of copy–move forgery using a method based on blur moment invariants
Mahdian, B., & Saic, S. (2007) · Forensic Science International · doi:10.1016/j.forsciint.2006.11.002 · Cited by 414
Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis
Lin, Z., He, J., Tang, X., & Tang, C.-K. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.03.019 · Cited by 395
The Dresden Image Database for Benchmarking Digital Image Forensics
Gloe, T., & Böhme, R. (2010) · Journal of Digital Forensic Practice · doi:10.1080/15567281.2010.531500 · Cited by 378
Scene labeling with LSTM recurrent neural networks
Byeon, W., Breuel, T. M., Raue, F., & Liwicki, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298977 · Cited by 375
Distinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · 2017 IEEE Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2017.8267647 · Cited by 318
Blind Authentication Using Periodic Properties of Interpolation
Mahdian, B., & Saic, S. (2008) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2004.924603 · Cited by 316
Li, G., Wu, Q., Tu, D., & Sun, S. (2007) · Multimedia and Expo, 2007 IEEE International Conference on · doi:10.1109/icme.2007.4285009 · Cited by 307
CoMoFoD #x2014; New database for copy-move forgery detection
Tralić, D., Zupančić, I., Grgić, S., & Grgić, M. (2013) · Queen Mary Research Online (Queen Mary University of London) · Cited by 306
Image Forgery Detection Using Adaptive Oversegmentation and Feature Point Matching
Pun, C.-M., Yuan, X.-C., & Bi, X.-L. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2423261 · Cited by 305
Robust Detection of Region-Duplication Forgery in Digital Image
Luo, W., Huang, J., & Qiu, G. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.1003 · Cited by 299
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2015) · arXiv · doi:10.48550/arxiv.1511.02680 · Cited by 292
JPEG Error Analysis and Its Applications to Digital Image Forensics
Luo, W., Huang, J., & Qiu, G. (2010) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2010.2051426 · Cited by 292
ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 281
Rotation Invariant Localization of Duplicated Image Regions Based on Zernike Moments
Ryu, S.-J., Kirchner, M., Lee, M.-J., & Lee, H.-K. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2272377 · Cited by 275
Exploiting Spatial Structure for Localizing Manipulated Image Regions
Bappy, J. H., Roy-Chowdhury, A. K., Bunk, J., Nataraj, L., & Manjunath, B. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.532 · Cited by 262
Self-citationPassive copy move image forgery detection using undecimated dyadic wavelet transform
Muhammad, G., Hussain, M., & Bebis, G. (2012) · Digital Investigation · doi:10.1016/j.diin.2012.04.004 · Cited by 229
Tampering Detection and Localization Through Clustering of Camera-Based CNN Features
Bondi, L., Lameri, S., Guera, D., Bestagini, P., Delp, E. J., & Tubaro, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.232 · Cited by 206
Detection and Localization of Image Forgeries Using Resampling Features and Deep Learning
Bunk, J., Bappy, J. H., Mohammed, T. M., Nataraj, L., Flenner, A., Manjunath, B. S., Chandrasekaran, S., Roy-Chowdhury, A. K., & Peterson, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.235 · Cited by 195
Self-citationImage forgery detection using steerable pyramid transform and local binary pattern
Muhammad, G., Al-Hammadi, M. H., Hussain, M., & Bebis, G. (2014) · Machine Vision and Applications · doi:10.1007/s00138-013-0547-4 · Cited by 192
Passive detection of doctored JPEG image via block artifact grid extraction
Li, W., Yuan, Y., & Yu, N. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.03.025 · Cited by 185
Improved DCT coefficient analysis for forgery localization in JPEG images
Bianchi, T., De Rosa, A., & Piva, A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5946978 · Cited by 182
Passive detection of copy-move forgery in digital images: State-of-the-art
Al-Qershi, O. M., & Khoo, B. E. (2013) · Forensic Science International · doi:10.1016/j.forsciint.2013.05.027 · Cited by 177
Image Region Forgery Detection: A Deep Learning Approach
Ying, Z., Goh, J., Lei, W. L., & Thing, V. L. L. (2016) · IOS Press eBooks · doi:10.3233/978-1-61499-617-0-1 · Cited by 156
Detecting Facial Retouching Using Supervised Deep Learning
Bharati, A., Singh, R., Mayank Vatsa, A., & Bowyer, K. W. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2561898 · Cited by 140
Pixel-Based Image Forgery Detection: A Review
Ansari, M. D., Ghrera, S. P., & Tyagi, V. (2014) · IETE Journal of Education · doi:10.1080/09747338.2014.921415 · Cited by 130
Exposing Postprocessed Copy–Paste Forgeries Through Transform-Invariant Features
Kakar, P., & Sudha, N. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2188390 · Cited by 124
Normalized Energy Density-Based Forensic Detection of Resampled Images
Feng, X., Cox, I. J., & Doërr, G. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2191946 · Cited by 115
Design Principles of Convolutional Neural Networks for Multimedia Forensics
Bayar, B., & Stamm, M. C. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-328 · Cited by 115
Image Forgery Localization via Integrating Tampering Possibility Maps
Li, H., Luo, W., Qiu, X., & Huang, J. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2656823 · Cited by 113
Image Forgery Localization based on Multi-Scale Convolutional Neural Networks
Liu, Y., Guan, Q., Zhao, X., & Cao, Y. (2018) · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) · doi:10.1145/3206004.3206010 · Cited by 106
A forgery detection algorithm for exemplar-based inpainting images using multi-region relation
Chang, I., Yu, J.-W., & Chang, C.-C. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.09.002 · Cited by 91
An efficient forgery detection algorithm for object removal by exemplar-based image inpainting
Liang, Z., Yang, G., Ding, X., & Li, L. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.03.004 · Cited by 89
Algorithm 781: generating Hilbert's space-filling curve by recursion
Breinholt, G., & Schierz, C. (1998) · ACM Transactions on Mathematical Software · doi:10.1145/290200.290219 · Cited by 82
Exploring DCT Coefficient Quantization Effects for Local Tampering Detection
Wang, W., Dong, J., & Tan, T. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2345479 · Cited by 81
A feature-based approach for image tampering detection and localization
Verdoliva, L., Cozzolino, D., & Poggi, G. (2014) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2014.7084319 · Cited by 79
Bayar, B., & Stamm, M. C. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952537 · Cited by 75
Hashmi, M. F., Anand, V., & Keskar, A. G. (2014) · AASRI Procedia · doi:10.1016/j.aasri.2014.09.015 · Cited by 72
Accurate and robust localization of duplicated region in copy–move image forgery
Jaberi, M., Bebis, G. N., Hussain, M., & Muhammad, G. (2013) · Machine Vision and Applications · doi:10.1007/s00138-013-0522-0 · Cited by 69
General-purpose image forensics using patch likelihood under image statistical models
Fan, W., Wang, K., & Cayre, F. (2015) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2015.7368606 · Cited by 66
Liu, Q., & Chen, Z. (2014) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2560365 · Cited by 65
Kwon, Y., Kim, K. I., Tompkin, J., et al. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389797 · Cited by 64
Detecting content adaptive scaling of images for forensic applications
Fillion, C., & Gaurav Sharma, A. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.838647 · Cited by 62
Nguyen, H. H., Tieu, T. N.-D., Nguyen-Son, H.-Q., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3230833.3230863 · Cited by 51
Algorithm for JPEG artifact reduction via local edge regeneration
Golestaneh, S. A., & Chandler, D. M. (2014) · Journal of Electronic Imaging · doi:10.1117/1.jei.23.1.013018 · Cited by 35
An energy-based method for the forensic detection of Re-sampled images
Feng, X., Cox, I. J., & Doërr, G. (2011) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2011.6011984 · Cited by 23
Visual artifacts based image splicing detection in uncompressed images
Manu, V. T., & Mehtre, B. M. (2015) · IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS) · doi:10.1109/cgvis.2015.7449911 · Cited by 11
Cited by
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“, [54, 55, 30, 8], can be applied.”
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Metadata
- Authors
- Bappy, J. H., Simons, C., Nataraj, L., Manjunath, B. S., & Roy-Chowdhury, A. K.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-07
- Volume
- 28
- Issue
- 7
- Pages
- 3286-3300
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2911605501
- Cited by
- 477
- References
- 80
- FWCI
- 21.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.