The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Learning Rich Features for Image Manipulation Detection
Open accessAbstract
Image manipulation detection is different from traditional semantic object detection because it pays more attention to tampering artifacts than to image content, which suggests that richer features need to be learned. We propose a two-stream Faster R-CNN network and train it end-to-end to detect the tampered regions given a manipulated image. One of the two streams is an RGB stream whose purpose is to extract features from the RGB image input to find tampering artifacts like strong contrast difference, unnatural tampered boundaries, and so on. The other is a noise stream that leverages the noise features extracted from a steganalysis rich model filter layer to discover the noise inconsistency between authentic and tampered regions. We then fuse features from the two streams through a bilinear pooling layer to further incorporate spatial co-occurrence of these two modalities. Experiments on four standard image manipulation datasets demonstrate that our two-stream framework outperforms each individual stream, and also achieves state-of-the-art performance compared to alternative methods with robustness to resizing and compression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
Bilinear CNN Models for Fine-Grained Visual Recognition
Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.170 · Cited by 2,135
Gao, Y., Beijbom, O., Zhang, N., & Darrell, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.41 · Cited by 871
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Research works printed but not linked: 5
- wen, 2016, Coveragea novel database for copy-move forgery detection, ICIP
- dong, 0, Casia image tampering detection evaluation database 2010
- 0, NIST Nimble 2016 Datasets
- krawetz, 2007, A picture's worth … Hacker Factor Solutions
- ng, 2009, Columbia Image Splicing Detection Evaluation Dataset
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“, [54, 55, 30, 8], can be applied.”
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Wu, Y., AbdAlmageed, W., & Natarajan, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00977 · Cited by 647
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499
Hybrid LSTM and Encoder–Decoder Architecture for Detection of Image Forgeries
Bappy, J. H., Simons, C., Nataraj, L., Manjunath, B. S., & Roy-Chowdhury, A. K. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2895466 · Cited by 477
Fighting Fake News: Image Splice Detection via Learned Self-Consistency
Huh, M., Liu, A., Owens, A., & Efros, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_7 · Cited by 442
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L., & Fritz, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 437
Self-citationLiu, X., Liu, Y., Chen, J., & Liu, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3189545 · Cited by 417
MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection
Dong, C., Chen, X., Hu, R., Cao, J., & Li, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3180556 · Cited by 357
Maras, M.-H., & Alexandrou, A. (2019) · The International Journal of Evidence & Proof · doi:10.1177/1365712718807226 · Cited by 343
Detecting GAN generated Fake Images using Co-occurrence Matrices
Nataraj, L., Mohammed, T. M., Manjunath, B. S., Chandrasekaran, S., Flenner, A., Bappy, J. H., & Roy-Chowdhury, A. K. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.5.mwsf-532 · Cited by 331
DIRE for Diffusion-Generated Image Detection
Wang, Z., Bao, J., Zhou, W., Wang, W., Hu, H., Chen, H., & Li, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02051 · Cited by 354
Exploring Temporal Coherence for More General Video Face Forgery Detection
Zheng, Y., Bao, J., Chen, D., Zeng, M., & Wen, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01477 · Cited by 320
TruFor: Leveraging All-Round Clues for Trustworthy Image Forgery Detection and Localization
Guillaro, F., Cozzolino, D., Sud, A., Dufour, N., & Verdoliva, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01974 · Cited by 275
Image Manipulation Detection by Multi-View Multi-Scale Supervision
Chen, X., Dong, C., Ji, J., Cao, J., & Li, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01392 · Cited by 263
SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization
Hu, X., Zhang, Z., Jiang, Z., Chaudhuri, S., Yang, Z., & Nevatia, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_19 · Cited by 261
Deepfake Detection: Current Challenges and Next Steps
Lyu, S. (2020) · 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105991 · Cited by 234
ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
Cozzolino, D., Thies, J., Rössler, A., Riess, C., Nießner, M., & Verdoliva, L. (2018) · arXiv · doi:10.48550/arxiv.1812.02510 · Cited by 221
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“In areas with lots of annotated data, the concept of transfer learning can help improve learning performance (Liang et al. 2019; Zhou et al. 2018; Suratkar et al. 2020).”
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
“…multi-scale retinex space (Chen et al., 2019a), two-stream Faster R-CNN with features from the RGB image and noise features by using steganalysis (Zhou et al., 2018), two-stream neural network with GoogLeNet for observing artifacts and a patch-based triplet network for capturing local noise…”
MethodMTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3102487 · Cited by 184
Protecting Celebrities from DeepFake with Identity Consistency Transformer
Dong, X., Bao, J., Chen, D., Zhang, T., Zhang, W., Yu, N., Chen, D., Wen, F., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00925 · Cited by 181
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165
Snis: a signal noise separation-based network for post-processed image forgery detection
Chen, J., Liao, X., Wang, W., Qian, Z., Qin, Z., & Wang, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3204753 · Cited by 129
Detect and locate: Exposing face manipulation by semantic-and noise-level telltales
Kong, C., Chen, B., Li, H., Wang, S., Rocha, A., & Kwong, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3169921 · Cited by 120
FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning
Kim, M., Tariq, S., & Woo, S. S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00111 · Cited by 118
Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors
Khalid, H., Kim, M., Tariq, S., & Woo, S. S. (2021) · Proceedings of the 1st Workshop on Synthetic Multimedia - Audiovisual Deepfake Generation and Detection · doi:10.1145/3476099.3484315 · Cited by 110
Face Forgery Detection by 3D Decomposition
Zhu, X., Wang, H., Fei, H., Lei, Z., & Li, S. Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00295 · Cited by 106
Impact of Deepfake Technology on Social Media: Detection, Misinformation and Societal Implications
AL-KHAZRAJI, S. H., SALEH, H. H., KHALID, A. I., & MISHKHAL, I. A. (2023) · The Eurasia Proceedings of Science Technology Engineering and Mathematics · doi:10.55549/epstem.1371792 · Cited by 98
SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features
Wu, X., Xie, Z., Gao, Y., & Xiao, Y. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053969 · Cited by 94
A Self-Supervised Descriptor for Image Copy Detection
Pizzi, E., Roy, S. D., Ravindra, S. N., Goyal, P., & Douze, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01413 · Cited by 101
One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework
Tariq, S., Lee, S., & Woo, S. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449809 · Cited by 91
Fighting Fake News: Two Stream Network for Deepfake Detection via Learnable SRM
Han, B., Han, X., Zhang, H., Li, J., & Cao, X. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3065735 · Cited by 77
Self-citationDon't trust your eyes: image manipulation in the age of DeepFakes
Langguth, J., Pogorelov, K., Brenner, S., Filkuková, P., & Schroeder, D. T. (2021) · Frontiers in Communication · doi:10.3389/fcomm.2021.632317 · Cited by 51
GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detection
Das, S., Islam, M. S., & Amin, M. R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00018 · Cited by 45
Detection and Localization of Facial Expression Manipulations
Mazaheri, G., & Roy-Chowdhury, A. K. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00283 · Cited by 44
Face Forgery Detection by 3D Decomposition and Composition Search
Zhu, X., Fei, H., Zhang, B., Zhang, T., Zhang, X., Li, S. Z., & Lei, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3233586 · Cited by 41
Identity-Driven DeepFake Detection
Dong, X., Bao, J., Chen, D., Zhang, W., Yu, N., Chen, D., Wen, F., & Guo, B. (2020) · arXiv · doi:10.48550/arxiv.2012.03930 · Cited by 26
Weakly-supervised deepfake localization in diffusion-generated images
Ţânţaru, D.-C., Oneaţă, E., & Oneaţă, D. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00614 · Cited by 25
Toward real text manipulation detection: New dataset and new solution
Luo, D., Liu, Y., Yang, R., Liu, X., Zeng, J., Zhou, Y., & Bai, X. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2024.110828 · Cited by 25
Videoforensicshq: Detecting High-Quality Manipulated Face Videos
Fox, G., Liu, W., Kim, H., Seidel, H.-P., Elgharib, M., & Theobalt, C. (2021) · 2021 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428101 · Cited by 22
Semi-Supervised Deep Domain Adaptation for Deepfake Detection
Seraj, M. S., Singh, A., & Chakraborty, S. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00116 · Cited by 14
GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection
Neves, J. C., Tolosana, R., Vera-Rodriguez, R., Lopes, V., Proenca, H., & Fierrez, J. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3007250 · Cited by 12
Counteracting the contemporaneous proliferation of digital forgeries and fake news
FERREIRA, A., CARVALHO, T., ANDALÓ, F., & ROCHA, A. (2019) · Anais da Academia Brasileira de Ciências · doi:10.1590/0001-3765201820180149 · Cited by 11
BioFors: A Large Biomedical Image Forensics Dataset
Sabir, E., Nandi, S., AbdAlmageed, W., & Natarajan, P. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01078 · Cited by 12
“Common forensics problems include deepfake detection [31, 41], splicing [51, 15], copy-move forgery detection (CMFD) [52, 14, 39], enhancement and removal detection [53, 56].”
BackgroundAtamna, M., Tkachenko, I., & Miguet, S. (2023) · 2023 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip49359.2023.10222043 · Cited by 8
Atamna, M., Tkachenko, I., & Miguet, S. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-88223-4_16 · Cited by 1
LayLens: Improving Deepfake Understanding through Simplified Explanations
Narang, A., Gupta, P., Su, L., & Dhall, A. (2025) · Proceedings of the 27th International Conference on Multimodal Interaction · doi:10.1145/3716553.3757093 · Cited by 1
Metadata
- Authors
- Zhou, P., Han, X., Morariu, V. I., & Davis, L. S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 1053-1061
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964146055
- Cited by
- 778
- References
- 33
- FWCI
- 16.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.