Exposing Digital Image Forgeries by Illumination Color Classification
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
For decades, photographs have been used to document space-time events and they have often served as evidence in courts. Although photographers are able to create composites of analog pictures, this process is very time consuming and requires expert knowledge. Today, however, powerful digital image editing software makes image modifications straightforward. This undermines our trust in photographs and, in particular, questions pictures as evidence for real-world events. In this paper, we analyze one of the most common forms of photographic manipulation, known as image composition or splicing. We propose a forgery detection method that exploits subtle inconsistencies in the color of the illumination of images. Our approach is machine-learning-based and requires minimal user interaction. The technique is applicable to images containing two or more people and requires no expert interaction for the tampering decision. To achieve this, we incorporate information from physics- and statistical-based illuminant estimators on image regions of similar material. From these illuminant estimates, we extract texture- and edge-based features which are then provided to a machine-learning approach for automatic decision-making. The classification performance using an SVM meta-fusion classifier is promising. It yields detection rates of 86% on a new benchmark dataset consisting of 200 images, and 83% on 50 images that were collected from the Internet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · cited 2×
“The kappa-value, which measures the degree of agreement between an arbitrary number of raters in deciding the class of a sample, based on the Fleiss [39] model, is 0.11.”
MethodInfluential(2006) · Springer eBooks · Cited by 8,123
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Visual categorization with bags of keypoints
Csurka, G. (2004) · European Conference on Computer Vision · Cited by 5,030
A spatial processor model for object colour perception
Buchsbaum, G. (1980) · Journal of the Franklin Institute · doi:10.1016/0016-0032(80)90058-7 · Cited by 1,694
Digital Camera Identification From Sensor Pattern Noise
Luka, J., Fridrich, J., & Goljan, M. (2006) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2006.873602 · Cited by 1,328 · cited 1×
“Still, JPEG compression is known to be a challenging scenario in several classes of forensic algorithms [43]–[45] One could also consider optimizing themachine-learning part of the algorithm.”
Backgroundvan de Weijer, J., Gevers, T., & Gijsenij, A. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901808 · Cited by 928
Object categorization by learned universal visual dictionary
Winn, J., Criminisi, A., & Minka, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.171 · Cited by 838
Computational Color Constancy: Survey and Experiments
Gijsenij, A., Gevers, T., & van de Weijer, J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2118224 · Cited by 632
Human detection using partial least squares analysis
Schwartz, W. R., Kembhavi, A., Harwood, D., & Davis, L. S. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459205 · Cited by 493
Statistical Tools for Digital Forensics
Popescu, A. C., & Farid, H. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30114-1_10 · Cited by 447
Barnard, K., Cardei, V., & Funt, B. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.802531 · Cited by 440
Exposing digital forgeries by detecting inconsistencies in lighting
Johnson, M. K., & Farid, H. (2005) · Proceedings of the 7th workshop on Multimedia and security · doi:10.1145/1073170.1073171 · Cited by 406
A comparison of computational color constancy Algorithms. II. Experiments with image data
Barnard, K., Martin, L., Coath, A., & Funt, B. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.802529 · Cited by 338
Exposing Digital Forgeries in Complex Lighting Environments
Johnson, M. K., & Farid, H. (2007) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2007.903848 · Cited by 316
Visual categorization with bags of keypoints
Duygulu, P. (2002) · European Conference on Computer Vision · Cited by 258
Vision of the unseen: Current trends and challenges in digital image and video forensics
Rocha, A., Scheirer, W., Boult, T., & Goldenstein, S. (2011) · ACM Computing Surveys · doi:10.1145/1978802.1978805 · Cited by 231
Trainable classifier-fusion schemes: An application to pedestrian detection
Junior, O. L., Delgado, D., Goncalves, V., & Nunes, U. (2009) · 2009 12th International IEEE Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2009.5309700 · Cited by 229
Detection of Nonaligned Double JPEG Compression Based on Integer Periodicity Maps
Bianchi, T., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2170836 · Cited by 205
Comparative study of global color and texture descriptors for web image retrieval
Penatti, O. A. B., Valle, E., & Torres, R. D. S. (2012) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.11.002 · Cited by 192
Color Constancy for Multiple Light Sources
Gijsenij, A., Lü, R., & Gevers, T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2165219 · Cited by 188
Color constancy through inverse-intensity chromaticity space
Tan, R. T., Nishino, K., & Ikeuchi, K. (2004) · Journal of the Optical Society of America A · doi:10.1364/josaa.21.000321 · Cited by 169
Exposing Digital Forgeries Through Specular Highlights on the Eye
Johnson, M. K., & Farid, H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77370-2_21 · Cited by 158
The Appearance of Human Skin: A Survey
Igarashi, T., Nishino, K., & Nayar, S. K. (2007) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000013 · Cited by 152
Perceiving Illumination Inconsistencies in Scenes
Ostrovsky, Y., Patrick Cavanagh, B., & Sinha, P. (2005) · Perception · doi:10.1068/p5418 · Cited by 149
Points of Interest and Visual Dictionaries for Automatic Retinal Lesion Detection
Rocha, A., Carvalho, T., Jelinek, H. F., Goldenstein, S., & Wainer, J. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2201717 · Cited by 146
Exposing photo manipulation with inconsistent reflections
O'Brien, J. F., & Farid, H. (2012) · ACM Transactions on Graphics · doi:10.1145/2077341.2077345 · Cited by 130
The Appearance of Human Skin: A Survey
Igarashi, T., Nishino, K., & Nayar, S. K. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980878 · Cited by 127
Exposing digital forgeries from 3-D lighting environments
Kee, E., & Farid, H. (2010) · 2010 IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2010.5711437 · Cited by 110
Scene Illumination as an Indicator of Image Manipulation
Rieß, C., & Angelopoulou, E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16435-4_6 · Cited by 73
Self-citationImage forensic analyses that elude the human visual system
Farid, H., & Bravo, M. J. (2010) · SPIE Proceedings · doi:10.1117/12.837788 · Cited by 66
Image Manipulation Detection With Binary Similarity Measures
Bayram, S., Avcıbaş, İ., Sankur, B., & Memon, N. D. (2005) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.39339 · Cited by 54
Image Splicing Detection Using Illuminant Color Inconsistency
Wu, X., & Fang, Z. (2011) · International Conference on Multimedia Information Networking and Security · doi:10.1109/mines.2011.135 · Cited by 45
Linear row and column predictors for the analysis of resized images
Kirchner, M. (2010) · ACM workshop on Multimedia and security · doi:10.1145/1854229.1854234 · Cited by 44
Physics-based illuminant color estimation as an image semantics clue
Rieß, C., & Angelopoulou, E. (2009) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2009.5414088 · Cited by 7
Self-citation
Cited by
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Learning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
“[11] extracted the illumination features from image and use a Support Vector Machine (SVM) classifier for tampering classification.”
BackgroundMethodInfluential
Metadata
- Authors
- de Carvalho, T. J., Riess, C., Angelopoulou, E., Pedrini, H., & de Rezende Rocha, A.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2013-07
- Volume
- 8
- Issue
- 7
- Pages
- 1182-1194
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W1983586459
- Cited by
- 406
- References
- 39
- FWCI
- 16.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.