Nonlinear image representation using divisive normalization
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
In this paper, we describe a nonlinear image representation based on divisive normalization that is designed to match the statistical properties of photographic images, as well as the perceptual sensitivity of biological visual systems. We decompose an image using a multi-scale oriented representation, and use Student's t as a model of the dependencies within local clusters of coefficients. We then show that normalization of each coefficient by the square root of a linear combination of the amplitudes of the coefficients in the cluster reduces statistical dependencies. We further show that the resulting divisive normalization transform is invertible and provide an efficient iterative inversion algorithm. Finally, we probe the statistical and perceptual advantages of this image representation by examining its robustness to added noise, and using it to enhance image contrast.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citationNormalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835
Natural signal statistics and sensory gain control
Schwartz, O., & Simoncelli, E. P. (2001) · Nature Neuroscience · doi:10.1038/90526 · Cited by 835
Self-citationHuman luminance pattern-vision mechanisms: masking experiments require a new model
Foley, J. M. (1994) · Journal of the Optical Society of America A · doi:10.1364/josaa.11.001710 · Cited by 573
Model of visual contrast gain control and pattern masking
Watson, A. B., & Solomon, J. A. (1997) · Journal of the Optical Society of America A · doi:10.1364/josaa.14.002379 · Cited by 472
Teo, P. C., & Heeger, D. J. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413502 · Cited by 471
Cortical neurons: Isolation of contrast gain control
Geisler, W. S., & Albrecht, D. G. (1992) · Vision Research · doi:10.1016/0042-6989(92)90196-p · Cited by 211
Cited by
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
“layer is inspired by visual neuroscience models [3], [4].”
BackgroundWhat is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
“The local contrast normalization layer is inspired by computational neuroscience models [24, 20].”
MethodBuilding high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
“This exper-iment shows that patches, being detected as faces by the OpenCV face detector, account for less than 3% of the 100,000 sampled patches”
BackgroundMethodMan vs. computer: Benchmarking machine learning algorithms for traffic sign recognition
Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.016 · Cited by 1,537
Traffic sign recognition with multi-scale Convolutional Networks
Sermanet, P., & LeCun, Y. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033589 · Cited by 759
Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features
Xue, W., Mou, X., Zhang, L., Bovik, A. C., & Feng, X. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2355716 · Cited by 641
“As in [38] and [39], we propose to normalize the GM and LOG coefficients to obtain stable statistical image representations.”
MethodNormalization Techniques in Training DNNs: Methodology, Analysis and Application
Huang, L., Qin, J., Zhou, Y., Zhu, F., Liu, L., & Shao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3250241 · Cited by 537
A Realization-Theoretic Foundation for Fault Diagnosis, with Diagnosability Equivalence Predictions
Bronstein, M. M., Bruna, J., Cohen, T., & Veličković, P. (2021) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2026.1 · Cited by 519
Blind Image Quality Assessment Based on High Order Statistics Aggregation
Xu, J., Ye, P., Li, Q., Du, H., Liu, Y., & Doermann, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2585880 · Cited by 495
Arevalo, J., González, F. A., Ramos-Pollán, R., Oliveira, J. L., & Guevara Lopez, M. A. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.12.014 · Cited by 476
Damage detection techniques for wind turbine blades: A review
Du, Y., Zhou, S., Jing, X., Peng, Y., Wu, H., & Kwok, N. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.106445 · Cited by 463
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
Vehicle Type Classification Using a Semisupervised Convolutional Neural Network
Dong, Z., Wu, Y., Pei, M., & Jia, Y. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2402438 · Cited by 387
Reduced reference image quality assessment based on Weibull statistics
Xue, W., & Mou, X. (2010) · 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5518131 · Cited by 47
Metadata
- Authors
- Lyu, S., & Simoncelli, E. P.
- Venue
- 2008 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2008-06
- Volume
- 2008
- Pages
- 1-8
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2127230474
- Cited by
- 146
- References
- 7
- FWCI
- 4.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.