Information Content Weighting for Perceptual Image Quality Assessment
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Many state-of-the-art perceptual image quality assessment (IQA) algorithms share a common two-stage structure: local quality/distortion measurement followed by pooling. While significant progress has been made in measuring local image quality/distortion, the pooling stage is often done in ad-hoc ways, lacking theoretical principles and reliable computational models. This paper aims to test the hypothesis that when viewing natural images, the optimal perceptual weights for pooling should be proportional to local information content, which can be estimated in units of bit using advanced statistical models of natural images. Our extensive studies based upon six publicly-available subject-rated image databases concluded with three useful findings. First, information content weighting leads to consistent improvement in the performance of IQA algorithms. Second, surprisingly, with information content weighting, even the widely criticized peak signal-to-noise-ratio can be converted to a competitive perceptual quality measure when compared with state-of-the-art algorithms. Third, the best overall performance is achieved by combining information content weighting with multiscale structural similarity measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Pixel-based similarity [4-14]: These full-reference (FR) metrics, such as the PSNR and the mean squared error (MSE), are widely used for their computational simplicity. However, they lack a perceptual basis and often fail to capture spatial dependencies.”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citationElements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
Self-citationThe Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Self-citationImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
Peli, E. (1990) · Journal of the Optical Society of America A · doi:10.1364/josaa.7.002032 · Cited by 1,298
Modeling attention to salient proto-objects
Walther, D., & Koch, C. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.10.001 · Cited by 1,249
VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147
Video quality assessment based on structural distortion measurement
Wang, Z., Lu, L., & Bovik, A. C. (2004) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(03)00076-6 · Cited by 1,024
Self-citationModern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Self-citationPeli, E. (1988) · Annual Meeting Optical Society of America · doi:10.1364/oam.1988.fd8 · Cited by 937
Multiscale structural similarity for image quality assessment
Wang, Z. (2025) · doi:10.57702/c0fj14hf · Cited by 867
Self-citationOptimal eye movement strategies in visual search
Najemnik, J., & Geisler, W. S. (2005) · Nature · doi:10.1038/nature03390 · Cited by 848
Noise characteristics and prior expectations in human visual speed perception
Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 797
Digital images and human vision
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5492 · Cited by 656
Visibility of wavelet quantization noise
Watson, A. B., Yang, G. Y., Solomon, J. A., & Villasenor, J. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.605413 · Cited by 562
Teo, P. C., & Heeger, D. J. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413502 · Cited by 471
Scale Mixtures of Gaussians and the Statistics of Natural Images
Wainwright, M. J., & Simoncelli, E. P. (1999) · Cited by 450
ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS
Ponomarenko, N. N., Silvestri, F., Egiazarian, K., Carli, M., Astola, J. T., & Лукин, В. В. (2007) · Cited by 364
Visual Importance Pooling for Image Quality Assessment
Moorthy, A. K., & Bovik, A. C. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015374 · Cited by 340
Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation
Li, Q., & Wang, Z. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2014497 · Cited by 323
Self-citationDigital Video Image Quality and Perceptual Coding
(2017) · CRC Press eBooks · doi:10.1201/9781420027822 · Cited by 317
Perceptual Criteria for Image Quality Evaluation
Pappas, T. N., Safranek, R. J., & Chen, J. (2005) · Handbook of Image and Video Processing · doi:10.1016/b978-012119792-6/50118-2 · Cited by 289
Safranek, R. J., & Johnston, J. D. (2003) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1989.266837 · Cited by 233
Video quality assessment using a statistical model of human visual speed perception
Wang, Z., & Li, Q. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b61 · Cited by 210
Self-citationEmbedded foveation image coding
Wang, Z., & Bovik, A. C. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.951527 · Cited by 204
Self-citation(1993) · Cited by 196
Foveation scalable video coding with automatic fixation selection
Wang, Z., Lu, L., & Bovik, A. C. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.809015 · Cited by 196
Self-citationSpatial Pooling Strategies for Perceptual Image Quality Assessment
Wang, Z., & Shang, X. (2006) · 2006 International Conference on Image Processing · doi:10.1109/icip.2006.313136 · Cited by 195
Self-citationModeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation
Lu, Z., Lin, W., Yang, X., Ong, E., & Yao, S. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854478 · Cited by 185
GAFFE: A Gaze-Attentive Fixation Finding Engine
Rajashekar, U., van der Linde, I., Bovik, A. C., & Cormack, L. K. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.917218 · Cited by 170
Ninassi, A., Le Meur, O., Le Callet, P., & Barba, D. (2007) · 2007 IEEE International Conference on Image Processing · doi:10.1109/icip.2007.4379119 · Cited by 170
Spatial-temporal distortion metric for in-service quality monitoring of any digital video system:
Wolf, S., & Pinson, M. H. (1999) · SPIE Proceedings · doi:10.1117/12.371210 · Cited by 169
Foveated video quality assessment
Lee, S., Pattichis, M. S., & Bovik, A. C. (2002) · IEEE Transactions on Multimedia · doi:10.1109/6046.985561 · Cited by 165
On a unified architecture for video-on-demand services
Lee, J. Y. B. (2002) · IEEE Transactions on Multimedia · doi:10.1109/6046.985552 · Cited by 120
METRICS PERFORMANCE COMPARISON FOR COLOR IMAGE DATABASE
Ponomarenko, N. N., Battisti, F., Egiazarian, K., Astola, J. T., & Лукин, В. В. (2008) · Iris (Roma Tre University) · Cited by 104
Pseudo no reference image quality metric using perceptual data hiding
Ninassi, A., Callet, P. L., & Autrusseau, F. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.650780 · Cited by 83
An automatic image quality assessment technique incorporating higher level perceptual factors
Osberger, W. M., Bergmann, N. W., & Maeder, A. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1998.727227 · Cited by 62
Feature detection algorithm based on a visual system model
Peli, E. (2002) · Proceedings of the IEEE · doi:10.1109/5.982407 · Cited by 59
Can visual fixation patterns improve image fidelity assessment?
Larson, E. C., Vu, C. T., & Chandler, D. M. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4712319 · Cited by 45
Unveiling relationships between regions of interest and image fidelity metrics
Larson, E. C., & Chandler, D. M. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.769248 · Cited by 29
Regional attention to structural degradations for perceptual image quality metric design
Engelke, U., Nguyen, V., & Zepernick, H. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4517748 · Cited by 23
Research works printed but not linked: 5
- pappas, 2005, Handbook of Image and Video Proc
- wandell, 1995, Foundations of Vision
- watson, 1993, DCTune: A technique for visual optimization of DCT quantization matrices for individual images, in Soc Inform Display Dig Tech Papers, xxiv, 946
- lubin, 1993, Digital Images and Human Vision, 163
- 10.1109/TIP.2007.901820 · DOI · Paper page
Cited by
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
Xue, W., Zhang, L., Mou, X., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293423 · Cited by 1,697
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Metadata
- Authors
- Wang, Z., & Li, Q.
- Affiliations
- University of Waterloo (CA)
- The University of Texas at Austin (US)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2011-05
- Volume
- 20
- Issue
- 5
- Pages
- 1185-1198
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2114582993
- Cited by
- 1,304
- References
- 49
- Citations by year
- 2026: 32 · 2025: 74 · 2024: 80 · 2023: 80 · 2022: 97 · 2021: 103 · 2020: 125 · 2019: 109 · 2018: 80 · 2017: 84 · 2016: 101 · 2015: 104 · 2014: 93 · 2013: 79 · 2012: 42
- FWCI
- 52.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- perceptual image quality assessment, pooling, natural image statistics, PSNR, structural similarity, subjective image quality
- MeSH terms
- Algorithms, Humans, Image Enhancement, Sensitivity and Specificity, Reproducibility of Results, Information Storage and Retrieval, Biomimetics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.