Information Content Weighting for Perceptual Image Quality Assessment
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Many state-of-the-art perceptual image quality assessment (IQA) algorithms share a common two-stage structure: local quality/distortion measurement followed by pooling. While significant progress has been made in measuring local image quality/distortion, the pooling stage is often done in ad-hoc ways, lacking theoretical principles and reliable computational models. This paper aims to test the hypothesis that when viewing natural images, the optimal perceptual weights for pooling should be proportional to local information content, which can be estimated in units of bit using advanced statistical models of natural images. Our extensive studies based upon six publicly-available subject-rated image databases concluded with three useful findings. First, information content weighting leads to consistent improvement in the performance of IQA algorithms. Second, surprisingly, with information content weighting, even the widely criticized peak signal-to-noise-ratio can be converted to a competitive perceptual quality measure when compared with state-of-the-art algorithms. Third, the best overall performance is achieved by combining information content weighting with multiscale structural similarity measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Pixel-based similarity [4-14]: These full-reference (FR) metrics, such as the PSNR and the mean squared error (MSE), are widely used for their computational simplicity. However, they lack a perceptual basis and often fail to capture spatial dependencies.”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citationElements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
Self-citationThe Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Self-citationImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Research works printed but not linked: 5
- pappas, 2005, Handbook of Image and Video Proc
- wandell, 1995, Foundations of Vision
- watson, 1993, DCTune: A technique for visual optimization of DCT quantization matrices for individual images, in Soc Inform Display Dig Tech Papers, xxiv, 946
- lubin, 1993, Digital Images and Human Vision, 163
- 10.1109/TIP.2007.901820 · DOI · Paper page
Cited by
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
Xue, W., Zhang, L., Mou, X., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293423 · Cited by 1,697
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
“Correspondence to HVS has been evaluated for the following metrics (quality indices): SFF [44], componentwise FSIM and its color version FSIMc [20], PSNR-HA and PSNR-HMA [43], SR-SIM [45], MSSIM [46], MAD index [27], IW-SSIM [19], MSDDM [47], IW-PSNR [19], color version of PSNR which takes into account color in a mann…”
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Self-citationVSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment
Zhang, L., Shen, Y., & Li, H. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2346028 · Cited by 1,029
Image Quality Assessment: Unifying Structure and Texture Similarity
Ding, K., Ma, K., Wang, S., & Simoncelli, E. P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045810 · Cited by 952
Image Quality Assessment Based on Gradient Similarity
Liu, A., Lin, W., & Narwaria, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2175935 · Cited by 701
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Objective Quality Assessment of Tone-Mapped Images
Yeganeh, H., & Wang, Z. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2221725 · Cited by 630
Self-citationUsing Free Energy Principle For Blind Image Quality Assessment
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2373812 · Cited by 611
On the Mathematical Properties of the Structural Similarity Index
Brunet, D., Vrscay, E. R., & Wang, Z. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2173206 · Cited by 600
Self-citationKADID-10k: A Large-scale Artificially Distorted IQA Database
Lin, H., Hosu, V., & Saupe, D. (2019) · 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2019.8743252 · Cited by 523
A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images
Wang, S., Ma, K., Yeganeh, H., Wang, Z., & Lin, W. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2487369 · Cited by 444
Self-citationHaar wavelet downsampling: A simple but effective downsampling module for semantic segmentation
Xu, G., Liao, W., Zhang, X., Li, C., He, X., & Wu, X. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109819 · Cited by 434
Seven Challenges in Image Quality Assessment: Past, Present, and Future Research
Chandler, D. M. (2013) · ISRN Signal Processing · doi:10.1155/2013/905685 · Cited by 427
The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement
Gu, K., Zhai, G., Lin, W., & Liu, M. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2401732 · Cited by 390
Saliency-Guided Quality Assessment of Screen Content Images
Gu, K., Wang, S., Yang, H., Lin, W., Zhai, G., Yang, X., & Zhang, W. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2547343 · Cited by 303
Image Sharpness Assessment Based on Local Phase Coherence
Hassen, R., Wang, Z., & Salama, M. M. A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2251643 · Cited by 290
Self-citationReduced- and No-Reference Image Quality Assessment
Wang, Z., & Bovik, A. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942471 · Cited by 280
Self-citationReduced-Reference Image Quality Assessment by Structural Similarity Estimation
Rehman, A., & Wang, Z. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2197011 · Cited by 272
Self-citationNo-Reference Image Blur Assessment Based on Discrete Orthogonal Moments
Li, L., Lin, W., Wang, X., Yang, G., Bahrami, K., & Kot, A. C. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2392129 · Cited by 270
Review of medical image quality assessment
Chow, L. S., & Paramesran, R. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.02.006 · Cited by 265
Perceptual Quality Metric With Internal Generative Mechanism
Wu, J., Lin, W., Shi, G., & Liu, A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214048 · Cited by 258
SR-SIM: A fast and high performance IQA index based on spectral residual
Zhang, L., & Li, H. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467149 · Cited by 256
Predicting the Perceptual Quality of Point Cloud: A 3D-to-2D Projection-Based Exploration
Yang, Q., Chen, H., Ma, Z., Xu, Y., Tang, R., & Sun, J. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3033117 · Cited by 256
Dehazing Evaluation: Real-World Benchmark Datasets, Criteria, and Baselines
Zhao, S., Zhang, L., Huang, S., Shen, Y., & Zhao, S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2995264 · Cited by 169
Blind omnidirectional image quality assessment with viewport oriented graph convolutional networks
Xu, J., Zhou, W., & Chen, Z. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3015186 · Cited by 166
A Gabor Feature-Based Quality Assessment Model for the Screen Content Images
Ni, Z., Zeng, H., Ma, L., Hou, J., Chen, J., & Ma, K.-K. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839890 · Cited by 118
Demystifying MLOps and Presenting a Recipe for the Selection of Open-Source Tools
Ruf, P., Madan, M., Reich, C., & Ould-Abdeslam, D. (2021) · Applied Sciences · doi:10.3390/app11198861 · Cited by 112
Prospects of Structural Similarity Index for Medical Image Analysis
Mudeng, V., Kim, M., & Choe, S.-W. (2022) · Applied Sciences · doi:10.3390/app12083754 · Cited by 101
A Comparative Evaluation Of Temporal Pooling Methods For Blind Video Quality Assessment
Tu, Z., Chen, C.-J., Chen, L.-H., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2020) · 2020 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip40778.2020.9191169 · Cited by 71
Oszust, M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0158333 · Cited by 39
“Wang and Li in [5] proposed information content weighted SSIM (IW-SSIM) approach as an extension of MSSIM.”
MethodWang, S., Zhou, X., Li, C., Wang, S., Li, Y., Tan, T., & Zheng, H. (2025) · Research · doi:10.34133/research.1029 · Cited by 29
(2022) · doi:10.3390/electronics11040559 · Cited by 19
A Combined Full-Reference Image Quality Assessment Method Based on Convolutional Activation Maps
Varga, D. (2020) · Algorithms · doi:10.3390/a13120313 · Cited by 11
Agaian, S. S., Grigoryan, A. M., & Ayunts, H. (2026) · Information · doi:10.3390/info17070632
Metadata
- Authors
- Wang, Z., & Li, Q.
- Affiliations
- University of Waterloo (CA)
- The University of Texas at Austin (US)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2011-05
- Volume
- 20
- Issue
- 5
- Pages
- 1185-1198
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2114582993
- Cited by
- 1,304
- References
- 49
- Citations by year
- 2026: 32 · 2025: 74 · 2024: 80 · 2023: 80 · 2022: 97 · 2021: 103 · 2020: 125 · 2019: 109 · 2018: 80 · 2017: 84 · 2016: 101 · 2015: 104 · 2014: 93 · 2013: 79 · 2012: 42
- FWCI
- 52.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- perceptual image quality assessment, pooling, natural image statistics, PSNR, structural similarity, subjective image quality
- MeSH terms
- Algorithms, Humans, Image Enhancement, Sensitivity and Specificity, Reproducibility of Results, Information Storage and Retrieval, Biomimetics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.