The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Using Free Energy Principle For Blind Image Quality Assessment
Abstract
In this paper we propose a new no-reference (NR) image quality assessment (IQA) metric using the recently revealed free-energy-based brain theory and classical human visual system (HVS)-inspired features. The features used can be divided into three groups. The first involves the features inspired by the free energy principle and the structural degradation model. Furthermore, the free energy theory also reveals that the HVS always tries to infer the meaningful part from the visual stimuli. In terms of this finding, we first predict an image that the HVS perceives from a distorted image based on the free energy theory, then the second group of features is composed of some HVS-inspired features (such as structural information and gradient magnitude) computed using the distorted and predicted images. The third group of features quantifies the possible losses of “naturalness” in the distorted image by fitting the generalized Gaussian distribution to mean subtracted contrast normalized coefficients. After feature extraction, our algorithm utilizes the support vector machine based regression module to derive the overall quality score. Experiments on LIVE, TID2008, CSIQ, IVC, and Toyama databases confirm the effectiveness of our introduced NR IQA metric compared to the state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“In addition, some recent advances in brain science and neuroscience [29], [30] motivated us to design the no-reference free energy based quality metric (NFEQM) [17] for predicting the quality of both blurry and noisy images.”
BackgroundMethodMaking a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 4×
“We first evaluate the performance of the proposed NFERM with a total number of fifteen IQA approaches on the LIVE database [39]: 1) classical FR PSNR, SSIM [4], MS-SSIM [5]; 2) popular blind distortion-specific WNJE [21], MBBM [22], Sheikh [23], SINE [24], JNB [26], CPBD [27], NFEQM [17]; 3) state-of-the-art general-p…”
BackgroundMethodInfluentialMultiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
No-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 4×
“We first evaluate the performance of the proposed NFERM with a total number of fifteen IQA approaches on the LIVE database [39]: 1) classical FR PSNR, SSIM [4], MS-SSIM [5]; 2) popular blind distortion-specific WNJE [21], MBBM [22], Sheikh [23], SINE [24], JNB [26], CPBD [27], NFEQM [17]; 3) state-of-the-art general-p…”
MethodInfluentialFSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Handbook of Parametric and Nonparametric Statistical Procedures
(2004) · Technometrics · doi:10.1198/tech.2004.s209 · Cited by 4,661
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“Similar to the Bayesian brain hypothesis [45], a basic premise of the free energy based brain theory is that the cognitive process is manipulated by an internal generative model.”
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Information content weighting for perceptual image quality assessment
Wang, Z., & Li, Q. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2092435 · Cited by 1,304
Live image quality assessment database release 2
Sheikh, H. R. (2005) · Medical Entomology and Zoology · Cited by 1,275
Image Features From Phase Congruency
Kovesi, P. D. (1995) · UWA Profiles and Research Repository (UWA) · Cited by 1,110
TID2008 – A database for evaluation of full-reference visual quality assessment metrics
Ponomarenko, N. N., Лукин, В. В., & Zelensky, A. A. (2004) · Iris (Roma Tre University) · Cited by 992
The statistics of natural images
Ruderman, D. (1994) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/5/4/006 · Cited by 941
Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex
Carandini, M., Heeger, D. J., & Movshon, J. A. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08621.1997 · Cited by 922
Handbook of Parametric and Nonparametric Statistical Procedures
Sheskin, D. J. (1996) · CRC Press eBooks · doi:10.4324/9780203489536 · Cited by 910
Multiscale structural similarity for image quality assessment
Wang, Z. (2025) · doi:10.57702/c0fj14hf · Cited by 867
No-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
Image Quality Assessment Based on Gradient Similarity
Liu, A., Lin, W., & Narwaria, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2175935 · Cited by 701
A Variational Baysian Framework for Graphical Models
Attias, H. T. (1999) · neural information processing systems · Cited by 689
Handbook of computer vision and applications
Jähne, B., Haussecker, H. W., & Geißler, P. (1999) · Cited by 658
A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD)
Narvekar, N. D., & Karam, L. J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2131660 · Cited by 587
No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh, H. R., Bovik, A. C., & Cormack, L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854492 · Cited by 575 · cited 4×
“We first evaluate the performance of the proposed NFERM with a total number of fifteen IQA approaches on the LIVE database [39]: 1) classical FR PSNR, SSIM [4], MS-SSIM [5]; 2) popular blind distortion-specific WNJE [21], MBBM [22], Sheikh [23], SINE [24], JNB [26], CPBD [27], NFEQM [17]; 3) state-of-the-art general-p…”
MethodInfluentialA no-reference perceptual blur metric
Marziliano, P., Dufaux, F., Winkler, S., & Ebrahimi, T. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038902 · Cited by 557
Sharifi, K., & Leon-Garcia, A. (1995) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.350779 · Cited by 540
Rissanen, J., & Langdon, G. (1981) · IEEE Transactions on Information Theory · doi:10.1109/tit.1981.1056282 · Cited by 454
Learning without Human Scores for Blind Image Quality Assessment
Xue, W., Zhang, L., & Mou, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.133 · Cited by 404
Visual Importance Pooling for Image Quality Assessment
Moorthy, A. K., & Bovik, A. C. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015374 · Cited by 340
A Psychovisual Quality Metric in Free-Energy Principle
Zhai, G., Wu, X., Yang, X., Lin, W., & Zhang, W. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2161092 · Cited by 276
Self-citationReduced-Reference Image Quality Assessment by Structural Similarity Estimation
Rehman, A., & Wang, Z. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2197011 · Cited by 272
Perceptual Quality Metric With Internal Generative Mechanism
Wu, J., Lin, W., Shi, G., & Liu, A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214048 · Cited by 258
Mach bands are phase dependent
Morrone, M. C., Ross, J., Burr, D. C., & Owens, R. (1986) · Nature · doi:10.1038/324250a0 · Cited by 250
Perceptual Neural Organization: Some Approaches Based on Network Models and Information Theory
Linsker, R. (1990) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.13.030190.001353 · Cited by 248
Scale invariance and noise in natural images
Zoran, D., & Weiss, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459476 · Cited by 238
Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2014) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2014.2344471 · Cited by 227
Self-citationAutomatic Prediction of Perceptual Image and Video Quality
Bovik, A. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2257632 · Cited by 214
Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation
Ma, L., Li, S., Zhang, F., & Ngan, K. N. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2109701 · Cited by 162
Variational Bayes for generalized autoregressive models
Roberts, S. J., & Penny, W. D. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.801921 · Cited by 157
Gao, X., Gao, F., Tao, D., & Li, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271356 · Cited by 157
Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos
Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., & Etoh, M. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2004910 · Cited by 117
Self-citationSubjective and objective quality assessment for images with contrast change
Gu, K., Zhai, G., Yang, X., Zhang, W., & Liu, M. (2013) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2013.6738079 · Cited by 102
Self-citationA new reduced-reference image quality assessment using structural degradation model
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2013) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2013.6572041 · Cited by 73
Self-citationThree Dimensional Scalable Video Adaptation via User-End Perceptual Quality Assessment
Zhai, G., Cai, J., Lin, W., et al. (2008) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2008.2001720 · Cited by 70
Self-citationGu, K., Zhai, G., Yang, X., Zhang, W., & Liang, L. (2013) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2013.6607462 · Cited by 46
Self-citationNoise estimation using statistics of natural images
Zhai, G., & Wu, X. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6115828 · Cited by 44
Self-citationSelf-adaptive scale transform for IQA metric
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2013) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2013.6572353 · Cited by 35
Self-citationStructural similarity weighting for image quality assessment
Gu, K., Zhai, G., Yang, X., Zhang, W., & Liu, M. (2013) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2013.6618416 · Cited by 32
Self-citationNo‐Reference Stereoscopic IQA Approach: From Nonlinear Effect to Parallax Compensation
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2012) · Journal of Electrical and Computer Engineering · doi:10.1155/2012/436031 · Cited by 32
Self-citationDetails preservation inspired blind quality metric of tone mapping methods
Gu, K., Zhai, G., Liu, M., Yang, X., & Zhang, W. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865186 · Cited by 22
Self-citationGu, K., Zhai, G., Yang, X., & Zhang, W. (2013) · Signal Image and Video Processing · doi:10.1007/s11760-013-0445-2 · Cited by 20
Self-citationAdaptive high-frequency clipping for improved image quality assessment
Gu, K., Zhai, G., Liu, M., Xu, Q., Yang, X., Zhou, J. W., & Zhang, W. (2013) · Visual Communications and Image Processing · doi:10.1109/vcip.2013.6706347 · Cited by 14
Self-citation
Cited by
Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model
Li, M., Liu, J., Yang, W., Sun, X., & Guo, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2810539 · Cited by 1,245
Waterloo Exploration Database: New Challenges for Image Quality Assessment Models
Ma, K., Duanmu, Z., Wu, Q., Wang, Z., Yong, H., Li, H., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2631888 · Cited by 789
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Self-citationBlind Image Quality Estimation via Distortion Aggravation
Min, X., Zhai, G., Gu, K., Liu, Y., & Yang, X. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2816783 · Cited by 508
Self-citationBlind Quality Assessment Based on Pseudo-Reference Image
Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., & Chen, C. W. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2788206 · Cited by 450
Self-citation
Metadata
- Authors
- Gu, K., Zhai, G., Yang, X., & Zhang, W.
- Venue
- IEEE Transactions on Multimedia
- Published
- 2015-01
- Volume
- 17
- Issue
- 1
- Pages
- 50-63
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2063360098
- Cited by
- 611
- References
- 58
- FWCI
- 40.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.