The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
A Psychovisual Quality Metric in Free-Energy Principle
Abstract
In this paper, we propose a new psychovisual quality metric of images based on recent developments in brain theory and neuroscience, particularly the free-energy principle. The perception and understanding of an image is modeled as an active inference process, in which the brain tries to explain the scene using an internal generative model. The psychovisual quality is thus closely related to how accurately visual sensory data can be explained by the generative model, and the upper bound of the discrepancy between the image signal and its best internal description is given by the free energy of the cognition process. Therefore, the perceptual quality of an image can be quantified using the free energy. Constructively, we develop a reduced-reference free-energy-based distortion metric (FEDM) and a no-reference free-energy-based quality metric (NFEQM). The FEDM and the NFEQM are nearly invariant to many global systematic deviations in geometry and illumination that hardly affect visual quality, for which existing image quality metrics wrongly predict severe quality degradation. Although with very limited or even without information on the reference image, the FEDM and the NFEQM are highly competitive compared with the full-reference SSIM image quality metric on images in the popular LIVE database. Moreover, FEDM and NFEQM can measure correctly the visual quality of some model-based image processing algorithms, for which the competing metrics often contradict with viewers' opinions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“Recently, a so-called free-energy principle has been proposed in [3] and [4] to unify several brain theories in biological and physical sciences about human action, perception, and learning; some of which were seemingly not fully compatible with one another.”
The Origins of Order: Self-Organization and Selection in Evolution
Kauffman, S. A. (1993) · doi:10.1093/oso/9780195079517.001.0001 · Cited by 7,855
The origins of order; self organization and selection in evolution
(1994) · International Journal of Biochemistry · doi:10.1016/0020-711x(94)90119-8 · Cited by 6,649
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Treatise on Physiological Optics
von Helmholtz, H., & Southall, P. C. (1962) · Medical Entomology and Zoology · Cited by 2,196
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
New edge-directed interpolation
Li, X., & Orchard, M. T. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.951537 · Cited by 2,023
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Live image quality assessment database release 2
Sheikh, H. R. (2005) · Medical Entomology and Zoology · Cited by 1,275
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Model Selection and the Principle of Minimum Description Length
Hansen, M. H., & Yu, B. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753168398 · Cited by 788
A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
A Variational Baysian Framework for Graphical Models
Attias, H. T. (1999) · neural information processing systems · Cited by 689
Rissanen, J., & Langdon, G. (1981) · IEEE Transactions on Information Theory · doi:10.1109/tit.1981.1056282 · Cited by 454
Reduced-reference image quality assessment using a wavelet-domain natural image statistic model
Wang, Z., & Simoncelli, E. P. (2005) · SPIE Proceedings · doi:10.1117/12.597306 · Cited by 438
Wang, Z., Wu, G., Sheikh, H. R., Simoncelli, E. P., Yang, E.-H., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864165 · Cited by 293
Perceptual Neural Organization: Some Approaches Based on Network Models and Information Theory
Linsker, R. (1990) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.13.030190.001353 · Cited by 248
Scale invariance and noise in natural images
Zoran, D., & Weiss, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459476 · Cited by 238
Statistical Mechanics: A Set of Lectures
Moore, M. A. (1974) · Physics Bulletin · doi:10.1088/0031-9112/25/5/033 · Cited by 231
Video Quality Measurement Techniques
Wolf, S., & Pinson, M. (2002) · doi:10.70220/l2bp336n · Cited by 186
Variational Bayes for generalized autoregressive models
Roberts, S. J., & Penny, W. D. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.801921 · Cited by 157
A no-reference sharpness metric sensitive to blur and noise
Zhu, X., & Milanfar, P. (2009) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246976 · Cited by 147
Image quality assessment metrics based on multi-scale edge presentation
Zhai, G., Zhang, W., Yang, X., & Xu, Y. (2006) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips.2005.1579888 · Cited by 44
Self-citationBayesian methods for autoregressive models
Penny, W. D., & Roberts, S. (2002) · IEEE Workshop on Neural Networks for Signal Processing (NNSP) · doi:10.1109/nnsp.2000.889369 · Cited by 29
Cited by
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Self-citationUsing Free Energy Principle For Blind Image Quality Assessment
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2373812 · Cited by 611
Self-citationBlind Image Quality Estimation via Distortion Aggravation
Min, X., Zhai, G., Gu, K., Liu, Y., & Yang, X. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2816783 · Cited by 508
Self-citationBlind Quality Assessment Based on Pseudo-Reference Image
Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., & Chen, C. W. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2788206 · Cited by 450
Self-citationThe Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement
Gu, K., Zhai, G., Lin, W., & Liu, M. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2401732 · Cited by 390
Self-citation
Metadata
- Authors
- Zhai, G., Wu, X., Yang, X., Lin, W., & Zhang, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2012-01
- Volume
- 21
- Issue
- 1
- Pages
- 41-52
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2158546915
- Cited by
- 276
- References
- 29
- FWCI
- 12.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.