The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment
Abstract
Perceptual image quality assessment (IQA) aims to use computational models to measure the image quality in consistent with subjective evaluations. Visual saliency (VS) has been widely studied by psychologists, neurobiologists, and computer scientists during the last decade to investigate, which areas of an image will attract the most attention of the human visual system. Intuitively, VS is closely related to IQA in that suprathreshold distortions can largely affect VS maps of images. With this consideration, we propose a simple but very effective full reference IQA method using VS. In our proposed IQA model, the role of VS is twofold. First, VS is used as a feature when computing the local quality map of the distorted image. Second, when pooling the quality score, VS is employed as a weighting function to reflect the importance of a local region. The proposed IQA index is called visual saliency-based index (VSI). Several prominent computational VS models have been investigated in the context of IQA and the best one is chosen for VSI. Extensive experiments performed on four large-scale benchmark databases demonstrate that the proposed IQA index VSI works better in terms of the prediction accuracy than all state-of-the-art IQA indices we can find while maintaining a moderate computational complexity. The MATLAB source code of VSI and the evaluation results are publicly available online at http://sse.tongji.edu.cn/linzhang/IQA/VSI/VSI.htm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Self-citationFrequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383267 · Cited by 3,422
Self-citationMean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
State-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817
Image processing, analysis and machine vision
Dijkstra, T. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90073-6 · Cited by 1,805
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
Information content weighting for perceptual image quality assessment
Wang, Z., & Li, Q. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2092435 · Cited by 1,304
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147
TID2008 – A database for evaluation of full-reference visual quality assessment metrics
Ponomarenko, N. N., Лукин, В. В., & Zelensky, A. A. (2004) · Iris (Roma Tre University) · Cited by 992
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922
Saliency, attention, and visual search: An information theoretic approach
Bruce, N. D. B., & Tsotsos, J. K. (2009) · Journal of Vision · doi:10.1167/9.3.5 · Cited by 855
Image Signature: Highlighting Sparse Salient Regions
Hou, X., Harel, J., & Koch, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.146 · Cited by 834
Image quality assessment based on a degradation model
Damera-Venkata, N., Kite, T. D., Geisler, W. S., Evans, B. L., & Bovik, A. C. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.841940 · Cited by 806
Image Quality Assessment Based on Gradient Similarity
Liu, A., Lin, W., & Narwaria, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2175935 · Cited by 701
A unified approach to salient object detection via low rank matrix recovery
Shen, X., & Wu, Y. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247758 · Cited by 691
Handbook of computer vision and applications
Jähne, B., Haussecker, H. W., & Geißler, P. (1999) · Cited by 658
Static and space-time visual saliency detection by self-resemblance
Seo, H. J., & Milanfar, P. (2009) · Journal of Vision · doi:10.1167/9.12.15 · Cited by 633
Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study
Borji, A., Sihite, D. N., & Itti, L. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2210727 · Cited by 613
Geusebroek, J.-M., van den Boomgaard, R., Smeulders, A. W. M., & Geerts, H. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.977559 · Cited by 553
Color Image Database TID 2013: peculiarities and preliminary results
Ponomarenko, N. N., Єремеєв, О., Лукин, В. В., Egiazarian, K., Jin, L., Astola, J. T., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2013) · HAL · Cited by 419
Center-surround divergence of feature statistics for salient object detection
Klein, D. A., & Frintrop, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126499 · Cited by 369
Visual Importance Pooling for Image Quality Assessment
Moorthy, A. K., & Bovik, A. C. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015374 · Cited by 340
Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data
Liu, H., & Heynderickx, I. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2133770 · Cited by 245
A comprehensive evaluation of full reference image quality assessment algorithms
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467150 · Cited by 221
Self-citationRFSIM: A feature based image quality assessment metric using Riesz transforms
Zhang, L., Zhang, L., & Mou, X. (2010) · 2010 IEEE International Conference on Image Processing · doi:10.1109/icip.2010.5649275 · Cited by 218
Self-citationComputational versus Psychophysical Bottom-Up Image Saliency: A Comparative Evaluation Study
Toet, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.53 · Cited by 214
Visual Attention in Quality Assessment
Engelke, U., Kaprykowsky, H., Zepernick, H., & Ndjiki-Nya, P. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942473 · Cited by 135
Color and Scale: The Spatial Structure of Color Images
Geusebroek, J., van den Boomgaard, R., Smeulders, A. W. M., & Dev, A. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45054-8_22 · Cited by 89
Full Reference Image Quality Assessment Based on Saliency Map Analysis
Tong, Y., Konik, H., Cheikh, F. A., & Trémeau, A. (2010) · Journal of Imaging Science and Technology · doi:10.2352/j.imagingsci.technol.2010.54.3.030503 · Cited by 76
Overt visual attention for free-viewing and quality assessment tasks
Meur, O. L., Ninassi, A., Callet, P. L., & Barba, D. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.05.006 · Cited by 75
Perceptual quality assessment based on visual attention analysis
You, J., Perkis, A., Hannuksela, M. M., & Gabbouj, M. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631356 · Cited by 73
Do video coding impairments disturb the visual attention deployment?
Meur, O. L., Ninassi, A., Callet, P. L., & Barba, D. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.05.008 · Cited by 51
New strategy for image and video quality assessment
Ma, Q., Zhang, L., & Wang, B. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3302129 · Cited by 49
Self-citationOn performance of image quality metrics enhanced with visual attention computational models
Farias, M. C. Q., & Akamine, W. Y. L. (2012) · Electronics Letters · doi:10.1049/el.2012.0642 · Cited by 46
Can visual fixation patterns improve image fidelity assessment?
Larson, E. C., Vu, C. T., & Chandler, D. M. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4712319 · Cited by 45
Balancing Attended and Global Stimuli in Perceived Video Quality Assessment
You, J., Korhonen, J., Perkis, A., & Ebrahimi, T. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2172591 · Cited by 32
Unveiling relationships between regions of interest and image fidelity metrics
Larson, E. C., & Chandler, D. M. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.769248 · Cited by 29
Framework for optimal region of interest-based quality assessment in wireless imaging
Engelke, U., & Zepernick, H. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267097 · Cited by 27
Spatial bayesian surprise for image saliency and quality assessment
Gkioulekas, I., Evangelopoulos, G., & Maragos, P. A. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5650991 · Cited by 18
Cited by
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., & Samek, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2760518 · Cited by 1,138
Image Quality Assessment: Unifying Structure and Texture Similarity
Ding, K., Ma, K., Wang, S., & Simoncelli, E. P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045810 · Cited by 952
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
KADID-10k: A Large-scale Artificially Distorted IQA Database
Lin, H., Hosu, V., & Saupe, D. (2019) · 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2019.8743252 · Cited by 523
Metadata
- Authors
- Zhang, L., Shen, Y., & Li, H.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2014-10
- Volume
- 23
- Issue
- 10
- Pages
- 4270-4281
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2015196405
- Cited by
- 1,029
- References
- 51
- FWCI
- 53.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.