The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Blind Image Quality Assessment via Deep Learning
Open accessAbstract
This paper investigates how to blindly evaluate the visual quality of an image by learning rules from linguistic descriptions. Extensive psychological evidence shows that humans prefer to conduct evaluations qualitatively rather than numerically. The qualitative evaluations are then converted into the numerical scores to fairly benchmark objective image quality assessment (IQA) metrics. Recently, lots of learning-based IQA models are proposed by analyzing the mapping from the images to numerical ratings. However, the learnt mapping can hardly be accurate enough because some information has been lost in such an irreversible conversion from the linguistic descriptions to numerical scores. In this paper, we propose a blind IQA model, which learns qualitative evaluations directly and outputs numerical scores for general utilization and fair comparison. Images are represented by natural scene statistics features. A discriminative deep model is trained to classify the features into five grades, corresponding to five explicit mental concepts, i.e., excellent, good, fair, poor, and bad. A newly designed quality pooling is then applied to convert the qualitative labels into scores. The classification framework is not only much more natural than the regression-based models, but also robust to the small sample size problem. Thorough experiments are conducted on popular databases to verify the model's effectiveness, efficiency, and robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
No-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 8×
“Mittal et al. [26] presented BRISQUE to predict image quality in the spatial domain, Ye et al. [12] proposed CORNIA to extract features using K-means clustering and applied SVM to map the feature to quality.”
BackgroundInfluentialA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 2×
“Such structures are called NSS [19], [20].”
BackgroundMost apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
A Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2010.938364 · Cited by 1,121
TID2008 – A database for evaluation of full-reference visual quality assessment metrics
Ponomarenko, N. N., Лукин, В. В., & Zelensky, A. A. (2004) · Iris (Roma Tre University) · Cited by 992
No-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
Unsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh, H. R., Bovik, A. C., & Cormack, L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854492 · Cited by 575 · cited 3×
“As a result of the tendency to change, many BIQA algorithms have been devised [5], [8].”
MethodBayesian tree-structured image modeling using wavelet-domain hidden Markov models
Romberg, J. K., Choi, H., & Baraniuk, R. G. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.931100 · Cited by 503
On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures
Bianchini, M., & Scarselli, F. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293637 · Cited by 500
A DCT Statistics-Based Blind Image Quality Index
Saad, M. A., Bovik, A. C., & Charrier, C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2045550 · Cited by 372
What makes a good model of natural images?
Weiss, Y., & Freeman, W. T. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383092 · Cited by 300
Blind Image Quality Assessment Using a General Regression Neural Network
Li, C., Bovik, A. C., & Wu, X. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2120620 · Cited by 290
Deep Belief Networks using discriminative features for phone recognition
Mohamed, A.-R., Sainath, T. N., Dahl, G., Ramabhadran, B., Hinton, G. E., & Picheny, M. A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947494 · Cited by 286
Image Quality Assessment Based on Multiscale Geometric Analysis
Gao, X., Lu, W., Tao, D., & Li, X. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2018014 · Cited by 252
Self-citationLearning a blind measure of perceptual image quality
Tang, H., Joshi, N., & Kapoor, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995446 · Cited by 251
Sparse representation for blind image quality assessment
He, L., Tao, D., Li, X., & Gao, X. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247795 · Cited by 165
Self-citationLearning Deep and Wide: A Spectral Method for Learning Deep Networks
Shao, L., Wu, D., & Li, X. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2308519 · Cited by 163
Self-citationGao, X., Gao, F., Tao, D., & Li, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271356 · Cited by 157
Self-citationBlind Image Quality Assessment Without Human Training Using Latent Quality Factors
Mittal, A., Muralidhar, G. S., Ghosh, J., & Bovik, A. C. (2011) · IEEE Signal Processing Letters · doi:10.1109/lsp.2011.2179293 · Cited by 146
Single Image Super-Resolution With Multiscale Similarity Learning
Zhang, K., Gao, X., Tao, D., & Li, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2262001 · Cited by 139
Self-citationA Unified Learning Framework for Single Image Super-Resolution
Yu, J., Gao, X., Tao, D., Li, X., & Zhang, K. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2281313 · Cited by 96
Self-citationBilinear deep learning for image classification
Zhong, S.-H., Liu, Y., & Liu, Y. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2072344 · Cited by 83
Xia, Y., Sun, C., & Zheng, W. X. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2184800 · Cited by 65
Varadarajan, S., & Karam, L. J. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711776 · Cited by 62
A semantic no-reference image sharpness metric based on top-down and bottom-up saliency map modeling
Zhong, S.-H., Liu, Y., Liu, Y., & Chung, F.-L. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5653807 · Cited by 22
Cited by
Chen, C. L. P., & Liu, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2716952 · Cited by 1,957
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Liu, J., Gong, M., Qin, K., & Zhang, P. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2636227 · Cited by 522
Deep learning in microscopy image analysis: a survey
Xing, F., Xie, Y., Su, H., Liu, F., & Yang, L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2766168 · Cited by 460
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
Metadata
- Authors
- Hou, W., Gao, X., Tao, D., & Li, X.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2015-06
- Volume
- 26
- Issue
- 6
- Pages
- 1275-1286
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2170947705
- Cited by
- 368
- References
- 39
- FWCI
- 26.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.