The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs
Open accessAbstract
Objective assessment of image quality is fundamentally important in many image processing tasks. In this paper, we focus on learning blind image quality assessment (BIQA) models, which predict the quality of a digital image with no access to its original pristine-quality counterpart as reference. One of the biggest challenges in learning BIQA models is the conflict between the gigantic image space (which is in the dimension of the number of image pixels) and the extremely limited reliable ground truth data for training. Such data are typically collected via subjective testing, which is cumbersome, slow, and expensive. Here, we first show that a vast amount of reliable training data in the form of quality-discriminable image pairs (DIPs) can be obtained automatically at low cost by exploiting large-scale databases with diverse image content. We then learn an opinion-unaware BIQA (OU-BIQA, meaning that no subjective opinions are used for training) model using RankNet, a pairwise learning-to-rank (L2R) algorithm, from millions of DIPs, each associated with a perceptual uncertainty level, leading to a DIP inferred quality (dipIQ) index. Extensive experiments on four benchmark IQA databases demonstrate that dipIQ outperforms the state-of-the-art OU-BIQA models. The robustness of dipIQ is also significantly improved as confirmed by the group MAximum Differentiation competition method. Furthermore, we extend the proposed framework by learning models with ListNet (a listwise L2R algorithm) on quality-discriminable image lists (DIL). The resulting DIL inferred quality index achieves an additional performance gain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citationA theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 2×
“We first choose three best-trusted FR-IQA models, namely MS-SSIM [82], VIF [83], and GSMD [84].”
MethodSelf-citationNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Learning to rank using gradient descent
Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., & Hullender, G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102363 · Cited by 2,836
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
A desicion-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59119-2_166 · Cited by 2,252
Learning to rank: from pairwise approach to listwise approach
Cao, Z., Qin, T., Liu, T.-Y., Tsai, M.-F., & Li, H. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273513 · Cited by 1,960
Self-citationMost apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
The importance of phase in signals
Oppenheim, A. V., & Lim, J. S. (1981) · Proceedings of the IEEE · doi:10.1109/proc.1981.12022 · Cited by 1,868
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
Xue, W., Zhang, L., Mou, X., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293423 · Cited by 1,697
Learning to Rank for Information Retrieval
Liu, T.-Y. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,568
Self-citationShiftable multiscale transforms
Simoncelli, E. P., Freeman, W. T., Adelson, E. H., & Heeger, D. J. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119725 · Cited by 1,333
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
A Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Self-citationNo-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
Self-citationWaterloo Exploration Database: New Challenges for Image Quality Assessment Models
Ma, K., Duanmu, Z., Wu, Q., Wang, Z., Yong, H., Li, H., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2631888 · Cited by 789
Self-citationVisible differences predictor: an algorithm for the assessment of image fidelity
Daly, S. J. (1992) · SPIE Proceedings · doi:10.1117/12.135952 · Cited by 718
A support vector method for optimizing average precision
Yue, Y., Finley, T., Radlinski, F., & Joachims, T. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277790 · Cited by 704
Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features
Xue, W., Mou, X., Zhang, L., Bovik, A. C., & Feng, X. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2355716 · Cited by 641
Using Free Energy Principle For Blind Image Quality Assessment
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2373812 · Cited by 611
No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh, H. R., Bovik, A. C., & Cormack, L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854492 · Cited by 575
Perceptual blur and ringing metrics: application to JPEG2000
Marziliano, P., Dufaux, F., Winkler, S., & Ebrahimi, T. (2004) · Signal Processing: Image Communication · doi:10.1016/j.image.2003.08.003 · Cited by 491
Blind measurement of blocking artifacts in images
Wang, Z., Bovik, A. C., & Evan, B. L. (2002) · Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101) · doi:10.1109/icip.2000.899622 · Cited by 413
Self-citationLearning without Human Scores for Blind Image Quality Assessment
Xue, W., Zhang, L., & Mou, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.133 · Cited by 404
Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content
Zhu, X., & Milanfar, P. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2052820 · Cited by 383
A DCT Statistics-Based Blind Image Quality Index
Saad, M. A., Bovik, A. C., & Charrier, C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2045550 · Cited by 372
Blind Image Quality Assessment via Deep Learning
Hou, W., Gao, X., Tao, D., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2336852 · Cited by 368
Self-citationReduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation
Li, Q., & Wang, Z. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2014497 · Cited by 323
Self-citationSoftRank: optimizing non-smooth rank metrics
Taylor, M., Guiver, J., Robertson, S., & Minka, T. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341544 · Cited by 322
A generalized block-edge impairment metric for video coding
Wu, H. R., & Yuen, M. (1997) · IEEE Signal Processing Letters · doi:10.1109/97.641398 · Cited by 316
Wang, Z., Wu, G., Sheikh, H. R., Simoncelli, E. P., Yang, E.-H., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864165 · Cited by 293
Self-citationImage Sharpness Assessment Based on Local Phase Coherence
Hassen, R., Wang, Z., & Salama, M. M. A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2251643 · Cited by 290
Self-citationBlind Image Quality Assessment Using a General Regression Neural Network
Li, C., Bovik, A. C., & Wu, X. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2120620 · Cited by 290
Discriminative models for information retrieval
Nallapati, R. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009006 · Cited by 285
Reduced- and No-Reference Image Quality Assessment
Wang, Z., & Bovik, A. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942471 · Cited by 280
Self-citationReduced-Reference Image Quality Assessment by Structural Similarity Estimation
Rehman, A., & Wang, Z. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2197011 · Cited by 272
Self-citationNo-Reference Image Quality Assessment Using Visual Codebooks
Ye, P., & Doermann, D. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190086 · Cited by 270
Learning a blind measure of perceptual image quality
Tang, H., Joshi, N., & Kapoor, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995446 · Cited by 251
Subset Ranking Using Regression
Cossock, D., & Zhang, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11776420_44 · Cited by 236
Efficient DCT-domain blind measurement and reduction of blocking artifacts
Liu, S., & Bovik, A. C. (2002) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2002.806819 · Cited by 228
FRank: a ranking method with fidelity loss
Tsai, M.-F., Liu, T.-Y., Qin, T., Chen, H.-H., & Ma, W.-Y. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277808 · Cited by 228
Self-citationBlind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer
Wu, Q., Li, H., Meng, F., Ngan, K. N., Luo, B., Huang, C., & Zeng, B. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2412773 · Cited by 164
The importance of phase in image processing filters
Huang, T., Burnett, J., & Deczky, A. (1975) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1975.1162738 · Cited by 160
A No-Reference Metric for Perceived Ringing Artifacts in Images
Liu, H., Klomp, N., & Heynderickx, I. E. J. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2035848 · Cited by 159
A highly efficient method for blind image quality assessment
Wu, Q., Wang, Z., & Li, H. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7350816 · Cited by 152
Self-citationA no-reference sharpness metric sensitive to blur and noise
Zhu, X., & Milanfar, P. (2009) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246976 · Cited by 147
Learning to Rank for Blind Image Quality Assessment
Gao, F., Tao, D., Gao, X., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2377181 · Cited by 146
Self-citationOptimum polynomial retrieval functions based on the probability ranking principle
Fuhr, N. (1989) · ACM Transactions on Information Systems · doi:10.1145/65943.65944 · Cited by 145
Gao, X., Gao, F., Tao, D., & Li, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271356 · Cited by 142
Self-citationBlind Image Quality Assessment Without Human Training Using Latent Quality Factors
Mittal, A., Muralidhar, G. S., Ghosh, J., et al. (2011) · IEEE Signal Processing Letters · doi:10.1109/lsp.2011.2179293 · Cited by 140
Bayesian natural selection and the evolution of perceptual systems
Geisler, W. S., & Diehl, R. L. (2002) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2001.1055 · Cited by 101
Blind Image Quality Assessment Using Semi-supervised Rectifier Networks
Tang, H., Joshi, N., & Kapoor, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.368 · Cited by 97
Group MAD Competition? A New Methodology to Compare Objective Image Quality Models
Ma, K., Wu, Q., Wang, Z., Duanmu, Z., Yong, H., Li, H., & Zhang, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.184 · Cited by 97
Self-citationBeyond Human Opinion Scores: Blind Image Quality Assessment Based on Synthetic Scores
Ye, P., Kumar, J., & Doermann, D. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.540 · Cited by 95
Real-Time No-Reference Image Quality Assessment Based on Filter Learning
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.132 · Cited by 72
Image coding ringing artifact reduction using morphological post-filtering
Oguz, S. H., Hu, Y. H., & Nguyen, T.-T. (2002) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.1998.739051 · Cited by 59
Rank learning on training set selection and image quality assessment
Xu, L., Lin, W., Li, J., Wang, X., Yan, Y., & Fang, Y. (2014) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890291 · Cited by 8
Cited by
Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
Zhang, W., Ma, K., Yan, J., Deng, D., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2886771 · Cited by 949
Self-citationBlindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Su, S., Yan, Q., Zhu, Y., Zhang, C., Ge, X., Sun, J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00372 · Cited by 848
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
End-to-End Blind Image Quality Assessment Using Deep Neural Networks
Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., & Zuo, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2774045 · Cited by 619
Self-citationMANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Yang, S., Wu, T., Shi, S., Lao, S., Gong, Y., Cao, M., Wang, J., & Yang, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00126 · Cited by 527
Metadata
- Authors
- Ma, K., Liu, W., Liu, T., Wang, Z., & Tao, D.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-08
- Volume
- 26
- Issue
- 8
- Pages
- 3951-3964
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2618902759
- Cited by
- 353
- References
- 74
- FWCI
- 12.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.