The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
Open accessAbstract
We propose a deep bilinear model for blind image quality assessment that works for both synthetically and authentically distorted images. Our model constitutes two streams of deep convolutional neural networks (CNNs), specializing in two distortion scenarios separately. For synthetic distortions, we first pre-train a CNN to classify the distortion type and the level of an input image, whose ground truth label is readily available at a large scale. For authentic distortions, we make use of a pre-train CNN (VGG-16) for the image classification task. The two feature sets are bilinearly pooled into one representation for a final quality prediction. We fine-tune the whole network on the target databases using a variant of stochastic gradient descent. The extensive experimental results show that the proposed model achieves state-of-the-art performance on both synthetic and authentic IQA databases. Furthermore, we verify the generalizability of our method on the large-scale Waterloo Exploration Database, and demonstrate its competitiveness using the group maximum differentiation competition methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
(2010) · International Conference on Machine Learning · Cited by 13,995
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
No-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Convolutional Two-Stream Network Fusion for Video Action Recognition
Feichtenhofer, C., Pinz, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.213 · Cited by 2,684
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Bilinear CNN Models for Fine-Grained Visual Recognition
Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.170 · Cited by 2,135
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
Fukui, A., Park, D. H., Yang, D., Rohrbach, A., Darrell, T., & Rohrbach, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1044 · Cited by 1,582
Handbook of Image and Video Processing
(2005) · Elsevier eBooks · doi:10.1016/b978-0-12-119792-6.x5062-1 · Cited by 1,578
A Riemannian Framework for Tensor Computing
Pennec, X., Fillard, P., & Ayache, N. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-3222-z · Cited by 1,550
End-to-end Optimized Image Compression
Ballé, J., Laparra, V., & Simoncelli, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01704 · Cited by 1,275
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
A Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Self-citationDeep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., & Samek, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2760518 · Cited by 1,138
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Self-citationGao, Y., Beijbom, O., Zhang, N., & Darrell, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.41 · Cited by 871
Handbook of Image and Video Processing
Wells, P. N. T. (2001) · Physiological Measurement · doi:10.1088/0967-3334/22/1/702 · Cited by 827
Waterloo Exploration Database: New Challenges for Image Quality Assessment Models
Ma, K., Duanmu, Z., Wu, Q., Wang, Z., Yong, H., Li, H., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2631888 · Cited by 789
Self-citationUnsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
Ghadiyaram, D., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2500021 · Cited by 782
Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features
Xue, W., Mou, X., Zhang, L., Bovik, A. C., & Feng, X. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2355716 · Cited by 641
End-to-End Blind Image Quality Assessment Using Deep Neural Networks
Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., & Zuo, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2774045 · Cited by 619
Self-citationMatConvNet - Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.4564 · Cited by 578
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis lectures on image, video, and multimedia processing · doi:10.2200/s00010ed1v01y200508ivm003 · Cited by 501
Self-citationBlind Image Quality Assessment Based on High Order Statistics Aggregation
Xu, J., Ye, P., Li, Q., Du, H., Liu, Y., & Doermann, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2585880 · Cited by 495
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Bosse, S., Maniry, D., Müller, K., Wiegand, T., & Samek, W. (2018) · MPG.PuRe (Max Planck Society) · Cited by 469
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs
Ma, K., Liu, W., Liu, T., Wang, Z., & Tao, D. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2708503 · Cited by 353
Self-citationPerceptual quality prediction on authentically distorted images using a bag of features approach
Ghadiyaram, D., & Bovik, A. C. (2017) · Journal of Vision · doi:10.1167/17.1.32 · Cited by 322
Objective quality assessment of multiply distorted images
Jayaraman, D., Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR) · doi:10.1109/acssc.2012.6489321 · Cited by 322
Kim, J., Zeng, H., Ghadiyaram, D., Lee, S., Zhang, L., & Bovik, A. C. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2736018 · Cited by 283
Reduced- and No-Reference Image Quality Assessment
Wang, Z., & Bovik, A. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942471 · Cited by 280
Self-citationSimultaneous estimation of image quality and distortion via multi-task convolutional neural networks
Kang, L., Ye, P., Li, Y., & Doermann, D. (2015) · 2015 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2015.7351311 · Cited by 172
Wang, Z., & Simoncelli, E. P. (2008) · Journal of Vision · doi:10.1167/8.12.8 · Cited by 138 · cited 1×
“gMAD extends the idea of MAximum Differentiation (MAD) competition [50] that one counter-example is sufficient to disprove a model by allowing a group of models for competition and by finding the optimal stimuli in a large database [25].”
BackgroundSelf-citationTenenbaum, J. B., & Freeman, W. T. (1996) · Cited by 125
Group MAD Competition? A New Methodology to Compare Objective Image Quality Models
Ma, K., Wu, Q., Wang, Z., Duanmu, Z., Yong, H., Li, H., & Zhang, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.184 · Cited by 121
Self-citationDisplay device-adapted video quality-of-experience assessment
Rehman, A., Zeng, K., & Wang, Z. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2077917 · Cited by 115
Self-citationBlind Image Quality Assessment Using Semi-supervised Rectifier Networks
Tang, H., Joshi, N., & Kapoor, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.368 · Cited by 108
No-Reference Image Quality Assessment in Spatial Domain
Sun, T., Zhu, X., Pan, J., Wen, J., & Meng, F. (2014) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-12286-1_39 · Cited by 81
Quality-of-Experience of Adaptive Video Streaming
Duanmu, Z., Ma, K., & Wang, Z. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123418 · Cited by 33
Self-citation
Cited by
MUSIQ: Multi-scale Image Quality Transformer
Ke, J., Wang, Q., Wang, Y., Milanfar, P., & Yang, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00510 · Cited by 966
Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Su, S., Yan, Q., Zhu, Y., Zhang, C., Ge, X., Sun, J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00372 · Cited by 848
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Yang, S., Wu, T., Shi, S., Lao, S., Gong, Y., Cao, M., Wang, J., & Yang, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00126 · Cited by 527
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency
Golestaneh, S. A., Dadsetan, S., & Kitani, K. M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00404 · Cited by 465
MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment
Zhu, H., Li, L., Wu, J., Dong, W., & Shi, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01415 · Cited by 443
Metadata
- Authors
- Zhang, W., Ma, K., Yan, J., Deng, D., & Wang, Z.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2020-01
- Volume
- 30
- Issue
- 1
- Pages
- 36-47
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2905544033
- Cited by
- 949
- References
- 53
- FWCI
- 13.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.