The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment
Open accessAbstract
Recently, increasing interest has been drawn in exploiting deep convolutional neural networks (DCNNs) for no-reference image quality assessment (NR-IQA). Despite of the notable success achieved, there is a broad consensus that training DCNNs heavily relies on massive annotated data. Unfortunately, IQA is a typical small sample problem. Therefore, most of the existing DCNN-based IQA metrics operate based on pre-trained networks. However, these pre-trained networks are not designed for IQA task, leading to generalization problem when evaluating different types of distortions. With this motivation, this paper presents a no-reference IQA metric based on deep meta-learning. The underlying idea is to learn the meta-knowledge shared by human when evaluating the quality of images with various distortions, which can then be adapted to unknown distortions easily. Specifically, we first collect a number of NR-IQA tasks for different distortions. Then meta-learning is adopted to learn the prior knowledge shared by diversified distortions. Finally, the quality prior model is fine-tuned on a target NR-IQA task for quickly obtaining the quality model. Extensive experiments demonstrate that the proposed metric outperforms the state-of-the-arts by a large margin. Furthermore, the meta-model learned from synthetic distortions can also be easily generalized to authentic distortions, which is highly desired in real-world applications of IQA metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2017) · Cited by 11,625
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
No-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 8×
“Generally, conventional hand-crafted feature-based general-purpose NR-IQA methods can be divided into natural scene statistics (NSS) based metrics [8, 32, 33, 39] and learning-based metrics [53, 54, 36].”
BackgroundMethodInfluentialPrototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Live image quality assessment database release 2
Sheikh, H. R. (2005) · Medical Entomology and Zoology · Cited by 1,275
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241 · cited 8×
“For most of the distortion types (19 out of 24 on TID2013 and 19 out of 25 on KADID-10K), our method can achieve the best evaluation performance.”
BackgroundMethodInfluentialA Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., & Samek, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2760518 · Cited by 1,138
Talebi, H., & Milanfar, P. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2831899 · Cited by 1,023
Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
Zhang, W., Ma, K., Yan, J., Deng, D., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2886771 · Cited by 949
Unsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
Ghadiyaram, D., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2500021 · Cited by 782
Munkhdalai, T., & Yu, H. Q. (2017) · International Conference on Machine Learning · Cited by 771
KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment
Hosu, V., Lin, H., Sziranyi, T., & Saupe, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2967829 · Cited by 759
Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features
Xue, W., Mou, X., Zhang, L., Bovik, A. C., & Feng, X. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2355716 · Cited by 641 · cited 3×
“NR-IQA can be classified into distortion-specific methods [25, 24, 29, 47] and general-purpose methods [39, 32, 56, 51, 50, 12, 54, 49, 10].”
BackgroundMethodEnd-to-End Blind Image Quality Assessment Using Deep Neural Networks
Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., & Zuo, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2774045 · Cited by 619
Using Free Energy Principle For Blind Image Quality Assessment
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2373812 · Cited by 611
KADID-10k: A Large-scale Artificially Distorted IQA Database
Lin, H., Hosu, V., & Saupe, D. (2019) · 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2019.8743252 · Cited by 523 · cited 3×
“To validate the generalization performance of our meta-model for unknown distortions, we compare our method with six state-of-the-art general-purpose NR-IQA methods by using the Leave-One-Distortion-Out cross validation on TID2013 [38] and KADID-10K [27] databases.”
MethodBlind Image Quality Assessment Based on High Order Statistics Aggregation
Xu, J., Ye, P., Li, Q., Du, H., Liu, Y., & Doermann, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2585880 · Cited by 495
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Bosse, S., Maniry, D., Müller, K., Wiegand, T., & Samek, W. (2018) · MPG.PuRe (Max Planck Society) · Cited by 469
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
Learning without Human Scores for Blind Image Quality Assessment
Xue, W., Zhang, L., & Mou, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.133 · Cited by 404
Deep CNN-Based Blind Image Quality Predictor
Kim, J., Nguyen, A.-D., & Lee, S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2829819 · Cited by 331
Perceptual quality prediction on authentically distorted images using a bag of features approach
Ghadiyaram, D., & Bovik, A. C. (2017) · Journal of Vision · doi:10.1167/17.1.32 · Cited by 322
Objective quality assessment of multiply distorted images
Jayaraman, D., Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR) · doi:10.1109/acssc.2012.6489321 · Cited by 322
Kim, J., Zeng, H., Ghadiyaram, D., Lee, S., Zhang, L., & Bovik, A. C. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2736018 · Cited by 283 · cited 1×
“Hence, objective image quality assessment (IQA) [20] is needed to imitate human beings to automatically assess image quality, which has extensive applications in image restoration [6], image retrieval [13] and image quality monitoring systems [23], etc.”
BackgroundOn the use of deep learning for blind image quality assessment
Bianco, S., Celona, L., Napoletano, P., & Schettini, R. (2018) · Signal, Image and Video Processing · doi:10.1007/s11760-017-1166-8 · Cited by 277
No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments
Li, L., Lin, W., Wang, X., Yang, G., Bahrami, K., & Kot, A. C. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2392129 · Cited by 270
Self-citationNo-Reference Image Quality Assessment Using Visual Codebooks
Ye, P., & Doermann, D. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190086 · Cited by 270
Deep Learning of Human Visual Sensitivity in Image Quality Assessment Framework
Kim, J., & Lee, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.213 · Cited by 265
Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learning
Lin, K.-Y., & Wang, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00083 · Cited by 265
CVD2014—A Database for Evaluating No-Reference Video Quality Assessment Algorithms
Nuutinen, M., Virtanen, T., Vaahteranoksa, M., Vuori, T., Oittinen, P., & Hakkinen, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2562513 · Cited by 227
CID2013: A Database for Evaluating No-Reference Image Quality Assessment Algorithms
Virtanen, T., Nuutinen, M., Vaahteranoksa, M., Oittinen, P., & Hakkinen, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2378061 · Cited by 176
Vanschoren, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03548 · Cited by 169
A No-Reference Metric for Perceived Ringing Artifacts in Images
Liu, H., Klomp, N., & Heynderickx, I. E. J. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2035848 · Cited by 159
Gao, X., Gao, F., Tao, D., & Li, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271356 · Cited by 157
Few-shot Learning: A SurveyPreprint
Wang, Y., & Yao, Q. (2019) · arXiv (Cornell University) · Cited by 143
Naturalness-Aware Deep No-Reference Image Quality Assessment
Yan, B., Bare, B., & Tan, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2904879 · Cited by 131
SOM: Semantic obviousness metric for image quality assessment
Zhang, P., Zhou, W., Wu, L., & Li, H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298853 · Cited by 130
Referenceless Measure of Blocking Artifacts by Tchebichef Kernel Analysis
Li, L., Zhu, H., Yang, G., & Qian, J. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2294333 · Cited by 98
Self-citationA Probabilistic Quality Representation Approach to Deep Blind Image Quality PredictionPreprint
Zeng, H., Zhang, L., & Bovik, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08190 · Cited by 97
Golestaneh, S. A., & Karam, L. J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2601821 · Cited by 87
Blind Quality Metric of DIBR-Synthesized Images in the Discrete Wavelet Transform Domain
Wang, G., Wang, Z., Gu, K., Li, L., Xia, Z., & Wu, L. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2945675 · Cited by 83
Self-citationBlind Image Quality Assessment by Learning from Multiple Annotators
Ma, K., Liu, X., Fang, Y., & Simoncelli, E. P. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803390 · Cited by 71
Learning To Blindly Assess Image Quality In The Laboratory And Wild
Zhang, W., Ma, K., Zhai, G., & Yang, X. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9191278 · Cited by 69
Robust Quantization for General Similarity Search
Guo, Y., Ding, G., & Han, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2766445 · Cited by 65
KonIQ-10k: Towards an ecologically valid and large-scale IQA databasePreprint
Lin, H., Hosu, V., & Saupe, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08489 · Cited by 58
DECODE: Deep Confidence Network for Robust Image Classification
Ding, G., Guo, Y., Chen, K., Chu, C., Han, J., & Dai, Q. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2902115 · Cited by 56
Real-Time Scalable Visual Tracking via Quadrangle Kernelized Correlation Filters
Ding, G., Chen, W., Zhao, S., Han, J., & Liu, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2774778 · Cited by 54 · cited 1×
“Recent years have witnessed the great success of Deep Convolutional Neural Networks (DCNNs) [14] in many computer vision tasks [4, 5], which has also spawned a number of DCNNs-based NR-IQA approaches [16, 2, 28, 30, 52, 58, 57].”
BackgroundDendi, S. V. R., Dev, C., Kothari, N., & Channappayya, S. S. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2879518 · Cited by 47
Learning to Blindly Assess Image Quality in the Laboratory and WildPreprint
Zhang, W., Ma, K., Zhai, G., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00516 · Cited by 9
Cited by
MUSIQ: Multi-scale Image Quality Transformer
Ke, J., Wang, Q., Wang, Y., Milanfar, P., & Yang, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00510 · Cited by 966
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Yang, S., Wu, T., Shi, S., Lao, S., Gong, Y., Cao, M., Wang, J., & Yang, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00126 · Cited by 527
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency
Golestaneh, S. A., Dadsetan, S., & Kitani, K. M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00404 · Cited by 465
Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective
Zhang, W., Zhai, G., Wei, Y., Yang, X., & Ma, K. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01352 · Cited by 325
Image Quality Assessment Using Contrastive Learning
Madhusudana, P. C., Birkbeck, N., Wang, Y., Adsumilli, B., & Bovik, A. C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3181496 · Cited by 285
Metadata
- Authors
- Zhu, H., Li, L., Wu, J., Dong, W., & Shi, G.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 14131-14140
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034882073
- Cited by
- 443
- References
- 60
- FWCI
- 16.63
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.