The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Open accessAbstract
We present a deep neural network-based approach to image quality assessment (IQA). The network is trained end-to-end and comprises ten convolutional layers and five pooling layers for feature extraction, and two fully connected layers for regression, which makes it significantly deeper than related IQA models. Unique features of the proposed architecture are that: 1) with slight adaptations it can be used in a no-reference (NR) as well as in a full-reference (FR) IQA setting and 2) it allows for joint learning of local quality and local weights, i.e., relative importance of local quality to the global quality estimate, in an unified framework. Our approach is purely data-driven and does not rely on hand-crafted features or other types of prior domain knowledge about the human visual system or image statistics. We evaluate the proposed approach on the LIVE, CISQ, and TID2013 databases as well as the LIVE In the wild image quality challenge database and show superior performance to state-of-the-art NR and FR IQA methods. Finally, cross-database evaluation shows a high ability to generalize between different databases, indicating a high robustness of the learned features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 1×
“NIQE [21] extracts features based on a multivariate Gaussian model and relates them to perceived quality in an unsupervised manner.”
BackgroundMultiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 2×
“The obtained mean opinion score (MOS) values lie in the range [0, 9], where larger MOS indicate better visual”
BackgroundNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 2×
“Method CSIQ full DIIVINE [13] 0.146 BLIINDS-II [14] 0.456 BRISQUE [15] 0.639 CORNIA [16] 0.656 Patchwise (proposed) 0.717 Weighted (proposed) 0.733 LIVE database is evaluated on subsets of CSIQ and TID2013.”
MethodInfluentialFSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Self-citation
Cited by
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944481 · Cited by 1,725
Self-citationMUSIQ: Multi-scale Image Quality Transformer
Ke, J., Wang, Q., Wang, Y., Milanfar, P., & Yang, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00510 · Cited by 966
Image Quality Assessment: Unifying Structure and Texture Similarity
Ding, K., Ma, K., Wang, S., & Simoncelli, E. P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045810 · Cited by 952
Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
Zhang, W., Ma, K., Yan, J., Deng, D., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2886771 · Cited by 949
Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Su, S., Yan, Q., Zhu, Y., Zhang, C., Ge, X., Sun, J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00372 · Cited by 848
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency
Golestaneh, S. A., Dadsetan, S., & Kitani, K. M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00404 · Cited by 465
MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment
Zhu, H., Li, L., Wu, J., Dong, W., & Shi, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01415 · Cited by 443
A Review on State-of-the-Art Power Line Inspection Techniques
Yang, L., Fan, J., Liu, Y., Li, E., Peng, J., & Liang, Z. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3031194 · Cited by 433
RankSRGAN: Generative Adversarial Networks With Ranker for Image Super-Resolution
Zhang, W., Liu, Y., Dong, C., & Qiao, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00319 · Cited by 405
PieAPP: Perceptual Image-Error Assessment Through Pairwise Preference
Prashnani, E., Cai, H., Mostofi, Y., & Sen, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00194 · Cited by 339
Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
Zhang, W., Ma, K., Zhai, G., & Yang, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3061932 · Cited by 327
Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective
Zhang, W., Zhai, G., Wei, Y., Yang, X., & Ma, K. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01352 · Cited by 325
Image Quality Assessment Using Contrastive Learning
Madhusudana, P. C., Birkbeck, N., Wang, Y., Adsumilli, B., & Bovik, A. C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3181496 · Cited by 285
State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression
Xu, M., Li, C., Zhang, S., & Callet, P. L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2966864 · Cited by 281
TOPIQ: A Top-Down Approach From Semantics to Distortions for Image Quality Assessment
Chen, C., Mo, J., Hou, J., Wu, H., Liao, L., Sun, W., Yan, Q., & Lin, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3378466 · Cited by 276
Underwater Image Enhancement Quality Evaluation: Benchmark Dataset and Objective Metric
Jiang, Q., Gu, Y., Li, C., Cong, R., & Shao, F. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3164918 · Cited by 266
DeepISP: Toward Learning an End-to-End Image Processing Pipeline
Schwartz, E., Giryes, R., & Bronstein, A. M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2872858 · Cited by 265
PCQM: A Full-Reference Quality Metric for Colored 3D Point Clouds
Meynet, G., Nehme, Y., Digne, J., & Lavoue, G. (2020) · 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex48832.2020.9123147 · Cited by 261
Artificial Intelligence in Pharmaceutical and Healthcare Research
Bhattamisra, S. K., Banerjee, P., Gupta, P., Mayuren, J., Patra, S., & Candasamy, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010010 · Cited by 257
Hu, J., Liao, X., Wang, W., & Qin, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3074259 · Cited by 195
Blind omnidirectional image quality assessment with viewport oriented graph convolutional networks
Xu, J., Zhou, W., & Chen, Z. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3015186 · Cited by 166
ICface: Interpretable and Controllable Face Reenactment Using GANs
Tripathy, S., Kannala, J., & Rahtu, E. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093474 · Cited by 88
“by using two pre-trained networks, CNNIQA [16] and DeepIQA [5], proposed for NonReference (NR) and Full-Reference (FR) Image Quality Assessment (IQA).”
MethodWang, J., Duan, H., Liu, J., Chen, S., Min, X., & Zhai, G. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-981-99-9119-8_5 · Cited by 80
Barman, N., Jammeh, E., Ghorashi, S. A., & Martini, M. G. (2019) · IEEE Access · doi:10.1109/access.2019.2920477 · Cited by 71
Assessing Image Quality Issues for Real-World Problems
Chiu, T.-Y., Zhao, Y., & Gurari, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00370 · Cited by 63
Image Quality Assessment: From Mean Opinion Score to Opinion Score Distribution
Gao, Y., Min, X., Zhu, Y., Li, J., Zhang, X.-P., & Zhai, G. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3547872 · Cited by 58
(2022) · doi:10.3390/electronics11040559 · Cited by 19
Print Defect Mapping with Semantic Segmentation
Valente, A. C., Wada, C., Neves, D., Neves, D., Perez, F. V. M., Megeto, G. A. S., Cascone, M. H., Gomes, O., & Lin, Q. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093470 · Cited by 21
“Inspired by works in image quality assessment [2, 7], we also implement two different paradigms for print defect mapping: No-Reference (NR) and Full-Reference (FR).”
MethodResultA Combined Full-Reference Image Quality Assessment Method Based on Convolutional Activation Maps
Varga, D. (2020) · Algorithms · doi:10.3390/a13120313 · Cited by 11
No-reference image quality assessment based on global awareness
Hu, Z., Yang, G., Du, Z., Huang, X., Zhang, P., & Liu, D. (2024) · PLOS ONE · doi:10.1371/journal.pone.0310206 · Cited by 5
Metadata
- Authors
- Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., & Samek, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2018-01
- Volume
- 27
- Issue
- 1
- Pages
- 206-219
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2563786098
- Cited by
- 1,138
- References
- 40
- FWCI
- 28.98
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.