The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
Open accessAbstract
We present a deep neural network-based approach to image quality assessment (IQA). The network is trained end-to-end and comprises ten convolutional layers and five pooling layers for feature extraction, and two fully connected layers for regression, which makes it significantly deeper than related IQA models. Unique features of the proposed architecture are that: 1) with slight adaptations it can be used in a no-reference (NR) as well as in a full-reference (FR) IQA setting and 2) it allows for joint learning of local quality and local weights, i.e., relative importance of local quality to the global quality estimate, in an unified framework. Our approach is purely data-driven and does not rely on hand-crafted features or other types of prior domain knowledge about the human visual system or image statistics. We evaluate the proposed approach on the LIVE, CISQ, and TID2013 databases as well as the LIVE In the wild image quality challenge database and show superior performance to state-of-the-art NR and FR IQA methods. Finally, cross-database evaluation shows a high ability to generalize between different databases, indicating a high robustness of the learned features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 2×
“The obtained mean opinion score (MOS) values lie in the range [0, 9], where larger MOS indicate better visual”
BackgroundNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 2×
“Method CSIQ full DIIVINE [13] 0.146 BLIINDS-II [14] 0.456 BRISQUE [15] 0.639 CORNIA [16] 0.656 Patchwise (proposed) 0.717 Weighted (proposed) 0.733 LIVE database is evaluated on subsets of CSIQ and TID2013.”
MethodInfluentialFSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Self-citationLearning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Self-citationSignature Verification Using A "Siamese" Time Delay Neural Network
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000339 · Cited by 2,077
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
Xue, W., Zhang, L., Mou, X., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293423 · Cited by 1,697
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264
VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment
Zhang, L., Shen, Y., & Li, H. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2346028 · Cited by 1,029
Prechelt, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_5 · Cited by 951
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922
Why is image quality assessment so difficult?
Wang, Z., Bovik, & Lu, L. (2002) · IIEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.1004620 · Cited by 786
Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
Ghadiyaram, D., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2500021 · Cited by 782
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment
Soundararajan, R., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2166082 · Cited by 337
SR-SIM: A fast and high performance IQA index based on spectral residual
Zhang, L., & Li, H. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467149 · Cited by 256
A deep neural network for image quality assessment
Bosse, S., Maniry, D., Wiegand, T., & Samek, W. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533065 · Cited by 223
Self-citationAutomatic Prediction of Perceptual Image and Video Quality
Bovik, A. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2257632 · Cited by 214
DeepSim: Deep similarity for image quality assessment
Gao, F., Wang, Y., Li, P., Tan, M., Yu, J., & Zhu, Y. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.054 · Cited by 172
Psychophysiology-Based QoE Assessment: A Survey
Engelke, U., Darcy, D. P., Mulliken, G. H., Bosse, S., Martini, M. G., Arndt, S., Voigt‐Antons, J., Chan, K. Y., Ramzan, N., & Brunnstrom, K. E. (2016) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2609843 · Cited by 152
Self-citationImage Quality Assessment Using Human Visual DOG Model Fused With Random Forest
Pei, S., & Chen, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2440172 · Cited by 137
SOM: Semantic obviousness metric for image quality assessment
Zhang, P., Zhou, W., Wu, L., & Li, H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298853 · Cited by 130
Zhang, W., Borji, A., Wang, Z., Callet, P. L., & Liu, H. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2461603 · Cited by 128
Training Quality-Aware Filters for No-Reference Image Quality Assessment
Zhang, L., Gu, Z., Liu, X., Li, H., & Lu, J. (2014) · IEEE Multimedia · doi:10.1109/mmul.2014.50 · Cited by 55
Bosse, S., Acqualagna, L., Samek, W., Porbadnigk, A. K., Curio, G., Blankertz, B., Müller, K., & Wiegand, T. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2694807 · Cited by 41
Self-citationCombining full-reference image visual quality metrics by neural network
Лукин, В. В., Ponomarenko, N. N., Єремеєв, О., Egiazarian, K., & Astola, J. T. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2085465 · Cited by 34
Brain-Computer Interfacing for multimedia quality assessment
Bosse, S., Müller, K., Wiegand, T., & Samek, W. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844669 · Cited by 34
Self-citationNeural network-based full-reference image quality assessment
Bosse, S., Maniry, D., Müller, K., et al. (2016) · Picture Coding Symposium · doi:10.1109/pcs.2016.7906376 · Cited by 34
Self-citation
Cited by
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944481 · Cited by 1,725
Self-citationMUSIQ: Multi-scale Image Quality Transformer
Ke, J., Wang, Q., Wang, Y., Milanfar, P., & Yang, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00510 · Cited by 966
Image Quality Assessment: Unifying Structure and Texture Similarity
Ding, K., Ma, K., Wang, S., & Simoncelli, E. P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045810 · Cited by 952
Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
Zhang, W., Ma, K., Yan, J., Deng, D., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2886771 · Cited by 949
Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Su, S., Yan, Q., Zhu, Y., Zhang, C., Ge, X., Sun, J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00372 · Cited by 848
Metadata
- Authors
- Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., & Samek, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2018-01
- Volume
- 27
- Issue
- 1
- Pages
- 206-219
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2563786098
- Cited by
- 1,138
- References
- 40
- FWCI
- 28.98
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.