The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Deep Learning of Human Visual Sensitivity in Image Quality Assessment Framework
Abstract
Since human observers are the ultimate receivers of digital images, image quality metrics should be designed from a human-oriented perspective. Conventionally, a number of full-reference image quality assessment (FR-IQA) methods adopted various computational models of the human visual system (HVS) from psychological vision science research. In this paper, we propose a novel convolutional neural networks (CNN) based FR-IQA model, named Deep Image Quality Assessment (DeepQA), where the behavior of the HVS is learned from the underlying data distribution of IQA databases. Different from previous studies, our model seeks the optimal visual weight based on understanding of database information itself without any prior knowledge of the HVS. Through the experiments, we show that the predicted visual sensitivity maps agree with the human subjective opinions. In addition, DeepQA achieves the state-of-the-art prediction accuracy among FR-IQA models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2010) · International Conference on Machine Learning · Cited by 13,995
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“DeepQA was compared to eight FR-IQA metrics: PSNR, SSIM [32], MS-SSIM [33], VIF [28], GMSD [34], FSIMc [35], DOG-SSIMc [17], and FR-DCNN [14].”
MethodNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
Xue, W., Zhang, L., Mou, X., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2293423 · Cited by 1,697
Incorporating Nesterov Momentum into Adam
Dozat, T. (2016) · Cited by 1,595
Convolutional Neural Networks for No-Reference Image Quality Assessment
Kang, L., Ye, P., Li, Y., & Doermann, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.224 · Cited by 1,270
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
Contrast masking in human vision
Legge, G. E., & Foley, J. M. (1980) · Journal of the Optical Society of America · doi:10.1364/josa.70.001458 · Cited by 1,182
The steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
TID2008 – A database for evaluation of full-reference visual quality assessment metrics
Ponomarenko, N. N., Лукин, В. В., & Zelensky, A. A. (2004) · Iris (Roma Tre University) · Cited by 989
The visible differences predictor: an algorithm for the assessment of image fidelity
Daly, S. J. (1993) · The MIT Press eBooks · Cited by 828
Visible differences predictor: an algorithm for the assessment of image fidelity
Daly, S. J. (1992) · SPIE Proceedings · doi:10.1117/12.135952 · Cited by 718
A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile
Chou, C.-H., & Li, Y.-C. (1995) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.475889 · Cited by 651
Visualizing Deep Convolutional Neural Networks Using Natural Pre-images
Mahendran, A., & Vedaldi, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0911-8 · Cited by 496
Fully Deep Blind Image Quality Predictor
Kim, J., & Lee, S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2639328 · Cited by 459
Self-citationBlind Image Quality Assessment via Deep Learning
Hou, W., Gao, X., Tao, D., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2336852 · Cited by 368
Learning a blind measure of perceptual image quality
Tang, H., Joshi, N., & Kapoor, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995446 · Cited by 251
A deep neural network for image quality assessment
Bosse, S., Maniry, D., Wiegand, T., & Samek, W. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533065 · Cited by 223
Image Quality Assessment Using Multi-Method Fusion
Liu, T.-J., Lin, W., & Kuo, C.-C. J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2236343 · Cited by 195
SVD-Based Quality Metric for Image and Video Using Machine Learning
Narwaria, M., & Lin, W. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2163391 · Cited by 151
Image Quality Assessment Using Human Visual DOG Model Fused With Random Forest
Pei, S., & Chen, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2440172 · Cited by 130
Image Quality Assessment Using Similar Scene as Reference
Liang, Y., Wang, J., Wan, X., Gong, Y., & Zheng, N. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_1 · Cited by 58
Lv, Y., Jiang, G., Yu, M., Xu, H., Shao, F., & Liu, S. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351221 · Cited by 46
A Fast Feature Similarity Index for Image Quality Assessment
Xu, S., Liu, X., & Jiang, S. (2015) · International Journal of Signal Processing Image Processing and Pattern Recognition · doi:10.14257/ijsip.2015.8.11.17 · Cited by 11
Cited by
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Deep Learning for Image Super-Resolution: A Survey
Wang, Z., Chen, J., & Hoi, S. C. H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2982166 · Cited by 1,969
State of the Art in Defect Detection Based on Machine Vision
Ren, Z., Fang, F., Yan, N., & Wu, Y. (2022) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-021-00343-6 · Cited by 799
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Learning in the Frequency Domain
Xu, K., Qin, M., Sun, F., Wang, Y., Chen, Y.-K., & Ren, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00181 · Cited by 563
Metadata
- Authors
- Kim, J., & Lee, S.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 1969-1977
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2737134362
- Cited by
- 265
- References
- 35
- FWCI
- 7.04
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.