The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Unified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images
Abstract
Digital images in the real world are created by a variety of means and have diverse properties. A photographical natural scene image (NSI) may exhibit substantially different characteristics from a computer graphic image (CGI) or a screen content image (SCI). This casts major challenges to objective image quality assessment, for which existing approaches lack effective mechanisms to capture such content type variations, and thus are difficult to generalize from one type to another. To tackle this problem, we first construct a cross-content-type (CCT) database, which contains 1,320 distorted NSIs, CGIs, and SCIs, compressed using the high efficiency video coding (HEVC) intra coding method and the screen content compression (SCC) extension of HEVC. We then carry out a subjective experiment on the database in a well-controlled laboratory environment. Moreover, we propose a unified content-type adaptive (UCA) blind image quality assessment model that is applicable across content types. A key step in UCA is to incorporate the variations of human perceptual characteristics in viewing different content types through a multi-scale weighting framework. This leads to superior performance on the constructed CCT database. UCA is training-free, implying strong generalizability. To verify this, we test UCA on other databases containing JPEG, MPEG-2, H.264, and HEVC compressed images/videos, and observe that it consistently achieves competitive performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“1) Corner Feature: We adopt Shi and Tomasi’s minimum eigenvalue method [30] to detect corners.”
MethodMaking a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“Many existing work [31]–[33] has shown that multi-scale”
BackgroundSelf-citationNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
Self-citationA Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Rayner, K. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902816461 · Cited by 2,682
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Handbook of Parametric and Nonparametric Statistical Procedures: Third Edition
Sheskin, D. J. (2003) · doi:10.1201/9781420036268 · Cited by 1,551
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Image database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
Study of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922
Self-citationNo-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
Self-citationUnsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
Using Free Energy Principle For Blind Image Quality Assessment
Gu, K., Zhai, G., Yang, X., & Zhang, W. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2373812 · Cited by 611
Self-citationA No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD)
Narvekar, N. D., & Karam, L. J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2131660 · Cited by 587
Blind Image Quality Assessment Based on High Order Statistics Aggregation
Xu, J., Ye, P., Li, Q., Du, H., Liu, Y., & Doermann, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2585880 · Cited by 495
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471 · cited 1×
“We incorporate two NR VQA models, namely V-BLIINDS [61] and VIIDEO [62] into comparison.”
MethodLearning a No-Reference Quality Assessment Model of Enhanced Images With Big Data
Gu, K., Tao, D., Qiao, J.-F., & Lin, W. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2649101 · Cited by 443
Self-citationBlind measurement of blocking artifacts in images
Wang, Z., Bovik, A. C., & Evan, B. L. (2002) · Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101) · doi:10.1109/icip.2000.899622 · Cited by 413
Self-citation${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images
Vu, C. T., Phan, T. D., & Chandler, D. M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2169974 · Cited by 387
A Completely Blind Video Integrity Oracle
Mittal, A., Saad, M. A., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502725 · Cited by 357
dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs
Ma, K., Liu, W., Liu, T., Wang, Z., & Tao, D. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2708503 · Cited by 353
Self-citationSaliency-Guided Quality Assessment of Screen Content Images
Gu, K., Wang, S., Yang, H., Lin, W., Zhai, G., Yang, X., & Zhang, W. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2547343 · Cited by 303
Self-citationImage Sharpness Assessment Based on Local Phase Coherence
Hassen, R., Wang, Z., & Salama, M. M. A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2251643 · Cited by 290
Self-citationA Psychovisual Quality Metric in Free-Energy Principle
Zhai, G., Wu, X., Yang, X., Lin, W., & Zhang, W. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2161092 · Cited by 276
Self-citationA Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation
Vu, P. V., & Chandler, D. M. (2012) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2199980 · Cited by 271
No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments
Li, L., Lin, W., Wang, X., Yang, G., Bahrami, K., & Kot, A. C. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2392129 · Cited by 270
Self-citationNo-Reference Quality Assessment of Screen Content Pictures
Gu, K., Zhou, J., Qiao, J.-F., Zhai, G., Lin, W., & Bovik, A. C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2711279 · Cited by 242
Self-citationPerceptual Quality Assessment of Screen Content Images
Yang, H., Fang, Y., & Lin, W. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2465145 · Cited by 238
Self-citationA Fast Reliable Image Quality Predictor by Fusing Micro- and Macro-Structures
Gu, K., Li, L., Lu, H., Min, X., & Lin, W. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2652339 · Cited by 237
Self-citationViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices
Vu, P. V., & Chandler, D. M. (2014) · Journal of Electronic Imaging · doi:10.1117/1.jei.23.1.013016 · Cited by 185 · cited 5×
“We test UCA on MPEG-2, H.264, and HEVC compressed videos using the relevant subsets of 4 public video quality assessment (VQA) databases—VQEGHD3 [57], CSIQ [58], IVP [59], and LIVE [60].”
MethodInfluentialESIM: Edge Similarity for Screen Content Image Quality Assessment
Ni, Z., Ma, L., Zeng, H., Chen, J., Cai, C., & Ma, K.-K. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2718185 · Cited by 184
Self-citationQuality Prediction of Asymmetrically Distorted Stereoscopic 3D Images
Wang, J., Rehman, A., Zeng, K., Wang, S., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446942 · Cited by 165
Self-citationA highly efficient method for blind image quality assessment
Wu, Q., Wang, Z., & Li, H. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7350816 · Cited by 152
Self-citationDisplay device-adapted video quality-of-experience assessment
Rehman, A., Zeng, K., & Wang, Z. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2077917 · Cited by 115
Self-citationDCT-domain blind measurement of blocking artifacts in DCT-coded images
Bovik, A. C., & Liu, S. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.941272 · Cited by 106
Objective Quality Assessment of Screen Content Images by Uncertainty Weighting
Fang, Y., Yan, J., Liu, J., Wang, S., Li, Q., & Guo, Z. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2669840 · Cited by 99
Referenceless Measure of Blocking Artifacts by Tchebichef Kernel Analysis
Li, L., Zhu, H., Yang, G., & Qian, J. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2294333 · Cited by 98
Gradient Direction for Screen Content Image Quality Assessment
Ni, Z., Ma, L., Zeng, H., Cai, C., & Ma, K. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2599294 · Cited by 91
Self-citationSubjective and Objective Quality Assessment of Compressed Screen Content Images
Wang, S., Gu, K., Zhang, X., Lin, W., Zhang, L., Ma, S., & Gao, W. (2016) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2016.2598756 · Cited by 79
Self-citationScreen Content Coding Based on HEVC Framework
Zhu, W., Ding, W., Xu, J., Shi, Y., & Yin, B. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2315782 · Cited by 67
Image blockiness evaluation based on Sobel operator
Perra, C., Massidda, F., & Giusto, D. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1529769 · Cited by 60
Learning Structural Regularity for Evaluating Blocking Artifacts in JPEG Images
Li, L., Lin, W., & Zhu, H. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2320743 · Cited by 45
Self-citationBlind quality assessment of compressed images via pseudo structural similarity
Min, X., Zhai, G., Gu, K., Fang, Y., Yang, X., Wu, X., Zhou, J., & Liu, X. (2016) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7552955 · Cited by 40
Self-citationPerceptual screen content image quality assessment and compression
Wang, S., Gu, K., Zeng, K., Wang, Z., & Lin, W. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351037 · Cited by 21
Self-citationUltra-eye: UHD and HD images eye tracking dataset
Nemoto, H., Hanhart, P., Korshunov, P., et al. (2014) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2014.6982284 · Cited by 20
Cited by
PSNR vs SSIM: imperceptibility quality assessment for image steganography
Setiadi, D. R. I. M. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10035-z · Cited by 739
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Self-citationBlind Image Quality Estimation via Distortion Aggravation
Min, X., Zhai, G., Gu, K., Liu, Y., & Yang, X. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2816783 · Cited by 508
Self-citationBlind Quality Assessment Based on Pseudo-Reference Image
Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., & Chen, C. W. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2788206 · Cited by 450
Self-citationA Multimodal Saliency Model for Videos With High Audio-Visual Correspondence
Min, X., Zhai, G., Zhou, J., Zhang, X.-P., Yang, X., & Guan, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2966082 · Cited by 295
Self-citation
Metadata
- Authors
- Min, X., Ma, K., Gu, K., Zhai, G., Wang, Z., & Lin, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-11
- Volume
- 26
- Issue
- 11
- Pages
- 5462-5474
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2743390484
- Cited by
- 337
- References
- 53
- FWCI
- 9.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.