Deep Neural Network for Blind Visual Quality Assessment of 4K Content
Open accessThe DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
The 4K content can deliver a more immersive visual experience to consumers due to the huge improvement in spatial resolution. However, the high spatial resolution brings a great challenge for video transmission and storage. Therefore, it is necessary to compress or downscale the 4K content before transmitting it to end-users. Existing blind image quality assessment (BIQA) methods are not suitable for 4K contents due to the high spatial resolution and specific distortions caused by upscaling methods. In this paper, we propose a deep learning-based BIQA model for 4K content, aiming to recognize true and pseudo 4K content and meanwhile evaluate their visual quality. Considering the characteristic that high spatial resolution can represent more abundant high-frequency information, we first propose a Grey-level Co-occurrence Matrix (GLCM) based texture complexity measure to select three representative image patches from a 4K image, which can reduce the computational complexity and is proven to be very effective for the overall quality prediction. Then, we extract various visual features from the intermediate layers of the convolutional neural network (CNN) and integrate them into the quality-aware feature representation. Finally, two multilayer perception (MLP) networks are utilized to map the quality-aware features into the class probability and the quality score of each patch respectively. The overall quality index is obtained through averaging the results of all patches. The proposed model is trained via the multi-task learning manner and the uncertainty principle is introduced to balance the losses of the classification and regression tasks. The experimental results show that the proposed model outperforms all compared BIQA metrics on four 4K content quality assessment databases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“More recent approaches, including transformer-based and deep-learning-based models, have improved perceptual alignment but often introduce higher computational complexity and reduced interpretability [59-62].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [60]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
Cited by
Bilateral Reference for High-Resolution Dichotomous Image Segmentation
Zheng, P., Gao, D., Fan, D.-P., Liu, L., Laaksonen, J. T., Ouyang, W., & Sebe, N. (2024) · CAAI Artificial Intelligence Research · doi:10.26599/air.2024.9150038 · Cited by 235
Subjective and Objective Audio-Visual Quality Assessment for User Generated Content
Cao, Y., Min, X., Sun, W., & Zhai, G. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3290528 · Cited by 49
Self-citationA review of QoE research progress in metaverse
Zheng, G., & Yuan, L. (2023) · Displays · doi:10.1016/j.displa.2023.102389 · Cited by 39
A survey on learning-based low-light image and video enhancement
Ye, J. B., Qiu, C., & Zhang, Z. (2023) · Displays · doi:10.1016/j.displa.2023.102614 · Cited by 38
Self-citationVDPVE: VQA Dataset for Perceptual Video Enhancement
Gao, Y., Cao, Y., Kou, T., Sun, W., Dong, Y., Liu, X., Min, X., & Zhai, G. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00152 · Cited by 36
Self-citationSubjective and Objective Quality Assessment for in-the-Wild Computer Graphics Images
Zhang, Z., Sun, W., Zhou, Y., Jia, J., Zhang, Z., Liu, J., Min, X., & Zhai, G. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3631357 · Cited by 42
Self-citationNo-reference quality assessment for low-light image enhancement: Subjective and objective methods
Lin, W., Wu, Y., Xu, L., Chen, W., Zhao, T., & Wei, H. (2023) · Displays · doi:10.1016/j.displa.2023.102432 · Cited by 32
StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability
Kou, T., Liu, X., Sun, W., Jia, J., Min, X., Zhai, G., & Liu, N. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611860 · Cited by 37
Self-citationQuality assessment in the era of large models: A survey
Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3722559 · Cited by 23
Self-citationNTIRE 2023 Quality Assessment of Video Enhancement Challenge
Liu, X., Min, X., Sun, W., Zhang, Y., Zhang, K., Timofte, R., Zhai, G., Gao, Y., Cao, Y., Kou, T., et al. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00158 · Cited by 26
Self-citationA Reduced-Reference Quality Assessment Metric for Textured Mesh Digital Humans
Zhang, Z., Zhou, Y., Li, C., Fu, K., Sun, W., Liu, X., Min, X., & Zhai, G. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447636 · Cited by 23
Self-citationAfnan, A., Ullah, F., Yaseen, Y., Lee, J., Jamil, S., & Kwon, O.-J. (2023) · Italian National Conference on Sensors · doi:10.3390/s23031297 · Cited by 19
CLIPVQA: Video Quality Assessment via CLIP
Xing, F., Li, M., Wang, Y., Zhu, G., & Cao, X. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3511927 · Cited by 30
High-resolution image compression algorithms in remote sensing imaging
Ma, X. (2023) · Displays · doi:10.1016/j.displa.2023.102462 · Cited by 15
Tian, S., Zeng, T., Zou, W., Li, X., & Zhang, L. (2023) · Displays · doi:10.1016/j.displa.2023.102495 · Cited by 14
Assessing UHD Image Quality from Aesthetics, Distortions, and Saliency
Sun, W., Zhang, W., Cao, Y., Cao, L., Jia, J., Chen, Z., Zhang, Z., Min, X., & Zhai, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91856-8_7 · Cited by 27
Self-citationBH-VQA: Blind High Frame Rate Video Quality Assessment
Lu, W. H., Sun, W., Zhang, Z., Tu, D., Min, X., & Zhai, G. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00426 · Cited by 12
Self-citationHierarchical prior-guided quality assessment method for underwater images
Chen, C., Li, Z., Zhong, Z., Wang, X., & Shao, F. (2024) · Displays · doi:10.1016/j.displa.2024.102729 · Cited by 13
Towards versatile multimedia quality assessment for visual communications
Zhang, Z., Jia, Z., Li, C., Zhou, Y., Liu, X., Min, X., & Zhai, G. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4631-2 · Cited by 18
Self-citationOmnidirectional Image Quality Assessment With Mutual Distillation
Ma, P., Liu, L., Xiao, C., & Xu, D. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3503435 · Cited by 9
Human Perception-Oriented Enhancement and Smoothing for Perceptual Video Coding
Kang, B., & Kim, W. (2023) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2023.3291139 · Cited by 9
Perceptual ultra-high definition video coding based on adaptive just noticeable distortion model
Cui, X., Peng, Z., Chen, F., Jiang, G., & Yu, M. (2022) · Displays · doi:10.1016/j.displa.2022.102301 · Cited by 9
An Empirical Study for Efficient Video Quality Assessment
Sun, W., Fu, K., Cao, L., Zhu, D., Zhang, K., Zhu, Y., Zhang, Z., Hu, M., Min, X., & Zhai, G. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00129 · Cited by 15
Self-citationDistillation-Based Utility Assessment for Compacted Underwater Information
Liao, H., Jiang, N., Chen, W., Wei, H., & Zhao, T. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3358108 · Cited by 8
A convolutional neural network-based rate control algorithm for VVC intra coding
Wang, J., Shang, X., Zhao, X., & Zhang, Y. (2024) · Displays · doi:10.1016/j.displa.2024.102652 · Cited by 7
Shen, S., Yue, H., Li, K., & Yang, J. (2024) · Displays · doi:10.1016/j.displa.2024.102865 · Cited by 10
Multi-Layer Cross-Modal Prompt Fusion for No-Reference Image Quality Assessment
Lü, Y., Zhou, Z., Yang, Z., Han, S., Jiang, X., & Xu, M. (2025) · Displays · doi:10.1016/j.displa.2025.103045 · Cited by 8
Visual saliency assistance mechanism based on visually impaired navigation systems
Lu, F., Lian, Y., Jin, B., & Gu, W. (2023) · Displays · doi:10.1016/j.displa.2023.102482 · Cited by 6
No-Reference Multi-Level Video Quality Assessment Metric for 3D-Synthesized Videos
Wang, G., Huang, B., Gu, K., Liu, Y., Liu, H., Shi, Q., Zhai, G., & Zhang, W. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3396696 · Cited by 6
Self-citationZhang, H., Song, L., Gan, W., & Xie, R. (2023) · Displays · doi:10.1016/j.displa.2023.102492 · Cited by 9
Blind light field image quality measurement via four-stream convolutional neural network
Ma, J., Wang, J., An, P., Liu, D., & Xu, G. (2024) · Displays · doi:10.1016/j.displa.2024.102901 · Cited by 7
SFP-Net: Scatter-feature-perception network for underwater image enhancement
Wang, Z., Guo, J., Zhang, J., Zhang, G., Yu, T., Zhao, S., & Zhu, D. (2025) · Displays · doi:10.1016/j.displa.2025.103132 · Cited by 6
Luminance decomposition and Transformer based no-reference tone-mapped image quality assessment
Chen, Z., He, Z., Luo, T., Jin, C., & Song, Y. (2024) · Displays · doi:10.1016/j.displa.2024.102881 · Cited by 5
Revisiting the robustness of spatio-temporal modeling in video quality assessment
Yan, J., Wu, L., Jiang, W., Liu, C., & Shen, F. (2023) · Displays · doi:10.1016/j.displa.2023.102585 · Cited by 5
A Database and Model for the Visual Quality Assessment of Super-Resolution Videos
Zhou, F., Wei, S., Lu, Z., & Qiu, G. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3382949 · Cited by 10
Retouched Face Image Quality Assessment Based on Differential Perception and Textual Prompt
Zhou, T., Tan, S., Li, G., Tian, S., Tang, C., Wang, Z., & Yue, G. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3447454 · Cited by 6
Li, Z., Li, X., Shi, J., & Shao, F. (2024) · Displays · doi:10.1016/j.displa.2024.102877 · Cited by 8
Texture dominated no-reference quality assessment for high resolution image by multi-scale mechanism
Huang, Z., Liu, H., Jia, Z., Zhang, S., Zhang, Y., & Liu, S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130003 · Cited by 7
Magnification-arbitrary depth super-resolution with multiscale consistency deformable alignment
Xu, D., Xiaopeng Fan, B., Zhao, D., & Gao, W. (2023) · Displays · doi:10.1016/j.displa.2023.102500 · Cited by 4
A feature compression method based on similarity matching
Jiang, W., Shen, H., Xu, Z., Yang, C., & Yang, J. (2024) · Displays · doi:10.1016/j.displa.2024.102728 · Cited by 5
LPCNet: End-to-end lane detection with PnP compression and condition DETR
Lu, F., Sun, G., Yu, H., Huang, Y., Zhou, T., & Yao, S. (2024) · Displays · doi:10.1016/j.displa.2024.102902 · Cited by 7
Causal perception inspired representation learning for trustworthy image quality assessment
Wang, L., Wu, Q., Yuan, D., Meng, F., Wang, Z., & Ngan, K. N. (2025) · Displays · doi:10.1016/j.displa.2025.103046 · Cited by 4
ADS-VQA: Adaptive sampling model for video quality assessment
Cheng, S., Li, X., Zeng, Z., & Yan, J. (2024) · Displays · doi:10.1016/j.displa.2024.102792 · Cited by 3
Dual-graph hierarchical interaction network for referring image segmentation
Shi, Z., Wu, Q., Li, H., Meng, F., & Ngan, K. N. (2023) · Displays · doi:10.1016/j.displa.2023.102575 · Cited by 4
Liu, M., Yang, B., Zan, P., Chen, L., Wang, B., & Xia, X. (2024) · Displays · doi:10.1016/j.displa.2024.102879 · Cited by 4
You, J., Jiang, G., Jiang, H., Xug, H., Jiang, Z., Zhu, Z., & Yu, M. (2023) · Displays · doi:10.1016/j.displa.2023.102515 · Cited by 3
JND-based multi-module cooperative perceptual optimization for HEVC
Wang, H., Chen, Y., Ye, Q., Li, Z., Pan, A., Yin, H., Wang, L., Yin, J., Jin, H., Yu, L., et al. (2024) · Displays · doi:10.1016/j.displa.2024.102783 · Cited by 2
Self-citationTan, X., Zhang, J., Quan, Y., Li, J., Wu, Y., & Bian, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680907 · Cited by 3
Lv, M., Shang, X., Wang, J., Li, G., & Wang, G. (2024) · Displays · doi:10.1016/j.displa.2024.102866 · Cited by 2
Plaid fabric image retrieval based on hand-crafted features and relevant feedback
Zhang, X., Zhao, P., Pan, R., & Gao, W. (2024) · Displays · doi:10.1016/j.displa.2024.102899 · Cited by 1
Comparing Blind Image Quality Metrics for Reliable Image Assessment
Fieraru, C. G., Biserică, M., Plajer, I. C., & Ivanovici, M. (2025) · IEEE Access · doi:10.1109/access.2025.3583029 · Cited by 2
Li, Q., Pan, D., Ying, Z., Liang, Q., & Shi, P. A. (2024) · Displays · doi:10.1016/j.displa.2024.102883 · Cited by 1
Agaian, S. S., Grigoryan, A. M., & Ayunts, H. (2026) · Information · doi:10.3390/info17070632
Enhancing Extended Reality Assisted Surgery through a Field-of-View Video Delivery Optimization
Alekseeva, D., Mezina, A., Bürget, R., Arponen, O., Lohan, E. S., & Ometov, A. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111093
Yu, R., & Hu, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131834 · Cited by 1
Collaborative Offloading for Interacting Users in Cloud–Edge–Terminal Networks
Yan, X., Chen, N., Ni, Z., Xue, H., Sun, H., & Chen, H. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3625670
Liang, Z., Sheng, W., Ma, H., Zhou, F., & Qiu, G. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3679733
Lu, Y., Yang, Z., Jin, S., Jiang, X., & Xu, M. (2026) · Displays · doi:10.1016/j.displa.2026.103611
Adaptive Picture Mirroring for Video Coding Efficiency Enhancement
Lorkiewicz, M., Mieloch, D., Kit, J., Stankowski, J., Dziembowski, A., Karwowski, D., & Maćkowiak, S. (2026) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2026.3713269
Sun, W., Jiang, Y., Zhu, D., Sang, J., Xu, J., Zhang, W., & Zhai, G. (2026) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex69967.2026.11618385
Self-citationImage accuracy prediction based on no-reference metrics using GA-XGBoost
Zhou, H., Zhu, H., Bian, Y., Teng, X., Liu, Y., Liu, M., Liu, K., & Ni, J. (2026) · Signal Image and Video Processing · doi:10.1007/s11760-026-05655-1
Metadata
- Authors
- Lu, W., Sun, W., Min, X., Zhu, W., Zhou, Q., He, J., Wang, Q., Zhang, Z., Wang, T., & Zhai, G.
- Affiliations
- Shanghai Jiao Tong University (CN)
- Department of Video Cloud Technology, Bilibili Inc., Shanghai, China
- ORCID
- Venue
- IEEE Transactions on Broadcasting
- Published
- 2023-06
- Volume
- 69
- Issue
- 2
- Pages
- 406-421
- ISSN
- 0018-9316 (ISSN-L)
- 1557-9611
- OpenAlex
- W4312606564
- Cited by
- 60
- References
- 97
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 23 · 2023: 19
- FWCI
- 4.42
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Broadcasting (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSFC (62225112, 61831015, 62101325, 62271312, 61901260)
- National Key Research and Development Program of China (2021YFE0206700)
- Shanghai Municipal Science and Technology Major Project (2021SHZDZX0102)
- Shanghai Pujiang Program (22PJ1407400)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- no-reference image quality assessment, 4K video, high spatial resolution, texture complexity, gray level co-occurrence matrix, patch selection, quality-aware features, multilayer perceptron, multi-task learning, uncertainty principle, video compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.