No-reference image and video quality assessment: a classification and review of recent approaches
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
The field of perceptual quality assessment has gone through a wide range of developments and it is still growing. In particular, the area of no-reference (NR) image and video quality assessment has progressed rapidly during the last decade. In this article, we present a classification and review of latest published research work in the area of NR image and video quality assessment. The NR methods of visual quality assessment considered for review are structured into categories and subcategories based on the types of methodologies used for the underlying processing employed for quality estimation. Overall, the classification has been done into three categories, namely, pixel-based methods, bitstream-based methods, and hybrid methods of the aforementioned two categories. We believe that the review presented in this article will be helpful for practitioners as well as for researchers to keep abreast of the recent developments in the area of NR image and video quality assessment. This article can be used for various purposes such as gaining a structured overview of the field and to carry out performance comparisons for the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
No-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 1×
“In contrast to most of the approaches mentioned before that involve transformation of an image into another domain such as DCT, the NSS-based quality estimator presented in [108] performs in the spatial domain.”
ResultMean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh, H. R., Bovik, A. C., & Cormack, L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854492 · Cited by 575 · cited 2×
“The method proposed in [91] first determines the type of distortion by using an ANN classifier and then, depending on these results, either uses a ringing [92] or blur [43] method for the quality assessment.”
BackgroundMethodA DCT Statistics-Based Blind Image Quality Index
Saad, M. A., Bovik, A. C., & Charrier, C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2045550 · Cited by 372 · cited 1×
“Saad et al. have presented their DCT statistics-based image integrity index in [106].”
BackgroundBlind image quality assessment through anisotropy
Gabarda, S., & Cristóbal, G. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b42 · Cited by 301 · cited 1×
“The proposed method has not been tested for its correlation with subjective assessment but it has a competitive performance in comparison with a contemporary method [85] of blind image quality evaluation.”
MethodA no-reference perceptual image sharpness metric based on a cumulative probability of blur detection
Narvekar, N. D., & Karam, L. J. (2009) · 2009 International Workshop on Quality of Multimedia Experience · doi:10.1109/qomex.2009.5246972 · Cited by 208 · cited 1×
“A similar method found in [21,32] improves [29] by addition of the concept of commutative probability of blur detection (CPBD) so that the method should estimate the quality by including the impact of HVS sensitivity towards blur perception at different contrast levels.”
MethodFast and reliable structure-oriented video noise estimation
Amer, A., & Dubois, E. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2004.837017 · Cited by 178
No-reference image quality assessment based on DCT domain statistics
Brandão, T., & Queluz, M. P. (2008) · Signal Processing · doi:10.1016/j.sigpro.2007.09.017 · Cited by 147
Video Quality Pooling Adaptive to Perceptual Distortion Severity
Park, J., Seshadrinathan, K., Lee, S., & Bovik, A. C. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2219551 · Cited by 119 · cited 1×
“Temporal pooling quality methods such as Minkowski summation or other methods such as adaptive to perceptual distortion [136] can be used for this purpose.”
MethodNo-reference perceptual image quality metric using gradient profiles for JPEG2000
Liang, L., Wang, S., Chen, J., Ma, S., Zhao, D., & Gao, W. (2010) · Signal Processing: Image Communication · doi:10.1016/j.image.2010.01.007 · Cited by 74
Content-Based Video Quality Prediction for MPEG4 Video Streaming over Wireless Networks
Khan, A., Sun, L., & Ifeachor, E. (2009) · Journal of Multimedia · doi:10.4304/jmm.4.4.228-239 · Cited by 59 · cited 1×
“Khan et al. have proposed a content-based method to combine encoding and transmission level parameters to predict video quality in [123].”
Method
Cited by
Perceptual video quality assessment: a survey
Min, X., Duan, H., Sun, W., Zhu, Y., & Zhai, G. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4133-3 · Cited by 218
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
He, Y., Gan, B., Chen, S., Zhou, Y., Yin, G., Song, L., Sheng, L., Shao, J., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00434 · Cited by 161
“We follow common practices in visual quality assessment [39] with distortions of compression, transmission, capture, color, etc.”
Challenges of future multimedia QoE monitoring for internet service providers
Robitza, W., Ahmad, A., Kara, P. A., Atzori, L., Martini, M. G., Raake, A., & Sun, L. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4870-z · Cited by 57
“They therefore require less data, which typically comes at the cost of lower accuracy [38].”
BackgroundBBAND INDEX: A NO-REFERENCE BANDING ARTIFACT PREDICTOR
Tu, Z., Lin, J., Wang, Y., Adsumilli, B., & Bovik, A. C. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053634 · Cited by 46
Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming
Søgaard, J., Krasula, L., Shahid, M., Temel, D., Brunnström, K., & Razaak, M. (2016) · Electronic Imaging · doi:10.2352/issn.2470-1173.2016.13.iqsp-206 · Cited by 43
Self-citation
Metadata
- Authors
- Shahid, M., Rossholm, A., Lövström, B., & Zepernick, H.-J.
- Venue
- EURASIP Journal on Image and Video Processing
- Published
- 2014-08-14
- Volume
- 2014
- Issue
- 1
- ISSN
- 1687-5176 (ISSN-L)
- 1687-5281
- OpenAlex
- W2140952319
- Cited by
- 177
- References
- 14
- FWCI
- 16.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.