The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Abstract
With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 9×
“The MS-SSIM is an extension of the single-scale approach used in SSIM and provides more flexibility by incorporating the variations of the image resolution and viewing conditions.”
MethodInfluentialImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 3×
“(not to be confused with NTIA VQM [58]) was defined in terms of a weighted mean distortion and a maximum distortion as follows:”
BackgroundMethodStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147
Video quality assessment based on structural distortion measurement
Wang, Z., Lu, L., & Bovik, A. C. (2004) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(03)00076-6 · Cited by 1,024
STRUCTURE AND FUNCTION OF VISUAL AREA MT
Born, R. T., & Bradley, D. C. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131052 · Cited by 1,023 · cited 1×
“science studies indicate that the visual area MT is critical for the perception of video quality [87].”
BackgroundNoise characteristics and prior expectations in human visual speed perception
Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 797
Cited by
A Survey on Quality of Experience of HTTP Adaptive Streaming
Seufert, M., Egger, S., Slanina, M., Zinner, T., Hoßfeld, T., & Tran-Gia, P. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2360940 · Cited by 844
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506
Seven Challenges in Image Quality Assessment: Past, Present, and Future Research
Chandler, D. M. (2013) · ISRN Signal Processing · doi:10.1155/2013/905685 · Cited by 427
Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
Soundararajan, R., & Bovik, A. C. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2214933 · Cited by 368
Developing a predictive model of quality of experience for internet video
Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., & Zhang, H. (2013) · Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM · doi:10.1145/2486001.2486025 · Cited by 349
From QoS to QoE: A Tutorial on Video Quality Assessment
Chen, Y., Wu, K., & Zhang, Q. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2363139 · Cited by 330
Study of Subjective and Objective Quality Assessment of Audio-Visual Signals
Min, X., Zhai, G., Zhou, J., Farias, M. C. Q., & Bovik, A. C. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2988148 · Cited by 328
Saliency-Aware Video Compression
Hadizadeh, H., & Bajic, I. V. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2282897 · Cited by 326
No-Reference Quality Assessment of Natural Stereopairs
Chen, M.-J., Cormack, L. K., & Bovik, A. C. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2267393 · Cited by 268
Measurement of Quality of Experience of Video-on-Demand Services: A Survey
Juluri, P., Tamarapalli, V., & Medhi, D. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2401424 · Cited by 229
Perceptual video quality assessment: a survey
Min, X., Duan, H., Sun, W., Zhu, Y., & Zhai, G. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4133-3 · Cited by 218
ViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices
Vu, P. V., & Chandler, D. M. (2014) · Journal of Electronic Imaging · doi:10.1117/1.jei.23.1.013016 · Cited by 185
QoE in Video Transmission: A User Experience-Driven Strategy
Zhao, T., Liu, Q., & Chen, C. W. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2619982 · Cited by 171
QoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS
Hoßfeld, T., Heegaard, P. E., Varela, M., & Möller, S. (2016) · Quality and User Experience · doi:10.1007/s41233-016-0002-1 · Cited by 135
Spatiotemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment
Bampis, C. G., Li, Z., & Bovik, A. C. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2868262 · Cited by 128
A Survey of Emerging Concepts and Challenges for QoE Management of Multimedia Services
Skorin-Kapov, L., Varela, M., Hoßfeld, T., & Chen, K.-T. (2018) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3176648 · Cited by 116
Prospects of Structural Similarity Index for Medical Image Analysis
Mudeng, V., Kim, M., & Choe, S.-W. (2022) · Applied Sciences · doi:10.3390/app12083754 · Cited by 101
Impact of packet loss and delay variation on the quality of real-time video streaming
Frnda, J., Voznak, M., & Sevcik, L. (2016) · Telecommunication Systems · doi:10.1007/s11235-015-0037-2 · Cited by 64
QoE in video streaming over wireless networks: perspectives and research challenges
Su, G.-M., Su, X., Bai, Y., Wang, M., Vasilakos, A. V., & Wang, H. (2016) · Wireless Networks · doi:10.1007/s11276-015-1028-7 · Cited by 55
Survey on QoE Assessment Approach for Network Service
Yang, M., Wang, S., Calheiros, R. N., & Yang, F. (2018) · IEEE Access · doi:10.1109/access.2018.2867253 · Cited by 54
Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications
García, B., López-Fernández, L., Gortázar, F., & Gallego, M. (2019) · Electronics · doi:10.3390/electronics8080854 · Cited by 44
Quality assessment in the era of large models: A survey
Zhang, Z., Zhou, Y., Li, C., Zhao, B., Liu, X., & Zhai, G. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3722559 · Cited by 23
Imtiaz, M. B., & Kamran, R. (2025) · Sensors · doi:10.3390/s25113503 · Cited by 4
Metadata
- Authors
- Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J.
- Venue
- IEEE Transactions on Broadcasting
- Published
- 2011-06
- Volume
- 57
- Issue
- 2
- Pages
- 165-182
- ISSN
- 0018-9316 (ISSN-L)
- 1557-9611
- OpenAlex
- W2132549992
- Cited by
- 613
- References
- 60
- FWCI
- 60.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.