The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Abstract
With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 9×
“The MS-SSIM is an extension of the single-scale approach used in SSIM and provides more flexibility by incorporating the variations of the image resolution and viewing conditions.”
MethodInfluentialImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 3×
“(not to be confused with NTIA VQM [58]) was defined in terms of a weighted mean distortion and a maximum distortion as follows:”
BackgroundMethodStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147
Video quality assessment based on structural distortion measurement
Wang, Z., Lu, L., & Bovik, A. C. (2004) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(03)00076-6 · Cited by 1,024
STRUCTURE AND FUNCTION OF VISUAL AREA MT
Born, R. T., & Bradley, D. C. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131052 · Cited by 1,023 · cited 1×
“science studies indicate that the visual area MT is critical for the perception of video quality [87].”
BackgroundNoise characteristics and prior expectations in human visual speed perception
Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 797
Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Seshadrinathan, K., & Bovik, A. C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2034992 · Cited by 708 · cited 11×
“The model described two indices, namely a Spatial MOVIE index that primarily captures spatial distortions and a Temporal MOVIE index that captures temporal distortions.”
BackgroundMethodInfluentialDigital Video Quality: Vision Models and Metrics
WINKLER, S. S. (2005) · Cited by 388
Perceptual quality measure using a spatiotemporal model of the human visual system:
Van den Branden Lambrecht, C. J., & Verscheure, O. (1996) · SPIE Proceedings · doi:10.1117/12.235440 · Cited by 341
Digital Video Quality: Vision Models and Metrics
Winkler, S. (2005) · Wiley eBooks · doi:10.1002/9780470024065 · Cited by 331
Digital Video Image Quality and Perceptual Coding
(2017) · CRC Press eBooks · doi:10.1201/9781420027822 · Cited by 317
Digital video quality metric based on human vision
Watson, A. B., Hu, Q. J., & McGowan, J. F. (2001) · Journal of Electronic Imaging · doi:10.1117/1.1329896 · Cited by 317
Wien, M., Schwarz, H., & Oelbaum, T. (2007) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2007.905530 · Cited by 307
Kendall's advanced theory of statistics. Vol.2A: Classical inference and the linear model
Stuart, A., Ord, J. K., & Arnold, S. F. (1999) · Cited by 248
Issues in vision modeling for perceptual video quality assessment
Winkler, S. (1999) · Signal Processing · doi:10.1016/s0165-1684(99)00062-6 · Cited by 223
Standardization activities in the ITU for a QoE assessment of IPTV
Takahashi, A., Hands, D., & Barriac, V. (2008) · IEEE Communications Magazine · doi:10.1109/mcom.2008.4473087 · Cited by 219
Video quality assessment using a statistical model of human visual speed perception
Wang, Z., & Li, Q. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b61 · Cited by 210
Assessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments
Staelens, N., Moens, S., Van den Broeck, W., Marien, I., Vermeulen, B., Lambert, P., Van de Walle, R., & Demeester, P. (2010) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2010.2067710 · Cited by 166
Digital color image processing within the framework of a human visual model
Faugeras, O. D. (1979) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1979.1163262 · Cited by 157
No-reference image and video quality estimation: Applications and human-motivated design
Hemami, S. S., & Reibman, A. R. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.05.009 · Cited by 145
Picture Quality Prediction Based on a Visual Model
Lukas, F., & Budrikis, Z. L. (1982) · IEEE Transactions on Communications · doi:10.1109/tcom.1982.1095616 · Cited by 140
Parametric Packet-Layer Model for Monitoring Video Quality of IPTV Services
Yamagishi, K., & Hayashi, T. (2008) · International Conference on Communications · doi:10.1109/icc.2008.29 · Cited by 138
The QoE Evaluation Method through the QoS-QoE Correlation Model
Kim, H. J., Lee, D. H., Lee, J. M., Lee, K. H., Lyu, W., & Choi, S. G. (2008) · Networked Computing and Advanced Information Management · doi:10.1109/ncm.2008.202 · Cited by 128
PVQM – A perceptual video quality measure
Hekstra, A. P., Beerends, J. G., Ledermann, D., et al. (2002) · Signal Processing Image Communication · doi:10.1016/s0923-5965(02)00056-5 · Cited by 102
Perceptual-based Quality Metrics for Image and Video Services: A Survey
Engelke, U., & Zepernick, H. (2007) · Next Generation Internet Networks (NGI) · doi:10.1109/ngi.2007.371215 · Cited by 94
Brunnstrom, K. E., Hands, D. S., Speranza, F., et al. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.932162 · Cited by 76
Traffic characteristics of H.264/AVC variable bit rate video
der Auwera, G. V., David, P. T., & Martin Reisslein, B. (2008) · IEEE Communications Magazine · doi:10.1109/mcom.2008.4689260 · Cited by 67
Implications of Smoothing on Statistical Multiplexing of H.264/AVC and SVC Video Streams
der Auwera, G. V., & Martin Reisslein, B. (2009) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2009.2027399 · Cited by 65
Objective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality
Ciubotaru, B., Muntean, G., & Ghinea, G. (2009) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2009.2020448 · Cited by 64
Objective methods for assessment of video quality : state of the art
Olsson, S., Stroppiana, M., & Baïna, J. (1997) · IEEE Transactions on Broadcasting · doi:10.1109/11.664028 · Cited by 61
Multidimensional image quality measure using singular value decomposition
Shnayderman, A., Gusev, A., & Eskicioğlu, A. M. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.530554 · Cited by 60
Introduction to the Issue on Visual Media Quality Assessment
Karam, L. J., Ebrahimi, T., Hemami, S. S., Pappas, T. N., Safranek, R. J., Wang, Z., & Watson, A. B. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015485 · Cited by 46
Self-citationA MATLAB-based framework for image and video quality evaluation
Murthy, A. V., & Karam, L. J. (2010) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5516091 · Cited by 43
Self-citationRule-Based No-Reference Video Quality Evaluation Using Additionally Coded Videos
Oelbaum, T., Keimel, C., & Diepold, K. J. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015473 · Cited by 36
Lu, L., Wang, Z., Bovik, A. C., & Kouloheris, J. L. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2002.1035718 · Cited by 35
No-reference video quality evaluation for high-definition video
Keimel, C., Oelbaum, T., & Diepold, K. J. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4959791 · Cited by 33
Application of the NTIA General Video Quality Metric (VQM) to HDTV Quality Monitoring
Wolf, S. (2007) · Cited by 32
A new perceptual quality metric for compressed video
Bhat, A., Richardson, I. E. G., & Kannangara, S. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4959738 · Cited by 31
Objective measurements of video quality using the wavelet transform
Lee, C., & Kwon, O. (2003) · Optical Engineering · doi:10.1117/1.1523420 · Cited by 29
NR objective continuous video quality assessment model based on frame quality measure
Kawayoke, Y., & Horita, Y. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711772 · Cited by 29
Evaluation of the H.264 Scalable Video Coding in Error Prone IP Networks
Monteiro, R., Calafate, C. T., & Nunes, M. S. (2008) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2008.2001717 · Cited by 28
Video Quality Assessment Using Objective Parameters Based on Image Segmentation
Pessoa, A. C. F., Falcão, A. X., Nishihara, R. M., et al. (1999) · SMPTE Journal · doi:10.5594/j04308 · Cited by 18
Okamoto, J., Hayashi, T., Takahashi, A., et al. (2006) · Electronics and Communications in Japan (Part I Communications) · doi:10.1002/ecja.20265 · Cited by 16
Video quality assesment using M-SVD
Tao, P., & Eskicioğlu, A. M. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.696142 · Cited by 15
Colour perceptual video quality metric
Ong, E. P., Lin, W., Lu, Z., & Yao, S. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530606 · Cited by 15
Efficient Full-Reference Assessment of Image and Video Quality
Ndjiki-Nya, P., Barrado, M., & Wiegand, T. (2007) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2007.4379108 · Cited by 14
New Full-Reference Visual Quality Assessment Based on Human Visual Perception
Lee, S.-O., & Sim, D. (2008) · International Conference on Consumer Electronics · doi:10.1109/icce.2008.4587874 · Cited by 13
Improving the verification process of video quality metrics
Keimel, C., Oelbaum, T., & Diepold, K. J. (2009) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246966 · Cited by 13
Towards a Video QoE Definition in Converged Networks
Venkataraman, M., Sengupta, S., Chatterjee, M., et al. (2007) · doi:10.1109/icdt.2007.74 · Cited by 13
Video quality metric for low bitrate compressed videos
Ong, E. P., Yang, X., Lin, W., Lu, Z., & Yao, S. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2004.1421878 · Cited by 11
Towards a Video QoE Definition in Converged Networks
Venkataraman, M., Sengupta, S., Chatterjee, M., et al. (2007) · International Conference on Digital Telecommunications (ICDT) · doi:10.1109/icdt.2007.36 · Cited by 11
Virtanen, T., Radun, J. E., Paul Lindroos, D., Suomi, S., Säämänen, T., Vuori, T., Vaahteranoksa, M., & Nyman, G. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.765831 · Cited by 10
Natural motion statistics for no-reference video quality assessment
Saad, M. A., & Bovik, A. C. (2009) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246957 · Cited by 10
Multiple reference impairment scale subjective assessment method for digital video
Wu, H. R., Yu, Z., & Qiu, B. (2003) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2002.1027870 · Cited by 9
Analysis and Modelling of No-Reference Video Quality Assessment
Tian, Y., & Zhu, M. Q. (2009) · International Conference on Computer and Automation Engineering · doi:10.1109/iccae.2009.51 · Cited by 7
Impact of router queuing disciplines on multimedia QoE in IPTV deployments
Calyam, P. P., Chandrasekaran, P., Trueb, G., et al. (2009) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246969 · Cited by 6
Cited by
A Survey on Quality of Experience of HTTP Adaptive Streaming
Seufert, M., Egger, S., Slanina, M., Zinner, T., Hoßfeld, T., & Tran-Gia, P. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2360940 · Cited by 844
Perceptual image quality assessment: a survey
Zhai, G., & Min, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2757-1 · Cited by 655
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506
Seven Challenges in Image Quality Assessment: Past, Present, and Future Research
Chandler, D. M. (2013) · ISRN Signal Processing · doi:10.1155/2013/905685 · Cited by 427
Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
Soundararajan, R., & Bovik, A. C. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2214933 · Cited by 368
Metadata
- Authors
- Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J.
- Venue
- IEEE Transactions on Broadcasting
- Published
- 2011-06
- Volume
- 57
- Issue
- 2
- Pages
- 165-182
- ISSN
- 0018-9316 (ISSN-L)
- 1557-9611
- OpenAlex
- W2132549992
- Cited by
- 613
- References
- 60
- FWCI
- 60.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.