Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.
Abstract
We present a family of reduced reference video quality assessment (QA) models that utilize spatial and temporal entropic differences. We adopt a hybrid approach of combining statistical models and perceptual principles to design QA algorithms. A Gaussian scale mixture model for the wavelet coefficients of frames and frame differences is used to measure the amount of spatial and temporal information differences between the reference and distorted videos, respectively. The spatial and temporal information differences are combined to obtain the spatio-temporal-reduced reference entropic differences. The algorithms are flexible in terms of the amount of side information required from the reference that can range between a single scalar per frame and the entire reference information. The spatio-temporal entropic differences are shown to correlate quite well with human judgments of quality, as demonstrated by experiments on the LIVE video quality assessment database.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“Any image QA algorithm can be trivially extended to videos by applying the algorithm on every frame of the video and by calculating the average score.”
MethodSelf-citationImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Self-citationSecrets of optical flow estimation and their principles
Sun, D., Roth, S., & Black, M. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539939 · Cited by 1,389
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 1×
“Other FR VQA algorithms account for temporal distortions from temporal filter responses [11], temporal decorrelation [12], evaluating quality over temporal trajectories [13] and studying the temporal evolution of spatial distortions [14].”
BackgroundStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160 · cited 2×
“Depending on the desired application and problem constraints, this framework of algorithms also allows users to pick any algorithm from the class of algorithms presented which meets the performance requirements and data rates required for quality computation.”
BackgroundSelf-citationVSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147 · cited 1×
“Any image QA algorithm can be trivially extended to videos by applying the algorithm on every frame of the video and by calculating the average score.”
MethodThe steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
A model of neuronal responses in visual area MT
Simoncelli, E. P., & Heeger, D. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00183-1 · Cited by 941
Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Seshadrinathan, K., & Bovik, A. C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2034992 · Cited by 708 · cited 3×
“However, the successful application of either HVS-based approaches or statistical approaches to capture temporal distortions has been limited.”
BackgroundSelf-citationObjective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613
Scale Mixtures of Gaussians and the Statistics of Natural Images
Wainwright, M. J., & Simoncelli, E. P. (1999) · Cited by 450
Perceived rate of movement depends on contrast
Thompson, P. (1982) · Vision Research · doi:10.1016/0042-6989(82)90153-5 · Cited by 433
Contrast sensitivity at high velocities
Burr, D. C., & Ross, J. (1982) · Vision Research · doi:10.1016/0042-6989(82)90196-1 · Cited by 344
RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment
Soundararajan, R., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2166082 · Cited by 337
Self-citationDigital Video Quality: Vision Models and Metrics
Winkler, S. (2005) · Wiley eBooks · doi:10.1002/9780470024065 · Cited by 331
Digital video quality metric based on human vision
Watson, A. B., Hu, Q. J., & McGowan, J. F. (2001) · Journal of Electronic Imaging · doi:10.1117/1.1329896 · Cited by 317
Video quality assessment using a statistical model of human visual speed perception
Wang, Z., & Li, Q. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b61 · Cited by 210
On the Spatial Statistics of Optical Flow
Roth, S., & Black, M. J. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0016-x · Cited by 168
Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment
Ninassi, A., Le Meur, O., Le Callet, P., & Barba, D. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2014806 · Cited by 159
Visual cortical receptive fields in monkey and cat: Spatial and temporal phase transfer function
Hamilton, D. B., Albrecht, D. G., & Geisler, W. S. (1989) · Vision Research · doi:10.1016/0042-6989(89)90186-7 · Cited by 124
Speed can go up as well as down at low contrast: Implications for models of motion perception
Thompson, P., Brooks, K. R., & Hammett, S. T. (2005) · Vision Research · doi:10.1016/j.visres.2005.08.005 · Cited by 121
PVQM – A perceptual video quality measure
Hekstra, A. P., Beerends, J. G., Ledermann, D., Caluwe, F. E. D., Kohler, S., Koenen, R., Rihs, S., Ehrsam, M., & Schlauss, D. (2002) · Signal Processing Image Communication · doi:10.1016/s0923-5965(02)00056-5 · Cited by 115
A scalable wavelet-based video distortion metric and applications
Masry, M., Hemami, S. S., & Sermadevi, Y. (2006) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2005.861946 · Cited by 94 · cited 1×
“The algorithm is based on computing losses in the spatial gradients of the luminance components and features based on the product of luminance contrast and motion, and on measuring color impairments.”
MethodTemporal Trajectory Aware Video Quality Measure
Barkowsky, M., Bialkowski, J., Eskofier, B., Bitto, R., & Kaup, A. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015375 · Cited by 75
Gunawan, I. P., & Ghanbari, M. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2007.913755 · Cited by 65
A Reduced Reference Video Quality Assessment method based on the human motion perception
Rohani, M., Avanaki, A. N., Nader‐Esfahani, S., & Bashirpour, M. (2010) · International Symposium on Telecommunications · doi:10.1109/istel.2010.5734137 · Cited by 11
Research works printed but not linked: 1
- 2003, JNDmetrix Technology
Cited by
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471
“We have also found that a simple and regular local natural video statistic (NVS) model nicely describes filtered or transformed time-differential (or frame differenced) videos in the wavelet and DCT domains [25], [37].”
BackgroundSelf-citationA Completely Blind Video Integrity Oracle
Mittal, A., Saad, M. A., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502725 · Cited by 357
Self-citationStudy of Subjective and Objective Quality Assessment of Audio-Visual Signals
Min, X., Zhai, G., Zhou, J., Farias, M. C. Q., & Bovik, A. C. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2988148 · Cited by 328
“Some of the most successful VQA models rely on natural scene statistics models to characterize quality, including VIF [10], STRRED [13], VMAF [14], SpEED [39], etc. Similar signal statistics have been observed to be fundamental to audio signals with similar implications for audio perception [52], [53].”
MethodInfluentialSelf-citationUGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
Tu, Z., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3072221 · Cited by 363
“RR-VQA models only make use of a limited amount of reference information [24], [25].”
MethodSelf-citationFastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimation
Tassano, M., Delon, J., & Veit, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00143 · Cited by 276
“ity assessment metric [42].”
Metadata
- Authors
- Soundararajan, R., & Bovik, A. C.
- Affiliations
- The University of Texas at Austin (US)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2013-04
- Volume
- 23
- Issue
- 4
- Pages
- 684-694
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2044338482
- Semantic Scholar
- 3b3621dfd7f2a4237f1226d38ff9e25ecbb6e24a
- Cited by
- 368
- References
- 27
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 42 · 2023: 36 · 2022: 26 · 2021: 48 · 2020: 37 · 2019: 22 · 2018: 37 · 2017: 28 · 2016: 14 · 2015: 17 · 2014: 21 · 2013: 9
- FWCI
- 15.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- video quality assessment, reduced-reference quality assessment, Gaussian scale mixture model, wavelet coefficients, frame difference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.