Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.
Abstract
We present a family of reduced reference video quality assessment (QA) models that utilize spatial and temporal entropic differences. We adopt a hybrid approach of combining statistical models and perceptual principles to design QA algorithms. A Gaussian scale mixture model for the wavelet coefficients of frames and frame differences is used to measure the amount of spatial and temporal information differences between the reference and distorted videos, respectively. The spatial and temporal information differences are combined to obtain the spatio-temporal-reduced reference entropic differences. The algorithms are flexible in terms of the amount of side information required from the reference that can range between a single scalar per frame and the entire reference information. The spatio-temporal entropic differences are shown to correlate quite well with human judgments of quality, as demonstrated by experiments on the LIVE video quality assessment database.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“Any image QA algorithm can be trivially extended to videos by applying the algorithm on every frame of the video and by calculating the average score.”
MethodSelf-citationImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Self-citationSecrets of optical flow estimation and their principles
Sun, D., Roth, S., & Black, M. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539939 · Cited by 1,389
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 1×
“Other FR VQA algorithms account for temporal distortions from temporal filter responses [11], temporal decorrelation [12], evaluating quality over temporal trajectories [13] and studying the temporal evolution of spatial distortions [14].”
BackgroundStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160 · cited 2×
“Depending on the desired application and problem constraints, this framework of algorithms also allows users to pick any algorithm from the class of algorithms presented which meets the performance requirements and data rates required for quality computation.”
BackgroundSelf-citationVSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147 · cited 1×
“Any image QA algorithm can be trivially extended to videos by applying the algorithm on every frame of the video and by calculating the average score.”
MethodThe steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
A model of neuronal responses in visual area MT
Simoncelli, E. P., & Heeger, D. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00183-1 · Cited by 941 · cited 2×
“The computation of the quality index from the spatial and temporal information concerns the processing that occurs in the later stages of human visual processing, where there is evidence of interactions between the two [24].”
BackgroundMotion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Seshadrinathan, K., & Bovik, A. C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2034992 · Cited by 708 · cited 3×
“However, the successful application of either HVS-based approaches or statistical approaches to capture temporal distortions has been limited.”
BackgroundSelf-citationObjective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613
Research works printed but not linked: 1
- 2003, JNDmetrix Technology
Cited by
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471
“We have also found that a simple and regular local natural video statistic (NVS) model nicely describes filtered or transformed time-differential (or frame differenced) videos in the wavelet and DCT domains [25], [37].”
BackgroundSelf-citationA Completely Blind Video Integrity Oracle
Mittal, A., Saad, M. A., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502725 · Cited by 357
Self-citationStudy of Subjective and Objective Quality Assessment of Audio-Visual Signals
Min, X., Zhai, G., Zhou, J., Farias, M. C. Q., & Bovik, A. C. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2988148 · Cited by 328
“Some of the most successful VQA models rely on natural scene statistics models to characterize quality, including VIF [10], STRRED [13], VMAF [14], SpEED [39], etc. Similar signal statistics have been observed to be fundamental to audio signals with similar implications for audio perception [52], [53].”
MethodInfluentialSelf-citationUGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
Tu, Z., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3072221 · Cited by 363
“RR-VQA models only make use of a limited amount of reference information [24], [25].”
MethodSelf-citationFastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimation
Tassano, M., Delon, J., & Veit, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00143 · Cited by 276
“ity assessment metric [42].”
QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey
Barakabitze, A. A., Barman, N., Ahmad, A., Zadtootaghaj, S., Sun, L., Martini, M. G., & Atzori, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2958784 · Cited by 239
“Peak Signal-to-Noise Ratio (PSNR) [49] FR Images - Frames Structural Similarity Index Metric (SSIM) [44] 2004 FR Images - Frames Video Multimethod Assessment Fusion (VMAF) [45] 2016 FR Images - Frames Visual Information Fidelity (VIF) [50] 2006 FR Images - Frames HDR-VDP-2: A calibrated visual metric for visibility an…”
Automatic Prediction of Perceptual Image and Video Quality
Bovik, A. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2257632 · Cited by 214
“will also reliably follow a GSM model [24].”
BackgroundMethodInfluentialSelf-citationPerceptual video quality assessment: a survey
Min, X., Duan, H., Sun, W., Zhu, Y., & Zhai, G. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4133-3 · Cited by 218
RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content
Tu, Z., Yu, X., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2021.3090333 · Cited by 215
“To the best of our knowledge, we propose the first general, effective and efficient temporal statistics model based on bandpass regularities of natural videos along the time dimension, going beyond simpler frame-difference models [78].”
Self-citationWu, H., Zhang, E., Liao, L., Chen, C., Hou, J., Wang, A., Sun, W., Yan, Q., & Lin, W. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01843 · Cited by 215
Study of Temporal Effects on Subjective Video Quality of Experience
Bampis, C. G., Li, Z., Moorthy, A. K., Katsavounidis, I., Aaron, A., & Bovik, A. C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2729891 · Cited by 188
“puted ST-RRED [26] between the original pristine video and #2 - constant encoding bitrate under the same total bit budget constraint.”
MethodSelf-citationQoE Modeling for HTTP Adaptive Video Streaming–A Survey and Open Challenges
Barman, N., & Martini, M. G. (2019) · IEEE Access · doi:10.1109/access.2019.2901778 · Cited by 178
“, are captured usingVideo-RREDSTSQ predictor [89].”
MethodSpatiotemporal Statistics for Video Quality Assessment
Li, X., Guo, Q., & Lu, X. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2568752 · Cited by 176
FovVideoVDP: a visible difference predictor for wide field-of-view video
Mantiuk, R. K., Denes, G., Chapiro, A., Kaplanyan, A., Rufo, G., Bachy, R., Lian, T., & Patney, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459831 · Cited by 160
In-Capture Mobile Video Distortions: A Study of Subjective Behavior and Objective Algorithms
Ghadiyaram, D., Pan, J., Bovik, A. C., Moorthy, A. K., Panda, P., & Yang, K.-C. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2707479 · Cited by 154
Self-citationSpEED-QA: Spatial Efficient Entropic Differencing for Image and Video Quality
Bampis, C. G., Gupta, P., Soundararajan, R., & Bovik, A. C. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2726542 · Cited by 150
“Given the recently observed robust performance of spatiotemporal RR entropic differencing (ST-RRED) on a wide range of VQA databases [14], [18], we chose to investigate whether it is possible to design QA algorithms similar to ST-RRED, but with reduced complexity, and without sacrificing quality prediction accuracy.”
BackgroundMethodInfluentialSelf-citationA Quality-of-Experience Database for Adaptive Video Streaming
Duanmu, Z., Rehman, A., & Wang, Z. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2822870 · Cited by 155
“In this regard, we evaluate a wide variety of VQA algorithms including PSNR, SSIM [45], MS-SSIM [46], STRRED [49], VQM [48], VMAF [50], SSIMplus [47], and VIIDEO [51] against human subjective scores on two datasets to test their generalizability on streaming videos, where dataset DA includes the videos without stallin…”
MethodKaplanyan, A., Sochenov, A., Leimkühler, T., Okunev, M., Goodall, T., & Rufo, G. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356557 · Cited by 169
Spatiotemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment
Bampis, C. G., Li, Z., & Bovik, A. C. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2868262 · Cited by 128
“This local operation approximates the multi-scale multi-orientation steerable filter decomposition used in [20] and is very compute-efficient.”
BackgroundMethodInfluentialSelf-citationNo-Reference Video Quality Assessment With 3D Shearlet Transform and Convolutional Neural Networks
Li, Y., Po, L.-M., Cheung, C.-H., Xu, X., Feng, L., Yuan, F., & Cheung, K.-W. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2430711 · Cited by 122
“In [16], [28], and [29], the statistical properties of the frame-differenced natural Fig.”
BackgroundA Subjective and Objective Study of Stalling Events in Mobile Streaming Videos
Ghadiyaram, D., Pan, J., & Bovik, A. C. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2768542 · Cited by 119
Self-citationPhysics-based Noise Modeling for Extreme Low-light Photography
Wei, K., Fu, Y., Zheng, Y., & Yang, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3103114 · Cited by 210
Neural supersampling for real-time rendering
Xiao, L., Nouri, S., Chapman, M., Fix, A., Lanman, D. R., & Kaplanyan, A. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392376 · Cited by 137
Streaming Video QoE Modeling and Prediction: A Long Short-Term Memory Approach
Eswara, N., Ashique, S., Panchbhai, A., Chakraborty, S., Sethuram, H. P., Kuchi, K., Kumar, A., & Channappayya, S. S. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2895223 · Cited by 124
“We investigate three VQA metrics for STSQ: 1) STRRED [21], a reduced-reference metric, 2) MS-SSIM [28], a full-reference metric, and 3) NIQE [49], a no-reference metric.”
BackgroundMethodInfluentialNeutralizing the impact of atmospheric turbulence on complex scene imaging via deep learning
Jin, D., Chen, Y., Lu, Y., Chen, J., Wang, P., Liu, Z., Guo, S., & Bai, X. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00392-1 · Cited by 131
“The VQA reduced reference entropic differencing (RRED) index 28 , including S-RRED and T-RRED, was used to perform integration of three-dimensional assessment scores.”
MethodDelay-Constrained Video Transmission: Quality-Driven Resource Allocation and Scheduling
Khalek, A. A., Caramanis, C., & Heath, R. W. (2014) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2014.2332304 · Cited by 94
“We measure video quality using the spatio-temporal reduced reference entropic differencing (STRRED) index [36].”
MethodInfluentialAn Optical Flow-Based Full Reference Video Quality Assessment Algorithm
Manasa, K., & Channappayya, S. S. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2548247 · Cited by 93
No-Reference Video Quality Assessment Using Natural Spatiotemporal Scene Statistics
Dendi, S. V. R., & Channappayya, S. S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984879 · Cited by 102
“ST-RRED [25] is a popular RRVQA technique based on the spatial and temporal entropic differences.”
MethodModeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations
Chen, C., Choi, L. K., de Veciana, G., Caramanis, C., Heath, R. W., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2312613 · Cited by 93
“Since the proposed model predicts the average TVSQ per second, the prediction timescales are suitable for HTTP-based streaming.”
MethodSelf-citationA Survey on Multimedia Services QoE Assessment and Machine Learning-Based Prediction
Kougioumtzidis, G., Poulkov, V. K., Zaharis, Z. D., & Lazaridis, P. I. (2022) · IEEE Access · doi:10.1109/access.2022.3149592 · Cited by 114
“(STRRED) computes the distortion between an impaired and a reference video sequence by constructing a Gaussian scale mixture (GSM), using the wavelet coefficients of the frames and frame differences [65].”
MethodNeighbourhood Representative Sampling for Efficient End-to-End Video Quality Assessment
Wu, H., Chen, C., Liao, L., Hou, J., Sun, W., Yan, Q., Gu, J., & Lin, W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3319332 · Cited by 145
“Classical VQA Methods: Classical VQA methods [31], [32], [33], [34] employ handcraft features to evaluate video quality.”
MethodNo-reference video quality assessment via feature learning
Xu, J., Ye, P., Liu, Y., & Doermann, D. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025098 · Cited by 85
“Recently, more complex models have been proposed, including MOVIE [2], STMAD [3] and STRRED [4].”
MethodBlind Video Quality Assessment With Weakly Supervised Learning and Resampling Strategy
Zhang, Y., Gao, X., He, L., Lu, W. B., & He, R. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2868063 · Cited by 86
“Furthermore, we also compare the RR-VQA metric (STRRED [10]) and the state-of-the-art NR-VQA metrics (V-BLIINDS [20], SSDCT).”
BackgroundMethodRecurrent and Dynamic Models for Predicting Streaming Video Quality of Experience
Bampis, C. G., Li, Z., Katsavounidis, I., & Bovik, A. C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2815842 · Cited by 84
“1) [32], MS-SSIM [76], SSIM [77] and ST-RRED [33] (see Table V).”
BackgroundSelf-citationStreaming video over HTTP with consistent quality
Li, Z., Begen, A. C., Gahm, J., Shan, Y., Osler, B., & Oran, D. (2014) · Proceedings of the 5th ACM Multimedia Systems Conference · doi:10.1145/2557642.2557658 · Cited by 86
DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment
Wu, H., Chen, C., Liao, L., Hou, J., Sun, W., Yan, Q., & Lin, W. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3249741 · Cited by 111
“temporal relationships, which is also explored by [26], [27],”
BackgroundModeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations
Chen, C., Member, S., Choi, L. K., Member, S., Veciana, G. A. D., Caramanis, C., Heath, R. W., & Bovik, A. C. (2014) · Cited by 69
Self-citationLearning a Continuous-Time Streaming Video QoE Model
Ghadiyaram, D., Pan, J., & Bovik, A. C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2790347 · Cited by 72
“Multi-learner Stall only Inputs + Scene Criticality STRRED [26] 0.”
BackgroundMethodInfluentialSelf-citationVideo Compressed Sensing Using a Convolutional Neural Network
Shi, W., Liu, S., Jiang, F., & Zhao, D. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2978703 · Cited by 66
Subjective and Objective Quality Assessment of High Frame Rate Videos
Madhusudana, P. C., Yu, X., Birkbeck, N., Wang, Y., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Access · doi:10.1109/access.2021.3100462 · Cited by 65
Self-citationA Continuous QoE Evaluation Framework for Video Streaming Over HTTP
Eswara, N., Manasa, K., Kommineni, A., Chakraborty, S., Sethuram, H. P., Kuchi, K., Kumar, A., & Channappayya, S. S. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2742601 · Cited by 62
“The STSQ scores required for training were precomputed using Video-RRED [8].”
MethodInfluentialA Perception-Based Hybrid Model for Video Quality Assessment
Zhang, F., & Bull, D. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2428551 · Cited by 66
“More recently, Soundararajan and Bovik [38] presented an RR video quality assessment approach based on spatiotemporal entropic differencing, which enables complexity reduction through the analysis of reduced spatiotemporal content.”
BackgroundContinuous Prediction of Streaming Video QoE Using Dynamic Networks
Bampis, C. G., Li, Z., & Bovik, A. C. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2705423 · Cited by 65
Self-citationAn Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming
Barman, N., Schmidt, S., Zadtootaghaj, S., Martini, M. G., & Möller, S. (2018) · Proceedings of the 23rd Packet Video Workshop · doi:10.1145/3210424.3210434 · Cited by 61
“We used Spatio-temporal-reduced reference entropic dierences (ST-RRED), an RR metric proposed by the authors in [6], since it is one of the most widely used RR metrics with very good performance on various VQA databases [7].”
MethodA Hitchhiker’s Guide to Structural Similarity
Venkataramanan, A. K., Wu, C., Bovik, A. C., Katsavounidis, I. X., & Shahid, Z. (2021) · IEEE Access · doi:10.1109/access.2021.3056504 · Cited by 81
“Distortions predictably alter these statistics, making it possible to create highly competitive picture and video quality predictors like the Full-Reference (FR) Visual Information Fidelity (VIF) index [26], the Spatio-Temporal Reduced Reference Entropic Differences (ST-RRED) model [27], the efficient SpEED-QA [28], a…”
MethodSelf-citationRate Adaptation and Admission Control for Video Transmission With Subjective Quality Constraints
Chen, C., Zhu, X., Veciana, G. A. D., Bovik, A. C., & Heath, R. W. (2014) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2014.2337277 · Cited by 66
“Then, we predict the RDMOSs for each second of the decoded videos using the high-accuracy ST-RRED (Spatial-Temporal Reduced Reference Entropic Difference) index [36].”
MethodSelf-citationObjective Video Quality Assessment Combining Transfer Learning With CNN
Zhang, Y., Gao, X., He, L., Lu, W. B., & He, R. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2890310 · Cited by 58
“Based on the availability of reference information, there exist three categories of objective VQA methods including full-reference (FR) [3]–[7], reducedreference (RR) [8], and no-reference (NR) VQA methods [9]–[12].”
MethodQuality Assessment for Video With Degradation Along Salient Trajectories
Wu, J., Liu, Y., Dong, W., Shi, G., & Lin, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2908377 · Cited by 59
“, MOVIE [9], VQM_VFD [33], stRRED [34], Vis3 [11], FePVQ [35], FLOSIM [13], VMAF [36], SpEED [37] and Peng [14]), as well as two FR IQA models (GMSD [28] and MS-SSIM [38]) are compared with our model on five VQA databases (i.”
MethodBlind quality assessment of videos using a model of natural scene statistics and motion coherency
Saad, M. A., & Bovik, A. C. (2012) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2012.6489018 · Cited by 64
“We also compare against two top-performing reduced reference VQA approaches VQM [9], Video RRED [10] and two leading full-reference VQA indices MOVIE [11] and ST-MAD [12].”
MethodSelf-citationRaake, A., Borer, S., Satti, S. M., Gustafsson, J., Rao, R. R. R., Medagli, S., List, P., Göring, S., Lindero, D., Robitza, W., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3032080 · Cited by 62
“Other examples are ST-RRED [85] and SpEED-VQA [86].”
MethodContrastive Self-Supervised Pre-Training for Video Quality Assessment
Chen, P., Li, L., Wu, J., Dong, W., & Shi, G. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3130536 · Cited by 62
Predicting the Quality of Compressed Videos With Pre-Existing Distortions
Yu, X., Birkbeck, N., Wang, Y., Bampis, C. G., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3107213 · Cited by 60
“There are also successful RR models, such as ST-RRED and SpEED-QA [26].”
BackgroundMethodInfluentialSelf-citationTowards Perceptually Optimized Adaptive Video Streaming-A Realistic Quality of Experience Database
Bampis, C. G., Li, Z., Katsavounidis, I. X., Huang, T.-Y., Ekanadham, C., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3073294 · Cited by 62
“Our first experiment was to evaluate several well-known video quality and QoE metrics, including PSNR, PSNRhvs [71], SSIM [72], MS-SSIM [73], ST-MAD [74], ViS3 [24], VQM-VFD [75], V-BLIINDS [76], ST-RRED [77], VMAF [3] (version 0.6.1), SQI [10] and Video ATLAS [70].”
MethodInfluentialSelf-citationBlind image quality assessment on real distorted images using deep belief nets
Ghadiyaram, D., & Bovik, A. C. (2014) · 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP) · doi:10.1109/globalsip.2014.7032260 · Cited by 46
“…us to explore the feasibility of developing analogous powerful blind video quality assessment models using space-time natural video statistics based models [18] , [19] and also to practically adapt our model in real-world applications such as monitoring the quality of streamed media content.”
BackgroundSelf-citationMadhusudana, P. C., Birkbeck, N., Wang, Y., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3106801 · Cited by 63
“We define entropy scaling factors similar to the ones used in [4], [31] as:”
BackgroundMethodResultInfluentialSelf-citationConvolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services
Duc, T. N., Tran, C. M., Tan, P. X., & Kamioka, E. (2020) · IEEE Access · doi:10.1109/access.2020.3004125 · Cited by 53
“Reduced Reference Entropic Differences (STRRED) [33], Multi-Scale Structural Similarity (MS-SSIM) [34], Peak Signal to Noise Ratio (PSNR) [35], etc.”
VR Sickness Versus VR Presence: A Statistical Prediction Model
Kim, W., Lee, S., & Bovik, A. C. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3036782 · Cited by 56
“As discussed in [38] temporal frame differences obey regular statistical laws, while optical flow/motion vectors are much less regular.”
BackgroundSelf-citationNo Reference Quality Assessment of Stereo Video Based on Saliency and Sparsity
Yang, J., Ji, C., Jiang, B., Lu, W. B., & Meng, Q. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2789583 · Cited by 45
“Entropy can be used to measure the information quantities on the basis of Shannon theory [50].”
MethodSubjective and Objective Quality Assessment of Compressed Screen Content Videos
Li, T., Min, X., Zhao, H., Zhai, G., Xu, Y., & Zhang, W. (2020) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2020.3028335 · Cited by 45
“In STRRED [37], a Gaussian scale mixture model for the wavelet coefficients of frames and frame differences is used to measure the amount of spatial and temporal information differences between the reference and distorted videos, respectively.”
MethodSpatiotemporal Representation Learning for Blind Video Quality Assessment
Liu, Y., Wu, J., Li, L., Dong, W., Zhang, J., & Shi, G. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3114509 · Cited by 48
ColorVideoVDP: A visual difference predictor for image, video and display distortions
Mantiuk, R., Hanji, P., Ashraf, M., Asano, Y., & Chapiro, A. (2024) · ACM Transactions on Graphics · doi:10.1145/3658144 · Cited by 88
“STRRED [Soundararajan and Bovik, 2012] compares the per-frame entropy of fitted local distributions of wavelet coefficients.”
BackgroundMethodA Subjective and Objective Study of Space-Time Subsampled Video Quality
Lee, D. Y., Paul, S., Bampis, C. G., Ko, H., Kim, J.-H., Jeong, S., Homan, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3137658 · Cited by 47
“Among these, ST-RRED [33] and SpEED [34] are natural scene statistics (NSS) based models that measure the statistical space-time statistical deviations between a distorted videos and their references.”
BackgroundSelf-citationJin, Y., Chen, M., Goodall, T., Patney, A., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3087322 · Cited by 52
“1) Non-foveated IQA algorithms: We first tested 7 non-foveated IQA algorithms on both databases: PSNR, SSIM [34], MS-SSIM [35], VIF 1 [36], S-RRED [58], Speed-IQA [59] and FSIM [37].”
MethodSelf-citationFeature-based prediction of streaming video QoE: Distortions, stalling and memory
Bampis, C. G., & Bovik, A. C. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.05.017 · Cited by 116
Self-citationDeep Blind Video Quality Assessment Based on Temporal Human Perception
Ahn, S., & Lee, S. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451450 · Cited by 43
“7858 STRRED [17] 0.”
Video restoration based on deep learning: a comprehensive survey
Rota, C., Buzzelli, M., Bianco, S., & Schettini, R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10302-5 · Cited by 58
“Soundararajan and Bovik (2012) proposed Spatio-Temporal Reduced Reference Entropic Differencies (STRRED), a reduced-reference metric that computes wavelet coefficients of frame differences modeled as Gaussian scale mixture, and measures the difference in the amount of spatial and temporal information contained in dist…”
BackgroundMethodQu, Q., Liang, H., Chen, X., Chung, Y. Y., & Shen, Y. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3372037 · Cited by 52
“STRRED focuses on the structural retention in videos, offering insights into the preservation of inherent video patterns post-processing [46].”
BackgroundMethodA time-varying subjective quality model for mobile streaming videos with stalling events
Ghadiyaram, D., Pan, J., & Bovik, A. C. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2188882 · Cited by 33
Self-citationnofu — A Lightweight No-Reference Pixel Based Video Quality Model for Gaming Content
Göring, S., Rao, R. R. R., & Raake, A. (2019) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2019.8743262 · Cited by 41
“In addition, they analyzed the RR methods STRRED [31] and SpeedQA [1].”
MethodUser-Generated Video Quality Assessment: A Subjective and Objective Study
Li, Y., Meng, S., Zhang, X., Wang, M., Wang, S., Wang, Y., & Ma, S. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3122347 · Cited by 39
“ST-RRED [10] is a RR VQA model in which a Gaussian scale mixture model is used to measure the spatial and temporal information differences, these measured differences between the reference and distorted videos are further combined to predict video quality.”
Unsupervised Curriculum Domain Adaptation for No-Reference Video Quality Assessment
Chen, P., Li, L., Wu, J., Dong, W., & Shi, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00513 · Cited by 53
“While entire or partial information of reference videos is attainable in FR/RR-VQA metrics [24, 35, 1, 42], NR-VQA metrics exploit distortion-specific or natural video statistical models without the participation of any information from original videos, which is the major advantage in practical applications and also t…”
BackgroundMethodInfluentialCai, L., Dong, X., Zhou, K., & Cao, X. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3390404 · Cited by 49
“4) Evaluation Metrics: In this work, the peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM) [80], and spatiotemporal reduced reference entropic differences (ST-RRED) [81] are used to evaluate the quality of denoising results.”
MethodNo reference stereo video quality assessment based on motion feature in tensor decomposition domain
Jiang, G., Liu, S., Yu, M., et al. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.12.001 · Cited by 33
Video quality assessment accounting for temporal visual masking of local flicker
Choi, L. K., & Bovik, A. C. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.06.009 · Cited by 33
Self-citationMultiframe-to-Multiframe Network for Video Denoising
Chen, H., Jin, Y., Xu, K., Chen, Y., & Zhu, C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3077140 · Cited by 40
Deep 3D Mask Volume for View Synthesis of Dynamic Scenes
Lin, K.-E., Xiao, L., Liu, F., Yang, G., & Ramamoorthi, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00177 · Cited by 47
“Specifically, we employ the STRRED metric [40] to evaluate stability across time.”
Neural foveated super‐resolution for real‐time VR rendering
Ye, J., Meng, X., Guo, D., Shang, C., Mao, H., & Yang, X. (2024) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2287 · Cited by 34
“We demonstrate the user study results in Section 4.4 and analyze our methods with ablation study in Section 4.5.”
InfluentialTowards Perceptually Optimized End-to-end Adaptive Video StreamingPreprint
Bampis, C. G., Li, Z., Katsavounidis, I. X., Huang, T.-Y., Ekanadham, C., & Bovik, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03898 · Cited by 106
“In our first experiment, we applied several well-known video quality and QoE metrics, including PSNR, PSNRhvs [63], SSIM [64], MS-SSIM [65], ST-RRED [66], VMAF [3] (version 0.6.1), SQI [10] and Video ATLAS [15].”
MethodInfluentialSelf-citationA dynamic system model of time-varying subjective quality of video streams over HTTP
Chen, C., Choi, L. K., Veciana, G. A. D., Caramanis, C., Heath, R. W., & Bovik, A. C. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638329 · Cited by 26
“A STSQ predictor such as those in [5] [7] [8] [9] [10] operates by extracting perceptually relevant spatial and temporal features from videos then uses these to form predictions of local video quality.”
MethodSelf-citationNeuralPassthrough: Learned Real-Time View Synthesis for VR
Xiao, L., Nouri, S., Hegland, J., Garcia, A. G., & Lanman, D. R. (2022) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3528233.3530701 · Cited by 46
VDPVE: VQA Dataset for Perceptual Video Enhancement
Gao, Y., Cao, Y., Kou, T., Sun, W., Dong, Y., Liu, X., Min, X., & Zhai, G. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00152 · Cited by 36
“Objective VQA can avoid the disadvantages of subjective VQA, which can be specifically divided into full-reference (FR) VQA [1, 38], reduced-reference (RR) VQA [36], and no-reference (NR) VQA [24, 30, 37, 49, 52].”
BackgroundMethodZeng, K., Yeganeh, H., & Wang, Z. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532790 · Cited by 31
“7083 STRRED[21] RR 0.”
AVQBits—Adaptive Video Quality Model Based on Bitstream Information for Various Video Applications
Rao, R. R. R., Göring, S., & Raake, A. (2022) · IEEE Access · doi:10.1109/access.2022.3195527 · Cited by 29
Learning to Predict Streaming Video QoE: Distortions, Rebuffering and MemoryPreprint
Bampis, C. G., & Bovik, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00633 · Cited by 52
“These include standard frame-based techniques (FR-IQA) such as SSIM [11], [12] and MS-SSIM [13], temporal FR-VQA methods such as VQM VFD [14], MOVIE [15], ST-MAD [16], VMAF [17] and FLOSIM [18] and reduced-reference models like STRRED [19].”
InfluentialSelf-citationA novel selective encryption scheme for H.264/AVC video with improved visual security
He, J., Xu, Y., Luo, W., Tang, S., & Huang, J. (2020) · Signal Processing Image Communication · doi:10.1016/j.image.2020.115994 · Cited by 27
Temporal Reasoning Guided QoE Evaluation for Mobile Live Video Broadcasting
Chen, P., Li, L., Wu, J., Zhang, Y., & Lin, W. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060255 · Cited by 29
“This allows to combine the perceptual VQA indexes, which could be further classified as full-reference (FR) [18]–[22], reduced-reference (RR) [23]–[26] or no-reference (NR) [27]–[34] depending on whether entire or part of the original reference video is available during the evaluation process, and…”
BackgroundMethodPerceptual quality assessment of 3D dynamic meshes: Subjective and objective studies
Torkhani, F., Wang, K., & Chassery, J. (2015) · Signal Processing Image Communication · doi:10.1016/j.image.2014.12.008 · Cited by 36
“• Two video PQA metrics: the full-reference Video Quality Metric (VQM) [45] and the reduced-reference metric named Spatio-Temporal Reduced Reference Entropic Differencing (S TRRED) measure [46].”
MethodSubjective evaluation and objective measures for point clouds — State of the art
Dumić, E., Duarte, C. R., & Cruz, L. A. D. S. (2018) · doi:10.23919/smagrimet.2018.8369848 · Cited by 28
Reduced reference image and video quality assessments: review of methods
Dost, S., Saud, F., Shabbir, M., Khan, M. G., Shahid, M. U., & Lövström, B. (2022) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-021-00578-y · Cited by 35
“The spatio-temporal entropic differences [9] are linked well with human judgments of multimedia quality [93].”
BackgroundToward Naturalistic 2D-to-3D Conversion
Huang, W., Cao, X., Lü, K., Dai, Q., & Bovik, A. C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2385474 · Cited by 25
“In the future we intend to extend our work into the space-time modelling domain by using recent (temporal) video statistics models [37], [38].”
MethodSelf-citationVideo quality assessment by compact representation of energy in 3D-DCT domain
He, L., Lu, W. B., Jia, C., & Hao, L. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.08.143 · Cited by 26
View Synthesis of Dynamic Scenes Based on Deep 3D Mask Volume
Lin, K., Yang, G., Xiao, L., Liu, F., & Ramamoorthi, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3289333 · Cited by 26
LMM-VQA: Advancing Video Quality Assessment With Large Multimodal Models
Ge, Q., Sun, W., Zhang, Y., Li, Y., Ji, Z., Sun, F., Jui, S., Min, X., & Zhai, G. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3571788 · Cited by 59
“…assessment (VQA) methods [38] have been proposed in recent years, which can be categorized into reference-based VQA, including full-reference [2, 53] and reduced-reference VQA [15, 51], and no-reference VQA, also known as blind VQA (BVQA) [21– 23, 46, 52, 54, 55, 58, 59, 61, 63, 64, 69, 70, 79].”
MethodQuality assessment of DIBR-synthesized views: An overview
Tian, S., Zhang, L., Zou, W., Li, X., Su, T., Morin, L., & Déforges, O. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.062 · Cited by 26
Modular Framework and Instances of Pixel-Based Video Quality Models for UHD-1/4K
Göring, S., Rao, R. R. R., Feiten, B., & Raake, A. (2021) · IEEE Access · doi:10.1109/access.2021.3059932 · Cited by 24
“SpeedQA [3] is based on spatial ef(cid:28)cient entropic differencing for quality assessment and STRRED [83] uses spatial and temporal entropic differences.”
MethodReduced-reference stereoscopic image quality assessment based on view and disparity zero-watermarks
Zhou, W., Jiang, G., Yu, M., Shao, F., & Peng, Z. (2013) · Signal Processing Image Communication · doi:10.1016/j.image.2013.10.005 · Cited by 24
An objective and subjective quality assessment study of passive gaming video streaming
Barman, N., Zadtootaghaj, S., Schmidt, S., Martini, M. G., & Möller, S. (2018) · International Journal of Network Management · doi:10.1002/nem.2054 · Cited by 29
Blind Image Quality Assessment for Super Resolution via Optimal Feature Selection
Beron, J., Benítez-Restrepo, H. D., & Bovik, A. C. (2020) · IEEE Access · doi:10.1109/access.2020.3014497 · Cited by 25
Self-citationLight-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancement
Dong, Y., Liu, X., Gao, Y., Zhou, X., Tan, T., & Zhai, G. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611923 · Cited by 29
“Objective VQA can be divided into Full-Reference (FR) VQA [2], Reduced-Reference (RR) VQA [32], and No-Reference (NR) VQA [27] contingent on the amount of required pristine video information [33].”
BackgroundPerceptual Quality Assessment of NeRF and Neural View Synthesis Methods for Front‐Facing Views
Liang, H., Wu, T., Hanji, P., Banterle, F., Gao, H., Mantiuk, R., & Öztireli, C. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15036 · Cited by 46
“…and monitor conditions FovVideoVDP ✓ ✓ Spatial-temporal metric that accounts [29] for foveation effect STRRED ✓ ✓ Hybrid metric measures temporal [46] motion and spatial difference VMAF ✓ ✓ Support Vector Machine combination [22] of multiple image and video metrics HDR-VQM ✓ ✓ Spatial-temporal…”
Background
Metadata
- Authors
- Soundararajan, R., & Bovik, A. C.
- Affiliations
- The University of Texas at Austin (US)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2013-04
- Volume
- 23
- Issue
- 4
- Pages
- 684-694
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2044338482
- Semantic Scholar
- 3b3621dfd7f2a4237f1226d38ff9e25ecbb6e24a
- Cited by
- 368
- References
- 27
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 42 · 2023: 36 · 2022: 26 · 2021: 48 · 2020: 37 · 2019: 22 · 2018: 37 · 2017: 28 · 2016: 14 · 2015: 17 · 2014: 21 · 2013: 9
- FWCI
- 15.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- video quality assessment, reduced-reference quality assessment, Gaussian scale mixture model, wavelet coefficients, frame difference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.