Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index; 12 of the 89 sources its claims cite were checked for support.
Abstract
There has recently been a great deal of interest in the development of algorithms that objectively measure the integrity of video signals. Since video signals are being delivered to human end users in an increasingly wide array of applications and products, it is important that automatic methods of video quality assessment (VQA) be available that can assist in controlling the quality of video being delivered to this critical audience. Naturally, the quality of motion representation in videos plays an important role in the perception of video quality, yet existing VQA algorithms make little direct use of motion information, thus limiting their effectiveness. We seek to ameliorate this by developing a general, spatio-spectrally localized multiscale framework for evaluating dynamic video fidelity that integrates both spatial and temporal (and spatio-temporal) aspects of distortion assessment. Video quality is evaluated not only in space and time, but also in space-time, by evaluating motion quality along computed motion trajectories. Using this framework, we develop a full reference VQA algorithm for which we coin the term the MOtion-based Video Integrity Evaluation index, or MOVIE index. It is found that the MOVIE index delivers VQA scores that correlate quite closely with human subjective judgment, using the Video Quality Expert Group (VQEG) FRTV Phase 1 database as a test bed. Indeed, the MOVIE index is found to be quite competitive with, and even outperform, algorithms developed and submitted to the VQEG FRTV Phase 1 study, as well as more recent VQA algorithms tested on this database.
Overview
CoChat Summary
TL;DR
The paper develops MOVIE, a full-reference video quality assessment index that integrates spatial and temporal/motion quality using spatio-temporal Gabor decomposition and motion trajectories. On the VQEG FRTV Phase 1 database, MOVIE correlates closely with subjective scores and is competitive with or outperforms several leading VQA algorithms.
Key findings
- On the entire VQEG FRTV Phase 1 database, MOVIE achieved SROCC 0.833, LCC 0.821, and OR 0.644, compared with PSNR SROCC 0.786, Proponent P8 SROCC 0.803, and SSIM with weighting SROCC 0.812.
- On only the 16 natural videos and their distorted versions (256 videos), MOVIE achieved SROCC 0.860, LCC 0.858, OR 0.656, and RMSE 8.093; PSNR had SROCC 0.739 and SSIM without weighting had SROCC 0.802.
- Temporal MOVIE alone outperformed Spatial MOVIE on the entire database (SROCC 0.816 vs. 0.793) and on natural videos (SROCC 0.835 vs. 0.825), and combining both improved over either separately.
- The RMSE between subjective scores and MOVIE scores after nonlinear regression on the entire VQEG database was 8.76; the outlier ratio using the three-sigma rule was 0.488 on the entire database and 0.461 on natural videos.
Methods
- MOVIE is a full-reference VQA framework: reference and test videos are decomposed with a Gabor filterbank; spatial quality uses divisive normalization/contrast masking inspired by SSIM and information-theoretic IQA; temporal quality uses optical flow from the reference via a multi-scale Fleet–Jepson algorithm and motion-tuned weighted Gabor responses; spatial and temporal scores are pooled using coefficient-of-variation frame descriptors and a product.
- Evaluation used the VQEG FRTV Phase 1 database: 20 reference sequences and 16 distorted versions of each, totaling 320 videos; the algorithm ran on one field of interlaced video and ignored color. A separate natural-video analysis used 16 references and 256 videos after omitting 4 animated sources.
- Performance was measured with SROCC, LCC after logistic nonlinear regression, outlier ratio, and RMSE, and compared against PSNR, SSIM variants, and VQEG proponent models.
Limitations
- The paper states that MOVIE ignores color information and uses only one field of interlaced video; color is listed as a future improvement.
- The paper states that temporal pooling is a simple mean of frame-level descriptors, with more advanced temporal pooling left for future work; it also notes that the model is implicitly geared toward natural videos, and 4 animated sequences are omitted from the natural-video table because they contain synthetic properties and text.
- The paper states that evaluation is limited to the VQEG FRTV Phase 1 database, that VQM performance is not reported because VQM was trained on VQEG data, and that some compared algorithms’ reported performance is from the 2000 VQEG study and may have improved since.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
10 Valid · 9 Not valid · 43 Not checked · 80 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This study reveals that cells in V1 that project to MT may be regarded as local motion energy filters that are spatio-temporally separable and tuned to a specific frequency and orientation (such as the Gabor filters used here).”
What the sources say
- Partly supportedcites [35] [35] J. A. Movshon and W. T. Newsome, 'Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys,' Journal Neuroscience , vol. 16, no. 23, pp. 7733-7741, 1996. - sourceExperimental — accuracy not yet measured
The Discussion describes V1 neurons projecting to MT as local motion energy filters responsive within bandpass limits for orientation and spatial and temporal frequency. The spatial and temporal receptive-field results report frequency tuning, but our copy does not establish that these neurons are spatiotemporally separable. (LLM, conf=0.87)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Further, the responses of several spatio-temporally separable responses can be combined to encode the local speed and direction of motion of the video sequence [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Partly supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - sourceExperimental — accuracy not yet measured
The MT pattern cells section says the model combines responses from V1 cells to produce selectivity for velocity, which includes speed and direction. But the Spatio-temporal frequency tuning section says the model's V1 responses are not spatially and temporally separable; separable tuning is described as a possible alternative, not a feature of the model. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Translational motion has an easily accessible representation in the frequency domain and these ideas have been used to build motion estimation algorithms for video [8], [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [8] [8] A. B. Watson and J. Ahumada, A. J., 'Model of human visual-motion sensing,' Journal Optical Society America A: Optics Image Science Vision , vol. 2, no. 2, pp. 322-342, 1985. - source
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The MT pattern cells section states that the power spectrum of a translating two-dimensional pattern lies on a plane in the spatio-temporal frequency domain, with the plane’s orientation determined by velocity. The paper uses this representation to explain its model, supporting the attributed claim. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Our temporal quality computation bears several similarities with the neuronal model of MT in [58], [72]. Similarities include the weighting procedure based on the distance between the linear filters and the motion plane and the normalization of weighted responses.”
What the sources say
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The Additional information section says the MT weighting depends on Euclidean distance to the preferred velocity plane. The MT pattern cells section says MT responses are computed from a weighted sum of V1 inputs and then normalized. Together, these support the similarities attributed to this model. (LLM, conf=0.93)
- Not checked — no full text of the sourcecites [72] [72] N. C. Rust, V. Mante, E. P. Simoncelli, and J. A. Movshon, 'How MT cells analyze the motion of visual patterns.' Nature Neuroscience , vol. 9, no. 11, pp. 1421-1431, Nov 2006. - source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Root Mean Squared Error (RMSE) between subjective scores and MOVIE scores after non-linear regression on the entire VQEG database is 8.76.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims
Create a free account to see all 142 claims and to verify the 2 references still open.
- Probably not a substantial claim. 48
- It may state two separate claims as one. 41
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One reason frame-by-frame IQA performs less well for VQA is because it ignores temporal information, which is important for video quality due to temporal effects, such as temporal masking and motion perception.3,4”
From ViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices (2014) · cites this paper as [4]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Each of these filters has a standard deviation of 2 . 65 pixels along both spatial coordinates and 2 . 65 frames along the temporal axis. In our implementation, the Gabor filters were sampled out to a width of three standard deviations; so the support of the kernels at the finest scale are 15 pixels and 15 frames along the spatial and temporal axes respectively.”
Reported 15 · recomputed 15.9
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citation(1981) · Cited by 11,963
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
Self-citationA universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Self-citationComputational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Self-citationSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Research works printed but not linked: 7
- webster, 2008, progress and future plans for vqeg, ETSI STQ Workshop Multimedia Quality of Service
- fox, 1978, Handbook of Sensory Physiology Volume VIII Perception
- lubin, 1993, Digital Images and Human Vision, 163
- seshadrinathan, 2007, an information theoretic video quality metric based on motion models, 1st Int Workshop Video Process Quality Metrics Consum Electron
- girod, 1993, Digital Images and Human Vision, 207
- 0, (2008) NTT News Release
- 2008, Objective Perceptual Multimedia Video Quality Measurement in the Presence of a Full Reference
Cited by
Items 101–200 of 717
BVI-HD: A Video Quality Database for HEVC Compressed and Texture Synthesized Content
Zhang, F., Moss, F. M., Baddeley, R., & Bull, D. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2817070 · Cited by 64
“This is also statistically significant based on the Ftest results in TABLE II, while the difference is not significant between any two of MS-SSIM, VIF, VSNR, VQM, MOVIE and STMAD.”
MethodInfluentialHybrid Distortion-Based Rate-Distortion Optimization and Rate Control for H.265/HEVC
Yuan, H., Wang, Q., Liu, Q., Huo, J., & Li, P. (2021) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2021.3065636 · Cited by 62
“The bitrates generated with QPs of 22, 27, 32, and 37 for both RA and LD configurations were used as the target bitrates for RC.”
BackgroundMethodA Survey on Perceptually Optimized Video Coding
Zhang, Y., Zhu, L., Jiang, G., Kwong, S., & Kuo, C. ‐. J. (2022) · ACM Computing Surveys · doi:10.1145/3571727 · Cited by 73
“[82], reference and distorted videos were decomposed with multiple Gabor ilters and quality degradations were measured with the Gabor coeicient diferences in spatial and temporal domains.”
InfluentialAcqualagna, L., Bosse, S., Porbadnigk, A. K., Curio, G., Müller, K., Wiegand, T., & Blankertz, B. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/2/026012 · Cited by 63
Evaluation of temporal variation of video quality in packet loss networks
Yim, C., & Bovik, A. C. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.11.002 · Cited by 67
“A general framework for measuring spatial and temporal video distortions along motion trajectories was proposed in the MOtion-based Video Integrity Evaluation (MOVIE) index [24].”
MethodSelf-citationObjective Video Quality Assessment Based on Perceptually Weighted Mean Squared Error
Hu, S., Jin, L., Wang, H., Zhang, Y., Kwong, S., & Kuo, C. ‐. J. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2556499 · Cited by 57
Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication
Getu, T. M., Kaddoum, G., & Bennis, M. (2023) · IEEE Access · doi:10.1109/access.2023.3269848 · Cited by 91
“To this end, the principal axis of the filter set is oriented in the frequency domain along the direction of motion [191], [221].”
BackgroundMethodInfluentialCharacterizing perceptual artifacts in compressed video streams
Zeng, K., Zhao, T., Rehman, A., & Wang, Z. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2043128 · Cited by 55
Stereoscopic 3D Visual Discomfort Prediction: A Dynamic Accommodation and Vergence Interaction Model
Oh, H., Lee, S., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2506340 · Cited by 58
“A number of models for predicting video quality have been proposed [53], [55], [63], [64], but only a few have been proposed for predicting the quality of S3D viewing in terms of the degree of experienced visual discomfort [61], [62].”
BackgroundSelf-citationObjective Video Quality Assessment Combining Transfer Learning With CNN
Zhang, Y., Gao, X., He, L., Lu, W. B., & He, R. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2890310 · Cited by 58
“A motion-tuned spatiotemporal quality assessment method—MOtion-based Video Integrity Evaluation (MOVIE) [4]—is localized multiscale framework for evaluating dynamic video fidelity that integrates both spatial and temporal aspects of distortion assessment.”
MethodQuality Assessment for Video With Degradation Along Salient Trajectories
Wu, J., Liu, Y., Dong, W., Shi, G., & Lin, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2908377 · Cited by 59
“Existing models with a preciser predicted performance always need more computation cost (such as MOVIE, Vis3, and VQA_VFD), while a much faster algorithm (like SpEED, or VMAF) always could not perform well on all evaluating databases.”
BackgroundMethodInfluentialAdvanced H.264/AVC-Based Perceptual Video Coding: Architecture, Tools, and Assessment
Naccari, M., & Pereira, F. M. B. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2130430 · Cited by 53
“To assess the IST-PVC RD performance, the video quality metric (VQM) proposed by NTIA [35] and the recently designed motion-based video integrity evaluation (MOVIE) proposed by Seshadrinathan et al. [ 36 ] have been selected.”
MethodAssessing quality of experience for adaptive HTTP video streaming
Xue, J., Zhang, D., Yu, H., et al. (2014) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2014.6890604 · Cited by 54
Full-Reference Video Quality Assessment by Decoupling Detail Losses and Additive Impairments
Li, S., Ma, L., & Ngan, K. N. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2190473 · Cited by 54
Survey on QoE Assessment Approach for Network Service
Yang, M., Wang, S., Calheiros, R. N., & Yang, F. (2018) · IEEE Access · doi:10.1109/access.2018.2867253 · Cited by 54
“[60] detects video distortion not separately in space and time domain, but rather in space-time domain through computing motion trajectories of the object in video and making spatio-temporal distortion assessments.”
BackgroundBlind quality assessment of videos using a model of natural scene statistics and motion coherency
Saad, M. A., & Bovik, A. C. (2012) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2012.6489018 · Cited by 64
“We also compare against two top-performing reduced reference VQA approaches VQM [9], Video RRED [10] and two leading full-reference VQA indices MOVIE [11] and ST-MAD [12].”
MethodSelf-citationVideo Quality Assessment Based on Measuring Perceptual Noise From Spatial and Temporal Perspectives
Zhao, Y., Yu, L., Chen, Z., & Zhu, C. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2157189 · Cited by 51
“Recently, more efforts have been devoted to video artifact measurement from a dynamic perspective [9]–[12].”
BackgroundA video texture database for perceptual compression and quality assessment
Papadopoulos, M. A., Zhang, F., Agrafiotis, D. K., & Bull, D. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351309 · Cited by 52
No-reference video quality assessment in the compressed domain
Lin, X., Ma, H., Luo, L., & Chen, Y. (2012) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2012.6227454 · Cited by 50
Predicting the Quality of Compressed Videos With Pre-Existing Distortions
Yu, X., Birkbeck, N., Wang, Y., Bampis, C. G., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3107213 · Cited by 60
“Early work on VQA models largely focused on referencebased models, beginning with the simple PSNR and advancing to more sophisticated FR frame-based models that better account for visual perception, including SSIM, MPQM [16], MS-SSIM [17], VIF, VSNR [18], FSIM [19], IW-SSIM [20], and DOG-SSIM [21], and spatial-tempora…”
MethodSelf-citationStudy of Saliency in Objective Video Quality Assessment
Zhang, W., & Liu, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2651410 · Cited by 53
“MOVIE: The motion-based video integrity evaluation index [7] utilises a general, spatio-spectrally localized multi-scale framework for evaluating dynamic video fidelity.”
MethodImpact of video content and transmission impairments on quality of experience
Paudyal, P., Battisti, F., & Carli, M. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3214-0 · Cited by 49
“Moreover, by taking into account the video content related features, spatial-temporal perceptual information [9] and salient motion related features [8, 36], the prediction capability of the quality assessment metric might be enhanced.”
BackgroundTowards Perceptually Optimized Adaptive Video Streaming-A Realistic Quality of Experience Database
Bampis, C. G., Li, Z., Katsavounidis, I. X., Huang, T.-Y., Ekanadham, C., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3073294 · Cited by 62
“Note that we did not include complex VQA metrics like MOVIE [78] in our evaluation, which can be computationally inefficient for 1080p input videos and sometimes lead to out-of-memory issues [39].”
MethodSelf-citationChipQA: No-Reference Video Quality Prediction via Space-Time Chips
Ebenezer, J. P., Shang, Z., Wu, Y., Wei, H., Sethuraman, S., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3112055 · Cited by 59
“Motion has also been used in several FR VQA models [24]–[26] and NR VQA models [2], [3], [5], [7].”
MethodSelf-citationNo-Reference Retargeted Image Quality Assessment Based on Pairwise Rank Learning
Ma, L., Xu, L., Zhang, Y., Yan, Y., & Ngan, K. N. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2614187 · Cited by 50
“Recently, more effective quality metrics have been proposed, such as feature similarity (FSIM) [16] for natural image, and motion-based video integrity evaluation (MOVIE) [17] for natural video.”
BackgroundConsistent Quality Oriented Rate Control in HEVC Via Balancing Intra and Inter Frame Coding
Gao, W., Jiang, Q., Wang, R., et al. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3079231 · Cited by 48
“Also, it is recognized that both spatial and temporal artifacts need to be evaluated [6] in video quality assessment.”
BackgroundAdaptive Block-size Transform based Just-Noticeable Difference model for images/videos
Ma, L., Ngan, K. N., Zhang, F., & Li, S. (2011) · Signal Processing Image Communication · doi:10.1016/j.image.2011.02.002 · Cited by 50
“As the proposed visual quality metric has modeled both the spatial and temporal HVS properties, it performs comparably with VIF and MOVIE.”
ResultInfluentialMadhusudana, P. C., Birkbeck, N., Wang, Y., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3106801 · Cited by 63
“basic operations, such as frame differences [4], [5], [7], [29] or that perform expensive motion estimation computations [15], [17], [21].”
BackgroundMethodSelf-citationUnderwater image restoration: A state‐of‐the‐art review
Fayaz, S., Parah, S. A., Qureshi, G. J., & Kumar, V. (2020) · IET Image Processing · doi:10.1049/ipr2.12041 · Cited by 52
Shen, W., Zhou, M., Liao, X., Jia, W., Xiang, T., Fang, B., & Shang, Z. (2022) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2022.3164332 · Cited by 49
“Seshadrinathan and Bovik [20] proposed a spatio-spectrally localized multiscale framework to integrate the spatiotemporal aspects of distortion for evaluating dynamic video fidelity.”
BackgroundSurvey of information theory in visual quality assessment
Soundararajan, R., & Bovik, A. C. (2013) · Signal Image and Video Processing · doi:10.1007/s11760-013-0442-5 · Cited by 50
“While both [18] and [19] look at spatiotemporal data, it might be interesting to consider the spatial and temporal data independently in view of the accepted model of independent processing of these in the visual cortex [20].”
BackgroundMethodInfluentialSelf-citationNovel Spatio-Temporal Structural Information Based Video Quality Metric
Wang, Y., Jiang, T., Ma, S., & Gao, W. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2186745 · Cited by 45
“As same as the test condition in [8], we used the scores assigned in the “low” quality regime as the subjective scores for these videos.”
BackgroundMethodInfluentialVideo quality assessment for computer graphics applications
Aydın, T. O., Čadík, M., Myszkowski, K., & Seidel, H. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866187 · Cited by 51
Perceptual Quality Assessment of Internet Videos
Xu, J., Li, J., Zhou, X., Zhou, W., Wang, B., & Chen, Z. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475486 · Cited by 58
“To precisely evaluate the perceptual quality of videos, traditional methods mainly focus on the structural [47], gradient [29], motion [38], saliency [52] information and usually require reference videos for comparison.”
MethodColor and Depth Priors in Natural Images
Su, C.-C., Cormack, L. K., & Bovik, A. C. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2249075 · Cited by 48
“These invalid range values are carefully avoided during the filtering process in the statistical analysis and modeling.”
MethodSelf-citationA MATLAB-based framework for image and video quality evaluation
Murthy, A. V., & Karam, L. J. (2010) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5516091 · Cited by 44
“This is because they might require data in different file formats (e.g., The MOVIE index [ 9 ] requires input to be YUV4:2:0 planar while the VQM metric [10] accepts AVI or interleaved UYVY files).”
BackgroundColor-Sensitivity-Based Combined PSNR for Objective Video Quality Assessment
Shang, X., Liang, J., Guo-zhong, W., Zhao, H., Wu, C., & Lin, C. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2836974 · Cited by 50
“Many methods, such as the structure similarity (SSIM) [6]–[8], video quality metric (VQM) [9], visual signal-to-noise ratio (VSNR) [10], visual information fidelity (VIF) [11], motion-based video integrity evaluation index (MOVIE) [12], feature similarity (FSIM) index [13], and works in [14]–[16], have been proposed t…”
MethodSubjective and Objective Quality Assessment of Compressed Screen Content Videos
Li, T., Min, X., Zhao, H., Zhai, G., Xu, Y., & Zhang, W. (2020) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2020.3028335 · Cited by 45
“MOtion-based Video Integrity Evaluation (MOVIE) index [29] seeks a novel model by developing a general, spatio-spectrally localized multiscale framework for evaluating dynamic video fidelity, and it considers both spatial and temporal (and spatial-temporal) aspects of the video distortions.”
MethodSpatiotemporal Representation Learning for Blind Video Quality Assessment
Liu, Y., Wu, J., Li, L., Dong, W., Zhang, J., & Shi, G. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3114509 · Cited by 48
Jin, Y., Chen, M., Goodall, T., Patney, A., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3087322 · Cited by 52
“An FR algorithm called the MOVIE index [52] represents temporal artifacts by modeling the responses of motion sensitive neurons in extra-cortical area MT [53].”
MethodSelf-citationNo-reference image blur assessment using multiscale gradient
Chen, M.-J., & Bovik, A. C. (2009) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246973 · Cited by 43
Self-citationEfficient Video Quality Assessment Along Temporal Trajectories
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2010.2087470 · Cited by 49
“From the plot, one would conjecture that MC-SSIM performs well for the high-quality case, and seems to present lowered performance for the low-quality one.”
BackgroundMethodSelf-citationOcclusion-aware Video Temporal Consistency
Yao, C.-H., Chang, C.-Y., & Chien, S. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123363 · Cited by 41
“…(MS-SSIM) of Wang et al. [32], natural visual feature based video quality metric (VQM) of Pinson et al. [25], and motion tuned spatio-temporal quality assessment of natural videos (MOVIE) proposed by Seshadrinathan et al. [27] generally give the best performance in evaluating natural videos.”
BackgroundA Cost-Constrained Video Quality Satisfaction Study on Mobile Devices
Li, F., Shuang, F., Liu, Z., et al. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2764329 · Cited by 41
“Full-reference models, such as structural similarity (SSIM) [3], multi-scale structural similarity (MS-SSIM) [4], and motion-based video integrity evaluation (MOVIE) [5] are widely used for QoE assessment.”
MethodScreen Content Video Quality Assessment: Subjective and Objective Study
Cheng, S., Zeng, H., Chen, J., Hou, J., Zhu, J., & Ma, K. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3018256 · Cited by 45
“…progresses have been made in the study of subjective and objective image/video quality assessment (IQA/VQA) [11], [12] for the natural images (e.g., [13]–[17]), natural videos (e.g., [18]–[23]), screen content images (e.g., [2], [24]–[27]), and cross-content-type images (e.g., [28]–[32]).”
BackgroundMethodInfluentialSingle-trial EEG classification of artifacts in videos
Mustafa, M., Guthe, S., & Magnor, M. A. (2012) · ACM Transactions on Applied Perception · doi:10.1145/2325722.2325725 · Cited by 41
“However, most of the research is geared towards using perception-based algorithms to create rendered sequences or perceptual algorithms to determine the quality of the rendered output [Seshadrinathan and Bovik 2010].”
MethodFeature-based prediction of streaming video QoE: Distortions, stalling and memory
Bampis, C. G., & Bovik, A. C. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.05.017 · Cited by 116
Self-citationDeep Blind Video Quality Assessment Based on Temporal Human Perception
Ahn, S., & Lee, S. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451450 · Cited by 43
“8884 MOVIE [16] 0.”
Video restoration based on deep learning: a comprehensive survey
Rota, C., Buzzelli, M., Bianco, S., & Schettini, R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10302-5 · Cited by 58
Cost-Oriented Adaptive Multimedia Delivery
Molnar, A., & Muntean, C. H. (2013) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2013.2244786 · Cited by 41
“- Video Quality Metric [39], SSIM - Structural Similarity Index [40], MS-SSIM - MultiScale-Structural SIMilarity index [41], MOVIE - MOtion-based Video Integrity Evaluation [42], etc.”
MethodAutomatic prediction of perceptual quality of multimedia signals—a survey
Seshadrinathan, K., & Bovik, A. C. (2010) · Multimedia Tools and Applications · doi:10.1007/s11042-010-0625-9 · Cited by 46
“MOVIE has been shown to match human visual perception of video quality quite closely [64].”
BackgroundMethodInfluentialSelf-citationVisual Quality Assessment of Synthesized Views in the Context of 3D-TV
Bosc, E., Callet, P. L., Morin, L., & Pressigout, M. (2012) · Springer eBooks · doi:10.1007/978-1-4419-9964-1_15 · Cited by 40
Learning Spatiotemporal Interactions for User-Generated Video Quality Assessment
Zhu, H., Chen, B., Zhu, L., & Wang, S. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3207148 · Cited by 42
“The interaction in spatiotemporal space, which can be achieved by the comparisons of features from the consecutive frames [28], [30], [31], [32], is specifically modeled based upon the difference between the consecutive frames in the feature domain.”
BackgroundMethodSatisfied-User-Ratio Modeling for Compressed Video
Zhang, X., Yang, C., Wang, H., Xu, W., & Kuo, C. ‐. J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2965994 · Cited by 38
“In [22], MOtionbased Video Integrity Evaluation (MOVIE) index is proposed”
BackgroundTemporally Adaptive Shading Reuse for Real-Time Rendering and Virtual Reality
Mueller, J. H., Neff, T., Voglreiter, P., Steinberger, M., & Schmalstieg, D. (2021) · ACM Transactions on Graphics · doi:10.1145/3446790 · Cited by 40
“A few video quality metrics incorporate temporal aspects [den Branden Lambrecht and Verscheure 1996; Pinson and Wolf 2004; Seshadrinathan and Bovik 2010; Watson 2001; Yang et al. 2007], but focus mostly on video compression related artifacts such as frame dropping and have not been evaluated for…”
BackgroundNatural scene statistics of color and range
Su, C.-C., Bovik, A. C., & Cormack, L. K. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6116191 · Cited by 35
Self-citation3D-SSIM for video quality assessment
Zeng, K., & Wang, Z. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6466936 · Cited by 53
“This is estimated to be only less than 1% and 0.1% of the well known VQM [14] and MOVIE [5] algorithms, respectively.”
BackgroundMethodInfluentialQuality Assessment for Omnidirectional Video: A Spatio-Temporal Distortion Modeling Approach
Gao, P., Zhang, P., & Smolić, A. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3044458 · Cited by 43
“Further, Seshadrinathan et al. proposed [29] a general framework for measuring both spatial and temporal video distortions and a VQA algorithm called the MOtion-based Video Integrity Evaluation (MOVIE) index, which is based on their earlier work [30].”
MethodA Tutorial for Emerging Wireless Medical Video Transmission Systems [Wireless Corner]
Panayides, A. S., Pattichis, M. S., Pattichis, C. S., & Pitsillides, A. (2011) · IEEE Antennas and Propagation Magazine · doi:10.1109/map.2011.5949369 · Cited by 34
“Of particu lar interest is the new motion-based video integrity evaluation (MOVIE) metric described in [ 39 ], which claims to outperform all video-quality assessment algorithms to date [7].”
BackgroundUser-Generated Video Quality Assessment: A Subjective and Objective Study
Li, Y., Meng, S., Zhang, X., Wang, M., Wang, S., Wang, Y., & Ma, S. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3122347 · Cited by 39
“In [7], a spatio-spectrally localized multiscale framework for evaluating dynamic video fidelity by motion quality along computed motion trajectories was presented.”
Video quality assessment accounting for temporal visual masking of local flicker
Choi, L. K., & Bovik, A. C. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.06.009 · Cited by 33
“The Temporal MOVIE Index measures motion quality relevant to temporal distortions, whereby errors are computed between the motion tuned responses of reference and distorted video sequences to evaluate temporal video integrity [24].”
BackgroundMethodInfluentialSelf-citationAttention modeling for video quality assessment: Balancing global quality and local quality
You, J., Korhonen, J., & Perkis, A. (2010) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2010.5583037 · Cited by 32
“between the reference and distorted video sequences in the MOVIE quality model [2], which can evaluate motion quality along computed motion trajectories.”
BackgroundQoE-Enabled Big Video Streaming for Large-Scale Heterogeneous Clients and Networks in Smart Cities
Chen, B.-W., Ji, W., Jiang, F., & Rho, S. (2015) · IEEE Access · doi:10.1109/access.2015.2506648 · Cited by 31
“5) Motion-based video integrity evaluation (MOVIE): In [78], a video qualitative evaluation was presented for modeling not only spatial and temporal domains but also spatiotemporal domains.”
BackgroundSparse Representation-Based Video Quality Assessment for Synthesized 3D Videos
Zhang, Y., Zhang, H., Yu, M., Kwong, S., & Ho, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2929433 · Cited by 29
“The comparison methods include three categories: eight conventional 2D IQA/VQA metrics, i.e., PSNR, SSIM [1], WSNR [43], MSSSIM [2], IW-SSIM [44], IW-PSNR [44], VQM [4] and MOVIE [5], seven 3D synthesized IQA metrics, i.e., Bosc [7], MP-PSNR [12], MW-PSNR [13], MPPSNRr [14], MW-PSNRr [14], 3DSwIM [9] and LOGS [10], th…”
InfluentialSelf-Supervised Representation Learning for Video Quality Assessment
Jiang, S., Sang, Q., Hu, Z., & Liu, L. (2022) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2022.3197904 · Cited by 31
“…VQA models are developed by extracting hand-crafted features from the video, such as natural scene statistics (NSS) features [13], [17], [26], [27], [28], [29], [30], motion features [31], [32], [33], and distortion type-sensitive features [32], [34], [35], [36] for perceptual quality prediction.”
MethodTowards Perceptually Optimized End-to-end Adaptive Video StreamingPreprint
Bampis, C. G., Li, Z., Katsavounidis, I. X., Huang, T.-Y., Ekanadham, C., & Bovik, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03898 · Cited by 106
“It is also more computationally efficient than time-consuming VQA models such as MOVIE [73] and VQM-VFD [74].”
MethodSelf-citationTemporal quality assessment for mobile videos
Chan, A., Pande, A., Baik, E., & Mohapatra, P. (2012) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/2348543.2348572 · Cited by 32
Interactive Progressive Visualization with Space-Time Error Control
Frey, S., Sadlo, F., Ma, K., et al. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346319 · Cited by 29
“As input for MOVIE, we compute a video for each parameter setting along with a reference video that batch renders a full-quality image for every frame.”
BackgroundMethodInfluentialA dynamic system model of time-varying subjective quality of video streams over HTTP
Chen, C., Choi, L. K., Veciana, G. A. D., Caramanis, C., Heath, R. W., & Bovik, A. C. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638329 · Cited by 26
“In this paper, we propose a method to predict the TVSQ of videos streamed over HTTP. Predicting the TVSQ of a quality varying video is challenging because the TVSQ depends on many elements of the video including spatial distortions, temporal arti facts, and variations in both of these [5] [6] .”
MethodSelf-citationRepresenting software project vision by means of video: A quality model for vision videos
Karras, O., Schneider, K. A., & Fricker, S. A. (2019) · Journal of Systems and Software · doi:10.1016/j.jss.2019.110479 · Cited by 34
“However, we focused on the use of subjective judgments since asking humans for their opinion is considered as the ultimate standard and right way to assess video quality [35].”
BackgroundInfluentialBalancing Attended and Global Stimuli in Perceived Video Quality Assessment
You, J., Korhonen, J., Perkis, A., & Ebrahimi, T. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2172591 · Cited by 32
“Seshadrinathan and Bovik [9] proposed to evaluate the motion quality along computed motion trajectories in a motion-based video integrity evaluation (MOVIE) model.”
BackgroundMethodA no-reference video quality assessment based on Laplacian pyramids
Zhu, K., Hirakawa, K., Asari, V. K., & Saupe, D. (2013) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2013.6738011 · Cited by 28
“The performance comparison in Table 3 shows our NR VQA is competitive with the " general-purpose " FR VQA algorithms (MS-SSIM [16], V-VIF [17], MOVIE [18]) listed in [14] for H.264 coded videos.”
MethodPerceptual Attributes Optimization for Multivideo Summarization
Nie, L., Hong, R., Zhang, L., Xia, Y., Tao, D., & Sebe, N. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2493558 · Cited by 26
“The proposed method (PM) is closely related to the video summarization techniques and the image/video quality evaluation models [24], [38], [42] in image processing and computer vision.”
MethodZhang, F., Mackin, A., & Bull, D. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296291 · Cited by 27
“Four correlation statistics, Linear Correlation Coefficient (LCC), Spearman Rank Order Correlation Coefficient (SROCC), Outlier Ratio (OR) and 2Another popular generic video quality metric MOVIE [25] has not been tested here, due to the large memory required for high frame rate content.”
Efficient video denoising based on dynamic nonlocal means
Han, Y., & Chen, R. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.01.002 · Cited by 27
Perceptual sensitivity-based rate control method for high efficiency video coding
Zeng, H., Yang, A., Ngan, K. N., et al. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2997-3 · Cited by 27
“Therefore, although there are many existing visual quality assessment metrics that have good measurement of HVS perception [19, 20], they are not applicable to video coding process.”
BackgroundAbboud, F., Chouzenoux, É., Pesquet, J.-C., Chenot, J.-H., & Laborelli, L. (2017) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-016-0696-y · Cited by 28
“Table 1 presents the performance of our restoration method in terms of SNR, averaged SSIM [34], and MOVIE [35].”
MethodRate-Distortion Optimization Using Adaptive Lagrange Multipliers
Zhang, F., & Bull, D. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2873837 · Cited by 28
“In contrast, more advanced methods, such as MOVIE [22] and STMAD [31], are not appropriate for in-loop application due to their high complexity and/or latency characteristics.”
MethodYao, J.-C., & Liu, G.-Z. (2019) · IEEE transactions on broadcasting · doi:10.1109/tbc.2018.2878360 · Cited by 23
“Furthermore, for two FR VQA metrics, namely, VQM and MOVIE, the stability of their PLCC and SROCC in the three video databases is less than that of proposed metric.”
MethodInfluentialAn artificial-neural-network-based QoE estimation model for Video streaming over wireless networks
Kang, Y., Chen, H., & Xie, L. (2013) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchina.2013.6671126 · Cited by 27
“An FR video quality evaluation model is presented based on video content in [5].”
MethodLi, J., Krasula, L., Baveye, Y., et al. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2903722 · Cited by 27
“OBJECTIVE VIDEO QUALITY METRICS Generally, the state-of-the-art objective video quality metrics such as PSNR, SSIM [38], MS-SSIM [39], MOVIE [40], VQM [41], VQM-VFD [42], SSIMplus [43], VMAF [44] are used to predict the exact perceptual quality of the video sequences, and do not consider the threshold for acceptabilit…”
MethodA GMM-based stair quality model for human perceived JPEG images
Hu, S., Wang, H., & Kuo, C. ‐. J. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7471840 · Cited by 27
“The traditional quality metric for coded image/video, such as the peak signal-to-noise ratio (PSNR), is a continuous function of the coding bit rate [1, 2, 3, 4].”
BackgroundLearning to Predict Streaming Video QoE: Distortions, Rebuffering and MemoryPreprint
Bampis, C. G., & Bovik, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00633 · Cited by 52
“It achieves quality prediction efficiency without the need to compute motion vectors, unlike [38], [15].”
Self-citationConsistent Visual Quality Control in Video Coding
Xu, L., Li, S., Ngan, K. N., & Ma, L. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2243657 · Cited by 27
“The spatial masking effect was investigated elaborately in the past research [9], [12]–[14].”
BackgroundInfluentialSpatial-temporal Video Quality Metric based on an estimation of QoE
Amirshahi, S. A., & Larabi, M. (2011) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2011.6065718 · Cited by 28
“In the later case most metrics combine results from a spatial approach and a temporal approach at the last step of the pooling procedure [5].”
No-Reference View Synthesis Quality Prediction for 3-D Videos Based on Color–Depth Interactions
Shao, F., Yuan, Q., Lin, W., & Jiang, G. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2748460 · Cited by 25
“We compare the performance of the proposed HEVSQP model on the NBU-3D Synthesized Video Quality Database with nine existing quality metrics, including three 2D IQA metrics (PSNR, SSIM [12], VIFP [13]), three 2D VQA metrics (MOVIE [22], VADM [24], and V-BLIINDS [26]), three 3D metrics (BEQM [35], 3D-DQE [42], and StSD…”
MethodInfluentialTemporal Reasoning Guided QoE Evaluation for Mobile Live Video Broadcasting
Chen, P., Li, L., Wu, J., Zhang, Y., & Lin, W. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060255 · Cited by 29
“This allows to combine the perceptual VQA indexes, which could be further classified as full-reference (FR) [18]–[22], reduced-reference (RR) [23]–[26] or no-reference (NR) [27]–[34] depending on whether entire or part of the original reference video is available during the evaluation process, and…”
BackgroundHigh-Efficiency 3D Depth Coding Based on Perceptual Quality of Synthesized Video
Zhang, Y., Yang, X., Liu, X., Zhang, Y., Jiang, G., & Kwong, S. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2615290 · Cited by 26
“Moreover, we compared the performance of the proposed SVQM with the state-of-the-art objective image and video quality metrics, including PSNR, SSIM [23], VQM [29], MOVIE [30] and PSPTNR [27], as well as the VQA for the synthesized video in [28] (denoted by 'VQA_SIAT').”
Audio-driven Neural Gesture Reenactment with Video Motion Graphs
Zhou, Y., Yang, J., Li, D., Saito, J., Aneja, D., & Kalogerakis, E. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00341 · Cited by 38
“To evaluate the quality of the generated video, we adopt the metric, MOVIE [57] index, to evaluate the video distortion in spatio-temporal aspects.”
MethodVideo Compression Artifacts Removal With Spatial-Temporal Attention-Guided Enhancement
Jiang, N., Chen, W., Lin, J., Zhao, T., & Lin, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3338087 · Cited by 31
Video quality assessment by compact representation of energy in 3D-DCT domain
He, L., Lu, W. B., Jia, C., & Hao, L. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.08.143 · Cited by 26
Helmrich, C. R., Siekmann, M., Becker, S., Bosse, S., Marpe, D., & Wiegand, T. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054089 · Cited by 34
“Naturally, more sophisticated, but computationally more complex, temporal activity measures that account for block-internal motion between frames i, i –1 and if applicable, i – 2 before subjecting si to the temporal filter ht in i may be devised [15], [16].”
BackgroundNo-Reference Video Quality Assessment Using Space-Time Chips
Ebenezer, J. P., Shang, Z., Wu, Y., Wei, H., & Bovik, A. C. (2020) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp48831.2020.9287151 · Cited by 29
“Motion has been used to guide video quality prediction in several full-reference models [9], [14], [15], but few NR models [1], [16].”
BackgroundMethodSelf-citationQuality assessment of DIBR-synthesized views: An overview
Tian, S., Zhang, L., Zou, W., Li, X., Su, T., Morin, L., & Déforges, O. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.062 · Cited by 26
A Study of Subjective and Objective Quality Assessment of HDR Videos
Shang, Z., Ebenezer, J. P., Venkataramanan, A. K., Wu, Y., Wei, H., Sethuraman, S., & Bovik, A. C. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3333217 · Cited by 33
“More recent popular VQA models include Structural Similarity (SSIM) [19], Multiscale SSIM (MS-SSIM) [29], Gradient Magnitude Similarity Deviation (GMSD) [30], most apparent distortion (MAD) [31], visual information fidelity (VIF) [20], and FSIM [32], among others [33], [34], [35], [36].”
MethodSelf-citationSSIM-based video admission control and resource allocation algorithms
Zanforlin, M., Munaretto, D., Zanella, A., & Zorzi, M. (2014) · International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) · doi:10.1109/wiopt.2014.6850361 · Cited by 28
“, specially when the scope of the work is to express the perceived quality of sequential static images coded at different levels of compression, as in our work.”
BackgroundPacket losses and objective video quality metrics in H.264 video streaming
Tommasi, F., Luca, V. D., & Melle, C. (2014) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2014.12.003 · Cited by 24
Efficient motion weighted spatio-temporal video SSIM index
Moorthy, A. K., & Bovik, A. C. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.844198 · Cited by 27
“Recently, Seshadrinathan and Bovik proposed the Motion-based Video Integrity Evaluation (MOVIE) index for VQA.7,11 MOVIE utilized a multi-scale spatio-temporal Gabor filter bank to decompose the videos and to compute motion vectors.”
MethodSelf-citationHong, W., & Yu, L. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2780285 · Cited by 24
“, motion masking [4], and binocular properties, e.”
BackgroundThe Performance of Quality Metrics in Assessing Error-Concealed Video Quality
Kazemi, M., Ghanbari, M., & Shirmohammadi, S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984356 · Cited by 15
“MOtion-based Video Integrity Evaluation (MOVIE) index is computed based on the structural difference of the spatio-temporal Gabor filtered original and the processed video sequences [33].”
Method
Metadata
- Authors
- Seshadrinathan, K., & Bovik, A. C.
- Affiliations
- Intel (United States) (US)
- The University of Texas at Austin (US)
- ORCID
- Bovik, A.C.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2010-02
- Volume
- 19
- Issue
- 2
- Pages
- 335-350
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2165222134
- Semantic Scholar
- cac2475bcbb52641ac02e7fe046e808d01e4eaaf
- Cited by
- 708
- References
- 83
- Citations by year
- 2026: 14 · 2025: 16 · 2024: 25 · 2023: 31 · 2022: 43 · 2021: 50 · 2020: 41 · 2019: 41 · 2018: 60 · 2017: 59 · 2016: 52 · 2015: 59 · 2014: 69 · 2013: 43 · 2012: 48
- FWCI
- 38.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- video quality assessment, subjective quality correlation, movement trajectories
- MeSH terms
- Algorithms, Humans, Image Processing, Computer-Assisted, Movement, Video Recording, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.