Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index; 12 of the 89 sources its claims cite were checked for support.
Abstract
There has recently been a great deal of interest in the development of algorithms that objectively measure the integrity of video signals. Since video signals are being delivered to human end users in an increasingly wide array of applications and products, it is important that automatic methods of video quality assessment (VQA) be available that can assist in controlling the quality of video being delivered to this critical audience. Naturally, the quality of motion representation in videos plays an important role in the perception of video quality, yet existing VQA algorithms make little direct use of motion information, thus limiting their effectiveness. We seek to ameliorate this by developing a general, spatio-spectrally localized multiscale framework for evaluating dynamic video fidelity that integrates both spatial and temporal (and spatio-temporal) aspects of distortion assessment. Video quality is evaluated not only in space and time, but also in space-time, by evaluating motion quality along computed motion trajectories. Using this framework, we develop a full reference VQA algorithm for which we coin the term the MOtion-based Video Integrity Evaluation index, or MOVIE index. It is found that the MOVIE index delivers VQA scores that correlate quite closely with human subjective judgment, using the Video Quality Expert Group (VQEG) FRTV Phase 1 database as a test bed. Indeed, the MOVIE index is found to be quite competitive with, and even outperform, algorithms developed and submitted to the VQEG FRTV Phase 1 study, as well as more recent VQA algorithms tested on this database.
Overview
CoChat Summary
TL;DR
The paper develops MOVIE, a full-reference video quality assessment index that integrates spatial and temporal/motion quality using spatio-temporal Gabor decomposition and motion trajectories. On the VQEG FRTV Phase 1 database, MOVIE correlates closely with subjective scores and is competitive with or outperforms several leading VQA algorithms.
Key findings
- On the entire VQEG FRTV Phase 1 database, MOVIE achieved SROCC 0.833, LCC 0.821, and OR 0.644, compared with PSNR SROCC 0.786, Proponent P8 SROCC 0.803, and SSIM with weighting SROCC 0.812.
- On only the 16 natural videos and their distorted versions (256 videos), MOVIE achieved SROCC 0.860, LCC 0.858, OR 0.656, and RMSE 8.093; PSNR had SROCC 0.739 and SSIM without weighting had SROCC 0.802.
- Temporal MOVIE alone outperformed Spatial MOVIE on the entire database (SROCC 0.816 vs. 0.793) and on natural videos (SROCC 0.835 vs. 0.825), and combining both improved over either separately.
- The RMSE between subjective scores and MOVIE scores after nonlinear regression on the entire VQEG database was 8.76; the outlier ratio using the three-sigma rule was 0.488 on the entire database and 0.461 on natural videos.
Methods
- MOVIE is a full-reference VQA framework: reference and test videos are decomposed with a Gabor filterbank; spatial quality uses divisive normalization/contrast masking inspired by SSIM and information-theoretic IQA; temporal quality uses optical flow from the reference via a multi-scale Fleet–Jepson algorithm and motion-tuned weighted Gabor responses; spatial and temporal scores are pooled using coefficient-of-variation frame descriptors and a product.
- Evaluation used the VQEG FRTV Phase 1 database: 20 reference sequences and 16 distorted versions of each, totaling 320 videos; the algorithm ran on one field of interlaced video and ignored color. A separate natural-video analysis used 16 references and 256 videos after omitting 4 animated sources.
- Performance was measured with SROCC, LCC after logistic nonlinear regression, outlier ratio, and RMSE, and compared against PSNR, SSIM variants, and VQEG proponent models.
Limitations
- The paper states that MOVIE ignores color information and uses only one field of interlaced video; color is listed as a future improvement.
- The paper states that temporal pooling is a simple mean of frame-level descriptors, with more advanced temporal pooling left for future work; it also notes that the model is implicitly geared toward natural videos, and 4 animated sequences are omitted from the natural-video table because they contain synthetic properties and text.
- The paper states that evaluation is limited to the VQEG FRTV Phase 1 database, that VQM performance is not reported because VQM was trained on VQEG data, and that some compared algorithms’ reported performance is from the 2000 VQEG study and may have improved since.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
10 Valid · 9 Not valid · 43 Not checked · 80 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This study reveals that cells in V1 that project to MT may be regarded as local motion energy filters that are spatio-temporally separable and tuned to a specific frequency and orientation (such as the Gabor filters used here).”
What the sources say
- Partly supportedcites [35] [35] J. A. Movshon and W. T. Newsome, 'Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys,' Journal Neuroscience , vol. 16, no. 23, pp. 7733-7741, 1996. - sourceExperimental — accuracy not yet measured
The Discussion describes V1 neurons projecting to MT as local motion energy filters responsive within bandpass limits for orientation and spatial and temporal frequency. The spatial and temporal receptive-field results report frequency tuning, but our copy does not establish that these neurons are spatiotemporally separable. (LLM, conf=0.87)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Further, the responses of several spatio-temporally separable responses can be combined to encode the local speed and direction of motion of the video sequence [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Partly supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - sourceExperimental — accuracy not yet measured
The MT pattern cells section says the model combines responses from V1 cells to produce selectivity for velocity, which includes speed and direction. But the Spatio-temporal frequency tuning section says the model's V1 responses are not spatially and temporally separable; separable tuning is described as a possible alternative, not a feature of the model. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Translational motion has an easily accessible representation in the frequency domain and these ideas have been used to build motion estimation algorithms for video [8], [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [8] [8] A. B. Watson and J. Ahumada, A. J., 'Model of human visual-motion sensing,' Journal Optical Society America A: Optics Image Science Vision , vol. 2, no. 2, pp. 322-342, 1985. - source
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The MT pattern cells section states that the power spectrum of a translating two-dimensional pattern lies on a plane in the spatio-temporal frequency domain, with the plane’s orientation determined by velocity. The paper uses this representation to explain its model, supporting the attributed claim. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Our temporal quality computation bears several similarities with the neuronal model of MT in [58], [72]. Similarities include the weighting procedure based on the distance between the linear filters and the motion plane and the normalization of weighted responses.”
What the sources say
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The Additional information section says the MT weighting depends on Euclidean distance to the preferred velocity plane. The MT pattern cells section says MT responses are computed from a weighted sum of V1 inputs and then normalized. Together, these support the similarities attributed to this model. (LLM, conf=0.93)
- Not checked — no full text of the sourcecites [72] [72] N. C. Rust, V. Mante, E. P. Simoncelli, and J. A. Movshon, 'How MT cells analyze the motion of visual patterns.' Nature Neuroscience , vol. 9, no. 11, pp. 1421-1431, Nov 2006. - source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Root Mean Squared Error (RMSE) between subjective scores and MOVIE scores after non-linear regression on the entire VQEG database is 8.76.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims
Create a free account to see all 142 claims and to verify the 2 references still open.
- Probably not a substantial claim. 48
- It may state two separate claims as one. 41
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One reason frame-by-frame IQA performs less well for VQA is because it ignores temporal information, which is important for video quality due to temporal effects, such as temporal masking and motion perception.3,4”
From ViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices (2014) · cites this paper as [4]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Each of these filters has a standard deviation of 2 . 65 pixels along both spatial coordinates and 2 . 65 frames along the temporal axis. In our implementation, the Gabor filters were sampled out to a width of three standard deviations; so the support of the kernels at the finest scale are 15 pixels and 15 frames along the spatial and temporal axes respectively.”
Reported 15 · recomputed 15.9
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citation(1981) · Cited by 11,963
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
Self-citationA universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Self-citationComputational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Self-citationSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Research works printed but not linked: 7
- webster, 2008, progress and future plans for vqeg, ETSI STQ Workshop Multimedia Quality of Service
- fox, 1978, Handbook of Sensory Physiology Volume VIII Perception
- lubin, 1993, Digital Images and Human Vision, 163
- seshadrinathan, 2007, an information theoretic video quality metric based on motion models, 1st Int Workshop Video Process Quality Metrics Consum Electron
- girod, 1993, Digital Images and Human Vision, 207
- 0, (2008) NTT News Release
- 2008, Objective Perceptual Multimedia Video Quality Measurement in the Presence of a Full Reference
Cited by
Items 601–700 of 717
Reduced-Reference Video Quality Metric Using Spatio-Temporal Activity Information
Rahman, F. D. A., Ibrahim, A. I., & Agrafiotis, D. K. (2018) · TELKOMNIKA (Telecommunication Computing Electronics and Control) · doi:10.12928/telkomnika.v16i2.9044 · Cited by 2
“More advanced FR metrics that take into account more perceptual aspects include the visual signal-to-noise ratio (VSNR) [3], video quality model (VQM) [4], motion tuned spatial-temporal quality assessment method (MOVIE) [5], spatio-temporal most apparent-distortion (STMAD) [6] and perception-based video quality metric…”
BackgroundGradient based full reference video quality assessment
Seyedebrahim, M., & Mansouri, A. (2017) · Iranian Conference on Machine Vision and Image Processing · doi:10.1109/iranianmvip.2017.8342370 · Cited by 1
A novel no-reference video quality assessment algorithm
Yang, L. F., Yang, Y., & Ma, Y. (2018) · IEEE Information Technology and Mechatronics Engineering Conference (ITOEC) · doi:10.1109/itoec.2018.8740719 · Cited by 1
Video quality assessment based on LOG filtering of videos and spatiotemporal slice images
Yan, P., & Mou, X. (2019) · Optoelectronic Imaging and Multimedia Technology · doi:10.1117/12.2536872 · Cited by 1
“2 , 1 = ( ) ( ) ( , ) 2 y t V STS f v x, y,t x g y t (6)”
Exploring the Gradient for Video Quality Assessment
Motamednia, H., Cheraaqee, P., & Mansouri, A. (2020) · Iranian Conference on Machine Vision and Image Processing · doi:10.1109/mvip49855.2020.9116869 · Cited by 1
“It is shown that the sensitivity of HVS to spatial artifacts decreases in fast motions [16].”
BackgroundMethodNo‐reference quality assessment of dynamic sports videos based on a spatiotemporal motion model
Kim, H., Shin, S., Kim, S., & Lee, G. Y. (2021) · ETRI Journal · doi:10.4218/etrij.2020-0160 · Cited by 1
“Seshadrinathan and Bovik [8] presented an FR-VQA method to evaluate dynamic video fidelity by integrating both spatial and temporal aspects of distortion assessment.”
MethodEnhanced optical flow-based full reference video quality assessment algorithm
Gujjunoori, S., Oruganti, M., & Pais, A. R. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12591-y · Cited by 2
IPTV Multiservice QoE Management System
Sánchez, A. C., Cutanda‐Rodriguez, M., Pérez‐Montero, A., Rogles, E., Gutiérrez, J., & Jaureguizar, F. (2014) · Wiley eBooks · doi:10.1002/9781118984352.ch5 · Cited by 1
3D video quality assessmentPreprint
Dehkordi, A. B. (2016) · arXiv (Cornell University) · doi:10.14288/1.0166613 · Cited by 1
“122 xi List of Figures Figure 2.1 Illustration of the proposed quality assessment technique .............................. 18 Figure 2.2 Selecting the best match: AD is the approximate corresponding block of AL in the right view + disparity; AR is the best match to AL within a search range .................... 19 Figu…”
BackgroundMethodInfluentialVisual saliency in image quality assessment
Zhang, W. (2017) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 2
Video quality assessment using subjective and objective metrics
Gaurav, R. (2013) · Akademik Açık Erişim (Işık Üniversitesi) · Cited by 1
Ling, S., Li, J., Che, Z., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.12107 · Cited by 1
“Motion plays a vital role in visual perception of the contents and the perceived quality of sequence since 1) clues related to the objects’ shapes are provided; 2) in most cases, visual attention is tend to be drawn on moving objects [24], [25], [26].”
BackgroundLearning for Video Super-Resolution through HR Optical Flow EstimationPreprint
Wang, L., Guo, Y., Lin, Z., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08573 · Cited by 1
“The MOVIE and VQM-VFD metrics are correlated with human perception and widely applied in video quality assessment.”
MethodInfluentialNeural Image Beauty Predictor Based on Bradley-Terry ModelPreprint
Li, S., Ma, H., & Hu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10127 · Cited by 2
“Image assessment includes the evaluation of image similarity, image quality assessment (IQA) or range of distortion including blocking, blur or noise [3], [5], [29], [34], [35], [42].”
BackgroundLuna, R., Zabaleta, I., & Bertalmı́o, M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.22.521587 · Cited by 1
Analyse et modélisation de la qualité perçue des applications de visiophonie
Saidi, I. (2018) · theses.fr (ABES) · doi:10.70675/5d295a30z98ecz4e27z9badz314b64828434 · Cited by 1
No-reference Video Quality Assessment and Applications
Zhu, K. (2014) · KOPS (University of Konstanz) · Cited by 1
Measuring MPEG Frame Loss Rate to Evaluate the Quality of Experience in IPTV Services
Hernando‐Loeda, D., de Vergara, J. E. L., Aracil, J., Madrigal, D., & Mata, F. (2014) · doi:10.1002/9781118984352.ch3
Affect-based Modeling and its Application in Multimedia Analysis Problems
Bhattacharya, A. (2012) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fi12081301
Which metric can predict coding gain of H.265/HEVC over H.264/AVC?
Xiao, J., Song, L., Luo, Z., et al. (2015) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb.2015.7177228
“MOVIE [15], take account of both spatial and temporal information but often have high computational complexities.”
BackgroundVideo Content-Based QoE Prediction for HEVC Encoded Videos Delivered over IP Networks
Anegekuh, L. (2015) · PEARL (University of Plymouth) · doi:10.24382/4574
A simplified subjective video quality assessment method based on signal detection theory
de-Frutos-López, M., Mejia-Ocana, A. B., Sanz-Rodríguez, S., Peláez-Moreno, C., Díaz-de-María, F., & Pizlo, Z. (2012) · Picture Coding Symposium · doi:10.1109/pcs.2012.6213336
“Popular VQA algorithms using this approach include the Video Quality Metric (VQM) [4], extensions of the Structural SIMilarity (SSIM) index [5] for video signals [6], and the recently proposed MOtion-based Video INtegrity Evaluation (MOVIE) index [7].”
MethodQuality assessment of perceptual color video based on a top-down framework and quaternion
Li, J., Wang, X., Li, G., Zhang, F., & Feng, D. D. (2013) · Multimedia Tools and Applications · doi:10.1007/s11042-013-1506-9
“Video quality assessment (VQA) has both scientific and practical significance, and as such has been intensively investigated for over two decades [6, 25].”
Video quality metric based on fixation prediction and foveal imaging
You, J., Ebrahimi, T., & Perkis, A. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6467158
“VQM [2], the MOVIE video quality index [11], and PSNR were also included in our experiments as reference.”
MethodNetwork video quality assessment based on MDI
Shi, Z., & Liu, H. (2013) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2013.6649315
“Video quality prediction models presents in [9] [10] consider encoder based distortions only and those in [11] [12] are based on video content features.”
BackgroundA Framework to Measure and Estimate Video Quality in SVC Real-Time Adaptive Systems
Fernández-Álvarez, A.-M., Pozueco, L., Cabrero, S., et al. (2014) · International Journal of Business Data Communications and Networking · doi:10.4018/ijbdcn.2014010103
“More advanced metrics such as MOVIE (Seshadrinathan & Bovik, 2010) introduce temporal and spatial considerations.”
BackgroundCapturing structural distortions in digital images and videos
Peng, P. (2012) · Summit (Simon Fraser University)
New Method for Spatial Scalable Video Quality Evaluation
Chen, C., Ji, W., Chen, B.-W., et al. (2015) · International Conference on Platform Technology and Service · doi:10.1109/platcon.2015.11
“Attempts have been made to measure the visual quality degradation which include structural similarity (SSIM) [5], multi-scale structural similarity [6], visual information fidelity(VIF) [7], visual contrast (VSNR) [8], perceptual distortion metric (PDM) for color video [9], peak signal-to-perceptualnoise ratio (PSPNR)…”
MethodAn FPGA-based hardware accelerator for simulating spatiotemporal neurons
Tarawneh, G., & Read, J. C. A. (2014) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs.2014.7050061
“In computer vision, spatiotemporal Gabor filters are used in motion detection [7], optical flow sensing [8], object recognition [9] and have been successfully applied in video quality assessment [10] and facial expression recognition [11].”
BackgroundMantel, C., Ladret, P., & Kunlin, T. (2011) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.871597
Network parameters for network video quality assessment
Shi, Z., & Liu, H. (2013) · Wireless Personal Multimedia Communications
VISUALLY LOSSLESS LEVEL VIDEO QUALITY ASSESSMENT: NRDPF-VQA
Rao, D. V. B., & Rani, N. U. (2015)
No-Reference Video Quality Assessment
Kulkarni, Y. R., & Kulkarni, C. V. (2014)
Imaging for the Automotive Environment
Denny, P. E., Jones, E., Glavin, M., Hughes, C., & Deegan, B. M. (2015) · Handbook of Visual Display Technology · doi:10.1007/978-3-642-35947-7_208-1
Learning based signal quality assessment for multimedia communications
Narwaria, M. (2012) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/50753
“The other a lgorithms being compared include the widely used PSNR, Speed-SSIM [78], V-VIF [82], the VQM [79], the algorithm based on ABT-JND model [196], MC-SSIM [75] and MOVIE [66] .”
MethodResultInfluentialCross-layer performance analysis and adaptation for real-time wireless video streaming
Loiacono, M. (2011) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3zs2w41
“The human eye is very sensitive to motion and can accurately judge the velocity and direction of motion of objects in a scene [3, 60].”
BackgroundMethodInfluentialVisual attention and perception models for assessing quality in 2D and 3D stereoscopic video
Velasco, J. P. L. (2016) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.39380
Video quality assessment based on a modified mean squared error
Loh, W.-T., Voo, K. H. B., & Bong, D. B. L. (2015) · IEEE International Conference on Signal and Image Processing Applications (ICSIPA) · doi:10.1109/icsipa.2015.7412242 · Cited by 1
“One of the famous VQA with competent performance is motion-based video integrity evaluation (MOVIE) algorithm proposed by Seshadrinathan and Bovik [13].”
MethodBlind Image Quality Assessment is Not Impossible Plenary Talk
Bovik, A. C. (2010) · Imaging and Applied Optics · doi:10.1364/dipa.2010.dma1
“I do believe that there is more room for improvement in objective video quality assessment (VQA), owing to the possibilities afforded by better models of motion perception [14], but I also think that a similar plateau in performance may soon be reached; progress on FR QA will thereafter be slow, absent an epiphany con…”
BackgroundSelf-citationPerformance Evaluation of Blind Image Quality Assessment on Deconvolving Images
Likhitha, R., & Ramesh, K. (2014) · International Journal of Advanced Research in Electrical Electronics and Instrumentation Engineering · doi:10.15662/ijareeie.2014.0308088
“Early methods for quality assessment focus on the quality degradation due to compression and network transmission [4, 12, 24, 28, 22, 23, 19, 27, 30, 32, 31, 24, 34, 2].”
MethodReduced frame set on wireless distorted video for quality assessment
Shao, H., Xiangming, W., Zhaoming, L., et al. (2016) · 中国邮电高校学报:英文版 · doi:10.1016/s1005-8885(16)60048-1
Perceptual Video Quality Assessment and Enhancement
Zeng, K. (2013) · UWSpace (University of Waterloo)
Čadík, M., & Aydın, T. O. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809477-8.00005-4
“The same authors published the MOVIE index in a follow-up work [20], which outputs two separate video quality streams for every 16 th frame of the assessed video: spatial (closely related to the structure term of SSIM) and temporal (assessment of the motion quality based on optical flow fields).”
BackgroundSaliency in objective video quality assessment: What is the ground truth?
Zhang, W., & Liu, H. (2016) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2016.7813333
“Table I shows the performance (in terms of CC and SROCC) of individual VQMs with and without saliency weighting when TABLE IV COMPARISON OF PERFORMANCE FOR VQMS WEIGHTED WITH GROUND-TRUTH SALIENCY AND MODELLED SALIENCY (BASED ON THREE SALIENCY MODELS, NAMELY GBVS, SDSR AND SR). original ground-truth GBVS SDSR SR PSNR…”
BackgroundInfluentialNR Video Quality Metric with Visual Saliency from H.264 Code Stream in Lossy Network ChannelsPreprint
Boujut, H., Benois‐Pineau, J., Ahmed, T., et al. (2012) · HAL (Le Centre pour la Communication Scientifique Directe)
Subjective and Objective Quality-of-Experience of Adaptive Video Streaming
Duanmu, Z. (2017) · UWSpace (University of Waterloo)
Video Quality Assessment by Decoupling Distortions on Primary Visual Information
Li, Y., Wang, X., Li, F., Guo, Q., Fan, Q., Peng, Q., Luo, W., Feng, M., Yuan, X., & Liu, S. (2017) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-72998-5_32
Bivariate statistics and binocular energy induced stereo-pair quality evaluator
Yao, Y., Shen, L., & An, P. (2017) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip.2017.8305062
“Therefore, many metrics adopt the theory of Gabor as their foundation [7] [16].”
BackgroundMotion-aware video quality assessment
Arvanitidou, M. G., & Sikora, T. (2017) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2017.8335727
“the case of VQA [3], [5] [6], where temporal correspondences constitute a determining factor.”
BackgroundMethodA novel way to calculate PDMOSL based on the coding parameters and network conditions
Du, L., Tian, C., Wu, Z., et al. (2017) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct.2017.8359838
“Most exiting research focuses on the full-reference model to calculate the end-to-end distortion, such as PSNR [3], SSIM [4] and MOVIE [5], but these indexes are difficult to reflect the visual feelings of human eyes.”
BackgroundToward an objective benchmark for video completion
Bokov, A., Vatolin, D. S., Ерофеев, М., et al. (2018) · Signal Image and Video Processing · doi:10.1007/s11760-018-1387-5
“Most existing digital image and video quality assessment metrics [22,28] are tailored to distortions that commonly occurinatypicalvideoacquisitionandtransmissionpipeline, including noise, blur, compression artifacts, such as blocking and ringing.”
BackgroundNo-Reference Video Quality Assessment Based on Ensemble of Knowledge and Data-Driven Models
Su, L., Cosman, P. C., & Peng, Q. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05716-9_19
“STMAD [22] and MOVIE [23] are recent VQA methods with top performance.”
MethodHVS Based Full Reference Video Quality Assessment Based on Optical Flow
Gujjunoori, S., & Oruganti, M. (2018) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1145/3243250.3243271
“Video quality assessment algorithms based on optical flow information are emerging [1, 2, 3].”
BackgroundMotion Trajectory based Spatial-Temporal Degradation Measurement for Video Quality Assessment
Wu, J., Liu, Y., & Shi, G. (2018) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip.2018.8698612
“, MOVIE [13], VQM VFD [14], stRRED [15], Vis3 [3], FePVQ [16], FLOSIM [4], SpEED [17] and Peng[5]), as well as two FR IQA models (GMSD [12] and MS-SSIM [18]) are employed for comparison.”
MethodA novel objective quality assessment method for video conferencing coding
Guan, Z., Lv, H., Ma, Y., et al. (2019) · China Communications · doi:10.12676/j.cc.2019.04.007
“Most recently, by combining both spatial and temporal aspects of distortion together, Seshadrinathan and Bovik proposed MOVIE metric [14] for objective visual quality assessment.”
BackgroundMethodInfluentialPerceptual Image and Video Quality
Ghadiyaram, D., Todd, G., Choi, L. K., & Alan, C. (2018) · doi:10.1201/9781351032742-140000489 · Cited by 1
“While extensions of SSIM to video have been shown to perform well, the leading FR VQA tool to date is the MOtion-based Video Integrity Evaluation (MOVIE) index [11].”
MethodThe Effect of Frame Rate on 3D Video Quality and BitratePreprint
Banitalebi-Dehkordi, A., Pourazad, M. T., & Nasiopoulos, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04826
“In addition, viewers tend to remember the quality of the most recent period of watched video (Like a hysteresis type effect) [41,42].”
BackgroundLahiri, A., Jain, A., & Biswas, P. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05861
Objective Video Quality Assessment Based On SURF Feature Matching
Shinde, P. S., & Dongre, Y. V. (2019) · International Conference on Computing Communication Control and automation · doi:10.1109/iccubea47591.2019.9129297 · Cited by 1
“MOVIE index has been proposed in the latest work [7], using a 3D-Gabor assessment to evaluate the quality of space, temporal quality, and Spatio-temporal quality.”
BackgroundMethodInfluentialDeep Local and Global Spatiotemporal Feature Aggregation for Blind Video Quality AssessmentPreprint
Zhou, W., & Chen, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.03411
“As shown in Table 1, the proposed method is compared with 14 state-of-the-art quality assessment metrics, including PSNR, SSIM [4], MS-SSIM [5], FSIM [6], MOVIE [7], ST-MAD [8], ViS3 [3], JVQ [9], VQM [10], STRRED [11], V-CORNIA [12], V-BLIINDS [14], VIIDEO [16], and DeepBVQA [17].”
MethodA machine-learning-driven solution to the problem of perceptual video quality metrics
Katsigiannis, S., Rabah, H., & Ramzan, N. (2020) · Institution of Engineering and Technology eBooks · doi:10.1049/pbpc034e_ch12
“Various works also examined video quality in relation to motion [15], in relation to the frame rate and quantisation [16], and in relation to network QoS and application QoS within the context of web streaming [17].”
BackgroundPerceptual Quality Assessment On DIBR Synthesized Videos With Composite Distortions
Wang, X., Wang, K., Yang, B., Li, F. W. B., & Liang, X. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9191187
“We additionally selected five typical IQA and two typical VQA models, namely VQM[19] and MOVIE[20].”
MethodThe VIP Gallery for Video Processing EducationPreprint
Goodall, T., & Bovik, A. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14625 · Cited by 1
“Another top-performing FR metric, the MOtion-based Video Integrity Evaluation (MOVIE) index, measures local motion and spatial accuracy [28].”
MethodSelf-citationConvolutional Block Design for Learned Fractional DownsamplingPreprint
Chen, L., Bampis, C. G., Li, Z., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.09999
“Fortunately, many video quality models [29]–[34] have been proposed in recent years.”
BackgroundSelf-citationMethod for Visual Video Defects Detection using Machine Learning
Fedasyuk, D. V., Lukomskyi, R., & Marusenkova, T. A. (2021) · doi:10.32782/cmis/2864-8
“Various researchers have proposed methods for determining quality based on motion information [11, 12].”
MethodObjective Video Quality Assessment with Motion Vector-based SIFT and SURF Feature MatchingPreprint
Shinde, P. S., & Dongre, Y. V. (2022) · Research Square · doi:10.21203/rs.3.rs-1572124/v1
Imaging for the Automotive Environment
Denny, P., Jones, E., Glavin, M., Hughes, C., & Deegan, B. M. (2016) · Springer eBooks · doi:10.1007/978-3-319-14346-0_208 · Cited by 1
Perceptually Correlated Image Quality Metrics
Phillips, J. B., & Eliasson, H. (2017) · Wiley eBooks · doi:10.1002/9781119054504.ch7
Wei, X., & Zhou, L. (2019) · SpringerBriefs in computer science · doi:10.1007/978-3-030-23350-1_1
AFull-Reference Video Quality Assessment Algorithm Based on MOVIE Index
Xu, Z., Jiang, X., & Ma, X. (2018) · doi:10.1109/controlo.2018.8439853
“proposed the MOtion-based Video Integrity Evaluation (MOVIE) index [5], which extends the multi-channel decomposition in the spatial domain to spatiotemporal domain and predict spatial distortion and temporal distortion respectively.”
MethodPanoramic Video Quality Assessment Based on Spatial-Temporal Convolutional Neural Networks
An, T., Sun, S., & Liu, R. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-3387-5_161
Machine Learning-Based Subjective Quality Estimation for Video Streaming Over Wireless Networks
Ghosh, M., & Singhal, C. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-6291-1.ch011 · Cited by 1
Deep Learning for Image/Video Restoration and Super-resolution
Tekalp, A. M. (2022) · doi:10.1561/9781680839739
Deng, D., & Tang, Y. (2022) · SID Symposium Digest of Technical Papers · doi:10.1002/sdtp.15958
Analysis of Video Quality Induced Spatio-Temporal Saliency Shifts
Wu, X., Dong, Z., Zhang, F., Rosin, P. L., & Liu, H. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897995 · Cited by 1
Methodology for Quantifying the Flicker Effect in Video Compression
Fedorov, V., Uzeev, A., Nezhivleva, K., Potashnikov, A., & Vlasuyk, I. V. (2022) · International Conference on Engineering Management of Communication and Technology (EMCTECH) · doi:10.1109/emctech55220.2022.9934053
“The temporary flicker masking model was first used in video quality assessments to increase the well-known MOVIE index [11] and create a new measure of video quality.”
MethodVideo Quality Assessment based on Deep Neural Network
Shi, Z. (2023) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2023.08.005
Spatio-Temporal Perception-Distortion Trade-Off in Learned Video SR
Rahimi, N., & Tekalp, A. M. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10223173 · Cited by 4
“Alternatively, MOVIE [15] integrates both spatial and temporal aspects of distortion assessment based on a spatio-spectrally localized multiscale framework.”
BackgroundRehman, U., Ali, S. F., Chung, E. S., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4635984
Uddin, A. F. M. S., Kim, D., Monira, M. S., Choi, J. W., Chung, T., & Bae, S. (2023) · Journal of Broadcast Engineering · doi:10.5909/jbe.2023.28.6.753
A 'Deep' Review of Video Super ResolutionPreprint
Gopalakrishnan, S., & Choudhury, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4679125
Estimates of Temporal Edge Detection Filters in Human Vision
Ebelin, P., Dénes, G., Akenine‐Möller, T., Åström, K., Oskarsson, M., & McIlhagga, W. (2023) · ACM Transactions on Applied Perception · doi:10.1145/3639052 · Cited by 1
“Models of human vision [ 47 ] are the basis of several popular image [ 2 , 5 , 25 ] and video quality metrics [ 24 , 38 ].”
BackgroundComplexity-Adaptive Reversible Video Information Hiding Based on Motion Vectors
Meng, Y., Niu, K., & Liang, Y. (2023) · International Conference on Computer Science and Management Technology (ICCSMT) · doi:10.1145/3644523.3644597
“On the other hand, modifications made to macroblocks with larger motion magnitudes and more scattered motion patterns in video frames are less likely to be perceived compared to modifications made to other macroblocks [8].”
BackgroundVideo QoE Modeling by Spatial-Temporal Resolutions
Mohamed, N. M. A., Wang, R., & Fang, Y. Z. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4279-3_21 · Cited by 1
A Screen Content Video Quality Assessment Model Based on Adaptive 3-D Convolution
Huang, H., Zeng, H., Chen, J., Lin, Q., Zheng, H., & Ma, K. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3568957
“…image quality assessment (IQA) models tailored for natural images (i.e., PSNR, SSIM [3], VIF [4], GMSD [5], PSIM [6]) and screen content images (i.e., SQMS [8], SVQI [9], MDOGS [10], GFM [11]), and VQA models for natural videos (i.e., MOVIE [13], SpEED [14], STMAD [15], VMAF [16], FAST [17]).”
Realism Constructs for ADS Simulation Testing
Woodlief, T., Sullivan, K., & Elbaum, S. G. (2025) · doi:10.1109/se4ads66461.2025.00012
Energy Efficiency of Video Quality Assessment Metrics
Moan, S. L., Nguyen, H. T., & Amirshahi, S. A. (2025) · Proceedings - International Conference on Image Processing · doi:10.1109/icip55913.2025.11084706
Mehta, M. A., Patel, J. K., Choudhary, A., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5601316
Ai, D., He, T., Lu, M., Wang, D., & Liu, Y. (2025) · Displays · doi:10.1016/j.displa.2025.103259 · Cited by 3
Joint model of Deep Hierarchical Network and Gabor features via Spatio-Temporal slicePreprint
Bediako, D. O., & Nornormey, E. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5899082
Joint model of Deep Hierarchical Network and Gabor features via Spatio-Temporal slicePreprint
Bediako, D. O., & Nornormey, E. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5899059
Hot Research Topics in Video Coding and Systems
Gao, W., & Ma, S. (2014) · Springer eBooks · doi:10.1007/978-3-319-14243-2_12
Temporally Aware Objective Quality Metric for Immersive Video
Stankowski, J., Sójka, B., Grajek, T., et al. (2025) · Applied Sciences · doi:10.3390/app16010274
HoloQA : Full Reference Video Quality Assessor of Rendered Human Avatars in Virtual Reality
Saha, A., Chen, Y.-C., Häne, C., Bazin, J., Katsavounidis, I. X., Chapiro, A., & Bovik, A. C. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3663930
“This is e ff ectively captured by CoV, as explained in [57].”
Self-citationResQ-UAV: A Novel Dataset Supporting Robust Recognition for Future Drone Rescue MissionsPreprint
Deng, J., Zhang, H., Liu, Z., & Yu, Z. (2026) · Research Square · doi:10.21203/rs.3.rs-8741863/v1
A No-Reference Framework for Animated Video Quality Prediction in Consumer Multimedia Applications
Mogasati, R. S., Ganavdiya, S., Poreddy, A. K. R., Appina, B., & Pachori, R. B. (2026) · IEEE transactions on consumer electronics · doi:10.1109/tce.2026.3671988
“Several research studies [20], [21] have employed the computation of non-overlapping spatiotemporal local patch decomposition for precise spatial and temporal analysis of a video.”
Fast and embeddable image and video denoising
Ferres, M. T. (2019) · theses.fr (ABES) · doi:10.70675/7fc8148dz1b54z49d1za568zbcdbb4f92754
Metadata
- Authors
- Seshadrinathan, K., & Bovik, A. C.
- Affiliations
- Intel (United States) (US)
- The University of Texas at Austin (US)
- ORCID
- Bovik, A.C.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2010-02
- Volume
- 19
- Issue
- 2
- Pages
- 335-350
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2165222134
- Semantic Scholar
- cac2475bcbb52641ac02e7fe046e808d01e4eaaf
- Cited by
- 708
- References
- 83
- Citations by year
- 2026: 14 · 2025: 16 · 2024: 25 · 2023: 31 · 2022: 43 · 2021: 50 · 2020: 41 · 2019: 41 · 2018: 60 · 2017: 59 · 2016: 52 · 2015: 59 · 2014: 69 · 2013: 43 · 2012: 48
- FWCI
- 38.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- video quality assessment, subjective quality correlation, movement trajectories
- MeSH terms
- Algorithms, Humans, Image Processing, Computer-Assisted, Movement, Video Recording, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.