The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index; 12 of the 89 sources its claims cite were checked for support.
Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Abstract
There has recently been a great deal of interest in the development of algorithms that objectively measure the integrity of video signals. Since video signals are being delivered to human end users in an increasingly wide array of applications and products, it is important that automatic methods of video quality assessment (VQA) be available that can assist in controlling the quality of video being delivered to this critical audience. Naturally, the quality of motion representation in videos plays an important role in the perception of video quality, yet existing VQA algorithms make little direct use of motion information, thus limiting their effectiveness. We seek to ameliorate this by developing a general, spatio-spectrally localized multiscale framework for evaluating dynamic video fidelity that integrates both spatial and temporal (and spatio-temporal) aspects of distortion assessment. Video quality is evaluated not only in space and time, but also in space-time, by evaluating motion quality along computed motion trajectories. Using this framework, we develop a full reference VQA algorithm for which we coin the term the MOtion-based Video Integrity Evaluation index, or MOVIE index. It is found that the MOVIE index delivers VQA scores that correlate quite closely with human subjective judgment, using the Video Quality Expert Group (VQEG) FRTV Phase 1 database as a test bed. Indeed, the MOVIE index is found to be quite competitive with, and even outperform, algorithms developed and submitted to the VQEG FRTV Phase 1 study, as well as more recent VQA algorithms tested on this database.
Overview
CoChat Summary
TL;DR
The paper develops MOVIE, a full-reference video quality assessment index that integrates spatial and temporal/motion quality using spatio-temporal Gabor decomposition and motion trajectories. On the VQEG FRTV Phase 1 database, MOVIE correlates closely with subjective scores and is competitive with or outperforms several leading VQA algorithms.
Key findings
- On the entire VQEG FRTV Phase 1 database, MOVIE achieved SROCC 0.833, LCC 0.821, and OR 0.644, compared with PSNR SROCC 0.786, Proponent P8 SROCC 0.803, and SSIM with weighting SROCC 0.812.
- On only the 16 natural videos and their distorted versions (256 videos), MOVIE achieved SROCC 0.860, LCC 0.858, OR 0.656, and RMSE 8.093; PSNR had SROCC 0.739 and SSIM without weighting had SROCC 0.802.
- Temporal MOVIE alone outperformed Spatial MOVIE on the entire database (SROCC 0.816 vs. 0.793) and on natural videos (SROCC 0.835 vs. 0.825), and combining both improved over either separately.
- The RMSE between subjective scores and MOVIE scores after nonlinear regression on the entire VQEG database was 8.76; the outlier ratio using the three-sigma rule was 0.488 on the entire database and 0.461 on natural videos.
Methods
- MOVIE is a full-reference VQA framework: reference and test videos are decomposed with a Gabor filterbank; spatial quality uses divisive normalization/contrast masking inspired by SSIM and information-theoretic IQA; temporal quality uses optical flow from the reference via a multi-scale Fleet–Jepson algorithm and motion-tuned weighted Gabor responses; spatial and temporal scores are pooled using coefficient-of-variation frame descriptors and a product.
- Evaluation used the VQEG FRTV Phase 1 database: 20 reference sequences and 16 distorted versions of each, totaling 320 videos; the algorithm ran on one field of interlaced video and ignored color. A separate natural-video analysis used 16 references and 256 videos after omitting 4 animated sources.
- Performance was measured with SROCC, LCC after logistic nonlinear regression, outlier ratio, and RMSE, and compared against PSNR, SSIM variants, and VQEG proponent models.
Limitations
- The paper states that MOVIE ignores color information and uses only one field of interlaced video; color is listed as a future improvement.
- The paper states that temporal pooling is a simple mean of frame-level descriptors, with more advanced temporal pooling left for future work; it also notes that the model is implicitly geared toward natural videos, and 4 animated sequences are omitted from the natural-video table because they contain synthetic properties and text.
- The paper states that evaluation is limited to the VQEG FRTV Phase 1 database, that VQM performance is not reported because VQM was trained on VQEG data, and that some compared algorithms’ reported performance is from the 2000 VQEG study and may have improved since.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
10 Valid · 9 Not valid · 43 Not checked · 80 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This study reveals that cells in V1 that project to MT may be regarded as local motion energy filters that are spatio-temporally separable and tuned to a specific frequency and orientation (such as the Gabor filters used here).”
What the sources say
- Partly supportedcites [35] [35] J. A. Movshon and W. T. Newsome, 'Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys,' Journal Neuroscience , vol. 16, no. 23, pp. 7733-7741, 1996. - sourceExperimental — accuracy not yet measured
The Discussion describes V1 neurons projecting to MT as local motion energy filters responsive within bandpass limits for orientation and spatial and temporal frequency. The spatial and temporal receptive-field results report frequency tuning, but our copy does not establish that these neurons are spatiotemporally separable. (LLM, conf=0.87)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Further, the responses of several spatio-temporally separable responses can be combined to encode the local speed and direction of motion of the video sequence [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Partly supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - sourceExperimental — accuracy not yet measured
The MT pattern cells section says the model combines responses from V1 cells to produce selectivity for velocity, which includes speed and direction. But the Spatio-temporal frequency tuning section says the model's V1 responses are not spatially and temporally separable; separable tuning is described as a possible alternative, not a feature of the model. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Translational motion has an easily accessible representation in the frequency domain and these ideas have been used to build motion estimation algorithms for video [8], [57], [58].”
What the sources say
- Not checked — no full text of the sourcecites [8] [8] A. B. Watson and J. Ahumada, A. J., 'Model of human visual-motion sensing,' Journal Optical Society America A: Optics Image Science Vision , vol. 2, no. 2, pp. 322-342, 1985. - source
- Not checked — no full text of the sourcecites [57] [57] D. J. Heeger, 'Optical flow using spatiotemporal filters,' Intl. Journal Computer Vision , vol. 1, no. 4, pp. 279-302, 1987. - source
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The MT pattern cells section states that the power spectrum of a translating two-dimensional pattern lies on a plane in the spatio-temporal frequency domain, with the plane’s orientation determined by velocity. The paper uses this representation to explain its model, supporting the attributed claim. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Our temporal quality computation bears several similarities with the neuronal model of MT in [58], [72]. Similarities include the weighting procedure based on the distance between the linear filters and the motion plane and the normalization of weighted responses.”
What the sources say
- Supportedcites [58] [58] E. P. Simoncelli and D. J. Heeger, 'A model of neuronal responses in visual area MT.' Vision Research , vol. 38, no. 5, pp. 743-761, Mar 1998. - source
The Additional information section says the MT weighting depends on Euclidean distance to the preferred velocity plane. The MT pattern cells section says MT responses are computed from a weighted sum of V1 inputs and then normalized. Together, these support the similarities attributed to this model. (LLM, conf=0.93)
- Not checked — no full text of the sourcecites [72] [72] N. C. Rust, V. Mante, E. P. Simoncelli, and J. A. Movshon, 'How MT cells analyze the motion of visual patterns.' Nature Neuroscience , vol. 9, no. 11, pp. 1421-1431, Nov 2006. - source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Root Mean Squared Error (RMSE) between subjective scores and MOVIE scores after non-linear regression on the entire VQEG database is 8.76.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims
Create a free account to see all 142 claims and to verify the 2 references still open.
- Probably not a substantial claim. 48
- It may state two separate claims as one. 41
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One reason frame-by-frame IQA performs less well for VQA is because it ignores temporal information, which is important for video quality due to temporal effects, such as temporal masking and motion perception.3,4”
From ViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices (2014) · cites this paper as [4]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Each of these filters has a standard deviation of 2 . 65 pixels along both spatial coordinates and 2 . 65 frames along the temporal axis. In our implementation, the Gabor filters were sampled out to a width of three standard deviations; so the support of the kernels at the finest scale are 15 pixels and 15 frames along the spatial and temporal axes respectively.”
Reported 15 · recomputed 15.9
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citation(1981) · Cited by 11,963
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
Self-citationA universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Self-citationComputational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Self-citationSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Research works printed but not linked: 7
- webster, 2008, progress and future plans for vqeg, ETSI STQ Workshop Multimedia Quality of Service
- fox, 1978, Handbook of Sensory Physiology Volume VIII Perception
- lubin, 1993, Digital Images and Human Vision, 163
- seshadrinathan, 2007, an information theoretic video quality metric based on motion models, 1st Int Workshop Video Process Quality Metrics Consum Electron
- girod, 1993, Digital Images and Human Vision, 207
- 0, (2008) NTT News Release
- 2008, Objective Perceptual Multimedia Video Quality Measurement in the Presence of a Full Reference
Cited by
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
“1 and is labeled as the DI-IVINE index.”
BackgroundSelf-citationBlind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
“Unlike much of the prior work on image/video quality assessment (QA) [1], [2], [4], [23], [24], we make little direct use of specific perceptual models such as area V1 cortical Fig.”
BackgroundSelf-citationStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
“However, this difference in performance is not statistically significant and further, MOVIE performs better than Temporal MOVIE on the wireless and IP videos in terms of LCC and on the VQEG database [43].”
BackgroundMethodResultInfluentialSelf-citationReal-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation
Caballero, J., Ledig, C., Aitken, A., Acosta, A., Totz, J., Wang, Z., & Shi, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.304 · Cited by 763
“The metrics compared are PSNR, structural similarity (SSIM) [40] and MOVIE [31] indices.”
MethodObjective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613
“The model described two indices, namely a Spatial MOVIE index that primarily captures spatial distortions and a Temporal MOVIE index that captures temporal distortions.”
BackgroundMethodInfluential
Metadata
- Authors
- Seshadrinathan, K., & Bovik, A. C.
- Affiliations
- Intel (United States) (US)
- The University of Texas at Austin (US)
- ORCID
- Bovik, A.C.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2010-02
- Volume
- 19
- Issue
- 2
- Pages
- 335-350
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2165222134
- Semantic Scholar
- cac2475bcbb52641ac02e7fe046e808d01e4eaaf
- Cited by
- 708
- References
- 83
- Citations by year
- 2026: 14 · 2025: 16 · 2024: 25 · 2023: 31 · 2022: 43 · 2021: 50 · 2020: 41 · 2019: 41 · 2018: 60 · 2017: 59 · 2016: 52 · 2015: 59 · 2014: 69 · 2013: 43 · 2012: 48
- FWCI
- 38.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- video quality assessment, subjective quality correlation, movement trajectories
- MeSH terms
- Algorithms, Humans, Image Processing, Computer-Assisted, Movement, Video Recording, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos. https://app.cochat.ai/papers/10.1109/tip.2009.2034992
- The paper
- Seshadrinathan, K., & Bovik, A. C. (2010). Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2009.2034992
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.