A Completely Blind Video Integrity Oracle
The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index.
Abstract
Considerable progress has been made toward developing still picture perceptual quality analyzers that do not require any reference picture and that are not trained on human opinion scores of distorted images. However, there do not yet exist any such completely blind video quality assessment (VQA) models. Here, we attempt to bridge this gap by developing a new VQA model called the video intrinsic integrity and distortion evaluation oracle (VIIDEO). The new model does not require the use of any additional information other than the video being quality evaluated. VIIDEO embodies models of intrinsic statistical regularities that are observed in natural vidoes, which are used to quantify disturbances introduced due to distortions. An algorithm derived from the VIIDEO model is thereby able to predict the quality of distorted videos without any external knowledge about the pristine source, anticipated distortions, or human judgments of video quality. Even with such a paucity of information, we are able to show that the VIIDEO algorithm performs much better than the legacy full reference quality measure MSE on the LIVE VQA database and delivers performance comparable with a leading human judgment trained blind VQA model. We believe that the VIIDEO algorithm is a significant step toward making real-time monitoring of completely blind video quality possible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Self-citationMultiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“We next compared VIIDEO with five FR indices: MSE, MS-SSIM [45], MOVIE [46], VQM [47], ST-MAD [48], one RR index: STRRED [3] and one learning based blind index: V-BLIINDS [8].”
MethodSelf-citationNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064
Self-citationDaugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219 · cited 1×
“orientation selective, unlike the responses of visual cortical neurons [34], [35].”
BackgroundA Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966
Self-citationNormalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835
kernlab- An S4 Package for Kernel Methods in R
Karatzoglou, A., Smola, A., Hornik, K., & Zeileis, A. (2004) · Journal of Statistical Software · doi:10.18637/jss.v011.i09 · Cited by 1,786
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763
Self-citationA new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 1×
“We next compared VIIDEO with five FR indices: MSE, MS-SSIM [45], MOVIE [46], VQM [47], ST-MAD [48], one RR index: STRRED [3] and one learning based blind index: V-BLIINDS [8].”
MethodStudy of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
Self-citationSTRUCTURE AND FUNCTION OF VISUAL AREA MT
Born, R. T., & Bradley, D. C. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131052 · Cited by 1,023 · cited 1×
“This may include more complete modeling of temporal filtering in the lateral geniculate nucleus (LGN) and motion processing in Areas MT/V5 and MST of extrastriate cortex [49]–[51].”
BackgroundA model of neuronal responses in visual area MT
Simoncelli, E. P., & Heeger, D. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00183-1 · Cited by 941
The statistics of natural images
Ruderman, D. (1994) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/5/4/006 · Cited by 941
Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos
Seshadrinathan, K., & Bovik, A. C. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2034992 · Cited by 708 · cited 1×
“We next compared VIIDEO with five FR indices: MSE, MS-SSIM [45], MOVIE [46], VQM [47], ST-MAD [48], one RR index: STRRED [3] and one learning based blind index: V-BLIINDS [8].”
MethodSelf-citationMetamers of the ventral stream
Freeman, J., & Simoncelli, E. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2889 · Cited by 667 · cited 1×
“in [43] of computing space-time correlations (used successfully there to model visual crowding) as a simple measure of”
MethodBlind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471
Self-citationVideo Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
Soundararajan, R., & Bovik, A. C. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2214933 · Cited by 368
Self-citationSelectivity for Complex Shapes in Primate Visual Area V2
Hegdé, J., & Van Essen, D. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-05-j0001.2000 · Cited by 323
Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies
Moorthy, A. K., Choi, L. K., Bovik, A. C., & de Veciana, G. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2212417 · Cited by 303
Self-citationReduced- and No-Reference Image Quality Assessment
Wang, Z., & Bovik, A. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942471 · Cited by 280
Self-citationRepresentation of Angles Embedded within Contour Stimuli in Area V2 of Macaque Monkeys
Ito, M., & Komatsu, H. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4364-03.2004 · Cited by 273
Neurons in monkey visual area V2 encode combinations of orientations
Anzai, A., Peng, X., & Van Essen, D. C. (2007) · Nature Neuroscience · doi:10.1038/nn1975 · Cited by 244 · cited 1×
“This is supported by measurements of V2 responses to complex shapes [38], combinations of orientations [39], and contour angles [40] which suggest a functional integration of V1 responses.”
MethodAutomatic Prediction of Perceptual Image and Video Quality
Bovik, A. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2257632 · Cited by 214
Self-citationTemporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus
Dong, D., & Atick, J. (1995) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/6/2/003 · Cited by 193
A spatiotemporal most-apparent-distortion model for video quality assessment
Vu, P. V., Vu, C. T., & Chandler, D. M. (2011) · 2011 18th IEEE International Conference on Image Processing · doi:10.1109/icip.2011.6116171 · Cited by 180
Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel
De Simone, F., Naccari, M., Tagliasacchi, M., Dufaux, F., Tubaro, S., & Ebrahimi, T. (2009) · 2009 International Workshop on Quality of Multimedia Experience · doi:10.1109/qomex.2009.5246952 · Cited by 141
Multiscale skewed heavy tailed model for texture analysis
Lasmar, N.-E., Stitou, Y., & Berthoumieu, Y. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5414404 · Cited by 128
Neural Representation of Natural Images in Visual Area V2
Willmore, B. D. B., Prenger, R. J., & Gallant, J. L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4099-09.2010 · Cited by 108
No-reference video quality metric based on artifact measurements
Farias, M. C. Q., & Mitra, S. K. (2005) · IEEE International Conference on Image Processing 2005 · doi:10.1109/icip.2005.1530348 · Cited by 107
Perceptual Temporal Quality Metric for Compressed Video
Yang, K., Guest, C. C., El-Maleh, K., & Das, P. K. (2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.906576 · Cited by 91
Detection of blocking artifacts in compressed video
Vlachos, T. (2000) · Electronics Letters · doi:10.1049/el:20000847 · Cited by 89
Experiments in segmenting texton patterns using localized spatial filters
Clark, M., & Bovik, A. C. (1989) · Pattern Recognition · doi:10.1016/0031-3203(89)90007-1 · Cited by 78
Self-citationA novel objective no-reference metric for digital video quality assessment
Yang, F., Wan, S., Chang, Y., & Wu, H. R. (2005) · IEEE Signal Processing Letters · doi:10.1109/lsp.2005.855553 · Cited by 64
A No-Reference Blocking Artifact Measure For Adaptive Video Processing
Muijs, R., & Kirenko, I. O. (2005) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.38737 · Cited by 62
A visual motion sensor based on the properties of V1 and MT neurons
Perrone, J. A. (2004) · Vision Research · doi:10.1016/j.visres.2004.03.003 · Cited by 60
Visual Response Properties of V1 Neurons Projecting to V2 in Macaque
El-Shamayleh, Y., Kumbhani, R. D., Dhruv, N. T., & Movshon, J. A. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2753-13.2013 · Cited by 48
Blockiness detection for MPEG2-coded video
Tan, K. T., & Ghanbari, M. (2000) · IEEE Signal Processing Letters · doi:10.1109/97.855443 · Cited by 43
No-reference quality metric for degraded and enhanced video
Caviedes, J. E., & Oberti, F. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.510112 · Cited by 41
No-reference video quality estimation based on error-concealment effectiveness
Yamada, T., Miyamoto, Y., & Serizawa, M. (2007) · doi:10.1109/packet.2007.4397052 · Cited by 36
No-reference video quality evaluation for high-definition video
Keimel, C., Oelbaum, T., & Diepold, K. J. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4959791 · Cited by 33
NR objective continuous video quality assessment model based on frame quality measure
Kawayoke, Y., & Horita, Y. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711772 · Cited by 29
Perceptual quality metric for digital video coding
Suthaharan, S. (2003) · Electronics Letters · doi:10.1049/el:20030308 · Cited by 28
A Prototype No-Reference Video Quality System
Dosselmann, R., & Yang, X. (2007) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2007.6 · Cited by 26
Schmid, A. (2009) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.015.2009 · Cited by 26
Video quality monitoring of streamed videos
Ong, E. P., Wu, S., Loke, M. H., Rahardja, S., Tay, J., Tan, C. K., & Huang, L. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4959793 · Cited by 17
No-reference modeling of the channel induced distortion at the decoder for H.264/AVC video coding
Naccari, M., Tagliasacchi, M., Pereira, F. M. B., et al. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4712257 · Cited by 16
No reference video quality estimation based on human visual system for 2.5/3G devices
Massidda, F., Giusto, D., & Perra, C. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.594032 · Cited by 13
Image analysis for video artifact estimation and measurement
Lu, J. (2001) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.420909 · Cited by 10
Research works printed but not linked: 3
- babu, 2004, No-reference metrics for video streaming applications, Proc Int Workshop Packet Video
- pastrana-vidal, 2006, Automatic quality assessment of video fluidity impairments using a no-reference metric, Proc Int Workshop Video Process Quality Metrics Consumer Electron, 1
- saad, 2012, Blind quality assessment of natural videos using motion coherency, Proc IEEE Asilomar Conf Signals Syst Comput, 332
Cited by
Quality Assessment of In-the-Wild Videos
Li, D., Jiang, T., & Jiang, M. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3351028 · Cited by 387
Two-Level Approach for No-Reference Consumer Video Quality Assessment
Korhonen, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2923051 · Cited by 354
“Pixel-based models use a raw video signal solely as an input [4]–[5], [7]–[10], [12], and hybrid models combine features from the bitstream with features extracted from the”
BackgroundMethodUnified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images
Min, X., Ma, K., Gu, K., Zhai, G., Wang, Z., & Lin, W. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2735192 · Cited by 337
UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
Tu, Z., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3072221 · Cited by 363
“Among these, NIQE, IL-NIQE, and VIIDEO are “completely blind” (opinion-unaware (OU)), since no training is required to build them.”
MethodInfluentialSelf-citationLarge-Scale Study of Perceptual Video Quality
Sinno, Z., & Bovik, A. C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2869673 · Cited by 310
“NIQE[36] and VIIDEO [39] are training-free models capable of outputting quality scores on video.”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Mittal, A., Saad, M. A., & Bovik, A. C.
- Affiliations
- Intel (United States) (US)
- ORCID
- Bovik, Alan C.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-01
- Volume
- 25
- Issue
- 1
- Pages
- 289-300
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2194363988
- Cited by
- 357
- References
- 50
- Citations by year
- 2026: 16 · 2025: 41 · 2024: 45 · 2023: 44 · 2022: 42 · 2021: 45 · 2020: 33 · 2019: 29 · 2018: 30 · 2017: 24 · 2016: 7
- FWCI
- 17.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- blind video quality assessment, video integrity, perceptual video quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.