The DOI matches its Crossref record; 43 of the 48 references it cites were found in a registry or an index.
Two-Level Approach for No-Reference Consumer Video Quality Assessment
Abstract
Smartphones and other consumer devices capable of capturing video content and sharing it on social media in nearly real time are widely available at a reasonable cost. Thus, there is a growing need for no-reference video quality assessment (NR-VQA) of consumer produced video content, typically characterized by capture impairments that are qualitatively different from those observed in professionally produced video content. To date, most of the NR-VQA models in prior art have been developed for assessing coding and transmission distortions, rather than capture impairments. In addition, the most accurate NR-VQA methods known in prior art are often computationally complex, and therefore impractical for many real life applications. In this paper, we propose a new approach for learning-based video quality assessment, based on the idea of computing features in two levels so that low complexity features are computed for the full sequence first, and then high complexity features are extracted from a subset of representative video frames, selected by using the low complexity features. We have compared the proposed method against several relevant benchmark methods using three recently published annotated public video quality databases, and our results show that the proposed method can predict subjective video quality more accurately than the benchmark methods. The best performing prior method achieves nearly similar accuracy, but at substantially higher computational cost.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Temporal pooling is one of the most important, unresolved problems for video quality prediction [42], [60], [76], [82], [83].”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“The model currently achieves SOTA performance on three UGC video quality databases, CVD2014 [12], KoNViD-1k [10], and LIVE-Qualcomm [13], at a reasonably low complexity, as reported by the authors.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“We observed in Section II-B that LIVE-VQC videos generally contain more (camera) motions than KoNViD-1k and YouTube-UGC, and TLVQM computes multiple motion relevant features.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“TLVQM does require that a large set of parameters (around 30) be specified, which may affect performance on datasets or application scenarios it has not been exposed to.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
Citations
Cites
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 4×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
BackgroundMethodInfluentialNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 3×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
MethodNatural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“between neighboring locations, as well as spatial and temporal frequencies, follow certain typical statistical distributions [37].”
BackgroundDesign of an image edge detection filter using the Sobel operator
Kanopoulos, N., Vasanthavada, N., & Baker, R. L. (1988) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.996 · Cited by 1,212
No-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
Unsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics
Winkler, S., & Mohandas, P. (2008) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2008.2000733 · Cited by 598
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471 · cited 4×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
MethodInfluentialA Completely Blind Video Integrity Oracle
Mittal, A., Saad, M. A., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502725 · Cited by 357 · cited 2×
“Pixel-based models use a raw video signal solely as an input [4]–[5], [7]–[10], [12], and hybrid models combine features from the bitstream with features extracted from the”
BackgroundMethod
Research works printed but not linked: 13
- 2011, Objective Multimedia Video Quality Measurement of HDTV for Digital Cable Television in the Presence of a Reduced Reference Signal
- 2016, Objective Perceptual Multimedia Video Quality Measurement of HDTV for Digital Cable Television in the Presence of a Full Reference
- 2012, Methodology for the Subjective Assessment of the Quality of Television Pictures
- 2010, Report on the validation of video quality models for high definition video content
- ghadiyaram, 2017, LIVE-Qualcomm Mobile in-Capture Video Quality Database
- hosu, 2017, KoNViD-1k Video Database
- korhonen, 2019, Two Level Video Quality Model (TlvQM)
- zheng, 2018, Source Code for Classical Biqa Methods
- 2018, Image & Video Quality Assessment Algorithms Laboratory for Image & Video Engineering the University of Texas in Austin
- 2018, Scikit-Learn Toolbox
- alpert, 1997, Subjective quality evaluation–the SSCQE and DSCQE methodologies, EBU Tech Rev, 271, 12
- 1999, Subjective video quality assessment methods for multimedia applications
- nuutinen, 2018, The CVD Video Database
Cited by
UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
Tu, Z., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3072221 · Cited by 363
“Some motion-related features (as in TLVQM) may not apply as well in this scenario.”
BackgroundMethodInfluentialA Deep Learning based No-reference Quality Assessment Model for UGC Videos
Sun, W., Min, X., Lu, W., & Zhai, G. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548329 · Cited by 240
“For the NR VQA methods, the hand-crafted feature based NR VQA methods such as TLVQM and VIDEVAL achieve pretty well performance by incorporating the rich spatial and temporal quality features, such as NSS features, motion features, etc., but they are inferior to the deep learning based NR VQA methods due to the strong…”
BackgroundMethodInfluentialFAST-VQA: Efficient End-to-End Video Quality Assessment with Fragment Sampling
Wu, H., Chen, C., Hou, J., Liao, L., Wang, A., Sun, W., Yan, Q., & Lin, W. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20068-7_31 · Cited by 244
Perceptual video quality assessment: a survey
Min, X., Duan, H., Sun, W., Zhu, Y., & Zhai, G. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4133-3 · Cited by 218
RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content
Tu, Z., Yu, X., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2021) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2021.3090333 · Cited by 215
“Evaluation Method: We used a support vector regressor (SVR) as the back-end regression model to learn the feature-to-score mappings [8], [9], [12], [13], [61].”
BackgroundMethodInfluential
Metadata
- Authors
- Korhonen, J.
- Affiliations
- Shenzhen University (CN)
- Corresponding author
- Korhonen, Jari
- ORCID
- Korhonen, Jari
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-12
- Volume
- 28
- Issue
- 12
- Pages
- 5923-5938
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2950154603
- Semantic Scholar
- f441c421b710c164872298679de173621dc980dc
- Cited by
- 354
- References
- 48
- Citations by year
- 2026: 38 · 2025: 67 · 2024: 65 · 2023: 72 · 2022: 48 · 2021: 53 · 2020: 10 · 2019: 1
- FWCI
- 12.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61772348)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- no-reference video quality assessment, consumer video, representative frame selection, computational efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Two-Level Approach for No-Reference Consumer Video Quality Assessment. https://app.cochat.ai/papers/10.1109/tip.2019.2923051
- The paper
- Korhonen, J. (2019). Two-Level Approach for No-Reference Consumer Video Quality Assessment. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2019.2923051
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.