An Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Video Quality assessment is imperative to estimate and hence manage the Quality of Experience (QoE) in video streaming applications to the end-user. Recent years have seen a tremendous advancement in the field of objective video quality assessment (VQA) metrics, with the development of models that can predict the quality of the videos streamed over the Internet. However, no work so far has attempted to study the performance of such quality assessment metrics on gaming videos, which are artificial and synthetic and have different streaming requirements than traditionally streamed videos. Towards this end, we present in this paper a study of the performance of objective quality assessment metrics for gaming videos considering passive streaming applications. Objective quality assessment considering eight widely used VQA metrics is performed on a dataset of 24 reference videos and 576 compressed sequences obtained by encoding them at 24 different resolution-bitrate pairs. We present an evaluation of the performance behavior of the VQA metrics. Our results indicate that VMAF predicts subjective video quality ratings the best, while NIQE turns out to be a promising alternative as a no-reference metric in some scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 1×
“Natural Image ality Evaluator (NIQE) is a learning-based NR quality estimation metric which uses statistical features based on the space domain NSS model [12].”
MethodNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 8×
“BRISQUE on the other hand results in almost similar performance as NIQE for 1080p and 720p resolutions but the correlation values decrease for 480p (wider spread of the scores) and all data.”
MethodInfluentialA Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing
Soundararajan, R., & Bovik, A. C. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2214933 · Cited by 368 · cited 1×
“We used Spatio-temporal-reduced reference entropic dierences (ST-RRED), an RR metric proposed by the authors in [6], since it is one of the most widely used RR metrics with very good performance on various VQA databases [7].”
Method
Cited by
QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey
Barakabitze, A. A., Barman, N., Ahmad, A., Zadtootaghaj, S., Sun, L., Martini, M. G., & Atzori, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2958784 · Cited by 239
“Emerging Multimedia Applications [31], [287]–[289], [321], [292], [293], [336], [332], [333], [335], [341] Mechanisms for ensuring the QoE for VR/AR, Mulsemedia, Video gaming and light field display.”
Self-citationPerceptual video quality assessment: a survey
Min, X., Duan, H., Sun, W., Zhu, Y., & Zhai, G. (2024) · Science China Information Sciences · doi:10.1007/s11432-024-4133-3 · Cited by 218
Barman, N., Jammeh, E., Ghorashi, S. A., & Martini, M. G. (2019) · IEEE Access · doi:10.1109/access.2019.2920477 · Cited by 71
Self-citation
Metadata
- Authors
- Barman, N., Schmidt, S., Zadtootaghaj, S., Martini, M. G., & Möller, S.
- Venue
- Proceedings of the 23rd Packet Video Workshop
- Publisher
- ACM
- Published
- 2018-06-12
- Pages
- 7-12
- OpenAlex
- W2809031010
- Cited by
- 61
- References
- 5
- FWCI
- 2.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming. https://app.cochat.ai/papers/10.1145/3210424.3210434
- The paper
- Barman, N., Schmidt, S., Zadtootaghaj, S., Martini, M. G., & Möller, S. (2018). An Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming. Proceedings of the 23rd Packet Video Workshop. https://doi.org/10.1145/3210424.3210434
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.