Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Objective video quality metrics are designed to estimate the quality of experience of the end user. However, these objective metrics are usually validated with video streams degraded under common distortion types. In the presented work, we analyze the performance of published and known full-reference and noreference quality metrics in estimating the perceived quality of adaptive bit-rate video streams knowingly out of scope. Experimental results indicate not surprisingly that state of the art objective quality metrics overlook the perceived degradations in the adaptive video streams and perform poorly in estimating the subjective quality results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is a full reference metric and the values closer to zero are the better.”
From Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study (2019) · cites this paper as [6]
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 1×
“• Naturalness Image Quality Evaluator (NIQE) features [19].”
BackgroundMultiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182 · cited 2×
“The general Video Quality Model (VQM) is a standardized method of objectively measuring video quality [14].”
MethodInfluentialMultiscale structural similarity for image quality assessment
Wang, Z. (2025) · doi:10.57702/c0fj14hf · Cited by 867
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471 · cited 9×
“In this case, PEVQ-S, MS-SSIM, and VQM-VFD significantly outperforms V-BLIINDS, but only PEVQ-S and VQM-VFD significantly outperforms PEVQ.”
MethodInfluentialNo-reference image and video quality assessment: a classification and review of recent approaches
Shahid, M., Rossholm, A., Lövström, B., & Zepernick, H.-J. (2014) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2014-40 · Cited by 177
Self-citationTemporal Video Quality Model Accounting for Variable Frame Delay Distortions
Pinson, M. H., Choi, L. K., & Bovik, A. C. (2014) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2014.2365260 · Cited by 62
Assessing quality of experience for adaptive HTTP video streaming
Xue, J., Zhang, D., Yu, H., et al. (2014) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2014.6890604 · Cited by 54
Subjective Video Quality Assessment of HTTP Adaptive Streaming Technologies
Robinson, D. C., Jutras, Y., & Craciun, V. (2012) · Bell Labs Technical Journal · doi:10.1002/bltj.20531 · Cited by 52
Cited by
Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study
Sara, U., Akter, M., & Uddin, M. S. (2019) · Journal of Computer and Communications · doi:10.4236/jcc.2019.73002 · Cited by 1,689
“Mean Squared Error (MSE) between two images such as ( ) , g x y and ( ) ˆ , g x y is defined as [6]”
BackgroundComparative Analysis of Image Quality Assessment Metrics: MSE, PSNR, SSIM and FSIM
Al Najjar, Y. (2024) · International Journal of Science and Research (IJSR) · doi:10.21275/sr24302013533 · Cited by 37
“Equation (4) displays the formula for SSIM, regarding reference [9]. equation (4) While both UIQI and SSIM are used to assess image quality, SSIM is more widely adopted due to its comprehensive evaluation of structural similarity.”
Metadata
- Authors
- Søgaard, J., Krasula, L., Shahid, M., Temel, D., Brunnström, K., & Razaak, M.
- Affiliations
- Technical University of Denmark (DK)
- Blekinge Institute of Technology (SE)
- Georgia Institute of Technology (US)
- Kingston University London (GB)
- Venue
- Electronic Imaging
- Published
- 2016-02-14
- Volume
- 28
- Issue
- 13
- Pages
- 1-7
- ISSN
- 2470-1173 (ISSN-L)
- OpenAlex
- W2290898426
- Semantic Scholar
- 96ea1f354e81dcc34f3f7acb348e5d40d424a2b3
- Cited by
- 43
- References
- 19
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 11 · 2023: 4 · 2022: 9 · 2021: 3 · 2020: 3 · 2019: 6 · 2018: 3
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- green
- urn.kb.se
- Licence
- other-oa
- Locations
- Electronic Imaging (publishedVersion)
- Publications (Mid Sweden University) (submittedVersion, other-oa)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- objective video quality metrics, perceptual video quality, adaptive video streaming, full-reference quality metrics, no-reference quality metrics, quality of experience, subjective quality assessment, video distortion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming. https://app.cochat.ai/papers/10.2352/issn.2470-1173.2016.13.iqsp-206
- The paper
- Søgaard, J., Krasula, L., Shahid, M., Temel, D., Brunnström, K., & Razaak, M. (2016). Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming. Electronic Imaging. https://doi.org/10.2352/issn.2470-1173.2016.13.iqsp-206
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.