VMAF reproducibility: Validating a perceptual practical video quality metric
The DOI matches its Crossref record; 3 of the 5 references it cites were found in a registry or an index.
Abstract
Measuring video quality with standard metrics ensures that operators can deliver to consumers the desired quality of experience (QoE) at an optimal cost. Such metrics also allow CODEC engineers to optimize the performance of their encoding algorithms. This paper briefly surveys existing video quality metrics and then presents results of the new Video Multi-Method Assessment Fusion (VMAF) metric [1] proposed by Netflix. The author and colleagues used VMAF to measure the quality of a 4K dataset encoded with the RealMedia video CODEC at a range of bitrates. They also gathered subjective quality assessments from a group of viewers for the same dataset. The paper presents findings of correlation between subjective and objective results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS
Ponomarenko, N. N., Silvestri, F., Egiazarian, K., Carli, M., Astola, J. T., & Лукин, В. В. (2007) · Cited by 364
Measuring video quality in the network: from quality of service to user experience
Staelens, N. (2015) · Ghent University Academic Bibliography (Ghent University) · Cited by 15
Research works printed but not linked: 3
- 0, Elementa
- 0, Methodology for the subjective assessment of the quality of television pictures, ITU-R Recommendation BT 500
- li, 2016, Toward A Practical Perceptual Video Quality Metric, Netflix TechBlog June
Cited by
Two-Level Approach for No-Reference Consumer Video Quality Assessment
Korhonen, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2923051 · Cited by 354
A Paradigm Shift toward Semantic Communications
Niu, K., Dai, J., Yao, S., Wang, S., Si, Z., Qin, X., & Zhang, P. (2022) · IEEE Communications Magazine · doi:10.1109/mcom.001.2200099 · Cited by 168
“For image and video sources, human perception of image quality is taken into account [14, 15], including peak SNR (PSNR), the multi-scale extension of the structural similarity index (MS-SSIM), the learned perceptual image patch similarity model (LPIPS), and the video multi-method assessment fusion…”
MethodComyco: Quality-Aware Adaptive Video Streaming via Imitation Learning
Huang, T., Zhou, C., Zhang, R.-X., Wu, C., Yao, X., & Sun, L. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351014 · Cited by 153
“trate. To achieve this, we first integrate the information of video contents, network status, and video playback states into the Comyco’s NN for bitrate selection (§4.1). Next, we consider using VMAF [38], an objective full-reference perceptual video quality metric, to measure the video quality. Concurrently, we also…”
MethodResultInfluentialHuang, T., Zhang, R.-X., Zhou, C., & Sun, L. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240545 · Cited by 110
“dynamic video scene (MV) respectively. In our experiment, we use Video Multi-Method Assessment Fusion(VMAF), a smart perceptual video quality assessment algorithm based on support vector machine(SVM) [23]. We compare the video quality score of each video in different encoders. In detail, we use three video encoders in…”
MethodVideo Super-Resolution and Caching—An Edge-Assisted Adaptive Video Streaming Solution
Zhang, A., Li, Q., Chen, Y., Ma, X., Zou, L., Jiang, Y., Xu, Z., & Muntean, G. (2021) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2021.3071010 · Cited by 81
Metadata
- Authors
- Rassool, R.
- Affiliations
- RealNetworks (United States) (US)
- Corresponding author
- Rassool, Reza
- Venue
- 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)
- Publisher
- IEEE
- Published
- 2017-06
- Pages
- 1-2
- OpenAlex
- W2737019897
- Cited by
- 235
- References
- 5
- Citations by year
- 2026: 23 · 2025: 39 · 2024: 37 · 2023: 36 · 2022: 30 · 2021: 37 · 2020: 17 · 2019: 12 · 2018: 4
- FWCI
- 2.64
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- VMAF, video quality metrics, perceptual video quality, reproducibility, subjective quality assessment, objective quality measurement, 4K video, data rate, quality of experience, subjective-objective correlation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: VMAF reproducibility: Validating a perceptual practical video quality metric. https://app.cochat.ai/papers/10.1109/bmsb.2017.7986143
- The paper
- Rassool, R. (2017). VMAF reproducibility: Validating a perceptual practical video quality metric. 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). https://doi.org/10.1109/bmsb.2017.7986143
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.