Study of Rating Scales for Subjective Quality Assessment of High-Definition Video
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
With the constant evolution of video technology and the deployment of new video services, content providers and broadcasters always face the challenge of delivering an adequate video quality which meets end-users expectations. The development of reliable quality testing and quality monitoring tools that can be used by broadcasters ultimately requires reliable objective video quality metrics. In turn, the validation of these objective models requires reliable subjective assessment, the most accurate representation of the quality perceived by end-users. Many different subjective assessment methodologies exist, and each has its advantages and drawbacks. One important element in a subjective testing methodology is the choice of the rating scale. In this paper, we make a direct comparison between four scales, which are either included in existing international standards or proposed to be used in future standardization activities related to video quality. We examine the subjective data from the points of view of response behavior from participants, similarity and variability of subjective scores. We discuss these results within the context of the subjective quality assessment of high-definition video compressed and transmitted over error-prone networks. Our experimental data show no overall statistical differences between the different scales. Results also show that the single-stimulus presentation provides highly repeatable results even if different scales or groups of participants are used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106
Cited by
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506
“[29] compared 5-, 9-, 11-point discrete and continuous scales for scoring video quality.”
BackgroundCVD2014—A Database for Evaluating No-Reference Video Quality Assessment Algorithms
Nuutinen, M., Virtanen, T., Vaahteranoksa, M., Vuori, T., Oittinen, P., & Hakkinen, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2562513 · Cited by 227
Yottixel – An Image Search Engine for Large Archives of Histopathology Whole Slide Images
Kalra, S., Tizhoosh, H. R., Choi, C., Shah, S., Diamandis, P., Campbell, C. J. V., & Pantanowitz, L. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101757 · Cited by 139
Histopathology Slide Indexing and Search — Are We There Yet?
Shang, H. H., Nasr, M. S., Veerla, J. P., Saurav, J. R., Hajighasemi, A., Malidarreh, P., Huber, M., Moleta, C., Makker, J., & Luber, J. M. (2024) · NEJM AI · doi:10.1056/aics2300019 · Cited by 5
Metadata
- Authors
- Huynh-Thu, Q., Garcia, M.-N., Speranza, F., Corriveau, P., & Raake, A.
- Venue
- IEEE Transactions on Broadcasting
- Published
- 2011-03
- Volume
- 57
- Issue
- 1
- Pages
- 1-14
- ISSN
- 0018-9316 (ISSN-L)
- 1557-9611
- OpenAlex
- W2142677209
- Cited by
- 171
- References
- 1
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Study of Rating Scales for Subjective Quality Assessment of High-Definition Video. https://app.cochat.ai/papers/10.1109/tbc.2010.2086750
- The paper
- Huynh-Thu, Q., Garcia, M.-N., Speranza, F., Corriveau, P., & Raake, A. (2011). Study of Rating Scales for Subjective Quality Assessment of High-Definition Video. IEEE Transactions on Broadcasting. https://doi.org/10.1109/tbc.2010.2086750
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.