Utility curves: mean opinion scores considered biased
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
In the Coqos project task performance measures and a corresponding framework are suggested and pursued as a novel and more suitable means for determining utility curves. TPM are intended to avoid limits inherent in traditional measures like mean opinion scores. MOS rely merely on subjective ratings rather than on more objective performance in relation to a particular task or application of interest. Informational relevance and its impact on subjects can be measured more effectively by TPM. Inhibiting psychological and cognitive effects like consciousness or nonconsciousness of degradations or individual focusing and perspectives of subjects can be more appropriately evaluated and dealt with by means of TPM. The increasing importance of adaptation, in particular with the advance of MPEG4, as a means for QoS provisioning, both in wireless and wired environments, requires sensible techniques to effectively determine utility curves.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 1×
“Sumby and Pollack [8] reported that the relative contribution of visual information is independent of the signalto-noise ratio (S/N), but the absolute contribution could be more pro tably exploited at low S/N.”
BackgroundIntermodal timing relations and audio-visual speech recognition by normal-hearing adults
McGrath, M., & Summerfield, Q. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392336 · Cited by 201
Cited by
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506
“[90] highlight several properties of MOS-based approaches that may prove problematic when used in certain applications.”
BackgroundA Few Thoughts on Cognitive Overload
Kirsh, D. (2000) · Intellectica. Revue de l'Association pour la Recherche Cognitive · doi:10.3406/intel.2000.1592 · Cited by 322
Self-citationQoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS
Hoßfeld, T., Heegaard, P. E., Varela, M., & Möller, S. (2016) · Quality and User Experience · doi:10.1007/s41233-016-0002-1 · Cited by 135
“[15]), as well as other mechanisms for assessing quality in more indirect ways, for example, by seeing how it affects the way users perform certain tasks [16], [17], [18], [19].”
BackgroundCan we ID from CCTV? Image quality in digital CCTV and face identification performance
Keval, H. U., & Sasse, M. A. (2008) · SPIE Proceedings · doi:10.1117/12.774212 · Cited by 17
Metadata
- Authors
- Knoche, H., De Meer, H. G., & Kirsh, D.
- Venue
- 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354)
- Publisher
- IEEE
- Published
- 2003-01-20
- Pages
- 12-14
- OpenAlex
- W2138095440
- Cited by
- 51
- References
- 2
- FWCI
- 2.22
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Utility curves: mean opinion scores considered biased. https://app.cochat.ai/papers/10.1109/iwqos.1999.766473
- The paper
- Knoche, H., De Meer, H. G., & Kirsh, D. (2003). Utility curves: mean opinion scores considered biased. 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354). https://doi.org/10.1109/iwqos.1999.766473
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.