Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Structural similarity index (SSIM) revisited: A data-driven approach
Bakurov, I., Buzzelli, M., Schettini, R., Castelli, M., & Vanneschi, L. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116087 · Cited by 421
A Comprehensive Review on Generative AI for Education
Mittal, U., Sai, S., Chamola, V., & Sangwan, D. (2024) · IEEE Access · doi:10.1109/access.2024.3468368 · Cited by 383
“These models have been trained over multiple deep learning models and are then evaluated using metrics such as signal-to-noise ratio [17] and mean-opinion-score [18].”
MethodAn Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
“(MOS) [2], [251]–[253], preference tests [18], [254] and bestworst scaling [255] could represent the intrinsic naturalness and similarity to the target.”
BackgroundOn the use of deep learning for blind image quality assessment
Bianco, S., Celona, L., Napoletano, P., & Schettini, R. (2018) · Signal, Image and Video Processing · doi:10.1007/s11760-017-1166-8 · Cited by 277
“The CNN is discriminatively fine-tuned to classify image sub-regions into five classes according to the 5-points MOS scale [43].”
MethodLossy Image Compression with Compressive Autoencoders
Huszár, F., Theis, L., Shi, W., & Cunningham, A. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.51995 · Cited by 237
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives. https://app.cochat.ai/papers/10.1007/s00530-014-0446-1
- The paper
- Streijl, R. C., Winkler, S., & Hands, D. S. (2016). Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives. Multimedia Systems. https://doi.org/10.1007/s00530-014-0446-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.