Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Items 601–650 of 650
Evaluating prosodic features of synthetic speech
Raatikainen, A. (2024) · Tampere University Institutional Repository (Tampere University)
Fang, L., Chen, Y., Zhou, T. R., Liu, L., Deng, Y., Li, X., & Ni, T. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131993
Quality Requirements for First Person View Unmanned Systems Control Service
Berezkin, A. (2026) · Proceedings of Telecommunication Universities · doi:10.31854/1813-324x-2026-12-1-7-15
QoE Assessment for Cloud-streamed Games based on Subjective Tests
Myhr, T. (2026) · DiVA (Digitala Vetenskapliga Arkivet)
Требования к качеству видеопотока при управлении беспилотными системами от первого лица
Александрович, Б. А. (2026) · Proceedings of Telecommunication Universities
EvoIQA - Explaining Image Distortions with Evolved White-Box LogicPreprint
Gupta, R., Bakurov, I., Haut, N., & Banzhaf, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.15887
Разработка агента для самообучения сильного ИИ на основе генеративных языковых моделей
Мальгин, Б. Д. (2025) · Электронный архив ЮУрГУ (South Ural State University)
Bitton, A. (2021) · theses.fr (ABES) · doi:10.70675/8c6172a2z19c4z4a60z9bffz9af76d821b8a
Traitement d'images pour l'automatisation de caractérisation sécuritaire de circuits intégrés
Abelé, R. (2021) · theses.fr (ABES) · doi:10.70675/a2fa711dzc163z485azb40az766961bc8b9b
Wang, Z., Wang, C., Zhao, J., Yao, D., Wang, J., & Li, J. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460744
UJCodec: An End-to-end Unet-Style Codec for Joint Speech Compression and Enhancement
陸品丞, Zhou, P., Chen, X., Wang, J., & Wang, Z. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462151
MTGAN: research on video watermarking based on multi-task generative adversarial networks
Zhang, H., Niu, K., Li, J., Zhu, S., Lu, Y., & Xu, Q. (2026) · The Computer Journal · doi:10.1093/comjnl/bxag040
IMaSC: A Malayalam Speech Corpus for High-Quality Text-to-Speech Synthesis
Gopinath, D. P., Thennal, D. K., Nair, V. V., Swaraj, K. S., & Sachin, G. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/39kfsuabkvgh
“We conducted a crowd-sourced Mean Opinion Score (MOS) listening test with 20 native language speakers to evaluate the models (Streijl et al., 2016).”
A Multi-Level Expressive Voice Cloning Method Based on Adaptive Grouped Code Modeling
Zhu, Y., Zhou, R., & Chen, G. (2026) · IEEE Access · doi:10.1109/access.2026.3691952
Gallegati, C., Bianchini, M., Scarselli, F., Murino, V., & Corradini, B. T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.07786
“For each condition c = ( k, τ, s ) —denoting dataset k , degradation τ , and severity s —we compute the Mean Opinion Score (MOS) [Streijl et al., 2016]: where r a ∈ { 1 , . . . , 5 } is the rating provided by annotator a , and A c is the set of valid ratings for that condition.”
Adaptive Multidimensional Model for User Interface Quality Assessment
Naydenova, I., Kovacheva, Z. S., & Georgiev, I. K. (2026) · Future Internet · doi:10.3390/fi18050261
LLM-Enabled Digital Teacher and Metaverse-Based Laboratory for Teaching Network Communications
Song, J., Yu, Y., & Wan, N. (2026) · International Conference on Educational and Information Technology · doi:10.1109/iceit68991.2026.11521098
“Final scores were reported as Mean Opinion Score (MOS) [20] on a 1-5 scale, computed as the average of item ratings within each dimension and presented with standard deviation and 95% confidence intervals.”
Mongolian Speech Data Augmentation Model Integrating Hierarchical Emotional Features
Qin, Y., Ma, Z., Guo, S., & Wang, K. (2025) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait67930.2025.11522645
“This includes Speaker Mean Opinion Score (SMOS) [14] and Emotion Mean Opinion Score (EMOS).”
A Controllable Emotional Intensity Data Augmentation Model for Mongolian Speech
Da, L., Guo, S., Wang, K., & Qin, Y. (2025) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait67930.2025.11522095
“In the subjective evaluation, the Intensity Mean Opinion Score (IMOS) [11] and the Generate Emotional Qualification Rate (GEQR) are used for evaluation.”
Real-time speech-to-speech translation with urgency preservation in time-sensitive scenarios
Pinna, S., Malloci, F. M., Marras, M., Recupero, D. R., Riboni, D., & Scarpi, G. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21723-7
“● Mean Opinion Score (MOS) : measures human perception of output quality on a five-point scale, following the ITU definition of opinion scores [41], which describes MOS as the “value on a predefined scale that a subject assigns to his opinion of the perfor - mance of a system” .”
Optimizing Large Language Models for Moroccan Dialect Translation: A Comparative Study
Tachicart, R., Bouzoubaa, K., & Korchi, A. (2026) · Operations Research Forum · doi:10.1007/s43069-026-00661-y
“For each criterion (fluency, adequacy), the MOS [60] is calculated by averaging the evaluators’ ratings: where s i is the score given by evaluator i , n is the number of evaluators (in our case n = 2 ), and criterion can be either adequacy or fluency.”
SingFox: A Multi-Lingual Singfake Detection Corpus
Shah, A. J., Trivedi, D. K., Borad, H., & Patil, H. A. (2026) · Interspeech (USB) · doi:10.21437/interspeech.2026-2573
Computational Attention-based Modeling of Individually Perceived Quality of Compressed Images
Tiotsop, L. F., Geissler, M., & Barkowsky, M. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3822181
“More recent research has recognized that a single average score is often insufficient to fully characterize Quality of Experience [10, 23, 28, 40, 43, 47].”
Santos, R. D. O., Macedo, C. J. A., Santos, C. E. D. S., & Oliveira, A. (2026) · IEEE Access · doi:10.1109/access.2026.3709304
An Image Dataset Quality Evaluation System for Industrial Object Detection Tasks
Zhu, S., Sun, Y., Lu, E., Zhu, X., & Liu, J. (2026) · Sensors · doi:10.3390/s26144465
“MOS [22] is a commonly used subjective evaluation index in the field of image quality assessment, as it comprehensively reflects observers’ subjective perceptions of image clarity, noise level, structural integrity, target distinguishability, and visual comfort.”
Xie, Y., Li, Q., Chen, Z., Chen, W., & Sun, W. (2026) · Speech Communication · doi:10.1016/j.specom.2026.103446
Sensitivity Analysis of Beta-Based System GoB Approximations from QoS and MoS Mappings
Hoßfeld, T., & Pérez, P. (2026) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex69967.2026.11618339
“The MOS is a well-established metric in the QoE community and has been extensively studied with respect to its methodology, applications, and limitations [15]–[17].”
Justification of Shewhart Charts Applicability for Video Stream Intensity Statistical Control
Александрович, Ч. А., Berezkin, A., & Rabin, A. V. (2026) · IEEE International Conference on Soft Computing and Measurements (SCM) · doi:10.1109/scm71573.2026.11625925
“Objective video stream quality metrics include PSNR [9] (peak sound-to-noise ratio) and SSIM [9] (structural similarity), while the subjective quality metrics include LPIPS [10] (learned perceptual image patch similarity) and MOS [11] (mean opinion score).”
Haptic Multi-Indicator Assessment Fusion
Liu, Q., Chen, J., Xu, R., & Song, R. F. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3726291
Tsani, M. K. (2025) · Walisongo Repository (Walisongo State Islamic University)
Chowdhury, A. A. (2026) · IRis (Bishop's University) · doi:10.71661/215
PATRICIA: proof-of-concept implementation and validation of a real-time singing synthesizer
Brum, L. A. Z., Meneses, E., & Moreno, E. D. (2025) · Simpósio Brasileiro de Computação Musical (SBCM) · doi:10.5753/sbcm.2025.13208
“The average of the scores given by each of the five users in each question corresponds to a Mean Opin-ion Score (MOS) [23] for each requirement.”
On Human Perception-Guided Video Stability Assessment
Souza, M. R. E., Decker, L. G. L., Campana, J. L. F., Maia, H. D. A., & Pedrini, H. (2026) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2026.5618
“Beyond handcrafted measures, a common strategy in the broader video quality assessment literature is to cast quality prediction as a supervised regression problem, where a model learns a mapping from objective features to subjective scores (e.g., MOS) [Min et al ., 2024; Streijl et al ., 2016].”
Zaman, F. N. (2025) · Walisongo Repository (Walisongo State Islamic University)
Zhu, Y., wang, Y., Zhou, Y., Liu, B., & Zhou, R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0358777
“Separate 5-point Mean Opinion Score (MOS) scales are used to evaluate naturalness (NAT), speaker similarity (SIM), and emotional expressiveness (EMO) [32].”
DIVE-Bench: Codec-Style High-FPS Video Understanding
Zhang, H., Chai, W., He, S., Li, A., & Fu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36987-1_23
CHUIG: Controllable High-Resolution Underwater Image Generator With Refined Diffusion Model
Xu, F., Yu, S., Cao, J., Liu, S., Wang, Y., Yan, X., & Li, F. (2026) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2026.3722363
MarIA: A Multimodal Approach to Voice Accessibility in Primary Health Care
Fran, P. A. F., Sá, R. V. P., Queiroz, L. D. J., Viola, P. C. D. A. F., Costa, S., de Souza, B. F., Almeida, J. D. S. D., Diniz, J. O. B., & Ribeiro, C. C. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39904-5_43
Sun, C., Cheng, L., & Yan, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00726
“We report mean opinion scores (MOS) (Streijl et al., 2016) for each dimension, with higher values indicating better perceived quality or relevance.”
Merging Passive and Active Measurements: Machine Learning for Network Monitoring
Perna, G. (2024) · PORTO@Iris
การพัฒนาโมเดลการเลียนเสียงเชิงลึกในการประยุกต์ใช้งานด้านสงครามไซเบอร์
Sirinam, P., & Praneetpolgrang, P. (2023) · National Defence Studies Institute Journal
Speak in Any Language: An End-to-End Framework for Faithful Multilingual Dubbing
Raju, K. S. P., Reddy, K. R. S., Goyal, N., & Choudhary, N. (2026) · International Conference on Emerging Techniques in Computational Intelligence (ICETCI) · doi:10.1109/icetci71772.2026.11710457
“…test the proposed framework on transcription accuracy (WER [13] and CER [14]), semantic similarity (BLEU [9] and BERTScore [18]), speech nat-uralness (MOS [15] and DNSMOS [16]) and duration alignment metrics to show that it achieves superior performance in high-quality multilingual video dubbing.”
User-guided dynamic topic discovery in large texts
Ramanan, K. V. (2023) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Leesaksakul, N., Wonganawat, N., Wutinarongtrakul, S., Kaewchuay, B., & Hsu, C.-H. (2026) · ACM Workshop on Mobile Immersive Computing, Networking, and Systems (ImmerCom) · doi:10.1145/3842656.3843821
Multimodal Style Control in Voice Conversion Using Textual and Acoustic Prompts
Kim, M., Um, S., & Kang, H.-G. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3742217
“Subjective metrics: Subjective evaluations were conducted using two 5-point mean opinion score (MOS) tests [56]: Nat-uralness MOS (NMOS) and Similarity MOS (SMOS).”
Can User Awareness through Visual Feedback increase the Tolerable Delay in VoIP Calls?
Thou, H., Dutta, A. K., Raman, B., & Rajamanickam, V. (2026) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3821581.3833131
Physiology-Informed Audio Quality and Listening Effort EstimationPreprint
McGuire, N., & Emmanouilidou, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.36865
“A listener’s rating depends on personal preference, prior experience, and a shifting interpretation of the scale, producing substantial variability across listeners and sessions [2, 3].”
Fr\'echet Oral Distance: A Coordinate-Free Metric and Benchmark for Speech-Driven Oral AnimationPreprint
Myung, J., Eum, S., Chung, H., & Park, U. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.01705
NepTTS-Bench: Native-Speaker Benchmarking and NepaliMOS for Nepali Text-to-SpeechPreprint
Thapa, A., Ghimire, R., & Pathak, L. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03718
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.