Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Items 301–400 of 650
Enhancing Quality of Experience of VoIP Traffic in SDN based End-hosts
Al‐Najjar, A., Layeghy, S., Portmann, M., & Indulska, J. (2018) · International Telecommunication Networks and Applications Conference (ITNAC) · doi:10.1109/atnac.2018.8615286 · Cited by 5
“which is time consuming, expensive, and often not practical [12][13].”
BackgroundNetwork Performance Criteria for Telecommunication Traffic Types driven by Quality of Experience
Ramadža, I., Pekić, V., & Ožegović, J. (2019) · Journal of Communications Software and Systems · doi:10.24138/jcomss.v15i3.738 · Cited by 5
“1] was used for QoE results, as MOS is considered relatively wellsuited for use by service providers and telecom operators for quality monitoring and alerts [4].”
MethodToward understanding the quality of subtitle synchronization to improve the viewer experience
Brito, J. O., Santos, C. A. S., Guimarães, R. L., & Borges, T. F. C. (2019) · Brazilian Symposium on Multimedia and the Web · doi:10.1145/3323503.3349565 · Cited by 5
“Para mitigar o segundo efeito, selecionamos um vídeo de curta duração [31] (aprox.”
BackgroundPGF-BIQA: Blind image quality assessment via probability multi-grained cascade forest
Liu, H., Li, C., Jin, S., Gao, W., Liu, F., Du, S., & Ying, S. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103695 · Cited by 5
Proceedings of the 7th International Workshop on Metamorphic Testing
(2022) · doi:10.1145/3524846 · Cited by 5
BanglaFake: Constructing and Evaluating a Specialized Bengali Deepfake Audio DatasetPreprint
Fahad, I. A., Asif, K., & Sikder, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.10885 · Cited by 5
“Mean opinion score (MOS) [26] is one of the most popular metrics for subjective evaluation.”
Zolnoori, M., Azadmaleki, H., Haghbin, Y., Zolnour, A., Nezhad, M. J. M., Rashidi, S., Naserian, M., Esmaeili, E., & Arpanahi, S. K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.08132 · Cited by 5
“Therefore, we used a qualitative method, Mean Opinion Score, 21 where two experts (HA, MZ) listened to 5% of the data (stratified by demographic and diagnostic classes) and rated quality on a 1–5 Likert scale.”
Concannon, D. (2020) · Research@THEA · Cited by 5
Geng, Y., Li, Y., Yang, J., Tianhan, J., An, B., Li, Y., & Shen, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.27383 · Cited by 5
Lightweight target speaker separation network based on joint training
Wang, J., Liu, H., Xu, L., Yang, W., Yi, W., & Liu, F. (2023) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-023-00317-3 · Cited by 4
“…(PESQ) [39], short-time objective intelligibility (STOI) [40], log spectral distance (LSD) [41], and three comprehensive mean opinion score (MOS) [42] metrics for speech quality: MOS predictor of intrusiveness of background noise (CBAK), MOS predictor of speech distortion (CSIG), MOS predictor…”
BackgroundAre students really biased against female professors? — Experimental evidence from India
Arora, P., & Roy, M. (2024) · Journal of Development Economics · doi:10.1016/j.jdeveco.2024.103362 · Cited by 4
Eye Tracking and Human Influence Factors’ Impact on Quality of Experience of Mobile Gaming
Nawaz, O., Khatibi, S., Sheikh, M. N., & Fiedler, M. (2024) · Future Internet · doi:10.3390/fi16110420 · Cited by 4
“Originally developed for scaling voice quality in telecommunications, the MOS has been studied extensively for its limitations in evaluating multimedia content [11,12,48].”
Silva, C. A. M., Bessa, R. J., Andrade, J., Coelho, F. A., Costa, R. B., Silva, C. D., Vlachodimitropoulos, G., Stavropoulos, D., Chadoulos, S., & Rua, D. (2024) · iScience · doi:10.1016/j.isci.2024.111430 · Cited by 4
Alternative Vietnamese Speech Synthesis System with Phoneme Structure
Tường, L. Q., Hao, D., Vo, T.-H., & Nguyen, D. D. (2019) · International Symposium on Communications and Information Technologies · doi:10.1109/iscit.2019.8905142 · Cited by 4
“We use the Mean Opinion Score (MOS) [23] to evaluate the quality of speech synthesized by our model.”
MethodInfluentialComparative Study for Multi-Speaker Mongolian TTS with a New Corpus
Liang, K., Liu, B., Hu, Y., Liu, R., Bao, F., & Gao, G. (2023) · Applied Sciences · doi:10.3390/app13074237 · Cited by 4
Al-Rubbiay, F. H., Youssef, A. Y., & Mahmood, S. D. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-3716-5_40 · Cited by 4
Learning a QoE Metric from Social Media and Gaming Footage
Alvarez, C., & Argyraki, K. (2023) · ACM Workshop on Hot Topics in Networks (HotNets) · doi:10.1145/3626111.3628208 · Cited by 4
“The industry standard is the Mean Opinion Score (MOS), which relies on asking users to rate their experience on a scale; it is simple to compute but has well-known biases and inconsistency issues [29].”
BackgroundInfluentialAdvancements in encoded speech data by background noise suppression under uncontrolled environment
Nagaraja, B. G., Thimmaraja Yadava, G., & Anees, M. (2024) · International Journal of Speech Technology · doi:10.1007/s10772-023-10078-1 · Cited by 4
“The subjective listening tests (Streijl et al., 2016; Viswa-nathan & Viswanathan, 2005; Loizou, 2011; Hu & Loizou, 2007) and overall SNR metric (Ma & Loizou, 2011; Wat-kins et al., 2018) are considered for the evaluation of the existing and proposed algorithms.”
Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment
Tiotsop, L. F., Servetti, A., Počta, P., Wallendael, G. V., Barkowsky, M., & Masala, E. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3664198 · Cited by 4
“Although the effectiveness of these approaches has been proven in many applications, several authors [11, 17, 31, 37, 42, 47, 65] have pointed out the need to go beyond the MOS to achieve an exhaustive assessment of the end users’ QoE.”
Oosthuizen, D., Sharma, T., Chavula, J., & Densmore, M. (2022) · EPiC series in computing · doi:10.29007/wwft · Cited by 4
Quality Assessment Criteria and Methods for 3D Digital Replica of Historical Printing Woodblocks
Ngo, T. D., Ta, V. C., Chau, M. T., Nguyen, H., Nguyen, H. X., & Ha, L. T. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3532854 · Cited by 4
“In this study, we use the Mean Opinion Score (MOS) method [15] to calculate the final score of evaluation.”
MethodAmbiguity-based evaluation of objective quality metrics for image compression
Cheon, M., & Lee, J. (2016) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2016.7498944 · Cited by 4
“The necessity of considering uncertainty of MOS was also raised in [14], [15].”
BackgroundMiSAL - A minimal quality representation switch logic for adaptive streaming
Dvir, A. Z., Harel, N., Dubin, R., Barkan, R. B., Shalala, R., & Hadar, O. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-07865-x · Cited by 4
“Nevertheless, the authors proposed a simplified model that estimates the MOS value based solely on two parameters: (1) the switching amplitude; i.e., the difference in quality levels, and (2) the total playback time during each quality level.”
MethodInfluentialVoice Quality Evaluation Platform for the Arabic Language
Amrouche, A., Boubakeur, K. N., Bentrcia, Y., Ferrat, K., Abed, A., & Falek, L. (2021) · National Conference on Electrical and Electronics Engineering (ELECO) · doi:10.1109/iceee52452.2021.9415924 · Cited by 4
“The most subjective test used is the MOS (Mean Opinion Score), where the quality is measured on a scale of 1 to 5; 1 for poor quality and 5 for excellent quality [2].”
BackgroundMethodA Concealment Technique For Missing VoIP Packets Across Non-deterministic IP Networks
Adelabu, M. A., Imoize, A. L., & Obaruakpor, U. (2021) · Journal of Telecommunication Electronic and Computer Engineering (JTEC) · doi:10.54554/jtec.2021.13.03.006 · Cited by 4
“It is the average value over all individual “values on a predefined scale that a subject assigns to his/her opinion of the performance of a system quality” [18][23][28][29].”
BackgroundCS-ACELP Speech Coding Simulink Modeling, Verification, and Optimized DSP Implementation on DSK 6713
Elsayed, H. A., Abotaleb, A. M., Mahmoud, E. M., & Zekry, A. (2019) · International Conference on Promising Electronic Technologies (ICPET) · doi:10.1109/icpet.2019.00022 · Cited by 4
Overview and Challenges of Ambient Systems, Towards a Constructivist Approach to their ModellingPreprint
Rocher, G., Tigli, J., Lavirotte, S., & Thanh, N. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09770 · Cited by 4
“In this context, the Mean Opinion Score (MOS [94]) is widely used.”
MethodMRecGen: Multimodal Appropriate Reaction GeneratorPreprint
Xu, J., Luo, C., Xie, W., Shen, L., Liu, X., Liu, L., Güneş, H., & Song, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.02609 · Cited by 4
Yuan, S., Whitmarsh, T., Kessler, D. A., Arponen, O., McLean, M. A., Baxter, G. C., Riemer, F., Kennerley, A. J., Brackenbury, W. J., Gilbert, F. J., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.16481 · Cited by 4
“An alternate labelling method is through human evaluations by expert readers to provide a Mean Opinion Score (MOS) of the image quality [24].”
MethodLi, Z., Zou, C., Ma, S., Yang, Z., Chen, D., Tang, Y., Cao, Z., Zhang, N., Lai, J.-H., Lin, R.-S., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.17610 · Cited by 4
“…medical VLM/LLM domain, we leverage the philosophy of double-stimulus continuous quality-scale (DSCQS) [78], utilize the mechanism of differential mean opinion scores (DMOS) [81], [82], and integrate the necessary medical domain knowledge to provide more fine-grained and robust evaluation results.”
MethodImproving Voice Quality in Speech Anonymization With Just Perception-Informed LossesPreprint
Ghosh, S., Thiele, T., Lorbeer, F., Dreyer, F., & Stober, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.15499 · Cited by 4
“Mean Opinion Score (MOS) Loss: The MOS is a widely used subjective metric for assessing the quality or naturalness of speech [32].”
MethodTTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained DiagnosisPreprint
Wang, X., Wang, J., Song, X., Song, B., Xie, J., Shao, J., Lin, Z., Wu, D., Meng, M., Luan, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.22225 · Cited by 4
“However, the traditional Mean Opinion Score (MOS) [7] faces a “black box” dilemma: its single scalar obscures real capabilities in pronunciation, prosody, and emotion, and fails to capture subtle artifacts that cause perceptual collapse.”
Chen, Z., Pang, Y., Jin, S., Qin, J., Li, S., & Yang, H. (2024) · Electronics · doi:10.3390/electronics13224514 · Cited by 3
Yu, Q., Chen, Y., Ma, J., Liang, X., & Tang, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.131011 · Cited by 3
Emphasis rendering for conversational text-to-speech with multi-modal multi-scale context modeling
Liu, R., Zhenqi, J., Yang, J., Hu, Y., & Li, H. (2026) · Speech Communication · doi:10.1016/j.specom.2026.103353 · Cited by 3
BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialects
Hasan, J., & Dipta, S. R. (2025) · Workshop on Bangla Language Processing (BLP) · doi:10.18653/v1/2025.banglalp-1.4 · Cited by 3
Understanding Frechet Speech Distance for Synthetic Speech Quality Evaluation
Kim, J.-W., Agarwal, D., & Cerina, F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464031 · Cited by 3
An Approach for Volume Decomposition in Robot-Based Additive Manufacturing
Lettori, J., Raffaeli, R., Borsato, M., Pellicciari, M., & Peruzzini, M. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1110-1127 · Cited by 3
Isra, J. R. (2024) · International Conference on Digital Transformation and Applications (ICDXA) · doi:10.1109/icdxa61007.2024.10470814 · Cited by 3
“The scores given by the evaluators were averaged resulting in the Mean Opinion Score (MOS) [15], illustrated in Fig.”
MethodATELIER: Service Tailored and Limited-Trust Network Analytics Using Cooperative Learning
Milani, M., Bega, D., Gramaglia, M., Serrano, P., & Mannweiler, C. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3401746 · Cited by 3
“But this classification cannot be performed by the MNO alone, since only the SP knows the ground truth about QoE (using, e.g., Mean Opinion Score (MOS) models [18], or Video Multi-method Assessment Fusion (VMAF) [19], [20]), and the traffic could be end-to-end encrypted.”
BackgroundSitting, Chatting, Waiting: Influence of Loading Times on Mobile Instant Messaging QoE
Seufert, A., Baur, C., Poignée, F., Seufert, M., & Hoßfeld, T. (2024) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex61742.2024.10598245 · Cited by 3
Deep Learning for Face Super-Resolution: A Techniques Review
Zhu, B., Zhao, K., Lu, T., Jiang, J., Wang, Z., Jiang, K., & Xiong, Z. (2024) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.20240045 · Cited by 3
Gamaka Synthesis for Kalpitha Swaras in Carnatic Music
Sankaranarayanan, R., Heck, L. P., & Weinberg, G. (2025) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw65056.2025.11011251 · Cited by 3
“The Mean Opinion Score (MOS) [28] is a common metric used in works such as [29].”
Chu, Y., Shim, Y., & Park, U. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91581-9_9 · Cited by 3
Design of a Low-Cost Visible Light Communication (VLC) System for Music and Video Streaming
Hocaoglu, K., Adar, A., Arikok, Y. A., & Rodoplu, V. (2019) · Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu48272.2019.8946361 · Cited by 3
“MOS is a numerical measure of the human-judged overall quality of an event or experience [11], where a score of 5 (Excellent) corresponds to an imperceptible impairment; a score of 4 (Good) to a perceptible but not annoying one; a score of 3 (Fair) to a slightly annoying impairment; a score of 2 (Poor) to an annoying…”
BackgroundAffordable Mobile Virtual Reality Earthquake Simulation
Liuwandy, P., Suryasari, & Wella, W. (2020) · International Conference on Informatics and Computing (ICIC) · doi:10.1109/icic50835.2020.9288562 · Cited by 3
Padhi, S., Kiran, K., Thakur, A., Dhillon, A., & Depuru, B. K. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24mar1984 · Cited by 3
Correlations of Evaluation Metrics for Voice Conversion: An Experimental Analysis
Nandi, A., Ghosh, S., Akhter, M. T., Dhar, S., & Jana, N. D. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725801 · Cited by 3
“Besides these, subjective assessments are employed through the mean opinion score (MOS) [16] to capture human perceptions of voice quality and speaker similarity, providing invaluable insights into the user experience of VC technologies.”
MethodInvestigating the Influence of Subtitles Synchronization in the Viewer's Quality of Experience
Guimarães, R. L., Brito, J. O., & Santos, C. A. S. (2018) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3274192.3274222 · Cited by 3
“O mais curioso é que a maioria desses usuários de legendas não possui qualquer problema auditivo; isso evidencia que esse tipo de mídia, complementar ao conteúdo audiovisual principal, muitas vezes desempenha um papel-chave para a Qualidade de Experiência (QoE) [41] do telespectador.”
BackgroundAdding an Emotions Filter to Javanese Text-to-Speech System
Mulyanto, E., Yuniarno, E. M., & Purnomo, M. H. (2018) · International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM) · doi:10.1109/cenim.2018.8711229 · Cited by 3
Jahromi, H. Z., Delaney, D. T., & Hines, A. (2019) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct46805.2019.8947014 · Cited by 3
“The perceived quality is commonly measured using a Mean Opinion Score (MOS) [4] aggregated from a group of user’s judgements.”
MethodMedia Informasi untuk Bank Baterai Berbasis Augmented Reality
Aulia, S., Purba, R. Y., & Gunarso, A. (2020) · Jurnal Nasional Teknik Elektro dan Teknologi Informasi (JNTETI) · doi:10.22146/.v9i3.381 · Cited by 3
“Berdasarkan hasil pengujian yang telah dilakukan, dapat diambil beberapa kesimpulan bahwa aplikasi media informasi bank baterai di PT. Telkom Witel Bandung bersifat friendly (MOS 4,3), interaktif (MOS 4,1), dan reliabel (MOS 4,2) .”
BackgroundInfluentialAnalysis of the Cost of Varying Levels of User Perceived Quality for Internet Access
Arnab, A. A., Raj, S. M. R. H., Schormans, J., Mukta, S. J., & Ahmad, N. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-68154-8_36 · Cited by 3
Myanmar Text-to-Speech Synthesis Using End-to-End Model
Qin, Q., Yang, J., & Li, P. (2020) · International Conference on Natural Language Processing and Information Retrieval (NLPIR) · doi:10.1145/3443279.3443295 · Cited by 3
“We use the mean opinion score (MOS) [26] to evaluate the comprehensive speech quality of the model.”
MethodA Real-Time Oral Cavity Gesture Based Words Synthesizer Using Sensors
Padmini, P., Paramasivam, C., Lal, G. J., Alharbi, S., & Bhowmick, K. (2022) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.022857 · Cited by 3
Machine learning assisted composition of traditional music from the Colombian Caribbean Region
Pico-Ripoll, D., Percybrooks, W., & Viloria-Núñez, C. (2022) · IEEE ANDESCON · doi:10.1109/andescon56260.2022.9989762 · Cited by 3
“As shown in Table I and Table II, average Scores for 2-RNN per tier models were mostly in the acceptable sector of the scale [16].”
BackgroundMethodSR-MT: a metamorphic method to test the robustness of speech recognition software
Wang, F., Ben, K., & Zhang, X. (2022) · IEEE/ACM International Workshop on Metamorphic Testing (MET) · doi:10.1145/3524846.3527339 · Cited by 3
“We invited 20 volunteers to assign a mean opinion score (MOS) [18], which has been widely used in listening tests, to quantify the speech quality.”
MethodResearch on Virtual Reality System of Gantry Dual-arm Welding Robot
Zhang, R., Zhang, Z., Xu, Y., Sun, H., Liu, C., & Zhang, B. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1300-1311 · Cited by 3
A Reactive Deep Learning-Based Model for Quality Assessment in Airport Video Surveillance Systems
Liu, W., Pan, Y., & Fan, Y. (2024) · Electronics · doi:10.3390/electronics13040749 · Cited by 3
Towards Internet Scale Quality-of-Experience Measurement with Twitter
Kergl, D., Roedler, R., & Rodosek, G. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-60774-0_8 · Cited by 3
“give a comprehensive summary of methods, applications, limitations and alternatives of the MOS in [30].”
Towards Behavior-oriented Quality of Experience Assessment for Online Video Services
Robitza, W. (2017) · ACM International Conference on Interactive Experiences for TV and Online Video · doi:10.1145/3084289.3084297 · Cited by 3
“These tests must also differ from methods commonly used in the QoE community, where a large number of samples of varying quality are shown to test subjects, requiring them to rate them on a predefined scale [21].”
MethodA Novel Quality Metric Using Spatiotemporal Correlational Data of Human Eye Maneuver
Podder, P. K., Paul, M., & Murshed, M. (2017) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2017.8227396 · Cited by 3
Yamazaki, T., Yamamoto, R., & Iijima, A. (2018) · IEICE Communications Express · doi:10.1587/comex.2018xbl0027 · Cited by 3
“The generic method for QoE evaluation is Mean Opinion Score (MOS), which is the average of values that subjects assign their individual opinion based on the predefined scale [5].”
MethodSysGpr: Sistema de generación de señales sintéticas pseudo-realistas
León‐García, F., Rodriguez-Lozano, F. J., Cubero-Fernández, A., Palomares, J. M., & Olivares, J. (2019) · Revista Iberoamericana de Automática e Informática Industrial RIAI · doi:10.4995/riai.2019.10025 · Cited by 3
“…de las señales generadas, éstas fueron realizadas por seis investigadores los cuales tienen conocimientos relacionados con el tratamiento de señales (el número de expertos escogidos, cumple los requisitos mı́nimos exigidos por MOS (Streijl et al., 2014) para obtener resultados concluyentes).”
BackgroundNo-reference quality assessment of HEVC video streams based on visual memory modelling
Dehkordi, M., Ebrahimi-Moghadam, A., Khademi, M., & Hadizadeh, H. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.103011 · Cited by 3
Improving mobile VoIP quality through bandwidth optimisation
Dantas, R., Exton, C., & Gear, A. L. (2017) · Arrow@dit (Dublin Institute of Technology) · doi:10.34961/3217 · Cited by 3
Towards transformation-resilient provenance detection of digital mediaPreprint
Hayes, J., Krishnamurthy, Dvijotham, Chen, Y., Dieleman, S., Kohli, P., & Casagrande, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07355 · Cited by 3
“MOS [Streijl et al., 2016] is a commonly used measure for audio quality; it is expressed as a single rational number, typically in the range 1–5, where 1 is lowest perceived quality, and 5 is the highest perceived quality.”
Non-Linear Scoring Model for Translation Quality EvaluationPreprint
Gladkoff, S., Han, L., & Gasova, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.13467 · Cited by 3
Wang, Y., Feng, M., Ward, R. K., Wang, Z. J., & Wang, L. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.28734.51529 · Cited by 3
Neural target speech extraction
Žmolíková, K. (2022) · Brno University of Technology Digital Library (Brno University of Technology) · Cited by 3
Personalizing facial expressions by exploring emotional mental prototypes
Yan, S. (2023) · theses.fr (ABES) · doi:10.70675/1757ca48z9dbaz493eza6b0zfe3fc4837c30 · Cited by 3
Naktal Moaid, E. D. A. N., & Mahmood, S. A. (2022) · MINAR International Journal of Applied Sciences and Technology · doi:10.47832/2717-8234.11.8 · Cited by 2
Liu, G., Zhang, T., Guo, H., Wen, J., & Lv, Y. (2023) · Applied Acoustics · doi:10.1016/j.apacoust.2023.109726 · Cited by 2
Expressive Speech Synthesis with Theme-Oriented Few-Shot Learning in ICAGC 2024
Wang, H., Wang, T., Gong, C., Jiang, Y., Liu, Q., Wang, L., & Dang, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800403 · Cited by 2
“Subjective evaluations are conducted by native speakers invited by the organizers, assessing Mean Opin-ion Score (MOS) [32] for speech naturalness, speaker similarity, and emotional expressiveness.”
Swar (Hindi): A Speaker-Aware Vocoder for Low-Resource Speech Synthesis
Purohit, R. M., & Patil, H. A. (2025) · International Conference on Asian Language Processing · doi:10.1109/ialp68296.2024.11156272 · Cited by 2
CATS: Clean-label backdoor attack on speech recognition via speech synthesis
Tang, Y., Xu, X., & Sun, L. (2025) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2025.103596 · Cited by 2
AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesis
Jia, Z., Zhao, Y., Aruukhan, Liu, R., & Li, H. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835562 · Cited by 2
A Framework to Analyze Quality of Service (QoS) for Text-To-Speech (TTS) Services
Fudzee, M. F. M., HASSAN, M. M., Mahdin, H., Kasim, S. B., & Abawajy, J. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-51281-5_59 · Cited by 2
Jang, J., Jang, H., Eo, T., Bang, K., & Hwang, D. (2018) · Applied Sciences · doi:10.3390/app8091688 · Cited by 2
“Lastly, we calculated mean opinion scores [38] from these subjective scores.”
MethodWilliams, S. (2022) · Springer eBooks · doi:10.1007/978-3-031-12488-4_4 · Cited by 2
Quality of Experience in Internet of Things: A Systematic Literature Review
Sanyour, R., Abdullah, M., & Abdullah, S. (2022) · Journal on internet of things · doi:10.32604/jiot.2022.040966 · Cited by 2
Sheferaw, G. K., Mwangi, W. R., Kimwele, M. W., Mamuye, A. L., & Salau, A. O. (2024) · IEEE Access · doi:10.1109/access.2024.3493604 · Cited by 2
“It involves gathering ratings from listeners who rate speeches on a scale typically ranging from 1 to 5 [42], [43], [44] with the following categories: 1 (bad): poor and difficult to understand; 2 (poor): somewhat understandable but with noticeable clarity issues; 3 (fair): understandable with…”
BackgroundD’Acquisto, G., & Naldi, M. (2019) · International Journal of Simulation Systems Science & Technology · doi:10.5013/ijssst.a.20.s1.11 · Cited by 2
Shah-Mohammadi, F., Tondwalkar, A. V., & Kwasinski, A. (2020) · Wireless Telecommunications Symposium · doi:10.1109/wts48268.2020.9198729 · Cited by 2
“The MOS, as the measure metric for the perceived satisfaction of end-users with the service received, has emerged as the most popular descriptor of human-perceived media quality, [10].”
BackgroundColour Image Authentication and Recovery Using Wavelet Packets Watermarking
Al-Otum, H. M. (2022) · Circuits Systems and Signal Processing · doi:10.1007/s00034-021-01927-y · Cited by 2
“The MOS experiment was provided in the following manner [30]: • The host and watermarked images were visually evaluated by 30 observers: 10 specialists in image processing, 10 persons that are familiar with image processing softwares, and 10 senior students that passed the image processing course.”
MethodWaiting along the Path: How Browsing Delays Impact the QoE of Music Streaming Applications
Seufert, A., Schweifler, R., Poignée, F., Seufert, M., & Hoßfeld, T. (2022) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex55416.2022.9900883 · Cited by 2
A New Speech Encoder Based on Dynamic Framing Approach
Liu, R., Yang, J., Zhou, X., & Yue, X. (2023) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2023.021995 · Cited by 2
Pei, H., Luo, M., & Du, S. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1271-1287 · Cited by 2
Mori, K., Negishi, T., Makabe, K., Sekiguchi, R., & Tsuchida, T. (2024) · Radiological Physics and Technology · doi:10.1007/s12194-024-00796-9 · Cited by 2
“Two cardiologists and 10 radiological technologists performed visual evaluation using the mean opinion score (MOS) and image contrast evaluation using SV and DA images [16].”
An overview of bit-depth enhancement: Algorithm datasets and evaluation
Liu, J., Li, X., & Zhai, G. (2024) · Displays · doi:10.1016/j.displa.2024.102896 · Cited by 2
VP & Unit Head (Import & Export), C. B. P., & Kamal, M. (2026) · doi:10.63125/agnvxs76 · Cited by 2
Pan, S., Chen, K., Chen, Y., & Zhou, W. (2017) · IET Communications · doi:10.1049/iet-com.2016.1096 · Cited by 2
Melo, M., Göebel, J., Farias, D. D. R., Santos, C., Tavares, T. A., Corrêa, G., Zatt, B., & Porto, M. (2017) · Brazilian Symposium on Multimedia and the Web · doi:10.1145/3126858.3131596 · Cited by 2
“…existem diversas métricas que podem ser aplicadas, mas uma das métricas mais utilizadas é a média das opiniões ( Mean Opinion Score – MOS) [16] com estímulo único, na qual os telespectadores são convidados a assistir uma sequência de teste codificada em um perfil de referência seguido da…”
BackgroundA Novel No-reference Subjective Quality Metric for Free Viewpoint Video Using Human Eye Movement
Podder, P. K., Paul, M., & Murshed, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75786-5_20 · Cited by 2
Tan, P. X., & Kamioka, E. (2018) · Journal of Computer and Communications · doi:10.4236/jcc.2018.68005 · Cited by 2
Moan, S. L., & Pedersen, M. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451660 · Cited by 2
“Furthermore, the traditional mean opinion scores (MOS) cannot realistically represent the diversity of perceptual abilities in a pool of several hundreds of participants [4].”
BackgroundNo-reference Speech Quality Assessment of SWB Signal Based on Machine Learning
Wang, R., Liu, Y., Ding, G., Wei, Y., Yang, H., Theories, W., & Lab, T. (2018) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2018.8491197 · Cited by 2
“However, the subjective test needs high economic costs and time consumptions [4] and it’s not appropriate for large-scale speech evaluation.”
BackgroundEMAN: The Human Visual Feature Based No-Reference Subjective Quality Metric
Podder, P. K., Paul, M., & Murshed, M. (2019) · IEEE Access · doi:10.1109/access.2019.2904732 · Cited by 2
“The widely used subjective metric MOS [27], [28] in contrast, is often biased FIGURE 1.”
MethodResearch on User-Oriented Quality Management of Network Operation and Maintenance
Zhang, B., Liu, X., Wang, X., & Zhang, H. (2020) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec48623.2020.9085042 · Cited by 2
“Average Opinion Score (MOS) The quantification of QoE is widely used in the evaluation of mean subjective score MOS(mean opinion score) proposed by ITU-T of the International Telecommunication Union, which is also an evaluation standard recognized by the industry[6].”
MethodImage Translation Method based on GAN for Surveillance under Dim Surround
Jung, S., Kwon, H., Kim, Y.-C., Ahn, S.-H., & Lee, S.-H. (2020) · The Journal of Korean Institute of Information Technology · doi:10.14801/jkiit.2020.18.8.9 · Cited by 2
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.