Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Items 101–200 of 650
Traffic Engineering in Software-defined Networks using Reinforcement Learning: A Review
Dake, D. K., Gadze, J. D., Klogo, G. S., & Nunoo‐Mensah, H. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120541 · Cited by 20
Message-Driven Generative Music Steganography Using MIDI-GAN
Su, Z., Zhang, G., Shi, Z., Hu, D., & Zhang, W. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3372139 · Cited by 19
“Forthefirstexperiment,weintroducedthemeanopinionscore (MOS) [51] to evaluate the perceived quality of the generated MIDI files.”
BackgroundDutta, D., Chetia, D., Sonowal, N., & Kalita, S. K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.07855 · Cited by 19
Gao, G., Zhang, H., Xia, Z., Luo, X., & Shi, Y.-Q. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3318048 · Cited by 18
How to measure and model QoE for networked games? A case study of World of Warcraft
Sužnjević, M., Skorin‐Kapov, L., Čereković, A., & Matijašević, M. (2019) · Multimedia Systems · doi:10.1007/s00530-019-00615-x · Cited by 18
“When conducting QoE studies, the reporting of only MOS values has previously been criticized, as MOS values average out the individual variations between users [47, 56].”
MethodDeveloping a Dynamic Cluster Quantization based Lossless Audio Compression (DCQLAC)
Mondal, U. K., & Debnath, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09886-3 · Cited by 18
“Entropy along with SNR, PSNR and MOS are also used for verifying present encoding method and compare the performance with existing lossless compression techniques.”
MethodInfluentialGowda, S. N., Pandey, D., & Gowda, S. N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.16041 · Cited by 18
“Finally, an image generation network creates photorealistic talking-head videos.”
A dataset of text prompts, videos and video quality metrics from generative text-to-video AI models
Chivileva, I., Lynch, P., Ward, T. E., & Smeaton, A. F. (2024) · Data in Brief · doi:10.1016/j.dib.2024.110514 · Cited by 18
“In assessing the quality of still images the “de facto’’ metric is mean opinion score (MOS) [ 16 ] which is the mean of the opinions and ratings of human evaluators gathered according to some numeric or qualitative scale such as we use here.”
BackgroundDebating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agents
He, H., Li, Y., Wen, D., Chen, Y., Cheng, R., Chen, D., & Lau, F. C. M. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792993 · Cited by 17
“Beyond accuracy, we conduct a Mean Opinion Score (MOS) evaluation [39] of justification quality based on the criteria proposed by Warren et al. [45], who identified three key dimensions of justification quality by interviews with fact-checking experts across five continents: (1) Evidence Used :…”
A CBAM‐GAN‐based method for super‐resolution reconstruction of remote sensing image
Wang, L., Yu, Q., Li, X., Zeng, H., Zhang, H., & Gao, H. (2023) · IET Image Processing · doi:10.1049/ipr2.12968 · Cited by 17
Pornpongtechavanich, P., & Daengsi, T. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-07928-z · Cited by 17
Deep-learning-based enhanced optic-disc photography
Ha, A., Sun, S., Kim, Y. K., Lee, J., Jeoung, J. W., Kim, H. C., & Park, K. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239913 · Cited by 17
“The 5 grades were numbered between 1 (‘poor’) and 5 (‘excellent’); then, we performed a mean opinion score (MOS) test to compare the qualitative assessments in and among the image groups [17].”
MethodSubjective Assessment Experiments That Recruit Few Observers With Repetitions (FOWR)
Pérez, P., Janowski, L., Garcia, N. N., & Pinson, M. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3098450 · Cited by 17
“We will measure association by computing Pearson’s linear correlation coefficient (PCC), as it is the most frequently used comparison metric both for objective and subjective scores [13].”
BackgroundMethodMean Opinion Score Estimation for Mobile Broadband Networks Using Bayesian Networks
El‐Saleh, A. A., Alhammadi, A., Shayea, I. A. M., Azizan, A., & Hassan, W. H. (2022) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.024642 · Cited by 17
Real-Time Classification of Real-Time Communications
Perna, G., Markudova, D., Trevisan, M., Garza, P., Meo, M., Munafò, M. M., & Carofiglio, G. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3189628 · Cited by 17
“As proven in the literature [15], [16], when presented with a good audio and several different degraded versions of video, users perceive sufficient QoE.”
BackgroundNo-Reference Video Quality Assessment Based on Visual Memory Modeling
Banitalebi-Dehkordi, M., Ebrahimi-Moghadam, A., Khademi, M., & Hadizadeh, H. (2019) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2019.2957670 · Cited by 17
“Digital Object Identifier 10.1109/TBC.2019.2957670 can be used to assess the video quality [1].”
BackgroundInfluentialImproving transfer of expressivity for end-to-end multispeaker text-to-speech synthesis
Kulkarni, A., Colotte, V., & Jouvet, D. (2021) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco54536.2021.9616249 · Cited by 17
“Likewise, for expressive MOS, listeners are directed to provide scores between 1 (bad) and 5 (excellent) depending on how synthesized speech utterance resembles the expressivity given in the reference speech utterance.”
MethodInfluentialAzadmaleki, H., Haghbin, Y., Rashidi, S., Nezhad, M. J. M., Zolnour, A., & Zolnoori, M. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02026-x · Cited by 16
Sun, Y., Wang, B., Li, S., Sun, Z. Y., Nguyen, H. M., & Duong, T. Q. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2935537 · Cited by 16
“By analogy to the QoE evaluation methods in [25], we adopt the mean opinion score (MOS) method to reflect the satisfaction for service quality.”
MethodSoftwarization and virtualization of VoIP networks
Montazerolghaem, A. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-022-04448-w · Cited by 16
“– Increasing the VoIP network’s throughput, – Reducing the delay in making a call, – Enhancing the quality and evaluating multimedia quality parameters, including Mean Opinion Score (MOS) [30] and R factor [31], – The integrated resources management of the VoIP network, – The centralized routing of signaling and media…”
BackgroundInfluentialUltraSR: Silent Speech Reconstruction via Acoustic Sensing
Fu, Y., Wang, S., Zhong, L., Chen, L., Ren, J., & Zhang, Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3419170 · Cited by 16
“Due to the lack of time-aligned reference speech to objectively compare the quality of reconstructed speech in silence, we adopt a widely used subjective evaluation technique, i.e., Mean Opinion Score (MOS) [64], to compare the quality of speech.”
MethodWoo, J., Hong, S., Kang, D. H., & An, D. (2024) · Applied Sciences · doi:10.3390/app142210490 · Cited by 16
Robotham, T., Rummukainen, O., Kurz, M., Eckert, M., & Habets, E. A. P. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3150491 · Cited by 16
“Consequently, many standards now exist to address these different scenarios [68].”
BackgroundA Novel End-to-End Turkish Text-to-Speech (TTS) System via Deep Learning
Oyucu, S. (2023) · Electronics · doi:10.3390/electronics12081900 · Cited by 16
Color Constancy for Uniform and Non-Uniform Illuminant Using Image Texture
Hussain, M. A., Sheikh-Akbari, A., & Halpin, E. (2019) · IEEE Access · doi:10.1109/access.2019.2919997 · Cited by 16
Kim-Lee, H.-J., Hong, S. W., Kim, D. K., Kim, J., Kim, H. S., Chung, S.-W., Cho, E.-H., Kim, H., & Lee, B.-K. (2020) · Microsystems & Nanoengineering · doi:10.1038/s41378-020-00203-4 · Cited by 16
Improving Audio Anomalies Recognition Using Temporal Convolutional Attention Networks
Huang, Q., & Hain, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414611 · Cited by 16
“, [3] investigated the applicability of three neural network-based approaches for non-intrusive audio quality assessment based on mean opinion score(MOS) estimation [5].”
BackgroundTest Generation Strategies for Building Failure Models and Explaining Spurious Failures
Jodat, B. A., Chandar, A., Nejati, S., & Sabetzadeh, M. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3638246 · Cited by 15
“The fitness function for NTSS measures the network quality based on the well-known mean opinion score ( MOS ) metric [85].”
MethodOsadebey, M. E., Pedersen, M., Arnold, D. L., & Wendel-Mitoraj, K. E. (2018) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2018.2855213 · Cited by 15
“It is recommended not to compare the MOS values produced from multi-category experiments such as our own experiments because the values derived from MOS experiment are strongly dependent on the set up of the experiment [68].”
BackgroundMethodTwo-level scheduling scheme for integrated 4G-WLAN network
Taha, M. Q., Ali, Z. H., & Ahmed, A. K. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i3.pp2633-2643 · Cited by 15
“If the value of MOS becomes lower than 2, then the voice becomes useless and the value is considered unacceptable by end users [24].”
BackgroundRobust Cough Detection With Out-of-Distribution Detection
Chen, Y., Attri, P., Barahona, J., Hernandez, M. L., Carpenter, D. M., Bozkurt, A. Y., & Lobaton, E. J. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3264783 · Cited by 15
“…rate for which we observe a significant drop of Virtual Speech Quality Objective Listener (ViSQOL), which compares the original signal and target signal to provide a speech quality score using the Mean Opinion Score (MOS) [41], on the “test-clean” set in the LibriSpeech (with speech labels) [39].”
MethodProbabilistic Fingermark Quality Assessment with Quality Region Localisation
Oblak, T., Haraksim, R., Beslay, L., & Peer, P. (2023) · Sensors · doi:10.3390/s23084006 · Cited by 15
“In contrast to simply calculate the average, or Mean Opinion Score (MOS) [32], a distribution of quality values also encodes other properties, such as variance or skewness.”
Background3D reconstruction system and multiobject local tracking algorithm designed for billiards
Rodriguez-Lozano, F. J., Gámez, J. C. V., Martínez, H., Palomares, J. M., & Olivares, J. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04542-3 · Cited by 15
“P.911 [85], which standardizes the use of MOS and specifies that the number of experts used in the assessment should be above 6.”
BackgroundFCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis
Hu, Y., Liu, R., Gao, G., & Li, H. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800061 · Cited by 15
“We conduct 5-point Likert scale mean opinion score (MOS) [32] listening experiments 1 to validate the FCTalker model in terms of prosodic expressiveness and context modeling.”
User-Centric Quality-of-Experience Optimization and Scheduling of Multicolor LEDs in VLC Systems
Bao, X., Gu, X., Zhang, W., & Chen, H. (2019) · IEEE Systems Journal · doi:10.1109/jsyst.2019.2924338 · Cited by 15
A preliminary study on evaluating Consultation Notes with Post-EditingPreprint
Moramarco, F., Korfiatis, A. P., Savkov, A., & Reiter, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04402 · Cited by 15
Image Quality Assessment with Gradient Siamese Network
Cong, H., Fu, L., Zhang, R., Zhang, Y., Wang, H., He, J.-R., & Gao, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00127 · Cited by 8
“In SIQA, Mean opinion score (MOS) is currently the best image quality metric, where a large number of observers are required to evaluate image quality in a controlled testing environment [5].”
BackgroundBao, X., Gu, X., & Zhang, W. (2018) · Optics Express · doi:10.1364/oe.26.027826 · Cited by 14
Qu, X., Liu, H., Sun, Z., Yin, X., Ong, Y.-S., Lu, L., & Ma, Z. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591876 · Cited by 14
Fundamental Relationships for Deriving QoE in Systems
Hoßfeld, T., Heegaard, P. E., Skorin‐Kapov, L., & Varela, M. (2019) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2019.8743339 · Cited by 14
Kulkarni, A., Colotte, V., & Jouvet, D. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1297 · Cited by 14
“Furthermore, we conducted the Mean Opinion Score (MOS) [32] perception test for subjective evaluation of proposed IAF based multi-speaker expressive text-to-speech synthesis system as well as for the RCVAE model.”
Zhou, X., Zhang, M., Zhou, Y., Wu, Z., & Li, H. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3657306 · Cited by 13
“We use the mean opinion score (MOS) [79] test to evaluate speech quality in terms of naturalness (NMOS).”
Incremental Text to Speech for Neural Sequence-to-Sequence Models Using Reinforcement Learning
Mohan, D. S. R., Lenain, R., Foglianti, L., Teh, T. H., Staib, M., Torresquintero, A., & Gao, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1822 · Cited by 13
“There are two aspects of the agent’s performance that we track: Quality: We compute the Mean Opinion Score (MOS) to measure the naturalness of our audio [37, 4].”
MethodReddy, H., Kar, A., & Østergaard, J. (2022) · Applied Acoustics · doi:10.1016/j.apacoust.2022.108627 · Cited by 13
Data Rate Reduction for Video Streams in Teleoperated Driving
Neumeier, S., Bajpai, V. K., Neumeier, M., Facchi, C., & Ott, J. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3171718 · Cited by 13
“The options to answer regarding MOS are Excellent , Good , Fair , Poor and Bad [47], while for the driveability they are No , Rather No , Rather Yes and Yes , avoiding the possibility to rate Uncertain .”
BackgroundArvind, & Ratan, R. (2019) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-019-00878-7 · Cited by 13
Evaluating the Influence of the HMD, Usability, and Fatigue in 360VR Video Quality Assessments
Orduna, M., Pérez, P., Díaz, C., & Garcia, N. N. (2020) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw50115.2020.00192 · Cited by 13
“The quality evaluation was examined with the Mean Opinion Score (MOS) and the Differential Quality Score (DMOS) from the subject’s rates, and the associated 95% Confidence Intervals (CI) [8].”
MethodQoE-Aware Rendering Service Allocation in Fog-Assisted Cloud Gaming Environments
Tsipis, A., Οικονόμου, Κ., Komianos, V., & Stavrakakis, I. (2020) · South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM) · doi:10.1109/seeda-cecnsm49515.2020.9221778 · Cited by 13
“Here it is augmented to contextualize the necessary QoE gaming agents, through on-the-fly QoE assessment, utilizing the G-Model [16] for acquiring Mean Opinion Score [17] QoE metrics.”
MethodInfluentialSpeech Time-Scale Modification With GANs
Cohen, E., Kreuk, F., & Keshet, J. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3164361 · Cited by 13
“However, MOS is often very subjective and hard to reproduce [31].”
BackgroundAffective Image Captioning for Visual Artworks Using Emotion-Based Cross-Attention Mechanisms
Ishikawa, S., & Sugiura, K. (2023) · IEEE Access · doi:10.1109/access.2023.3255887 · Cited by 13
Chen, J., Byun, J.-S., Elsner, M., & Perrault, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.14632 · Cited by 13
“Mean opinion score (MOS) is a subjective scoring system that allows human evaluators to rate the perceived quality of synthesized speech on a scale from 1 to 5, which is one of the most commonly employed evaluation methods for TTS system [35].”
CoCoEmo: Composable and Controllable Human-Like Emotional TTS via Activation SteeringPreprint
Wang, S., Tan, S., Liu, S., Jia, H. G., Huang, G., Bailey, J., & Dang, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.03420 · Cited by 13
Intra- and Inter-modal Context Interaction Modeling for Conversational Speech Synthesis
Jia, Z., & Liu, R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890216 · Cited by 12
“For the subjective evaluation metrics, we organize a dialogue-level mean opinion score (DMOS) [29] listening test with 20 graduate students whose second language is English and provide all volunteers with professional training on the rules.”
Ramírez-Jaime, A., Arce, G. R., Porras-Diaz, N., Єремеєв, О., Rubel, A., Лукин, В. В., Kopytek, M., Lech, P., Fastowicz, J., & Okarma, K. (2025) · Remote Sensing · doi:10.3390/rs17071215 · Cited by 12
Mondal, U. K., & Debnath, A. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12556-1 · Cited by 12
“MOS [24] is the quality rating and is calculated using (5).”
MethodEyes can draw: A high-fidelity free-eye drawing method with unimodal gaze control
Huang, L., Westin, T., Eladhari, M. P., Magnússon, S., & Chen, H. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102966 · Cited by 13
Prediction and Modeling for No-Reference Video Quality Assessment Based on Machine Learning
López, J. P., Martin, D., Jiménez, D., & Menéndez, J. M. (2018) · International Conference on Signal-Image Technology & Internet-Based Systems (SITIS) · doi:10.1109/sitis.2018.00019 · Cited by 12
“Mean Opinion Score (MOS) is the most commonly used parameter for subjective quality assessment, as it defines a predefined scale where subjects use their opinions to judge the performance of a system [5], being applied to a wide collection of applications, including video encoding and streaming transmission quality.”
Say What? A Dataset for Exploring the Error Patterns That Two ASR Engines Make
Moore, M., Saxon, M., Venkateswara, H., Berisha, V., & Panchanathan, S. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-3096 · Cited by 12
“to rate the speech on a scale of one (bad) to five (excellent) in terms of the quality of the sound [4].”
BackgroundBaziyad, M. S., Rabie, T. F., & Kamel, I. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10008-2 · Cited by 12
“Although this tool is considered basic, it is very well-known in the evaluation of numerous engineering systems [26].”
BackgroundShah-Mohammadi, F., & Kwasinski, A. (2020) · Wireless Telecommunications Symposium · doi:10.1109/wts48268.2020.9198732 · Cited by 12
“The MOS, as the most popular descriptor of human-perceived media quality [14], and its five level quality characterization (excellent, good, fair, poor, and bad) provides a common assessment metric across different traffic types and accordingly allows for a seamless integrated traffic management and…”
BackgroundA new method for judging thermal image quality with applications
Agaian, S., Ayunts, H., Trongtirakul, T., & Hovhannisyan, S. (2025) · Signal Processing · doi:10.1016/j.sigpro.2024.109769 · Cited by 11
Reddy, P. V., Rohith, D., Dhanush, S., Kumar, T. S. G., Lal, G. J., & Premjith, B. (2023) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca58529.2023.10395349 · Cited by 11
“MelGAN and Multi-Band MelGAN demonstrated high-quality vocoding, generating clear and realistic speech [16].”
BackgroundRahadianti, L., Azizah, A. Y., & Deborah, H. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e08038 · Cited by 11
Prospect Theory for Human-Centric Communications
Luo, K., Dang, S., Shihada, B., & Alouini, M. (2021) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2021.634950 · Cited by 11
“Perceptual measurements such as the mean opinion score (MOS) and the pseudo-subjective quality assessment (PSQA) have been developed to quantify user experience [26], [27].”
BackgroundBeyond Correlation: Evaluating Multimedia Quality Models With the Constrained Concordance Index
Ragano, A., Martinez, H. B., & Hines, A. (2024) · IEEE transactions on multimedia · doi:10.1109/tmm.2025.3542991 · Cited by 8
“Relying solely on MOS to measure QoE has been questioned due to its limited representation of QoE compared to other statistics such as standard deviation, confidence interval, and kurtosis [33].”
Awad, N., & Mkwawa, I.-H. M. (2017) · Annual Conference on New Trends in Information & Communications Technology Applications (NTICT) · doi:10.1109/ntict.2017.7976145 · Cited by 11
Mimicking Individual Media Quality Perception with Neural Network based Artificial Observers
Tiotsop, L. F., Mizdos, T., Barkowsky, M., Počta, P., Servetti, A., & Masala, E. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3464393 · Cited by 11
Bit-Plane Specific Measures and Its Applications in Analysis of Image Ciphers
Ratan, R., & Arvind (2019) · Communications in computer and information science · doi:10.1007/978-981-13-5758-9_24 · Cited by 11
Using Deep Speech Recognition to Evaluate Speech Enhancement Methods
Siddiqui, S., Rasool, G., Ramachandran, R. P., & Bouaynaya, N. C. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206817 · Cited by 11
MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied Baseline
Hu, Y., Yin, P., Liu, R., Bao, F., & Gao, G. (2022) · International Conference on Asian Language Processing · doi:10.1109/ialp57159.2022.9961271 · Cited by 11
“To evaluate naturalness, we conducted the mean opinion score (MOS) test [29].”
MethodDeep learning-based remote sensing image super-resolution: Recent advances and challenges
Yang, J., Ren, H., He, Z., & Zeng, M. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.132939 · Cited by 10
VideoVAE+: Large Motion Video Autoencoding with Cross-Modal Video VAE
Xing, Y., Fei, Y., He, Y., Chen, J., Xie, J., Chi, X., & Chen, Q. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01668 · Cited by 10
“We conduct the user study using Mean Opinion Score (MOS) [23].”
Ahn, J., Lee, H., Kim, Y., Kim, W., & Chung, J. (2021) · Sensors · doi:10.3390/s21062184 · Cited by 10
“ITU- Rec.”
MethodGenetic programming for structural similarity design at multiple spatial scales
Bakurov, I., Buzzelli, M., Castelli, M., Schettini, R., & Vanneschi, L. (2022) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3512290.3528783 · Cited by 10
“However, in practice, subjective evaluation happens to be complex, time-consuming, expensive, and sensitive to the experimental design [29].”
BackgroundMethodLearning Non-robustness using Simulation-based Testing: a Network Traffic-shaping Case Study
Jodat, B. A., Nejati, S., Sabetzadeh, M., & Saavedra, P. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00043 · Cited by 10
“A standard and well-known metric used in the network community to quantify network quality is Mean Opinion Score (MOS) [22].”
InfluentialDynaMiTE: Discovering Explosive Topic Evolutions with User Guidance
Balepur, N., Agarwal, S., Ramanan, K., Yoon, S., Yang, D., & Han, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.14 · Cited by 10
“…rank correlation coefficient ( Rank ) (Zar, 2005) to measure how similar the annotator’s order is to the true order of the topic evolution and ask annotators to rate their confidence ( Conf ) on a scale from 1 to 5 using Mean Opinion Score (Streijl et al., 2016), where 5 indicates total confidence.”
MethodInfluentialLossless audio codec based on CNN, weighted tree and arithmetic encoding (LACCWA)
Debnath, A., & Mondal, U. K. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17393-4 · Cited by 10
“• MOS: MOS (Mean Opinion Score) [31] is a statistic for gauging audio quality.”
Perceptually Adaptive Real-Time Tone Mapping
Tariq, T., Matsuda, N., Penner, E., Jia, J., Lanman, D. R., Ninan, A., & Chapiro, A. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618222 · Cited by 10
“This helps us ensure that the quality range reported in the study is scaled appropriately, and would allow for the calculation of a DMOS score if desired [Streijl et al. 2016].”
BackgroundMethodExploring Deepfake Detection: Techniques, Datasets and Challenges
Rana, P., & Bansal, S. R. (2024) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/160156 · Cited by 11
“The MOS score is calculated by having evaluators rate the quality of the images or videos [75], and taking the average of the scores [76].”
MethodSun, Q., Luo, Y., Li, S., Zhang, W., & Liu, W. (2024) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2024.emnlp-demo.5 · Cited by 10
MetricGAN+KAN: Kolmogorov-Arnold Networks in Metric-Driven Speech Enhancement Systems
Mai, Y., & Goetze, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890542 · Cited by 10
“…surrogate function which imitates non-differentiable intrusive metrics of audio quality such as PESQ [29], subjective mean opinion score (MOS) [30], or DNSMOS [31] since such perceptually motivated metrics often correlate better with human perception [2], [32] than traditional loss functions…”
Deriving QoE in systems: from fundamental relationships to a QoE-based Service-level Quality Index
Hoßfeld, T., Heegaard, P. E., Skorin‐Kapov, L., & Varela, M. (2020) · Quality and User Experience · doi:10.1007/s41233-020-00035-0 · Cited by 10
“The QoE values are shifted to a 5-point scale from [1; 5]”
MethodLow-Latency Incremental Text-to-Speech Synthesis with Distilled Context Prediction Network
Saeki, T., Takamichi, S., & Saruwatari, H. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9687904 · Cited by 10
Tiotsop, L. F., Servetti, A., Barkowsky, M., Počta, P., Mizdos, T., Wallendael, G. V., & Masala, E. (2022) · Signal Processing Image Communication · doi:10.1016/j.image.2022.116917 · Cited by 10
Performance Evaluation of VoIP Analysis and Simulation
Adjardjah, W., Kumassah, F., Abdallah, D. M., & Addor, J. A. (2023) · Journal of Engineering Research and Reports · doi:10.9734/jerr/2023/v25i7951 · Cited by 10
Shah, S. H. H., Han, K., & Lee, J. W. (2020) · Applied Sciences · doi:10.3390/app10072248 · Cited by 10
“Finally, we calculated the overall score given by the users in each category using the mean opinion score (MOS) technique [31].”
MethodYuan, Y., Duo, S., Tong, X., & Wang, Y. (2025) · Algorithms · doi:10.3390/a18080513 · Cited by 9
PE2LGP: tradutor de português europeu para língua gestual portuguesa em glosas
Gonçalves, M., Coheur, L., Nicolau, H., & Mineiro, A. (2021) · Linguamática · doi:10.21814/lm.13.1.338 · Cited by 9
Yu, Q., Liao, Y., Liu, K., He, Z., Zhao, Y., Li, F., & Shan, T. (2022) · Frontiers in Physics · doi:10.3389/fphy.2022.1045192 · Cited by 9
“Foggy sounds like nothing” — enriching the experience of voice assistants with sonic overlays
Esau, M., Marsh, A., Krauß, V., & Stevens, G. (2023) · Personal and Ubiquitous Computing · doi:10.1007/s00779-023-01722-3 · Cited by 9
Combining GAN with reverse correlation to construct personalized facial expressions
Yan, S., Soladié, C., Aucouturier, J., & Séguier, R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0290612 · Cited by 9
“To assess what observers thought of their own personalized facial expression prototypes, we employed the Mean Opinion Score, which is a popular indicator of perceived media quality [43].”
A model for automatic selection of IoT services in ambient assisted living for the elderly
Sabatucci, L., Cossentino, M., Napoli, C. D., & Susi, A. (2023) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2023.101845 · Cited by 9
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.0
Kim, M., Piao, Z., Lee, J., & Kang, H.-G. (2023) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi58575.2023.10313388 · Cited by 9
“For subjective evaluations of speech naturalness, we performed mean opinion score (MOS) tests [31].”
MethodComparative Evaluation of Various Lens and Ring Flash Combination for Intraoral Photography
Harikrishnan, S., Dinesh, S., Sivakumar, A., Awadh, W., Alshehri, A., Albar, N. H. M., Alamoudi, A. A., Bahammam, S., Zidane, B., Bahammam, H. A., et al. (2023) · Nigerian Journal of Clinical Practice · doi:10.4103/njcp.njcp_120_23 · Cited by 9
Nawaz, O., Fiedler, M., & Khatibi, S. (2024) · Electronics · doi:10.3390/electronics13020329 · Cited by 9
GNNAE-AVSS: Graph Neural Network Based Autoencoders for Audio-Visual Speech Synthesis
Ghosh, S., & Jana, N. D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651476 · Cited by 9
“The Mean Opinion Score (MOS) [41] serves as a subjective metric to evaluate the audio quality.”
BackgroundAutomatic Path Planning Offloading Mechanism in Edge-Enabled Environments
Herich, D., Vaščák, J., Zolotová, I., & Brecko, A. (2021) · Mathematics · doi:10.3390/math9233117 · Cited by 9
Speaker-Independent Spectral Enhancement for Bone-Conducted Speech
Cheng, L., Dou, Y., Zhou, J., Wang, H., & Tao, L. (2023) · Algorithms · doi:10.3390/a16030153 · Cited by 9
Wang, Y., Huang, Q., Liu, J., Jiang, C., & Shang, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16607-z · Cited by 9
“Mean Opinion Score (MOS) [41] is representative subjective method to evaluate video stabilization.”
Accented Text-to-Speech Synthesis with a Conditional Variational Autoencoder
Melechovský, J., Mehrish, A., Şişman, B., & Herremans, D. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902981 · Cited by 9
“The nat-uralness of audio is assessed through Mean Opinion Score (MOS) [21].”
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.