Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Items 201–300 of 650
Image retrieval based on fuzzy ontology
Liaqat, M., Khan, S., & Majid, M. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4812-9 · Cited by 9
The Visual Quality of Teleoperated Driving Scenarios How good is good enough?
Neumeier, S., Stapf, S., & Facchi, C. (2020) · International Symposium on Networks, Computers and Communications (ISNCC) · doi:10.1109/isncc49221.2020.9297343 · Cited by 9
“To obtain useful data, the Mean Opinion Score (MOS) [22], representing the perceived subjective quality, is an appropriate tool to be used.”
MethodBayesian framework inspired no-reference region-of-interest quality measure for brain MRI images
Osadebey, M., Pedersen, M., Arnold, D., & Wendel-Mitoraj, K. E. (2017) · Journal of Medical Imaging · doi:10.1117/1.jmi.4.2.025504 · Cited by 9
Modular and deep QoE/QoS mapping for multimedia services over satellite networks
Xu, S., Wang, X., & Huang, M. (2018) · International Journal of Communication Systems · doi:10.1002/dac.3793 · Cited by 9
“The double stimulus method and absolute category rating 53 are combined together to test user acceptance.”
MethodAn SD-WAN Solution Assuring Business Quality VoIP Communication for Home Based Employees
Radcliffe, D., Furey, E., & Blue, J. (2019) · International Conference on Smart Applications, Communications and Networking (SmartNets) · doi:10.1109/smartnets48225.2019.9069755 · Cited by 9
“Mean Opinion Score (MOS) is a numerical measure of a voice or video communication and is rated from 1 = Bad, 2= poor, 3= fair, 4= good, 5= excellent [10].”
BackgroundTowards Secure and Usable Authentication for Voice-Controlled Smart Home Assistants
Ponticello, A. (2020) · reposiTUm (TU Wien) · doi:10.34726/hss.2020.83782 · Cited by 9
A Survey of Foundation Models for Music UnderstandingPreprint
Li, W., Cai, Y. B., Wu, Z., Zhang, W., Chen, Y., Qi, R., Dong, M., Chen, P., Dong, X., Shi, F., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.09601 · Cited by 9
“The mean opinion score(MOS)[46] is one of the subjective evaluation method that determines the quality of audio by subjective score of human raters, so it is flexible to test different aspects of music.”
BackgroundKadam, S., & Kim, D. I. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3581778 · Cited by 8
“The mean opinion score (MOS) is calculated from these ratings to quantify QoE [80].”
Wu, Y., Deng, X., Shao, H., Cheng, K., Zhang, M., Jiang, Y., & Wang, F. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.066647 · Cited by 8
Bruder, C., Breda, P., & Larrouy-Maestri, P. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100211 · Cited by 8
Modeling Subject Scoring Behaviors in Subjective Experiments Based on a Discrete Quality Scale
Tiotsop, L. F., Servetti, A., Barkowsky, M., & Masala, E. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3382483 · Cited by 8
Mobile Based Decision Support System of Supplier Evaluation
Effendy, F. (2020) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v14i04.11371 · Cited by 8
Research on Voice Quality Evaluation Method Based on Artificial Neural Network
Di, Z., Xiao, T., Li, Y., Cheng, X., Li, B., Xu, L., Zhu, X., Zhi, L., & Xia, R. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00215 · Cited by 8
SQAD: Automatic Smartphone Camera Quality Assessment and Benchmarking
Fang, Z., Ignatov, A., Zamfir, E., & Timofte, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01877 · Cited by 8
“Although IQA methods aim to predict quantitative scores aligning with human perceptions measured by mean opinion scores (MOS) [54], they often lack objectivity, quantization, and physical reasoning due to diverse participant expertise levels and inherent biases.”
BackgroundMathematical Bottom-to-Up Approach in Video Quality Estimation Based on PHY and MAC Parameters
Goran, N., & Hadžialić, M. (2017) · IEEE Access · doi:10.1109/access.2017.2772042 · Cited by 8
“MOS (Mean Opinion Score) is the most commonly used quantitative measure of subjective assessment, while beside this, there are also qualitative measures that were conducted with the use of surveying and crowdsourcing techniques [6], [7].”
MethodComparing Network Performance of Mobile VoIP Solutions
Dantas, R., Exton, C., & Gear, A. L. (2018) · IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud) · doi:10.1109/mobilecloud.2018.00015 · Cited by 8
“[13] criticises the MOS scale and propose alternative ideas for media quality measurement.”
BackgroundAutofocus in infrared microscopy
Abelé, R., Fronte, D., Liardet, P. Y., Boï, J.-M., Damoiseaux, J.-L., & Merad, D. (2018) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa.2018.8502648 · Cited by 8
“Some subjective methods attempt to emulate HVS using the Mean Opinion Score, but they are time-consuming and generally non-deterministic; these methods are partly based on objective metrics pooled together to predict the quality score [2].”
MethodAdvCodeMix: Adversarial Attack on Code-Mixed Data
Das, S. D., Basak, A., Mandal, S., & Das, D. (2022) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3493700.3493705 · Cited by 8
Emilia: a speech corpus for Argentine Spanish text to speech synthesis
Torres, H., Gurlekian, J. A., Evin, D., & Cossio-Mercado, C. (2019) · Language Resources and Evaluation · doi:10.1007/s10579-019-09447-7 · Cited by 8
“1990; Streijl et al. 2016; Watson et al. 2001).”
Mission Resilience for Future Army Tactical Networks
Sullivan, D. J., Colbert, E., & Cowley, J. A. (2018) · Resilience Week (RWS) · doi:10.1109/rweek.2018.8473522 · Cited by 8
“Software algorithms can derive an MOS rating as well.”
MethodInfluentialQuality of Experience Metric of Streaming Video: A survey
(2018) · Iraqi Journal of Science · doi:10.24996/ijs.2018.59.3b.19 · Cited by 8
“In general, we need at least 15viewers subjects to give best result to the subjective metric and no more than 40 [16].”
BackgroundOverall Listening Experience — a new Approach to Subjective Evaluation of Audio
Schöffler, M. (2017) · OPUS FAU (Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV), on behalf of the Universitätsbibliothek Erlangen-Nürnberg) · Cited by 8
Wang, X., Zhao, Z., Ren, S., Zhang, S., Li, S., Li, X., Wang, Z., Qiu, L., Wan, G., Cao, X., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.11200 · Cited by 8
“Currently, the majority of TTS systems’ research continues to use Mean Opinion Score (MOS) [30] listening tests as the “gold standard,” commonly employing the five-level absolute category rating scale and its derivatives such as CMOS, CCR [26], and MUSHRA-style multi-stimulus methodologies [18].”
A Mel Spectrogram Enhancement Paradigm Based on CWT in Speech Synthesis
Hu, G., Tan, H., & Li, R. (2024) · International Conference on Asian Language Processing · doi:10.1109/ialp63756.2024.10661192 · Cited by 7
“It can be observed that the speech synthesis system utilising the Mel spectrogram Enhancement Paradigm receives significantly higher ratings from the testers, as evidenced by the higher mean opinion score (MOS) [23].”
BackgroundGhosh, S., Saha, S., & Jana, N. D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890863 · Cited by 7
“The model’s performance is evaluated using objective metrics like MCD [17], MSD [18], and F0-RMSE [19], and subjective metrics like MOS [20], ensuring the generation of high-quality, synchronized audio-visual content.”
EgoSonics: Generating Synchronized Audio for Silent Egocentric Videos
Rai, A., & Sridhar, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00483 · Cited by 7
“The following are the outcomes of this study: 80 % of the users believe that 90 % of our audios are realistic with an Mean Opinion Score (MOS) [44] of more than 4 .”
Video Stabilization: A Comprehensive Survey from Classical Mechanics to Deep Learning Paradigms
Xu, Q., Huang, Q., Jiang, C., Li, X., & Wang, Y. (2025) · Modelling—International Open Access Journal of Modelling in Engineering Science · doi:10.3390/modelling6020049 · Cited by 7
“Common full-reference metrics include Peak Signal-to-Noise Ratio (PSNR) [76], Mean-Squared Error (MSE) [77], and Structural Similarity (SSIM) [76].”
Multimodal Fine-grained Context Interaction Graph Modeling for Conversational Speech Synthesis
Jia, Z., Liu, R., Şişman, B., & Li, H. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.448 · Cited by 7
Deep Variational Metric Learning for Transfer of Expressivity in Multispeaker Text to Speech
Kulkarni, A., Colotte, V., & Jouvet, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59430-5_13 · Cited by 7
Don't Stop the Music: Crowdsourced QoE Assessment of Music Streaming with Stalling
Schwind, A., Moldovan, C., Janiak, T., Dworschak, N. D., & Hoßfeld, T. (2020) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex48832.2020.9123118 · Cited by 7
Performance measurement of a hybrid speech enhancement technique
Bahadur, I. N., Kumar, S., & Agarwal, P. (2021) · International Journal of Speech Technology · doi:10.1007/s10772-021-09830-2 · Cited by 7
Alaa, Y., Alfonse, M., & Aref, M. M. (2022) · International Conference on Computing and Informatics (ICCI) · doi:10.1109/icci54321.2022.9756059 · Cited by 7
Jafaryani, M., Sheikhzadeh, H., & Pourahmadi, V. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105279 · Cited by 7
AI Enhancements for Linguistic E-Learning System
Liu, J., Li, S., Ren, C., Lyu, Y., Xu, T., Wang, Z., & Chen, W. (2023) · Applied Sciences · doi:10.3390/app131910758 · Cited by 7
Enhancing mammography: a comprehensive review of computer methods for improving image quality
Santos, J. C., Santos, M. S., & Abreu, P. H. (2024) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/ad776b · Cited by 7
“A promising approach to bridging the gap between subjective and objective assessments is the Mean Opinion Score (MOS) [135], which translates the visual evaluations performed by experienced radiologists into a quantifiable metric.”
Fast Single Image Haze Removal Method Based on the Adaptive Gain and Minimum Channel
Tung, T.-C., Lai, S.-L., Chen, C., & Chou, Y.-C. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3543184 · Cited by 7
“To evaluate the subjective quality of the dehazed images generated by our method, a Mean Opinion Score (MOS) [53] assessment was conducted with the participation of 22 observers.”
On the Stimulation Frequency in SSVEP-based Image Quality Assessment
Bosse, S., Bagdasarian, M. T., Samek, W., Curio, G., & Wiegand, T. (2018) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2018.8463381 · Cited by 7
“5] Hz the SNR concentrates around occipital electrode positions, this concentration is partially reduced only for fstim ∈ [2, 10] Hz, in particular for the first harmonic.”
BackgroundNaktal Moaid, E. D. A. N., & Mahmood, S. A. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i3.pp2773-2778 · Cited by 7
“Quality of experience (QoE) In [24] mentioned that QoE is necessary and has been considered as a subjective matrix in media communication, as well as it has been adopted by ITU-T group [23, 25, 26].”
BackgroundInvestigating the Relationship between Cough Detection and Sampling Frequency for Wearable Devices
Abdelkhalek, M., Qiu, J., Hernandez, M., Bozkurt, A. Y., & Lobaton, E. J. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630082 · Cited by 7
Blur-specific image quality assessment of microscopic hyperspectral images
Quintana, L., Ortega, S., Fabelo, H. A., Balea-Fernandez, F., & Callicó, G. M. (2023) · Optics Express · doi:10.1364/oe.476949 · Cited by 7
ASSESSMENT OF QUALITY-OF-EXPERIENCE IN TELECOMMUNICATION SERVICES
Rodríguez, D. Z., & The Society of Digital Information and Wireless Communication (2016) · International Journal of Digital Information and Wireless Communications · doi:10.17781/p002149 · Cited by 7
QMET: A new quality assessment metric for no-reference video coding by using human eye traversal
Podder, P. K., Paul, M., & Murshed, M. (2016) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz.2016.7804439 · Cited by 7
“On the other side, the popularly used subjective testing method- MOS [15][16] is often biased by the testing environment, viewers mode, viewers expertise and many other factors.”
MethodBandwidth Extension WaveNet for Bone-Conducted Speech Enhancement
Zheng, C., Yang, J., Zhang, X., Cao, T., Sun, M., & Zheng, L. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-981-15-2756-2_1 · Cited by 7
Osadebey, M. E., Pedersen, M., Arnold, D. L., Wendel-Mitoraj, K. E., & Initiative, A. D. N. (2018) · BMC Medical Imaging · doi:10.1186/s12880-018-0266-4 · Cited by 7
“Mean opinion score is the average of the quality scores assigned to an image by multiple viewers [58].”
BackgroundTowards a comprehensive model for predicting the quality of individual visual experience
Zhu, Y., Heynderickx, I. E. J., Hanjalić, A., & Redi, J. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2085002 · Cited by 6
Users prefer Guetzli JPEG over same-sized libjpegPreprint
Alakuijala, J., Obryk, R., Szabadka, Z., & Wassenberg, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04416 · Cited by 7
“are naive, and the compression artifacts are too minor to capture on a 5-point scale. Similarly, a Mean Opinion Score may result in higher variability due to interpretation and/or language dierences [6]. Hence, we only gathered pairwise comparisons. Note that user preferences dier - some will be more sensitive to cert…”
BackgroundStyle Mixture of Experts for Expressive Text-To-Speech SynthesisPreprint
Jawaid, A., Chandra, S. S., Lu, J., & Şişman, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.03637 · Cited by 7
“Using metrics such as word error rate (WER) and character error rate (CER) [21] for intelligibility, mel cepstral distortion (MCD) for speech quality, F0 frame error (FFE) [15] and F0 root mean squared error (F0RMSE) for prosody, and speaker cosine similarity for speaker resemblance.”
Modeling Beyond MOS: Quality Assessment Models Must Integrate Context, Reasoning, and MultimodalityPreprint
Kerkouri, M. A., Tliba, M., Chetouani, A., Aburaed, N., & Bruno, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.19696 · Cited by 7
“Introduced for its simplicity and ease of deployment, MOS has become the default supervisory signal for training and evaluating quality assessment models [2, 14].”
Dhar, S., Jana, N. D., & Das, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.19197 · Cited by 7
“The MOS [145] is collected from human volunteers based on the perceptual quality and speaker similarity of the generated speech samples from the human hearing perspective.”
Dense Video Understanding with Gated Residual TokenizationPreprint
Zhang, H., Chai, W., He, S., Li, A., & Fu, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.14199 · Cited by 7
“Experiments on 0.5B and 7B models show that GRT achieves state-of-the-art accuracy and MOS, while accelerating tokenization by up to 46%.”
InfluentialInvariance Class based Surface Reconstruction using CNN Transfer Learning
Qie, Y., & Anwer, N. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1204-1220 · Cited by 6
Selma, T., Bentaleb, A., Masud, M. M., & Harous, S. (2024) · Technologies · doi:10.3390/technologies12050062 · Cited by 6
Ghosh, S., Saha, S., & Jana, N. D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889250 · Cited by 6
“Sub-jective evaluation of both audio and video is conducted using mean opinion score (MOS) [21].”
BnTTS: Few-Shot Speaker Adaptation in Low-Resource Setting
Basher, M. J. I., Kowsher, M., Islam, M. S., Nandi, R. N., Prottasha, N. J., Menon, M. H., Muntasir, T. A., Chowdhury, S. A., Alam, F., Yousefi, N., et al. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.279 · Cited by 6
Operations on Signed Distance Function Estimates
Bálint, C., Valasek, G., & Gergó, L. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1154-1174 · Cited by 6
MnTTS2: An Open-Source Multi-speaker Mongolian Text-to-Speech Synthesis Dataset
Liang, K., Liu, B., Hu, Y., Liu, R., Bao, F., & Gao, G. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-2401-1_28 · Cited by 6
Zafar, S., Nizami, I. F., Rehman, M. U., Majid, M., & Ryu, J. (2023) · Sensors · doi:10.3390/s23125652 · Cited by 6
The Transmission Rating Scale and its Relation to Subjective Scores
Pérez, P. (2023) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex58391.2023.10178659 · Cited by 6
“In fact, mean opinion scores are not a precise number, but a statistical measurement with some uncertainty [17].”
BackgroundLeveraging CNN and principal component analysis for dynamic variance control in audio compression
Debnath, A., & Mondal, U. K. (2024) · International Journal of Information Technology · doi:10.1007/s41870-024-02155-8 · Cited by 6
“The quality parameter Mean Opinion Score [23] i.e., MOS is utilized to assess the quality of experience.”
Kar, A., Shoba, S., & Reddy, H. (2024) · Circuits Systems and Signal Processing · doi:10.1007/s00034-024-02958-x · Cited by 6
“The MOS subjective assessment test [50] is used to rate the output of the speech signal in Fig.8.”
Wuttidittachotti, P., & Daengsi, T. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3901-5 · Cited by 6
“For example, it was stated that an E-model does not provide values of MOS that correlate very well with the values of subjective MOS [42], which is consistent with the statements in previous works [16, 55].”
ResultVietnamese Speech Synthesis with End-to-End Model and Text Normalization
Nhan, D. T., Tri, N. M., & Nam, C. X. (2020) · NAFOSTED Conference on Information and Computer Science (NICS) · doi:10.1109/nics51282.2020.9335905 · Cited by 6
“score) scoring system on the test set to check the quality of audios [25].”
BackgroundText-to-Speech Synthesis: Literature Review with an Emphasis on Malayalam Language
Jasir, M. P., & Balakrishnan, K. (2022) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3501397 · Cited by 6
“They used the MOS, comprehension test, and diagnostic rhyme test for evaluating the intelligibility of synthesized speech [69, 241].”
MethodSaeed, A., Hayat, M. F., Habib, T., Ghaffar, D. A., & Qureshi, M. A. (2022) · Speech Communication · doi:10.1016/j.specom.2021.12.005 · Cited by 6
Taillight Shape Creative Design based on Generative Adversarial Networks
Lin, H., Deng, X., & Zhang, D. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1043-1060 · Cited by 6
“The mean opinion score (MOS) is a commonly used subjective evaluation indicator [42].”
A Multi-Frame PCA-Based Stereo Audio Coding Method
Wang, J., Zhao, X., Xie, X., & Kuang, J. (2018) · Applied Sciences · doi:10.3390/app8060967 · Cited by 6
“The Mean Opinion Score (MOS) [22] of the restored music was recorded by 10 listeners.”
MethodWuttidittachotti, P., Khaoduang, P., & Daengsi, T. (2017) · Multimedia Systems · doi:10.1007/s00530-017-0549-6 · Cited by 6
Automatic facial flaw detection and retouching via discriminative structure tensor
Liu, X., Xie, L., Zhong, B., Du, J., & Peng, Q. (2017) · IET Image Processing · doi:10.1049/iet-ipr.2016.1095 · Cited by 6
Part-Syllable Transformation-Based Voice Conversion with Very Limited Training Data
Jannati, M. J., & Sayadiyan, A. (2017) · Circuits Systems and Signal Processing · doi:10.1007/s00034-017-0639-x · Cited by 6
“The subjective criterion of mean opinion score (MOS) [29], employing eight native speakers, was also used to determine the quality of the generated speeches.”
MethodSubjective and Objective QoE Measurement for H.265/HEVC Video Streaming over LTE
Husić, J. B., Baraković, S., & Osmanović, I. (2019) · Lecture notes in networks and systems · doi:10.1007/978-3-030-24986-1_34 · Cited by 6
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, SDN, and MECPreprint
Farahani, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.16951 · Cited by 6
Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context ModelingPreprint
Liu, R., Jia, Z., Yang, J. C., Hu, Y., & Li, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.09524 · Cited by 6
“Emphasis Ren-dering: To validate the emphasis rendering for ER-CTTS, we follow [23] and conduct dialogue-level Mean Opinion Score (DMOS) [40] as the subjective evaluation metric.”
MethodPROEMO: Prompt-Driven Text-to-Speech Synthesis Based on Emotion and Intensity ControlPreprint
Zhang, S., Mehrish, A., Li, Y., & Poria, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.06276 · Cited by 6
Histopathology Slide Indexing and Search — Are We There Yet?
Shang, H. H., Nasr, M. S., Veerla, J. P., Saurav, J. R., Hajighasemi, A., Malidarreh, P., Huber, M., Moleta, C., Makker, J., & Luber, J. M. (2024) · NEJM AI · doi:10.1056/aics2300019 · Cited by 5
NUAM-Net: A Novel Underwater Image Enhancement Attention Mechanism Network
Wen, Z., Zhao, Y., Gao, F., Su, H., Rao, Y., & Dong, J. (2024) · Journal of Marine Science and Engineering · doi:10.3390/jmse12071216 · Cited by 5
A systematic survey on video frame interpolation: Advances, challenges, and future directions
Huang, X., Wang, S., Xu, T., Feng, Z., & Yang, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.130660 · Cited by 5
Impact of Human and Content Factors on Quality of Experience of Online Video Streaming
Nawaz, O., Fiedler, M., & Khatibi, S. (2020) · International Joint Conference on e-Business and Telecommunications (ICETE) · doi:10.5220/0009831400590066 · Cited by 5
“but the critical observations and interpretations have not been unequivocally in this regard (Streijl et al., 2016; Pinson et al., 2012).”
BackgroundCorn: Co-Trained Full- and No-Reference Speech Quality Assessment
Manocha, P., Williamson, D. S., & Finkelstein, A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447687 · Cited by 5
Wang, X., Li, Z., Wang, S., Yang, Y., Peng, Y., & Fu, C. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1399012 · Cited by 5
Zhu, J., Ma, X., Yu, D., Li, Y., & Zhao, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125349 · Cited by 5
Decentralized Text-Based Person Re-Identification in Multi-Camera Networks
Agyeman, R., & Rinner, B. (2024) · IEEE Access · doi:10.1109/access.2024.3501382 · Cited by 5
Hao, Y., Charan, M. C. R., Bhat, G. S., & Panahi, I. M. S. (2017) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2017.8335706 · Cited by 5
“Mean opinion score (MOS) test [12] is used for measuring the speech quality from subjects in third experiment.”
MethodTotu, T., Buga, R. M., Dumitru, A. V., Costache, M., Sladoje, N., & Stanciu, S. G. (2018) · IEEE Access · doi:10.1109/access.2018.2868127 · Cited by 5
“As an empirical method, MOS presents a number of disadvantages regarding its use as ground-truth [36], [37].”
MethodFMPOD: A Novel Focus Metric Based on Polynomial Decomposition for Infrared Microscopy
Abelé, R., Moubtahij, R. E., Fronte, D., Liardet, P.-Y., Damoiseaux, J.-L., Boï, J.-M., & Merad, D. (2019) · IEEE photonics journal · doi:10.1109/jphot.2019.2940689 · Cited by 5
“A possibility is to pool together different objective metrics to predict the quality score, namely the Mean Opinion Score (MOS) [18], but it may require heavy computational work to process several criteria.”
BackgroundFiroozabadi, A. D., Pablo Irarrázaval, M., Adasme, P., Zabala‐Blanco, D., Durney, H., Olave, M. S., Játiva, P. P., & Azurdia-Meza, C. A. (2020) · Applied Sciences · doi:10.3390/app10113955 · Cited by 5
“We used 20 volunteers, where they listened first to the clean signal by the headset to have an idea of an excellent signal with a rating of 5 in the MOS scale and a noisy signal (before enhancement), which is the worst option in the MOS scale with a rating of 1.”
MethodInfluentialProsodic Unit Boundary Prediction of Myanmar Based on BERT-CRF Model
李, 培. (2021) · Computer Science and Application · doi:10.12677/csa.2021.113051 · Cited by 5
Application Layer ARQ Algorithm for Real-Time Multi-Source Data Streaming in UAV Networks
Lamri, M. A., Abilov, A., Vasiliev, D. S., Kaisina, I., & Nistyuk, A. I. (2021) · Sensors · doi:10.3390/s21175763 · Cited by 5
“We used human observers to rate the received video in terms of Mean Opinion Score (MOS) [22].”
MethodInfluentialResearch on handover strategy of heterogeneous networks based on user service quality
Wang, S., Tang, Y., & Du, J. (2021) · International Journal of Communication Systems · doi:10.1002/dac.5048 · Cited by 5
Multi-stage attention for fine-grained expressivity transfer in multispeaker text-to-speech system
Kulkarni, A., Colotte, V., & Jouvet, D. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909931 · Cited by 5
“A total of 20 French listeners participated in this MOS test and results are displayed in Table I with an associated 95 % confidence interval.”
MethodInfluentialCoCoCs: co-optimized compressive imaging driven by high-level vision
Huang, H., Hu, C., Li, J., Dong, X., & Chen, H. (2022) · Optics Express · doi:10.1364/oe.468733 · Cited by 5
Transformer Networks for Non-Intrusive Speech Quality Prediction
Jayesh, M. K., Sharma, M. K., Vonteddu, P., Shaik, M. A. B., & Ganapathy, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10020 · Cited by 5
“The mean opinion score (MOS), the estimated quality is the average of users’ judgment, is usually given in a scale ranging from 1 to 5 [2].”
BackgroundAutomatic Assembly Precedence Detection in Axisymmetric Products
Bonino, B., Giannini, F., Monti, M., & Raffaeli, R. (2023) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2023.1175-1189 · Cited by 5
Oh, Y., Lee, J., Han, Y., & Lee, K. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1405 · Cited by 5
“For speech quality evaluation, mean opinion score (MOS) [23] was measured through a questionnaire to verify the speech naturalness.”
MethodВИСОКОПРОДУКТИВНЕ НЕЙРОМЕРЕЖЕВЕ ЗАФАРБОВУВАННЯ ТРИВИМІРНИХ ФІГУР НА ОСНОВІ МОДЕЛІ PIX2PIX
Завальнюк, Є. К., Романюк, О., & Коробейнікова, Т. (2023) · Applied Questions of Mathematical Modeling · doi:10.32782/mathematical-modelling/2023-6-1-6 · Cited by 5
Evaluating Acoustic Parameters for DeepFake Audio Identification
Djiré, A. E., Sabané, A., Kaboré, A. K., Kafando, R., & Bissyandé, T. F. (2023) · IEEE Afro-Mediterranean Conference on Artificial Intelligence (AMCAI) · doi:10.1109/amcai59331.2023.10431521 · Cited by 5
“This subjective measure is the average of these scores between subjects and is widely used to determine the quality of a transmission or the synthesis of an audio signal [15].”
BackgroundCCLCap-AE-AVSS: Cycle consistency loss based capsule autoencoders for audio–visual speech synthesis
Ghosh, S., Jana, N. D., Si, T., Mallik, S., & Shah, M. A. (2024) · Journal of Intelligent Systems · doi:10.1515/jisys-2023-0171 · Cited by 5
“On the other hand, the subjective evaluation centers on gauging the human perception of the generated audio samples, employing the mean opinion score (MOS) [56] methodology.”
Ghosh, S., Dhar, S., & Jana, N. D. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-64070-4_19 · Cited by 5
A Novel QoS-Based QoE Evaluation Method for Streaming Video Service
Ning, Z., Liu, Y., Wang, X., Feng, Y., & Kong, X. (2017) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings-greencom-cpscom-smartdata.2017.147 · Cited by 5
Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation
Zhu, Z., He, X., Li, C., Liu, S., Jiang, K., Li, K., & Wang, J. (2023) · Sensors · doi:10.3390/s23146354 · Cited by 5
“The MOS index is shown in Table 3.”
MethodInfluentialAccurate Available Bandwidth Allocation in HTTP Adaptive Streaming
Tan, P. X., & Kamioka, E. (2017) · International journal of Computer Networks & Communications · doi:10.5121/ijcnc.2017.9507 · Cited by 5
“The MOS is the average of these scores across subjects [7].”
Background
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.