Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Metrics that mirror subjective human judgment, such as the mean opinion scores (MOS) and differential mean opinion scores (DMOS), continue to serve as the benchmark for validating objective algorithms [1-3].”
From A Survey and Tutorial on Image Quality Assessment with a Contrast-Weighted Structural Similarity Framework (2026) · cites this paper as [1]
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
(1966) · Medical Entomology and Zoology · Cited by 10,293
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“One example they offer is that they can measure the degradation in performance by wrong answers such as those introduced by McGurk effects [91], whereas a MOS score might miss this degradation.”
BackgroundModern Multidimensional Scaling: Theory and Applications
Borg, I., & Groenen, P. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01108.x · Cited by 2,197 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundModern Multidimensional Scaling: Theory and Applications
O'Connell, A. A., Borg, I., & Groenen, P. (1999) · Journal of the American Statistical Association · doi:10.2307/2669710 · Cited by 1,048
Perceptual visual quality metrics: A survey
Lin, W., & Jay Kuo, C.-C. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.01.005 · Cited by 922 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundMobile computation: Spatiotemporal integration of the properties of objects in motion
Cavanagh, P., Holcombe, A. O., & Chou, W. (2008) · Journal of Vision · doi:10.1167/8.12.1 · Cited by 715
Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613 · cited 2×
“Large numbers of subjective MOS data [94] and objective quality metrics [37-39] have been made available.”
BackgroundCoren, S., Porac, C., & Ward, L. M. (1979) · Optometry and Vision Science · doi:10.1097/00006324-197905000-00008 · Cited by 495
Learning without Human Scores for Blind Image Quality Assessment
Xue, W., Zhang, L., & Mou, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.133 · Cited by 404 · cited 1×
“Although recent novel methods for objective quality assessment [42, 43] have been able to reduce or eliminate the need for using subjective MOS in training (but not validation of course), validation and testing of objective models is still an essential part of the work.”
MethodDigital Video Quality: Vision Models and Metrics
WINKLER, S. S. (2005) · Cited by 388
Self-citationDigital Video Quality: Vision Models and Metrics
Winkler, S. (2005) · Wiley eBooks · doi:10.1002/9780470024065 · Cited by 331
Self-citationAnalysis of Public Image and Video Databases for Quality Assessment
Winkler, S. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2215007 · Cited by 299 · cited 1×
“Large numbers of subjective MOS data [94] and objective quality metrics [37–39] have been made available.”
BackgroundSelf-citationQuality control and improvement for multistage systems: A survey
Shi, J., & Zhou, S. (2009) · IIE Transactions · doi:10.1080/07408170902966344 · Cited by 263 · cited 1×
“From the objective perspective, the topic of quality control of multistage systems has been studied in industrial process engineering [89]; media distribution can be considered a special case of such systems.”
BackgroundA survey of hybrid MC/DPCM/DCT video coding distortions
Yuen, M., & Wu, H. R. (1998) · Signal Processing · doi:10.1016/s0165-1684(98)00128-5 · Cited by 254 · cited 1×
“impairments) from a measurement perspective [76], but more importantly perhaps, they should also reflect the various faults and impairment sources we are trying to isolate.”
BackgroundToward total quality of experience: A QoE model in a communication ecosystem
Rehman Laghari, K. U., & Connelly, K. (2012) · IEEE Communications Magazine · doi:10.1109/mcom.2012.6178834 · Cited by 220 · cited 1×
“[92] present a comprehensive framework that considers factors from the human domain (demographics, expectations, role), contextual domain (e.”
BackgroundComparing subjective video quality testing methodologies:
Pinson, M. H., & Wolf, S. (2003) · SPIE Proceedings · doi:10.1117/12.509908 · Cited by 201 · cited 1×
“Pinson and Wolf [25] compared both single-stimulus and double-stimulus continuous quality evaluation methodologies.”
BackgroundMeasuring perceived quality of speech and video in multimedia conferencing applications
Watson, A., & Sasse, M. A. (1998) · Proceedings of the sixth ACM international conference on Multimedia - MULTIMEDIA '98 · doi:10.1145/290747.290755 · Cited by 184 · cited 2×
“Watson and Sasse [6] use quality dimensions to find an appropriate scale.”
BackgroundMaximum likelihood difference scaling
Maloney, L. T., & Yang, J. N. (2003) · Journal of Vision · doi:10.1167/3.8.5 · Cited by 176 · cited 1×
“Maximum likelihood difference scaling (MLDS) was proposed as an experimental methodology and model to map difference measurements of the kind “difference between A and B is greater/smaller than the difference between C and D” to a supra-threshold difference scale [62], which has been successfully applied to image comp…”
MethodBrooks, A. C., Zhao, X., & Pappas, T. N. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.926161 · Cited by 175
Study of Rating Scales for Subjective Quality Assessment of High-Definition Video
Huynh-Thu, Q., Garcia, M.-N., Speranza, F., Corriveau, P., & Raake, A. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2010.2086750 · Cited by 171 · cited 1×
“[29] compared 5-, 9-, 11-point discrete and continuous scales for scoring video quality.”
BackgroundAssessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments
Staelens, N., Moens, S., Van den Broeck, W., Marien, I., Vermeulen, B., Lambert, P., Van de Walle, R., & Demeester, P. (2010) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2010.2067710 · Cited by 166 · cited 2×
“Also, subjects are less tolerant of errors in short sequences, and video impairments appear less annoying to viewers consuming content in more natural environments [17].”
BackgroundNo-reference image and video quality estimation: Applications and human-motivated design
Hemami, S. S., & Reibman, A. R. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.05.009 · Cited by 164 · cited 1×
“[77] for a review of no-reference image and video quality metrics.”
BackgroundEstimating Just-Noticeable Distortion for Video
Jia, Y., Lin, W., & Kassim, A. A. (2006) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2006.877397 · Cited by 162 · cited 10×
“JND has been defined as a subjective method and has been used extensively in psychophysical studies.”
BackgroundInfluentialTowards automated performance diagnosis in a large IPTV network
Mahimkar, A. A., Ge, Z., Shaikh, A., Wang, J., Yates, J., Zhang, Y., & Zhao, Q. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592596 · Cited by 147 · cited 1×
“1 3 techniques to identify problems and diagnose their root causes in large video delivery networks [79].”
BackgroundPerceptual-based quality assessment for audio–visual services: A survey
You, J., Reiter, U., Hannuksela, M. M., Gabbouj, M., & Perkis, A. (2010) · Signal Processing Image Communication · doi:10.1016/j.image.2010.02.002 · Cited by 146
Blind Image Quality Assessment Without Human Training Using Latent Quality Factors
Mittal, A., Muralidhar, G. S., Ghosh, J., & Bovik, A. C. (2012) · IEEE Signal Processing Letters · doi:10.1109/lsp.2011.2179293 · Cited by 139 · cited 1×
“Although recent novel methods for objective quality assessment [42, 43] have been able to reduce or eliminate the need for using subjective MOS in training (but not validation of course), validation and testing of objective models is still an essential part of the work.”
MethodWang, Z., & Simoncelli, E. P. (2008) · Journal of Vision · doi:10.1167/8.12.8 · Cited by 138 · cited 1×
“errors, vulnerabilities, and failure characteristics, of a quality metric, rather than to demonstrate that it satisfies certain specifications [51-53].”
BackgroundDiagnostic acceptability measure for speech communication systems
Voiers, W. D. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1977.1170198 · Cited by 135
Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos
Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., & Etoh, M. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2004910 · Cited by 117 · cited 1×
“Another study formulates multidimensional video quality assessment as a transformation between a multidimensional feature space and a quality space, where each space itself may be multi-dimensional [82].”
BackgroundSensation and Perception (1981)
DRETSKE, F. I. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/2827.003.0005 · Cited by 108
Performance comparisons of subjective quality assessment methods for mobile video
Tominaga, T., Hayashi, T., Okamoto, J., & Takahashi, A. (2010) · 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5517948 · Cited by 96 · cited 1×
“A comparison for many common testing methods, including absolute category rating (ACR), double-stimulus impairment scale (DSIS), double-stimulus continuous quality scale (DSCQS), and subjective assessment methodology for video quality (SAMVIQ), is done in [23] using mobile video as test clips.”
Quantifying the Relation Between Speech Quality and Speech Intelligibility
Preminger, J. E., & Tasell, D. J. V. (1995) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3803.714 · Cited by 94
Brunnstrom, K. E., Hands, D. S., Speranza, F., & Webster, A. A. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.932162 · Cited by 82
Self-citationReview of objective video quality metrics and performance comparison using different databases
Vranješ, M., Rimac-Drlje, S., & Grgić, K. (2012) · Signal Processing Image Communication · doi:10.1016/j.image.2012.10.003 · Cited by 82 · cited 1×
“Validation of objective models, such as [44] or the tests performed by VQEG, is based on a comparison of objective model outputs with subjective quality scores for a set of media clips.”
MethodQuality of perception: user quality of service in multimedia presentations
Ghinea, G., & Thomas, J. P. (2005) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2005.850960 · Cited by 81 · cited 1×
“Ghinea and Thomas [71] define quality of perception (QoP), which includes a user’s satisfaction with multimedia clips as well as a user’s ability to understand, synthesize, and analyze the information content of such presentations.”
BackgroundInteractive test methods for audiovisual communications
Itu-T (1996) · Medical Entomology and Zoology · Cited by 80
Learning to predict the perceived visual quality of photos
Wu, O., Hu, W., & Gao, J. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126246 · Cited by 79 · cited 1×
“[50] represent the visual quality of images as a distribution rather than a single scalar value.”
BackgroundThe Effect of Estimating Weights in Weighted Least Squares
Carroll, R. J., Wu, C., & Ruppert, D. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478699 · Cited by 77 · cited 1×
“Note, however, that the accuracy of this method depends on the accuracy of the individual variance estimates [48].”
MethodOn the properties of subjective ratings in video quality experiments
WINKLER, S. S. (2009) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246961 · Cited by 77 · cited 2×
“In theory, scales with higher granularity can result in smaller standard deviations of MOS [28]; in practice, however, these differences turn out to be insignificant.”
BackgroundSelf-citationDimension-based Quality Modeling of Transmitted Speech
Wältermann, M. (2013) · T-labs series in telecommunication services · doi:10.1007/978-3-642-35019-1 · Cited by 74 · cited 3×
“However, for the purpose of finding perpendicular dimensions reflecting different features that together form the integral quality judgment, it can actually be counterproductive to consider a separate dimension reflecting integral quality itself [70].”
BackgroundInfluentialMeasurement of visual impairment scales for digital video:
Watson, A. B., & Kreslake, L. (2001) · SPIE Proceedings · doi:10.1117/12.429526 · Cited by 63 · cited 2×
“The advantage of JND measurements is that—contrary to MOS—they are in absolute and statistically meaningful units and are less likely to be subject to context effects [60].”
BackgroundModeling subjective tests of quality of experience with a Generalized Linear Model
Janowski, L., & Papir, Z. (2009) · 2009 International Workshop on Quality of Multimedia Experience · doi:10.1109/qomex.2009.5246979 · Cited by 62 · cited 3×
“A simple way of achieving this is using weights that are equal to the reciprocal of the variance of each measurement (MOS) for each test clip; this is also referred to as variance-weighted regression, a special case of generalized least squares [47].”
BackgroundMethodAcceptance Threshold: A Bidimensional Research Method for User-Oriented Quality Evaluation Studies
Pyykko, S. J., Vadakital, V. K. M., & Hannuksela, M. M. (2008) · International Journal of Digital Multimedia Broadcasting · doi:10.1155/2008/712380 · Cited by 59 · cited 1×
“[59] even recommend a bi-dimensional approach to quality evaluation for this purpose, by considering satisfaction and acceptance separately.”
BackgroundOpen Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception
Strohmeier, D., Pyykko, S. J., & Kunze, K. (2010) · Advances in Multimedia · doi:10.1155/2010/658980 · Cited by 58
Radun, J. E., Leisti, T., Häkkinen, J. P., Ojanen, H. J., Olives, J.-L., Vuori, T., & Nyman, G. (2008) · ACM Transactions on Applied Perception · doi:10.1145/1278760.1278762 · Cited by 55
Evaluating Quality of Experience for Streaming Video in Real Time
Venkataraman, M., Chatterjee, M., & Chattopadhyay, S. (2009) · Globecom · doi:10.1109/glocom.2009.5425806 · Cited by 55 · cited 1×
“A similar approach is presented in [81] by constructing a k-dimensional Euclidean QoE space, where each dimension represents a parameter that may impact video quality.”
MethodUtility curves: mean opinion scores considered biased
Knoche, H., De Meer, H. G., & Kirsh, D. (2003) · 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354) · doi:10.1109/iwqos.1999.766473 · Cited by 51 · cited 1×
“[90] highlight several properties of MOS-based approaches that may prove problematic when used in certain applications.”
BackgroundForgiveness effect in subjective assessment of packet video
Seferidis, V. E., Ghanbari, M., & Pearson, D. E. (1992) · Electronics Letters · doi:10.1049/el:19921290 · Cited by 50 · cited 1×
“When interpreting data obtained from such studies, one must be aware of forgiveness [8] and recency [9] effects, where impairments that occurred some time ago tend to be “forgiven” or forgotten by the subject, while those occurring more recently tend to have a greater negative impact on the perception of video quality.”
MethodTradeoffs in subjective testing methods for image and video quality assessment
Rouse, D., Pépion, R., Callet, P. L., & Hemami, S. S. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.845389 · Cited by 44 · cited 1×
“SAMVIQ is also compared with ACR in [24], which addresses the differences in accuracy, granularity, and consistency between the two methods for both images and video.”
MethodMultidimensional modeling of image quality
Martens, J. B. O. S. (2002) · Proceedings of the IEEE · doi:10.1109/5.982411 · Cited by 41 · cited 1×
“Scaling perceptual differences of pairwise stimuli, which are then mapped into a multidimensional space using multi-dimensional scaling (MDS) procedures [66, 67].”
BackgroundMeasurement of scene-dependent quality variations in digitally coded television pictures
Aldridge, R. (1995) · IEE Proceedings - Vision, Image, and Signal Processing · doi:10.1049/ip-vis:19951937 · Cited by 39 · cited 1×
“When interpreting data obtained from such studies, one must be aware of forgiveness [8] and recency [9] effects, where impairments that occurred some time ago tend to be “forgiven” or forgotten by the subject, while those occurring more recently tend to have a greater negative impact on the perception of video quality.”
MethodOn the Properties of Mean Opinion Scores for Quality of Experience Management
Xu, J., Xing, L., Perkis, A., & Jiang, Y. (2011) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2011.88 · Cited by 37 · cited 4×
“In this respect, overall MOS can lead to unfairness among customers, depending on how it is used [33].”
BackgroundMethodInfluentialSullivan, M. A., Pratt, J. H., & Kortum, P. T. (2008) · International Conference on Designing Interactive User Experiences for TV and Video (UXTV) · doi:10.1145/1453805.1453807 · Cited by 33 · cited 3×
“[16] point out, designing and maintaining an infrastructure that aims for a service that is constantly scoring a maximum value is too costly and does not provide sufficient noticeable benefits.”
BackgroundInfluentialOf MOS and men: bridging the gap between objective and subjective quality measurements in mobile TV
Koning, T. C. M. D., van Veldhoven, P. J., Knoche, H. O., & Kooij, R. E. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.704159 · Cited by 32 · cited 1×
“[58] find that video requires a different (and possibly content-dependent) mapping function.”
BackgroundConsumer Opinions About Frequency of Artifacts in Digital Video
Cermak, G. W. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2014495 · Cited by 26 · cited 1×
“Some actual figures about the number of artifacts perceived by consumers and their acceptability are found in [87].”
BackgroundKeimel, C., Rothbucher, M., Shen, H., & Diepold, K. J. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942468 · Cited by 25 · cited 1×
“[80].”
Hinterleitner, F., Norrenbrock, C. R., & Möller, S. (2013) · SSW · Cited by 23
Reddy, A., Estrin, D. L., & Govindan, R. (2000) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.842989 · Cited by 19 · cited 1×
“In this respect, the issue of fault isolation has also been addressed by the networking community [78], using multi-resolution data analysis and statistical data mining Interrupted Continuous”
MethodSystematic stress testing of image quality estimators
Ciaramello, F. M., & Reibman, A. (2011) · 2011 18th IEEE International Conference on Image Processing · doi:10.1109/icip.2011.6116322 · Cited by 19 · cited 1×
“errors, vulnerabilities, and failure characteristics, of a quality metric, rather than to demonstrate that it satisfies certain specifications [51-53].”
BackgroundA strategy to jointly test image quality estimators subjectively
Reibman, A. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467156 · Cited by 16 · cited 1×
“Reibman [54] generalizes these approaches to define subjective tests with a high likelihood of exposing misclassification errors of objective quality metrics, whereas conventional subjective tests generate such samples only randomly.”
BackgroundObjective and subjective quality assessment with expert and non-expert viewers
Speranza, F., Poulin, F., Renaud, R., Caron, M., & Dupras, J. (2010) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5518177 · Cited by 16 · cited 1×
“• Should expert or non-expert subjects be used [13,14]? Experts typically are in better agreement on the quality of a specific clip, so a smaller panel can suffice.”
Background`Mean Time Between Failures': A Subjectively Meaningful Video Quality Metric
Suresh, N., & Jayant, N. S. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1660499 · Cited by 16 · cited 1×
“One interesting alternative was proposed by Suresh and Jayant [88].”
BackgroundPyykko, S. J., & Häkkinen, J. P. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.765697 · Cited by 13 · cited 1×
“• Is the composition of the panel representative of the target audience for the application of interest? Demographics such as gender, age, ethnicity, and education of the subjects are relevant and can affect MOS [12].”
BackgroundCorriveau, P. J. (2017) · CRC Press eBooks · doi:10.1201/9781420027822-4 · Cited by 11
Streijl, R. C., WINKLER, S. S., & Hands, D. S. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936776 · Cited by 10
Self-citationStatistical approach to the rational selection of experimental subjects
Araujo, P. W., & Frøyland, L. (2005) · Accreditation and Quality Assurance · doi:10.1007/s00769-005-0907-5 · Cited by 9 · cited 1×
“The number can be guided by the acceptable experimental error, as is done in medical experiments [11], or the desired confidence interval.”
BackgroundMeasuring the Quality of Quality Measures
Nachlieli, H., & Shaked, D. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2059708 · Cited by 9 · cited 1×
“Another such approach addressing this issue [49] proposes a rank agreement measure (RAM) from a geometric representation of subjects’ rank order preferences.”
BackgroundAUDITORY-PERCEPTUAL IDENTIFICATION OF VOICE QUALITY BY EXPERT AND NON-EXPERT LISTENERS*
Köster, O., Jessen, M. E., Khairi, F., & Eckert, H. (2007) · Cited by 8
OSLAM: Towards ontology-based SLA management for IPTV services
Seo, S., Kwon, A., Kang, J., & Hong, J. W. (2011) · IFIP/IEEE International Symposium on Integrated Network Management (IM) · doi:10.1109/inm.2011.5990570 · Cited by 8 · cited 1×
“[84] propose an architecture for defining and managing SLAs as well as detecting violations.”
BackgroundPerceptual Quality Measurement—Towards a More Efficient Process for Validating Objective Models
Streijl, R. C., WINKLER, S. S., & Hands, D. S. (2010) · Cited by 6
Self-citationSubjective video quality comparison using various displays
Choi, H., Jeong, T., & Lee, C. (2009) · Optical Engineering · doi:10.1117/1.3089699 · Cited by 4 · cited 1×
“Each modality has its own specific issues; for example, for speech tests, the language spoken is an important factor that can affect the outcome of the test; for audio tests, the use of headphones or speakers has to be considered; for video, the type and properties of the display can have an impact on ratings [15].”
BackgroundAYRES, P. G. (2001) · New Phytologist · doi:10.1046/j.1469-8137.2001.00041.x · Cited by 3
Research works printed but not linked: 5
- Guilford, J.P.: Psychometric Methods, 2nd edn. McGraw-Hill, New York (1954)
- Mullin, J., Smallwood, L., Watson, A., Wilson, G.M.: New techniques for assessing audio and video quality in real-time interactive communication. In: Proceedings of IHM-HCI, Lille. (2001)
- Sen, D.: Determining the dimensions of speech quality from PCA and MDS analysis of the diagnostic acceptability measure. In: Proceedings of MESAQIN, Prague (2011)
- Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proceedings of Human Factors in Telecommunications, pp. 253–260 (1995)
- Egger, S., Ries, M., Reichl, P.: Quality-of-experience beyond MOS: experiences with a holistic user test methodology for interactive video services. In: Proceedings of 21st ITC Specialist Seminar, Miyazaki (2010)
Cited by
Structural similarity index (SSIM) revisited: A data-driven approach
Bakurov, I., Buzzelli, M., Schettini, R., Castelli, M., & Vanneschi, L. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116087 · Cited by 421
A Comprehensive Review on Generative AI for Education
Mittal, U., Sai, S., Chamola, V., & Sangwan, D. (2024) · IEEE Access · doi:10.1109/access.2024.3468368 · Cited by 383
“These models have been trained over multiple deep learning models and are then evaluated using metrics such as signal-to-noise ratio [17] and mean-opinion-score [18].”
MethodAn Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
“(MOS) [2], [251]–[253], preference tests [18], [254] and bestworst scaling [255] could represent the intrinsic naturalness and similarity to the target.”
BackgroundOn the use of deep learning for blind image quality assessment
Bianco, S., Celona, L., Napoletano, P., & Schettini, R. (2018) · Signal, Image and Video Processing · doi:10.1007/s11760-017-1166-8 · Cited by 277
“The CNN is discriminatively fine-tuned to classify image sub-regions into five classes according to the 5-points MOS scale [43].”
MethodLossy Image Compression with Compressive Autoencoders
Huszár, F., Theis, L., Shi, W., & Cunningham, A. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.51995 · Cited by 237
Metadata
- Authors
- Streijl, R. C., Winkler, S., & Hands, D. S.
- Affiliations
- AT&T (United States) (US)
- Advanced Digital Sciences Center (SG)
- Microsoft (United Kingdom) (GB)
- Corresponding author
- Winkler, Stefan
- Venue
- Multimedia Systems
- Published
- 2014-12-28
- Volume
- 22
- Issue
- 2
- Pages
- 213-227
- ISSN
- 0942-4962 (ISSN-L)
- 1432-1882
- OpenAlex
- W1975163393
- Cited by
- 506
- References
- 78
- Citations by year
- 2026: 34 · 2025: 55 · 2024: 78 · 2023: 76 · 2022: 53 · 2021: 40 · 2020: 52 · 2019: 40 · 2018: 36 · 2017: 30 · 2016: 10 · 2015: 2
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Multimedia Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Keywords
- mean opinion score, subjective quality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.