QoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The validity of MOS is recently questioned by several researchers.
“Even though using MOS is the most widely used method, its validity is recently questioned by several researchers [35].”
From QoE in IoT: a vision, survey and future directions (2021) · cites this paper as [35]
Using MOS is the most widely used method for subjective ratings.
“Even though using MOS is the most widely used method, its validity is recently questioned by several researchers [35].”
From QoE in IoT: a vision, survey and future directions (2021) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The International Telecommunication Union
Jones, R. W. (2002) · Digest - IEEE Antennas and Propagation Society. International Symposium · doi:10.1109/aps.1997.631791 · Cited by 1,910 · see citing works
Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Martin Reisslein, B., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613 · see citing works
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506 · see citing works
Determinants of subscriber churn and customer loyalty in the Korean mobile telephony market
Kim, H.-S., & Yoon, C.-H. (2004) · Telecommunications Policy · doi:10.1016/j.telpol.2004.05.013 · Cited by 417 · see citing works
A Longitudinal Examination of Net Promoter and Firm Revenue Growth
Keiningham, T. L., Cooil, B., Andreassen, T. W., & Aksoy, L. (2007) · Journal of Marketing · doi:10.1509/jmkg.71.3.39 · Cited by 386 · see citing works
Comparing subjective video quality testing methodologies
Pinson, M., & Wolf, S. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.509908 · Cited by 201 · see citing works
Measuring perceived quality of speech and video in multimedia conferencing applications
Watson, A., & Sasse, M. A. (1998) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/290747.290755 · Cited by 184 · see citing works
Hoßfeld, T., Schatz, R., & Egger, S. (2011) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2011.6065690 · Cited by 169 · see citing works
Self-citationMetrics for the Internet Age: Quality of Experience and Quality of Business
van, M. (2001) · doi:10.25405/ncl.34126209 · Cited by 164 · see citing works
Assessment and Prediction of Speech Quality in Telecommunications
Möller, S. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3117-0 · Cited by 156 · see citing works
Self-citationThe predictive ability of different customer feedback metrics for retention
de Haan, E., Verhoef, P. C., & Wiesel, T. (2015) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2015.02.004 · Cited by 145 · see citing works
Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel
Simone, F., Naccari, M., Tagliasacchi, M., et al. (2009) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246952 · Cited by 141 · see citing works
Voice and speech quality perception : assessment and evaluation
Jekosch, U. (2005) · doi:10.1007/3-540-28860-0 · Cited by 119 · see citing works
QoS and QoE Management in UMTS Cellular Systems
(2006) · Wiley eBooks · doi:10.1002/9780470034057 · Cited by 116 · see citing works
Framing the Context of Use for Mobile HCI
Pyykko, S. J., & Vainio, T. (2010) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2010100101 · Cited by 111 · see citing works
The memory effect and its implications on Web QoE modeling
Hosfeld, T., Biedermann, S., Schatz, R., Platzer, A., Egger, S., & Fiedler, M. (2011) · International Teletraffic Congress · doi:10.5555/2043468.2043485 · Cited by 104 · see citing works
Performance comparisons of subjective quality assessment methods for mobile video
Tominaga, T., Hayashi, T., Okamoto, J., et al. (2010) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5517948 · Cited by 96 · see citing works
Perceptual-based Quality Metrics for Image and Video Services: A Survey
Engelke, U., & Zepernick, H. (2007) · Next Generation Internet Networks (NGI) · doi:10.1109/ngi.2007.371215 · Cited by 94 · see citing works
Of packets and people: a user-centered approach to quality of service
Bouch, A., Sasse, M. A., & deMeer, H. (2002) · doi:10.1109/iwqos.2000.847955 · Cited by 79 · see citing works
Modeling subjective tests of quality of experience with a Generalized Linear Model
Janowski, L., & Papir, Z. (2009) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246979 · Cited by 62 · see citing works
Subjective and Objective Quality Assessment of Image: A Survey
Mohammadi, P., Ebrahimi-Moghadam, A., & Shirani, S. (2014) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 59 · see citing works
Towards a comprehensive framework for QOE and user behavior modelling
Reichl, P., Egger, S., Möller, S., et al. (2015) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2015.7148138 · Cited by 54 · see citing works
Self-citationUtility curves: mean opinion scores considered biased
Knoche, H. O., de Meer, H., & Kirsh, D. (2003) · International Workshop on Quality of Service · doi:10.1109/iwqos.1999.766473 · Cited by 51 · see citing works
SUITABLE METHODOLOGY IN SUBJECTIVE VIDEO QUALITY ASSESSMENT: A RESOLUTION DEPENDENT PARADIGM
Péchard, S., Pépion, R., & Callet, P. L. (2008) · Cited by 49 · see citing works
Subjective Multimedia Quality Assessment
Brotherton, M. S., Huynh‐Thu, Q., Hands, D. S., et al. (2006) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1093/ietfec/e89-a.11.2920 · Cited by 35 · see citing works
Acceptability and Quality of Experience in over the top video
Spachos, P., Li, W., Chignell, M., et al. (2015) · doi:10.1109/iccw.2015.7247424 · Cited by 29 · see citing works
QoE beyond the MOS: Added value using quantiles and distributions
Hoßfeld, T., Heegaard, P. E., & Varela, M. (2015) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2015.7148142 · Cited by 26 · see citing works
Self-citationHow to evaluate objective video quality metrics reliably
Korhonen, J., Burini, N., You, J., et al. (2012) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2012.6263839 · Cited by 25 · see citing works
Sackl, A., Zwickl, P., & Reichl, P. (2013) · International Conference on Network and Service Management (CNSM) · doi:10.1109/cnsm.2013.6727850 · Cited by 23 · see citing works
Quality in Context-an ecological approach to assessing QoS for mobile TV
Sasse, M. A., & Knoche, H. (2006) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 22 · see citing works
Huynh‐Thu, Q., & Ghanbari, M. (2005) · SIP · Cited by 21 · see citing works
Siahaan, E., Redi, J., & Hanjalić, A. (2014) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2014.6982326 · Cited by 18 · see citing works
Video Performance Requirements for Tactical Video Applications
Pinson, M., Wolf, S., & Stafford, R. B. (2007) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/ths.2007.370025 · Cited by 18 · see citing works
Statistical analysis of ordinal user opinion scores
Mu, M., Mauthe, A., Gareth Tyson, A., & Cerqueira, E. (2012) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc.2012.6181112 · Cited by 16 · see citing works
An annotated dataset for Web Browsing QOE
Schatz, R., & Egger, S. (2014) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2014.6982293 · Cited by 15 · see citing works
International telecommunication union (ITU)
(2013) · Yearbook of the United Nations/United Nations yearbook collection · doi:10.18356/6c417aca-en · Cited by 11 · see citing works
Quality of Experience and Interactivity
Egger, S., Reichl, P., & Schoenenberg, K. (2014) · T-labs series in telecommunication services · doi:10.1007/978-3-319-02681-7_11 · Cited by 9 · see citing works
Measuring the Quality of Quality Measures
Nachlieli, H., & Shaked, D. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2059708 · Cited by 9 · see citing works
Pessemier, T. D., Moor, K. D., Verdejo, A. J., et al. (2011) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2011.6065689 · Cited by 7 · see citing works
Measuring speech quality impact on tasks performance
Durin, V., & Gros, L. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-538 · Cited by 5 · see citing works
Network quality differentiation: Regional effects, market entrance, and empirical testability
Mäki, T., Zwickl, P., & Varela, M. (2016) · IFIP Networking Conference (IFIP Networking) · doi:10.1109/ifipnetworking.2016.7497243 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Gros L, Chateau N, Durin V (2006) Speech quality: beyond the MOS score. In: Measurement of speech and audio quality in networks workshop (MESAQIN '06). Czech Republic, Prague
- Hoßfeld T, Heegaard PE, Varela M, Mo ¨ller S (2016) Formal definition of QoE metrics. ARXIV CS.MM Hoßfeld T, Heegaard PE, Varela M, Mo ¨ller S (2016) Scripts for the computation of QoE metrics beyond the MOS. https://github. com/hossfeld/QoE-Metrics.git
- Le Callet P, Mo ¨ller S, Perkis A (eds.) ( 2013) Qualinet white paper on definitions of quality of experience. European network on quality of experience in multimedia systems and services (cost action IC 1003)
Cited by
Sorted by citations
QoE in IoT: a vision, survey and future directions
Fizza, K., Banerjee, A., Mitra, K., Jayaraman, P. P., Ranjan, R., Patel, P., & Georgakopoulos, D. (2021) · Discover Internet of Things · doi:10.1007/s43926-021-00006-7 · Cited by 107 · see citing works
- Authors
- Hoßfeld, T., Heegaard, P. E., Varela, M., & Möller, S.
- Affiliations
- University of Duisburg-Essen (DE)
- Norwegian University of Science and Technology (NO)
- Technische Universität Berlin (DE)
- Corresponding author
- Hoßfeld, Tobias
- Venue
- Quality and User Experience
- Published
- 2016-09-02
- Volume
- 1
- Issue
- 1
- ISSN
- 2366-0139 (ISSN-L)
- 2366-0147
- OpenAlex
- W2474880636
- Cited by
- 135
- References
- 41
- Citations by year
- 2026: 6 · 2025: 15 · 2024: 12 · 2023: 15 · 2022: 17 · 2021: 22 · 2020: 16 · 2019: 11 · 2018: 11 · 2017: 8 · 2016: 2
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Quality and User Experience (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Funders
- Deutsche Forschungsgemeinschaft (H= 4770/1-2)
- European Cooperation in Science and Technology (ID0EXRBG11)
- Tekes (CELTIC+ project NOTTS)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Customer Service Quality and Loyalty
- Keywords
- quality of experience, mean opinion score, QoE metrics, subjective quality assessment, QoE estimation, customer churn
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
