The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Quantification of YouTube QoE via Crowdsourcing
Open accessAbstract
This paper addresses the challenge of assessing and modeling Quality of Experience (QoE) for online video services that are based on TCP-streaming. We present a dedicated QoE model for You Tube that takes into account the key influence factors (such as stalling events caused by network bottlenecks) that shape quality perception of this service. As second contribution, we propose a generic subjective QoE assessment methodology for multimedia applications (like online video) that is based on crowd sourcing - a highly cost-efficient, fast and flexible way of conducting user experiments. We demonstrate how our approach successfully leverages the inherent strengths of crowd sourcing while addressing critical aspects such as the reliability of the experimental data obtained. Our results suggest that, crowd sourcing is a highly effective QoE assessment method not only for online video, but also for a wide range of other current and future Internet applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
reCAPTCHA: Human-Based Character Recognition via Web Security Measures
von Ahn, L., Maurer, B., McMillen, C., Abraham, D., & Blum, M. (2008) · Science · doi:10.1126/science.1160379 · Cited by 1,115
Quality management on Amazon Mechanical Turk
Ipeirotis, P. G., Provost, F., & Wang, J. (2010) · Proceedings of the ACM SIGKDD Workshop on Human Computation · doi:10.1145/1837885.1837906 · Cited by 973
A generic quantitative relationship between quality of experience and quality of service
Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010) · IEEE Network · doi:10.1109/mnet.2010.5430142 · Cited by 837
Self-citationMeasuring the quality of experience of HTTP video streaming
Mok, R. K. P., Chan, E. W. W., & Chang, R. K. C. (2011) · 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops · doi:10.1109/inm.2011.5990550 · Cited by 473
Using Analytic QP and Sparseness to Speed Training of Support Vector Machines
Platt, J. C. (1998) · Cited by 270
TurKit: tools for iterative tasks on mechanical Turk
Little, G., Chilton, L. B., Goldman, M., & Miller, R. C. (2009) · Proceedings of the ACM SIGKDD Workshop on Human Computation · doi:10.1145/1600150.1600159 · Cited by 237
An Evaluation of QoE in Cloud Gaming Based on Subjective Tests
Jarschel, M., Schlosser, D., Scheuring, S., & Hoßfeld, T. (2011) · 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing · doi:10.1109/imis.2011.92 · Cited by 217
Self-citationHossfeld, T., Schatz, R., & Egger, S. (2011) · 2011 Third International Workshop on Quality of Multimedia Experience · doi:10.1109/qomex.2011.6065690 · Cited by 168
Self-citationAnatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com
Hirth, M., Hoßfeld, T., & Tran‐Gia, P. (2011) · International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS) · doi:10.1109/imis.2011.89 · Cited by 141
Self-citationDecision-Theoretic Control of Crowd-Sourced Workflows
Dai, P., Mausam, M., & Weld, D. S. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7760 · Cited by 126
Quadrant of euphoria: a crowdsourcing platform for QoE assessment
Chen, K.-T., Chang, C.-J., Wu, C., et al. (2010) · IEEE Network · doi:10.1109/mnet.2010.5430141 · Cited by 112
Huang, E., Zhang, H., Parkes, D. C., Gajos, K. Z., & Chen, Y. (2010) · doi:10.1145/1837885.1837908 · Cited by 72
Cost-Optimal Validation Mechanisms and Cheat-Detection for Crowdsourcing Platforms
Hirth, M., Hoßfeld, T., & Tran‐Gia, P. (2011) · International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS) · doi:10.1109/imis.2011.91 · Cited by 57
Self-citation
Cited by
A Survey on Quality of Experience of HTTP Adaptive Streaming
Seufert, M., Egger, S., Slanina, M., Zinner, T., Hoßfeld, T., & Tran-Gia, P. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2360940 · Cited by 844
Self-citationBest Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing
Hossfeld, T., Keimel, C., Hirth, M., Gardlo, B., Habigt, J., Diepold, K., & Tran-Gia, P. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2291663 · Cited by 283
Self-citationMeasurement of Quality of Experience of Video-on-Demand Services: A Survey
Juluri, P., Tamarapalli, V., & Medhi, D. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2401424 · Cited by 229
A Data-Driven Architecture for Personalized QoE Management in 5G Wireless Networks
Wang, Y., Li, P., Jiao, L., Su, Z., Cheng, N., Shen, X. S., & Zhang, P. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1500184wc · Cited by 125
Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience
Bampis, C. G., Li, Z., Katsavounidis, I., & Bovik, A. C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2815842 · Cited by 84
Metadata
- Authors
- Hoßfeld, T., Seufert, M., Hirth, M., Zinner, T., Tran-Gia, P., & Schatz, R.
- Venue
- 2011 IEEE International Symposium on Multimedia
- Publisher
- IEEE
- Published
- 2011-12
- Pages
- 494-499
- OpenAlex
- W2025518782
- Cited by
- 338
- References
- 16
- FWCI
- 19.37
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.