A nonlinear quality of experience model for high dynamic spatio-temporal mulsemedia
Abstract
In multimedia, quality of experience (QoE) accounts for the degree of delight or annoyance of the user of an application or service. Although humans have five senses, only two of these senses (i.e., sight and hearing) are stimulated by traditional multimedia contents. Therefore, the research efforts try to provide realistic media contents to the users. Realistic media contents are media with multiple sensorial effects, called mulsemedia, aimed at increasing user's experience through the five senses representation. This introduces a number of new issues, such as the QoE assessment for audiovisual sequences enriched with additional sensory effects such as light, wind, vibration, scent. QoE evaluation is based on mean opinion score (MOS) subjective tests measurement campaigns, which are time consuming, although allowing for the definition of statistical prediction models. The state of the art of QoE model for mulsemedia is based on parametric models. A linear model has been proposed, based on least square (LS) parameter estimation and validated on high dynamic spatio-temporal mulsemedia. This paper proposes a nonlinear model for predicting the QoE for high dynamic spatio-temporal mulsemedia. The parameter estimation relies on metaheuristic particle swarm optimization (PSO) which has been efficiently applied to optimization of nonlinear problems. A comparative analysis of the performance of the proposed model with the state of the art linear model for the QoE has been carried out based on the same MOS data set and assesses the effectiveness of the former with respect to the latter in case of high dynamic spatio-temporal mulsemedia.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Kennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192 · see citing works
A modified particle swarm optimizer
Shi, Y., & Eberhart, R. (1998) · 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360) · doi:10.1109/icec.1998.699146 · Cited by 11,497 · see citing works
Particle swarm optimization: developments, applications and resources
Eberhart, & Shi, Y. (2001) · Congress on Evolutionary Computation · doi:10.1109/cec.2001.934374 · Cited by 4,332 · see citing works
Mathematical Statistics and Data Analysis
Rabinowitz, L., & Rice, J. A. (1989) · Technometrics · doi:10.2307/3556160 · Cited by 3,142 · see citing works
Seber, G. A. F., & Wild, C. J. (1989) · Wiley series in probability and statistics · doi:10.1002/0471725315 · Cited by 1,962 · see citing works
A generic quantitative relationship between quality of experience and quality of service
Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010) · IEEE Network · doi:10.1109/mnet.2010.5430142 · Cited by 837 · see citing works
Qualinet White Paper on Definitions of Quality of Experience
Callet, P. L., Möller, S., Perkis, A., Brunnstrom, K. E., Beker, S., Moor, K. D., Dooms, A., Egger, S., Garcia, M.-N., Hoßfeld, T., et al. (2013) · HAL · Cited by 692 · see citing works
Chou, I.-C., & Voit, E. O. (2009) · Mathematical Biosciences · doi:10.1016/j.mbs.2009.03.002 · Cited by 391 · see citing works
Ghinea, G., Timmerer, C., Lin, W., & Gulliver, S. R. (2014) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2617994 · Cited by 169 · see citing works
A Basic Multimedia Quality Model
Hands, D. S. (2004) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2004.837233 · Cited by 164 · see citing works
Rainer, B., Waltl, M., Cheng, E., Shujau, M., Timmerer, C., Davis, S., Burnett, L., Ritz, C. H., & Hellwagner, H. (2012) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2012.6263842 · Cited by 53 · see citing works
VQM-based QoS/QoE mapping for streaming video
Wang, T., Pervez, A., & Zou, H. (2010) · IEEE International Conference on Broadband Network and Multimedia Technology (IC-BNMT) · doi:10.1109/icbnmt.2010.5705202 · Cited by 36 · see citing works
A_PSQA: Efficient real-time video streaming QoE tool in a future media internet context
Chérif, W., Ksentini, A., Négru, D., & Sidibé, M. (2011) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2011.6011993 · Cited by 34 · see citing works
Shiltagh, N. A., & Jalal, L. (2013) · Cited by 27 · see citing works
Self-citationA Triple User Characterization Model for Video Adaptation and Quality of Experience Evaluatio
Pereira, F. M. B. (2005) · IEEE Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2005.248674 · Cited by 26 · see citing works
Heuristic optimization of DVB-T/H SFN coverage using PSO and SA algorithms
Anedda, M., Morgade, J., Murroni, M., Angueira, P., Arrinda, A., Pérez, J. R., & Basterrechea, J. (2011) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb.2011.5954880 · Cited by 16 · see citing works
Self-citationESTIMATING THE PARAMETERS OF NONLINEAR REGRESSION MODELS THROUGH PARTICLE SWARM OPTIMIZATION
Özsoy, V. S., & Örkçü, H. H. (2016) · DergiPark (Istanbul University) · Cited by 15 · see citing works
Automatic quality of experience measuring on video delivering networks
Vera, D. D., Rodríguez‐Bocca, P., & Rubino, G. (2008) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1453175.1453190 · Cited by 13 · see citing works
A Generic Utility Model Representing the Quality of Sensory Experience
Rainer, B., & Timmerer, C. (2014) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2648429 · Cited by 12 · see citing works
Heuristic performance evaluation for DVB-T/T2 SFN network
Anedda, M., Angueira, P., Morgade, J., & Murroni, M. (2015) · Telecommunication Systems · doi:10.1007/s11235-015-9971-2 · Cited by 7 · see citing works
Self-citationJalal, L. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1109996 · Cited by 7 · see citing works
Self-citationJalal, L., Popescu, V., & Murroni, M. (2017) · doi:10.1109/optim.2017.7975095 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
4 of the 26 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey
Barakabitze, A. A., Barman, N., Ahmad, A., Zadtootaghaj, S., Sun, L., Martini, M. G., & Atzori, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2958784 · Cited by 239 · see citing works
A Survey of Emerging Concepts and Challenges for QoE Management of Multimedia Services
Skorin-Kapov, L., Varela, M., Hoßfeld, T., & Chen, K.-T. (2018) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3176648 · Cited by 116 · see citing works
Enhancing TV broadcasting services: A survey on mulsemedia quality of experience
Jalal, L., & Murroni, M. (2017) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb.2017.7986192 · Cited by 24 · see citing works
Self-citationModeling User Quality of Experience of Olfaction-Enhanced Multimedia
Murray, N., Muntean, G., Qiao, Y., Brennan, S., & Lee, B. (2018) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2018.2825297 · Cited by 24 · see citing works
A QoE Model for Mulsemedia TV in a Smart Home Environment
Jalal, L., Puddu, R., Martini, M. G., Popescu, V., & Murroni, M. (2022) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2022.3217676 · Cited by 16 · see citing works
Self-citationMethodologies and Trends in Multimedia Systems: A Systematic Literature Review
Peláez, C. A., Solano, A., Granollers, T., & Collazos, C. (2019) · Interacción · doi:10.1007/978-3-030-21902-4_9 · Cited by 3 · see citing works
Extension to 4K Resolution of a Parametric Model for Perceptual Video Quality Estimation
Sotelo, R., Joskowicz, J., Puddu, R., Giusto, D., & Anedda, M. (2018) · IEEE Broadcast Symposium (BTS) · doi:10.1109/bts.2018.8551143 · Cited by 2 · see citing works
- Authors
- Jalal, L., & Murroni, M.
- Affiliations
- University of Cagliari (IT)
- Venue
- 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX)
- Publisher
- IEEE
- Published
- 2017-05
- Volume
- 2
- Pages
- 1-6
- OpenAlex
- W2733202070
- Cited by
- 7
- References
- 26
- Citations by year
- 2022: 1 · 2019: 2 · 2018: 3 · 2017: 1
- FWCI
- 0.48
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Quality of Multimedia Experience (QoMEX) (publishedVersion)
- UNICA IRIS Institutional Research Information System (University of Cagliari) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Social Sciences › Sociology and Political Science › Multimedia Communication and Technology
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- quality of experience, particle swarm optimization, parameter estimation, mean opinion score, sensory effects, QoE prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
