Cited by 243Software-Defined Networks and 5GImage and Video Quality AssessmentNetwork Traffic and Congestion Control

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

Open access
Barakabitze, Alcardo Alex, Barman, Nabajeet, Ahmad, Arslan, Zadtootaghaj, Saman, Sun, Lingfen, Martini, Maria G., Atzori, Luigi·2020·IEEE Communications Surveys & Tutorials

Abstract

The highly demanding Over-The-Top (OTT) multimedia applications pose increased challenges to Internet Service Providers (ISPs) for assuring a reasonable Quality of Experience (QoE) to their customers due to lack of flexibility, agility and scalability in traditional networks. The future networks are shifting towards the cloudification of the network resources via Software Defined Networks (SDN) and Network Function Virtualization (NFV). This will equip ISPs with cutting-edge technologies to provide service customization during service delivery and offer QoE which meets customers' needs via intelligent QoE control and management approaches. Towards this end, we provide in this paper a tutorial and a comprehensive survey of QoE management solutions in current and future networks. We start with a high-level description of QoE management for multimedia services, which integrates QoE modelling, monitoring, and optimization. This followed by a discussion of HTTP Adaptive Streaming (HAS) solutions as the dominant technique for streaming videos over the best-effort Internet. We then summarize the key elements in SDN/NFV along with an overview of ongoing research projects, standardization activities and use cases related to SDN, NFV, and other emerging applications. We provide a survey of the state-of-the-art of QoE management techniques categorized into three different groups: a) QoE-aware/driven strategies using SDN and/or NFV; b) QoE-aware/driven approaches for adaptive streaming over emerging architectures such as multi-access edge computing, cloud/fog computing, and information-centric networking; and c) extended QoE management approaches in new domains such as immersive augmented and virtual reality, mulsemedia and video gaming applications. Based on the review, we present a list of identified future QoE management challenges regarding emerging multimedia applications, network management and orchestration, network slicing and collaborative service management in softwarized networks. Finally, we provide a discussion on future research directions with a focus on emerging research areas in QoE management, such as QoE-oriented business models, QoE-based big data strategies, and scalability issues in QoE optimization.

AI snapshot

Written from the paper’s full text.

TL;DR

This paper is a tutorial and comprehensive survey of QoE management for multimedia streaming services in current and future networks, with emphasis on SDN, NFV, MEC, cloud/fog, ICN, and emerging immersive applications. It synthesizes QoE modeling, monitoring, optimization, and control approaches, then outlines future research challenges and directions for softwarized 5G networks.

Key findings

  • The paper organizes QoE management into three major components: QoE modeling and assessment, QoE monitoring and measurement, and QoE optimization and control, and surveys their use for HTTP adaptive streaming, DASH, and SAND.
  • It reports that 82% of all IP traffic will be video by 2022, and mobile-connected devices are estimated to reach 14.6 billion by 2022, exceeding the world’s projected population of 8 billion.
  • It surveys QoE-aware/driven strategies using SDN/NFV, including server/network-assisted optimization, QoE fairness and personalized control, QoE-centric routing, MPTCP/segment routing, and OTT-ISP collaboration; cited results include MP-DASH reducing cellular usage and radio energy consumption by 99% and 85% respectively with negligible QoE degradation, and ICN prefetching increasing delivered video quality by 20% compared with DASH without prefetching.
  • It identifies future challenges in QoE management and orchestration, OTT-ISP collaboration, QoE-oriented business models, QoE-based big data, network sharing/slicing, scalability/resilience, security/privacy/trust, and multimedia communications in IoT.

Methods

  • Design: a tutorial and comprehensive survey, not an empirical study; it reviews and categorizes QoE management solutions across SDN/NFV, emerging architectures such as MEC, cloud/fog computing and ICN, and new domains including immersive AR/VR, mulsemedia, cloud gaming, and light field applications.
  • Data or sample: no primary dataset, human subjects, or experimental sample; the work draws on cited literature, standardization activities, research projects, and summary tables such as related surveys, QoE-centric management strategies, emerging-architecture strategies, and future challenges.
  • Main analysis: narrative literature review and taxonomy/comparison; no meta-analysis, systematic review protocol, or quantitative synthesis is reported.

Limitations

  • The paper does not state limitations of its own survey/tutorial.
  • Evident from the text: it is a tutorial/survey without primary data collection, experimental validation, or performance evaluation of the reviewed approaches.
  • Evident from the text: it does not describe a systematic review protocol or inclusion/exclusion criteria; coverage is broad and organized according to the authors’ taxonomy.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/comst.2019.2958784

Cites

339 of 339 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 142 cited sources checked · 0 supported · 0 flagged

  • Findingcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 23

    Using videoand network-aware prefetching strategy, the delivered video quality increases by 20%, compared to a DASH system without prefetching.

    “Using videoand network-aware prefetching strategy, the delivered video quality increases by 20%, compared to a DASH system without prefetching.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [281] [281] Y.-T. Yu, F. Bronzino, R. Fan, C. Westphal, and M. Gerla, 'CongestionAware Edge Caching for Adaptive Video Streaming in InformationCentric Networks,' 12th Annual IEEE Consumer Communications and Networking Conference (CCNC), , pp. 588-596, Jan 2015. - source

      Not checked in the free run.

  • Findingcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    The performance of the 5G radio scheduler is shown to depend on the number of 360 mulsemedia users, mobility, positioning and channel conditions.

    “The performance of the 5G radio scheduler is shown to depend on the number of 360 mulsemedia users, mobility, positioning and channel conditions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [320] [320] I.-S. Comsa, R. Trestian, and G. Ghinea, '360 Mulsemedia Experience over Next Generation Wireless Networks - A Reinforcement Learning Approach,' in 10th International Conference on Quality of Multimedia Experience (QoMEX 2018) , (Sardinia, Italy), May 2018. - source

      Not checked in the free run.

  • Premisecitation
    § B. Server And Network assisted DASH (SAND) · p. 9

    SAND messages improve the streaming session by providing information about real-time operational characteristics of networks, servers, proxies, caches, CDNs as well as DASH client's performance.

    “SAND messages improve the streaming session by providing information about real-time operational characteristics of networks, servers, proxies, caches, CDNs as well as DASH client's performance [109].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [109] [109] 'ISO/IEC 23009-5: Information Technology -Dynamic Adaptive Streaming over HTTP (DASH) - Part 5: Server and Network Assisted DASH (SAND). Standard,' Feb 2017. -

      Not checked in the free run.

  • Premisecitation
    § A. Related Work and Motivation · p. 3

    Recent efforts exploring QoE management using SDN and/or NFV are limited by a limited review and discussion of standardization activities related to SDN and/or NFV.

    “Although recent efforts explore the QoE management aspects using SDN and/or NFV, we note that these works are limited in at least one of the following: 1) limited review and discussion of the standardization activities related to SDN and/or NFV;”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [19] [19] Y. Wang, P. Li, L. Jiao, Z. Su, N. Cheng, X. S. Shen, and P. Zhang, 'A Data-Driven Architecture for Personalized QoE Management in 5G Wireless Networks,' IEEE Wireless Communications Magazine , vol. 24, pp. 102-110, Nov 2016. - source

      Not checked in the free run.

    • cites [24] [24] J. Nightingale, Q. Wang, J. M. A. Calero, E. Chirivella-Perez, M. Ulbricht, J. A. Alonso-López, R. Preto, T. Batista, T. Teixeira, M. J. Barros, and C. Reinsch, 'QoE-Driven, Energy-Aware Video Adapta- 20. tion in 5G Networks: The SELFNET Self-Optimisation Use Case,' International Journal of Distributed Sensor Networks , vol. 12, no. 1, pp. 1-15, 2016. - source

      Not checked in the free run.

    • cites [34] [34] P. Neves, R. Calé, M. Costa, G. Gaspar, J. Alcaraz-Calero, Q. Wang, J. Nightingale, G. Bernini, G. Carrozzo, A. Valdivieso, L. J. G. Villalba, M. Barros, A. Gravas, J. Santos, R. Maia, and R. Preto, 'Future mode of operations for 5G - The SELFNET approach enabled by SDN/NFV,' Computer Standards & Interfaces , vol. 54, pp. 229 - 246, 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisenone given
    § A. Related Work and Motivation · p. 3

    Recent efforts exploring QoE management using SDN and/or NFV do not describe how QoE can be managed, measured or controlled in emerging technologies such as cloud/fog computing, MEC or ICN and new domains with new constraints such as delay-sensitive applications like AR/VR or video gaming.

    “4) they do not describe how QoE can be managed/measured or controlled in emerging technologies (such as cloud/fog computing, MEC or Information Centric Networking (ICN)) and new domains with new constraints (e.g., delay sensitive applications such as AR/VR or video gaming applications).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. 117
  • May combine two claims. 45
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 23

    The DASC overcomes the network bottlenecks by converging progressively to the best available video quality.

    “Authors report that the DASC overcomes the network bottlenecks by converging progressively to the best available video quality.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [318] [318] Y. Liu, J. Geurts, J. Point, S. Lederer, B. Rainer, C. Müller, C. Timmerer, and H. Hellwagner, 'Dynamic adaptive streaming over CCN: A caching and overhead analysis,' in 2013 IEEE International Conference on Communications (ICC) , pp. 3629-3633, June 2013. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 23

    The upper bound for the average bitrate the clients can obtain is found, assuming that the network and streaming characteristics are known a priori.

    “The upper bound for the average bitrate the clients can obtain is found, assuming that the network and streaming characteristics are known a priori.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [282] [282] B. Rainer, D. Posch, and H. Hellwagner, 'Investigating the Performance of Pull-Based Dynamic Adaptive Streaming in NDN,' IEEE Journal on Selected Areas in Communications , vol. 34, pp. 2130-2140, Aug 2016. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    Using DASCache, the best experience for users is achieved in varying network conditions by switching to videos with better resolution.

    “Authors show that using DASCache, the best experience for users is achieved in varying network conditions by switching to videos with better resolution.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [279] [279] W. Li, S. M. A. Oteafy, and H. S. Hassanein, 'Dynamic adaptive streaming over popularity-driven caching in information-centric networks,' in 2015 IEEE International Conference on Communications (ICC) , pp. 5747-5752, June 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    Making use of mulsemedia increases the overall user enjoyment levels by up to 77%.

    “The impact of intensity of certain mulsemedia components, including haptic and air-flow on user-perceived experience are extensively studied in [295], where making use of mulsemedia increases the overall user enjoyment levels by up to 77%.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [295] [295] Z. Yuan, S. Chen, G. Ghinea, and G.-M. Muntean, 'User Quality of Experience of Mulsemedia Applications,' ACM Trans. Multimedia Comput. Commun. Appl. , vol. 11, pp. 15:1-15:19, Oct. 2014. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    The results from this study indicate that the frame rate have a smaller effect in VR applications with regards to improving the end-user's QoE.

    “The results from this study indicate that the frame rate have a smaller effect in VR applications with regards to improving the end-user's QoE.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [321] [321] M. Gandy, R. Catrambone, B. MacIntyre, C. Alvarez, E. Eiriksdottir, M. H. B. Davidson, and A. C. McLaughlin, ' Experiences with an AR evaluation test bed: Presence, performance, and physiological measurement,' in In Proceedings of the 2010 IEEE International Symposium on Mixed and Augmented Reality , pp. 127-136, November 2010. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning
    § B. Server And Network assisted DASH (SAND) · p. 9

    SDN can be used to provide a centralized control element for practical and scalable implementation of SAND.

    “For the practical and scalable implementation of the SAND approach, SDN can be used to provide a centralized control element.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § TABLE III: SOME OF THE COMMONLY USED IMAGE AND VIDEO QA MODELS. · p. 6

    A QoE-driven service adaptation and network optimization mechanism using resource allocation was proposed in [62] based on the 3GPP IP Multimedia Subsystem architecture.

    “A QoE-driven service adaptation and network optimization mechanism using resource allocation was proposed in [62] based on the 3GPP IP Multimedia Subsystem architecture”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [62] [62] L.Skorin-Kapov and M. Matijasevic, 'Modeling of a QoS matching and optimization function for multimedia services in the NGN,' in Proceedings of the 12th IFIP/IEEE International Conference on Management of Multimedia and Mobile Networks and Services: WiredWireless Multimedia Networks and Services Management (MMNS'09) , (Italy), pp. 55-64, Oct 2009. -

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § A. HTTP Adaptive Streaming (HAS) Solutions · p. 8

    3GPP in close collaboration with MPEG has developed the DASH standard.

    “However, due to the disparity of these proprietary HAS solutions and the media formats, the 3GPP in close collaboration with MPEG has developed the Dynamic Adaptive Streaming over HTTP (DASH) standard [100].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [100] [100] ISO/IEC 23009-1:2014, 'Preview Information technology - Dynamic adaptive streaming over HTTP (DASH) - Part 1: Media presentation description and segment formats.' https://www.iso.org/standard/65274. html, 2017. [Online: Accessed 06-September-2019]. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Currently, there are ongoing QoS based collaborations between OTTP and ISPs concerning peering agreements and OTTP's surrogate server hosting in ISP's network depending on agreement.

    “Currently, there are ongoing QoS based collaborations between the OTTP and ISPs concerning peering agreements and OTTP's surrogate server (SS) hosting in ISP's network depending on the agreement [112].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [112] [112] A. Ahmad, A. Floris, and L. Atzori, 'OTT-ISP Joint service management: a customer lifetime value based approach,' in IFIP/IEEE Symposium on Integrated Network and Service Management (IM), 2017 , pp. 1017-1022, 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Multimedia content delivery operations on OTTP side can be broadly divided into client request redirection and content distribution and replication.

    “The multimedia content delivery operations on the OTTP side can be broadly divided into two categories: 1) Client request redirection and; 2) Content distribution and replication [115].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [115] [115] A. Passarella, 'A survey on content-centric technologies for the current Internet: CDN and P2P solutions,' Computer Communications , vol. 35, no. 1, pp. 1-32, 2012. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § B. QoE Modeling and Assessment: Metrics and Models · p. 5

    Full Reference (FR) metrics are usually more accurate than Reduced Reference (RR) and No-reference (NR) metrics.

    “Due to full access to source information, FR metrics are usually more accurate than RR and NR metrics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § A. Related Work and Motivation · p. 3

    Recent efforts exploring QoE management using SDN and/or NFV are limited in scope because they do not provide different architectural approaches, implementations and deployment strategies for QoE management using SDN and/or NFV.

    “3) with regard to scope, they do not provide different architectural approaches, implementations and deployment strategies for QoE management using SDN and/or NFV;”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    In this case, OTTP cannot deliver adequate quality to end users while ISP has to transport data through non-optimal path since no information is shared between OTTP and ISPs.

    “In this case, the OTTP cannot deliver adequate quality to the end users while the ISP has to transport data through a non-optimal path since no information is being shared between the OTTP and ISPs.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § TABLE IV: A COMPARISON OF HTTP ADAPTIVE STREAMING SOLUTIONS. · p. 9

    In the presence of multiple DASH clients competing for shared network resources, HAS suffers from video instability due to bitrate switching, network resource underutilization, and QoE unfairness.

    “Despite the decentralized nature of the HAS principle, there are still some drawbacks especially in the presence of multiple DASH clients that compete for the shared network resources. Some of the HAS related issues include (1) video instability due to bitrate switching [105], (2) network resource underutilization, and (3) QoE unfairness [106].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [105] [105] D. Z. Rodríguez, Z. Wang, R. L. Rosa, and G. Bressan, 'The impact of video-quality-level switching on user quality of experience in dynamic adaptive streaming over HTTP,' EURASIP Journal on Wireless Communications and Networking , vol. 2014, no. 1, 2014. - source

      Not checked in the free run.

    • cites [106] [106] A. Bentaleb, A. C. Begen, R. Zimmermann, and S. Harous, 'SDNHAS: An SDN-Enabled Architecture to Optimize QoE in HTTP Adaptive Streaming,' IEEE Transactions on Multimedia , vol. 19, pp. 2136-2151, Oct 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. Server And Network assisted DASH (SAND) · p. 9

    SAND is an extension of the MPEG-DASH standard that has been recently finalized.

    “Server and Network assisted DASH (SAND) is an extension of the MPEG-DASH standard that has been recently finalized, [109], [110] to enhance the delivery of DASH content.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [109] [109] 'ISO/IEC 23009-5: Information Technology -Dynamic Adaptive Streaming over HTTP (DASH) - Part 5: Server and Network Assisted DASH (SAND). Standard,' Feb 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [110] [110] E. Thomas, M. O. van Deventer, T. Stockhammer, A. C. Begen, and J. Famaey, 'Enhancing MPEG DASH Performance via Server and Network Assistance,' SMPTE Motion Imaging Journal , vol. 126, pp. 22-27, Jan 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    In the collaboration scheme mentioned above, ISPs only have multi-hop peering connections with the Autonomous System.

    “However, in the collaboration scheme mentioned above, the ISPs only have multi-hop peering connections with the Autonomous System (AS) 4 .”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Request redirection mechanism can be based either on DNS unicast or on combination of DNS and anycast for assignment of most nearby server to clients.

    “The request redirection mechanism can be based either on Domain Name System (DNS) unicast or on a combination of DNS and anycast for assignment of the most nearby server to the clients [116].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [116] [116] M. Wichtlhuber, R. Reinecke, and D. Hausheer, 'An SDN-based CDN/ISP collaboration architecture for managing high-volume flows,' IEEE Transactions on Network and Service Management , vol. 12, no. 1, pp. 48-60, 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § TABLE III: SOME OF THE COMMONLY USED IMAGE AND VIDEO QA MODELS. · p. 6

    The main challenges with regards to QoE optimization and control may be summarized in the answers to four questions: what key quality parameters to optimize and control; where to control; when to perform QoE optimization and control; and how often to control and optimize QoE.

    “As stated in [8], the main challenges that arise with regards to QoE optimization and control may be summarized in the answers to the following four questions: (1) What key quality parameters to optimize and control? (2) Where to control (e.g., at the client, server and the network side)? (3) When to perform QoE optimization and control (e.g., during the service, that is, on-line control or in an”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [8] [8] S. Barakovi´ c and L. Skorin-Kapov, 'Survey and Challenges of QoE Management Issues in Wireless Networks,' Journal of Computer Networks and Communications , vol. 2013, pp. 1-28, Dec 2013. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [19] [19] Y. Wang, P. Li, L. Jiao, Z. Su, N. Cheng, X. S. Shen, and P. Zhang, 'A Data-Driven Architecture for Personalized QoE Management in 5G Wireless Networks,' IEEE Wireless Communications Magazine , vol. 24, pp. 102-110, Nov 2016. - source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    DNS based request redirection relies only on link layer information for CDN/SS assignment to clients, which does not allow it to react to congestion in ISP's network.

    “However, the DNS based request redirection relies only on the link layer-information for CDN/SS assignment to the clients, which does not allow it to react to the congestion in the ISP's network.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § D. QoE Optimization and Control · p. 5

    QoE management of multimedia services involves continuous optimization and dynamic control of relevant mechanisms from content generation to content consumption along the service delivery chain.

    “The QoE management of multimedia services, as shown in Fig. 4, involves continuous optimization and dynamic control of relevant mechanisms, from content generation to content consumption, along the service delivery chain.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: QoS metrics are not explicitly and directly linked with a customer's satisfaction of a service.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Google is providing peering connections for ISPs through IXPs, and Surrogate Servers are being provided under the Google Global Cache program.

    “For example, Google is providing peering connections for ISPs through IXPs, and also Surrogate Servers (SSs) are being provided under the Google Global Cache (GCC) program 2 .”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § A. Related Work and Motivation · p. 3

    Recent efforts exploring QoE management using SDN and/or NFV are limited by a lack of comprehensive descriptions of ongoing research projects, state-of-the-art efforts, challenges and concrete research directions in SDN and/or NFV and emerging multimedia services and applications in future networks.

    “2) lack of comprehensive descriptions of ongoing research projects, state-of-the-art efforts, challenges as well as concrete research directions in SDN and/or NFV, and emerging multimedia services and applications in future networks;”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § B. Server And Network assisted DASH (SAND) · p. 9

    MPEG-SAND messages are delivered over HTTP using XML format and follow a specific syntax as defined by the standard.

    “It is important to note that the MPEG-SAND messages are delivered over HTTP using the XML format and follow a specific syntax as defined by the standard in [109].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [109] [109] 'ISO/IEC 23009-5: Information Technology -Dynamic Adaptive Streaming over HTTP (DASH) - Part 5: Server and Network Assisted DASH (SAND). Standard,' Feb 2017. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation
    § I. INTRODUCTION · p. 2

    SDN and NFV may enable network management to be automated and ensure that end users' QoS/QoE requirements and Experience Level Agreement (ELA) are fulfilled in heterogeneous environments.

    “Indeed, SDN and NFV may enable network management to be automated and ensure that the end users' QoS/QoE requirements as well as Experience Level Agreement (ELA) 1 are fulfilled in the heterogeneous environments [23].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] [23] F. Z. Yousaf, M. Bredel, S. Schaller, and F. Schneider, 'NFV and SDNKey Technology Enablers for 5G Networks,' IEEE Journal on Selected Areas in Communications , vol. 35, pp. 2468 -2478, Nov 2017. - source

      Not checked in the free run.

    • Rests on an assumption: Future networks are shifting towards the cloudification of network resources via Software Defined Networks (SDN) and Network Function Virtualization (NFV).
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § I. INTRODUCTION · p. 1

    QoE management remains a challenging task due to many issues, which can be categorized into four aspects.

    “Despite these efforts, QoE management remains a challenging task due to many issues [8], [10] which can be categorized into four different aspects, as illustrated in Fig. 1.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [8] [8] S. Barakovi´ c and L. Skorin-Kapov, 'Survey and Challenges of QoE Management Issues in Wireless Networks,' Journal of Computer Networks and Communications , vol. 2013, pp. 1-28, Dec 2013. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [10] [10] J. Liu, S. Zhang, N. Kato, H. Ujikawa, and K. Suzuki, 'Device-todevice communications for enhancing quality of experience in software defined multi-tier LTE-A networks,' IEEE Network , vol. 29, no. 4, pp. 46-52, 2015. - source

      Not checked in the free run.

    • Rests on an assumption: Highly demanding Over-The-Top (OTT) multimedia applications pose increased challenges to Internet Service Providers (ISPs) for assuring a reasonable Quality of Experience (QoE) to their customers due to lack of flexibility, agility and scalability in traditional networks.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Netflix is providing private peering connections and SSs to collaborating ISPs under the Netflix Open Connect program.

    “Similarly, Netflix is providing private peering connections and SSs to the collaborating ISPs under the Netflix Open Connect program 3 .”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [3] [3] D. Rivera, N. Kushik, C. Fuenzalida, A. Cavalli, and N. Yevtushenko, 'QoE Evaluation based on QoS and QoBiz Parameters applied to an OTT service,' in IEEE International Conference on Web Services , (New York, NY, USA), pp. 57-64, 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    The multimedia service delivery chain involves OTTP, ISPs, CDNs, transit providers and IXPs, where each entity has a different role depending on mutual agreements.

    “The multimedia service delivery chain involves several entities which include OTTP, ISPs, CDNs, transit providers and IXPs, where each entity has a different role depending on their mutual agreements [111].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [111] [111] C.-L. Yeh, 'Conceptualized framework for regulation of OTT video services: A new battlefield of interconnection and peering,' 20th ITS Biennial Conference, Rio de Janeiro 2014: The Net and the Internet Emerging Markets and Policies 106896, International Telecommunications Society (ITS), 2014. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    If content is not available in last mile SS, client is served by CDN/SS located far from client's location, leading to cache misses and higher end-to-end delay which can decrease delivered quality.

    “However, if the content is not available in the last mile SS, the client is served by the CDN/SS located far from the client's location. This can lead to cache misses and higher end-to-end delay which can decrease the delivered quality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given
    § C. Summary · p. 13

    Both SDN and NFV seek to create a future software-based networking solution that offers flexible and automated network connectivity and QoE provisioning to end-users.

    “It is worth noting that both SDN and NFV seek to create a future software-based networking solution that offers flexible and automated network connectivity and QoE provisioning to the end-users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § V. QOE MANAGEMENT USING SDN AND NFV · p. 13

    Recent attention has been towards developing approaches that fully optimize video quality and maximize QoE while ensuring fairness among users.

    “In recent years, the attention has been towards developing approaches that fully optimize the video quality [192], [107] and maximize the QoE while ensuring fairness among users [193]-[195].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [192] [192] M. Xiao, V. Swaminathan, S. Wei, and S. Chen, 'DASH2M: Exploring HTTP/2 for Internet Streaming to Mobile Devices,' in Proceedings of the 24th ACM International Conference on Multimedia , (Amsterdam, The Netherlands), pp. 22-31, Oct 2016. - source

      Not checked in the free run.

    • cites [107] [107] G. Cofano, L. D. Cicco, T. Zinner, A. Nguyen-Ngoc, P. Tran-Gia, and S. Mascolo., 'Design and Experimental Evaluation of Networkassisted Strategies for HTTP Adaptive Streaming,' ACM Transactions on Multimedia Computing, Communications, and Applications , vol. 35, pp. 1-24, Nov 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [193]-[195]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § A. Server and Network-assisted Optimization Approaches using SDN · p. 13

    SDN can be used to provide a centralized control element for practical and scalable implementation of network-assisted QoE optimization.

    “For the practical and scalable implementation of this approach, SDN can be used to provide a centralized control element.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    These paths can be expressed by the segment routing strategy into SR paths, using the segment label list.

    “These paths can be expressed by the segment routing strategy into SR paths, using the segment label list as shown in [157], [232].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [157] [157] A. A. Barakabitze, I. Mkwawa, L. Sun, and E. Ifeachor, 'QualitySDN: Improving Video Quality using MPTCP and Segment Routing in SDN/NFV,' in 2018 4th IEEE Conference on Network Softwarization and Workshops (NetSoft) , pp. 182-186, June 2018. - source

      Not checked in the free run.

    • cites [232] [232] A. A. Barakabitze, L. Sun, I.-H. Mkwawa, and E. Ifeachor, 'A Novel QoE-Centric SDN-based Multipath Routing Approach of Mutimedia Services over 5G Networks,' in IEEE International Conference on Communications, , (Kansas City, MO, USA), May 2018. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    Global SIDs are recognized by all network nodes, while local SIDs are only known to the node associated with the SID.

    “Global SIDs are recognized by all network nodes, while local SIDs are only known to the node associated with the SID as demonstrated in [230], [231].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [230] [230] D. Luca, V. Luca, V. Pier Luigi, S. Giuseppe, and S. Stefano, 'Traffic Engineering with Segment Routing: SDN-based Architectural Design and Open Source Implementation,' Fourth European Workshop on Software Defined Networks (EWSDN), , Sept 2015. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [231] [231] C. Filsfils, N. K. Nainar, C. Pignataro, J. C. Cardona, and P. Francois, 'The Segment Routing Architecture,' in IEEE Global Communications Conference (GLOBECOM) , (San Diego, CA, USA), Feb 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    The IETF proposed the Segment Routing (SR) paradigm to provide TE solutions by simplifying the control plane where SDN/NFV switches no longer need to maintain routing information.

    “To overcome these limitations, the IETF proposed the Segment Routing (SR) paradigm to provide TE solutions by simplifying the control plane where SDN/NFV switches no longer need to maintain routing information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    TCAM extensively consumes power and is usually considered as an expensive resource to be developed.

    “TCAM extensively consumes power and is usually considered as an expensive resource to be developed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    With SR, a host or an edge router can steer a packet through the network using an ordered list of processing/forwarding functions called segments.

    “With SR, a host or an edge router can steer a packet through the network using an ordered list of processing/forwarding functions called segments.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. QoE-Fairness and Personalized QoE-centric Control in SDN · p. 15

    Some approaches discussed in V-A, such as [107], address QoE-fairness based on the SAND architecture.

    “Note that, some of the approaches discussed in the previous section V-A, such as [107], address QoE-fairness based on the SAND architecture.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [107] [107] G. Cofano, L. D. Cicco, T. Zinner, A. Nguyen-Ngoc, P. Tran-Gia, and S. Mascolo., 'Design and Experimental Evaluation of Networkassisted Strategies for HTTP Adaptive Streaming,' ACM Transactions on Multimedia Computing, Communications, and Applications , vol. 35, pp. 1-24, Nov 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    OTTP services utilizing Akamai CDNs deliver content based on flat organization where cache misses is avoided by fetching content directly from original server.

    “On the other hand, the OTTP services utilizing Akamai CDNs deliver the content based on the flat organization where cache misses is avoided by fetching the content directly from the original server [119].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [119] [119] E. Nygren, R. K. Sitaraman, and J. Sun, 'The Akamai Network: a Platform for High-Performance Internet Applications,' ACM SIGOPS Operating Systems Review , vol. 44, no. 3, pp. 2-19, 2010. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. Network Function Virtualization (NFV) · p. 13

    Most NFV use cases are based on those defined by ETSI.

    “Most of these use cases are based on those defined by the ETSI [156].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [156] [156] 'ETSI GS NFV 001 V1.1.1: Network function virtualization. Use cases, ETSI Ind. Spec. Group (ISG) Netw. Functions Virtualisation (NFV).' http://www.etsi.org/deliver/etsi\_gs/nfv/001\_099/001/01. 01.01\_60/gs\_nfv001v010101p.pdf, Oct 2013. [Online: Accessed 06September-2019]. -

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § C. Summary · p. 13

    SDN requires a new network platform where the control and data forwarding planes are decoupled.

    “SDN requires a new network platform where the control and data forwarding planes are decoupled.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning
    § B. QoE-Fairness and Personalized QoE-centric Control in SDN · p. 15

    The SDN controller can easily detect player-specific events, such as players joining/leaving the network and starting/stopping the playback.

    “In this way, the controller can easily detect playerspecific events, such as players joining/leaving the network and starting/stopping the playback.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § C. QoE-Centric Routing Mechanisms using SDN/NFV · p. 16

    The clients and content server report the QoE values to the SDN applications, which in turn use the reported QoE values and IFs to prepare the needed input for the SDN controller.

    “The clients and content server report the QoE values to the SDN applications, which in turn use the reported QoE values and IFs to prepare the needed input for the SDN controller.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    SDN-based MPTCP implementations can improve network throughput and meet the end-users' QoE.

    “SDN-based MPTCP implementations can improve network throughput and meet the end-users' QoE.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § C. Summary · p. 13

    NFV decouples NFs from dedicated hardware devices.

    “while SDN decouples the control plane from the data/packet forwarding plane, the NFV decouples NFs from dedicated hardware devices.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning
    § A. Server and Network-assisted Optimization Approaches using SDN · p. 13

    SAND enables service providers and operators to improve network bandwidth utilization and enhance end-users' video streaming experience.

    “It also enables service providers and operators to improve network bandwidth utilization and enhance the end-users' video streaming experience.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § C. Summary · p. 13

    NFV can run on legacy networks since NFs can reside on commodity servers.

    “This is not the case with NFV which can run on legacy networks since NFs can reside on commodity servers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § V. QOE MANAGEMENT USING SDN AND NFV · p. 13

    Many studies have focused on enhancing QoE by optimizing video quality adaptation algorithms on the client and/or server-side.

    “Many studies have been focusing on enhancing the QoE by optimizing the video quality adaptation algorithms on the client and/or the server-side [6], [191].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [6] [6] M. Seufert, S. Egger, M. Slanina, T. Zinner, T. Hoßfeld, and P. TranGia, 'A Survey on Quality of Experience of HTTP Adaptive Streaming,' IEEE Communications Surveys & Tutorials , vol. 17, pp. 469-492, First quarter 2015. - source

      Not checked in the free run.

    • cites [191] [191] Y. Sani, A. Mauthe, and C. Edwards, 'Adaptive Bitrate Selection: A Survey,' IEEE Communication Surveys & Tutorials , vol. 19, pp. 29853014, July 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    One solution to reduce cost could be the common usage of MPTCP and SR.

    “Therefore, one solution to reduce the cost could be the common usage of MPTCP and SR.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    Service providers have adopted SDN/NFV to implement traffic engineering to improve network efficiency, application performance, and end-user QoE.

    “As multimedia services/applications continue to grow, SPs have adopted SDN/NFV to implement TE to improve the network efficiency, application performance, and the end-user QoE.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    The list of Segment IDentifiers (SIDs) forms a chain of elements where packets are routed within an SDN/NFV system.

    “The list of Segment IDentifiers (SIDs) forms a chain of these elements where packets are routed within an SDN/NFV system.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    MPTCP has emerged as the transport protocol capable of creating multiple subflows and distributing them over multiple disjoint paths in the network such that all the links are optimally loaded.

    “MPTCP has emerged as the transport protocol capable of creating multiple subflows and distributing them over multiple disjoint paths in the network such that all the links are optimally loaded.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    Google has implemented a hierarchical distribution of content for YouTube and other Google services.

    “For example, Google has implemented a hierarchical distribution of content for YouTube and other Google services [117], [118].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [117] [117] Google, 'Google Edge Network.' https://peering.google.com/. (Online: Accessed 06-September-2019). -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [118] [118] V. K. Adhikari, S. Jain, Y. Chen, and Z. Zhang, 'Vivisecting YouTube: An active measurement study,' in 2012 Proceedings IEEE INFOCOM , pp. 2521-2525, March 2012. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § B. QoE-Fairness and Personalized QoE-centric Control in SDN · p. 15

    Approaches discussed in subsection V-B are only based on the SDN controller to control and manage QoE requirements of competing clients.

    “This is different from the approaches discussed in this subsection that are only based on the SDN controller to control and manage QoE requirements of the competing clients.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    Storing a large number of rules is the main limitation of SDN/NFV switches which can be alleviated by using SR where a logical path of MPTCP subflows can be expressed as a sequence of segments between the ingress and egress network nodes.

    “Storing a large number of rules is the main limitation of SDN/NFV switches which can be alleviated by using SR where a logical path of MPTCP subflows can be expressed as a sequence of segments between the ingress and egress network nodes (e.g., a switch/router/link).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    Studies in [240]-[243] propose that QoE monitoring should be performed by the OTTP because they have their applications installed in the user terminal.

    “The studies conducted in [240]-[243] propose that the QoE monitoring should be performed by the OTTP because they have their applications installed in the user terminal.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [240]-[243]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § B. Network Function Virtualization (NFV) · p. 13

    All existing NFV implementations and platforms focus on open source and orchestration of an operator's end-to-end service over NFVI supported by SDN and cloud technologies.

    “It is worth noting that all of the existing NFV implementations and platforms are focusing on open source and orchestration of operator's end-to-end service over NFVI supported by SDN and cloud technologies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § IV. NETWORK SOFTWARIZATION AND VIRTUALIZATION: THE PROMISE OF SDN AND NFV IN FUTURE NETWORKS · p. 11

    Network softwarization and virtualization using SDN and NFV is expected to impact several aspects in development and deployment of network services, such as CDN and video accelerators.

    “Network softwarization [122] and virtualization using SDN and NFV is expected to impact several aspects in the development and deployment of network services, such as CDN and video accelerators [123], [124].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [122] [122] I. Afolabi, T. Taleb, K. Samdanis, A. Ksentini, and H. Flinck, 'Network slicing & softwarization: A survey on principles, enabling technologies & solutions,' IEEE Surveys and Tutorials , vol. 20, pp. 2429-2453, March 2018. - source

      Not checked in the free run.

    • cites [123] [123] P. A. Frangoudis, L. Yala, A. Ksentini, and T. Taleb, 'An architecture for on-demand service deployment over a Telco CDN,' in 2016 IEEE International Conference on Communications (ICC) , pp. 1-6, May 2016. - source

      Not checked in the free run.

    • cites [124] [124] S. Retal, M. Bagaa, T. Taleb, and H. Flinck, 'Content delivery network slicing: QoE and cost awareness,' in 2017 IEEE International Conference on Communications (ICC) , (Paris), pp. 1-6, May 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    Common usage of MPTCP and SR would offer flexibility, reliability, scalability and improve the end-user QoE in SDN/NFV networks.

    “Such a solution would also offer flexibility, reliability, scalability and improve the end-user QoE in SDN/NFV networks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    To guarantee end-users' QoE-fairness level and performance requirements of SDN/NFV-based networks, the controller checks the available capacity of all connected paths and selects the shortest paths to transmit the subflows of the same MPTCP connection.

    “To guarantee the end-users' QoE-fairness level and performance requirements of SDN/NFV-based networks, the controller checks the available capacity of all connected paths and selects the shortest paths to transmit the subflows of the same MPTCP connection.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § A. Server and Network-assisted Optimization Approaches using SDN · p. 13

    Most research works following the SAND approach share a similar architecture.

    “Most research works following this approach share a similar architecture, as shown in Fig 13.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    MPTCP-based SDN/NFV implementations enable load balancing, reliable communications, and better network resources utilization that lead to higher system throughput and end-users' QoE.

    “MPTCP-based SDN/NFV implementations enable load balancing, reliable communications, and better network resources utilization that lead to higher system throughput and end-users' QoE [226].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [226] [226] J. Wu, C. Yuen, B. Cheng, M. Wang, and J. Chen, 'Streaming High-Quality Mobile Video with Multipath TCP in Heterogeneous Wireless Networks,' IEEE Transactions on Mobile Computing , vol. 15, pp. 2345-2361, Sep. 2016. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § C. Multimedia Delivery Chain and Service Management Issues · p. 10

    In worst case, client assigned to CDN outside ISP's network decreases quality and results in high cost for ISP and increased network load in ISP's core network.

    “In the worst case, the client is assigned to a CDN outside the ISPs network which will not only decrease the quality but also results in a high cost for the ISP and an increased network load in the ISP's core network.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § A. Server and Network-assisted Optimization Approaches using SDN · p. 13

    SAND enables HAS based streaming solutions to provide a fair distribution of bandwidth among users.

    “SAND enables HAS based streaming solutions to provide a fair distribution of bandwidth among users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § C. Summary · p. 13

    SDN decouples the control plane from the data/packet forwarding plane.

    “while SDN decouples the control plane from the data/packet forwarding plane, the NFV decouples NFs from dedicated hardware devices.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § V. QOE MANAGEMENT USING SDN AND NFV · p. 13

    Many SDN/NFV based solutions have been proposed, implemented and tested to see the value and benefits offered by these technologies.

    “As of today, many SDN/NFV based solutions have been proposed, implemented and tested to see the value and benefits offered by these technologies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § C. QoE-Centric Routing Mechanisms using SDN/NFV · p. 16

    The QoE measurement and collection of QoE IFs values in an SDN network is achieved through cooperation among clients, media content servers and SDN controllers.

    “The QoE measurement and collection of QoE IFs values in an SDN network is achieved through the cooperation among various components including clients, media content servers and SDN controllers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § D. QoE-Aware SDN/NFV-based Mechanisms using MPTCP and Segment Routing · p. 17

    The scope of SIDs can be either global or local.

    “The scope of these SIDs can be either global or local.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § B. QoE-Fairness and Personalized QoE-centric Control in SDN · p. 15

    Most works presented in subsection V-B utilize the SDN controller to manage and monitor all HAS players, their statuses, device capabilities, requested content, subscription plan types, QoE and buffer levels.

    “Most of the works presented in this subsection utilize the SDN controller to manage and monitor all HAS players, their statuses, device capabilities, requested content, subscription plan types, QoE and buffer levels.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    SDN and NFV may provide an opportunity to ISP and OTTP for collaborative service management.

    “SDN and NFV may provide an opportunity to ISP and OTTP for collaborative service management.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    The global market of 360 cameras is expected to grow at an annual rate of 35% between 2016 and 2020.

    “For example, the global market of 360 cameras is expected to grow at an annual rate of 35% between 2016 and 2020 10”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [10] [10] J. Liu, S. Zhang, N. Kato, H. Ujikawa, and K. Suzuki, 'Device-todevice communications for enhancing quality of experience in software defined multi-tier LTE-A networks,' IEEE Network , vol. 29, no. 4, pp. 46-52, 2015. -

      Not checked in the free run.

  • May combine two claims.

    Premisereasoning
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    In viewpoint-dependent streaming, the portion outside the viewpoint is streamed at an average or lower quality while the part of the video watched by the user is streamed at the highest possible quality.

    “In viewpoint-dependent streaming, the portion outside the viewpoint is streamed at an average or lower quality while the part of the video watched by the user is streamed at the highest possible quality.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    In the case of a flash crowd appearance, VNF with VSS can be utilized to decrease the network load and end-to-end delay for content retrieval.

    “For example, in the case of a flash crowd appearance, VNF with VSS can be utilized to decrease the network load and end-to-end delay for content retrieval.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning
    § VI. QOE- MANAGEMENT APPROACHES USING EMERGING ARCHITECTURES · p. 20

    SDN and NFV have proved to be the appealing technologies for QoE management and control in future networks.

    “SDN and NFV have proved to be the appealing technologies for QoE management and control in future networks, as discussed previously in Section V.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    The user in VR is immersed in a virtual environment and can dynamically and freely decide the preferred viewpoint.

    “The user in VR is immersed in a virtual environment and can dynamically and freely decide the preferred viewpoint [31].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [31] [31] S. Petrangeli, J. V. D. Hooft, T. Wauters, and F. D. Turck, 'Quality of Experience-Centric Management of Adaptive Video Streaming Services: Status and Challenges,' ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) , vol. 14, pp. 2 -28, May 2018. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § F. QoE-aware/driven Approaches using Full Adoption of SDN and NFV · p. 19

    The use of SDN and NFV provides a higher degree of freedom regarding the placement of QoE measurement points and flexible control of multimedia traffic flows compared to approaches implemented using SDN or NFV only.

    “The use of SDN and NFV provides a higher degree of freedom regarding the placement of QoE measurement points and flexible control of multimedia traffic flows compared to approaches implemented using SDN or NFV only.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    DASCache enables fast video streaming with high QoE over ICNs by minimizing the average access time per bit of video contents requested by the enduser.

    “DASCache enables fast video streaming with high QoE over ICNs by minimizing the average access time per bit of video contents requested by the enduser.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [279] [279] W. Li, S. M. A. Oteafy, and H. S. Hassanein, 'Dynamic adaptive streaming over popularity-driven caching in information-centric networks,' in 2015 IEEE International Conference on Communications (ICC) , pp. 5747-5752, June 2015. - source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation
    § F. QoE-aware/driven Approaches using Full Adoption of SDN and NFV · p. 19

    As the adoption of SDN and NFV matures towards future 5G networks, the software-defined NFV architecture can offer an active traffic steering and joint optimization of network functions that further turns into QoE-management offerings.

    “As the adoption of SDN and NFV matures towards future 5G networks, the software-defined NFV architecture [256] can offer an active traffic steering and joint optimization of network functions that further turns into QoE-management offerings [257].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [256] [256] Y. Li and M. Chen, 'Software-Defined Network Function Virtualization: A Survey,' IEEE Access , vol. 3, pp. 2542-2553, 2015. - source

      Not checked in the free run.

    • cites [257] [257] A. Martin, J. Egaña, J. Flórez, J. Montalbán, I. G. Olaizola, M. Quartulli, R. Viola, and M. Zorrilla, 'Network Resource Allocation System for QoE-Aware Delivery of Media Services in 5G Networks,' IEEE Transactions on Broadcasting , vol. 64, pp. 561-574, June 2018. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    With the increasing acceptance and demand of 360 immersive videos which are of much higher size than traditional 2D videos, Internet traffic is expected to further grow in the next few years.

    “With the increasing acceptance and demand of 360 immersive videos which are of much higher size than traditional 2D videos, Internet traffic is expected to further grow in the next few years.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [10] [10] J. Liu, S. Zhang, N. Kato, H. Ujikawa, and K. Suzuki, 'Device-todevice communications for enhancing quality of experience in software defined multi-tier LTE-A networks,' IEEE Network , vol. 29, no. 4, pp. 46-52, 2015. -

      Not checked in the free run.

    • cites [11] [11] B. Alcardo Alex and X. Tan, 'Performance Analysis of PAPR Reduction Using DFT-Spreading OFDMA Technique,' International Journal of Innovative Research in Computer and Communication Engineering , vol. 3, pp. 1401-1409, March 2015. -

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § D. Summary · p. 23

    ICN approaches may also combine the benefits of pervasive fine-grained caching platforms and multi-path transmissions similar to MPTCP, an advantage that entails higher throughput compared to standard TCP/IP.

    “It is worth noting that ICN approaches may also combine the benefits of pervasive fine-grained caching platforms and multi-path transmissions similar to MPTCP, an advantage that entails higher throughput compared to standard TCP/IP.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    DASCache can also enable users to switch to videos with better resolution.

    “DASCache can also enable users to switch to videos with better resolution.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [279] [279] W. Li, S. M. A. Oteafy, and H. S. Hassanein, 'Dynamic adaptive streaming over popularity-driven caching in information-centric networks,' in 2015 IEEE International Conference on Communications (ICC) , pp. 5747-5752, June 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 19

    Server and network-based optimization maximizes end users' QoE through best path calculations for each service flow, optimal bitrates computation for clients to obtain QoE-fairness, and optimizing QoE by assigning different priority to a video stream depending on requested quality.

    “Maximizes the end users' QoE through the best path calculations for each service flow, optimal bitrates computation for the clients so as to obtain QoE-fairness in the delivered video, Optimizing the QoE by assigning a different priority to a video stream depending on the requested quality”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § D. Summary · p. 23

    ICN can improve the end users' QoE through edge cache prefetching mechanisms that consider network monitoring for populating a cache as per the requirements/needs ahead of the client requests.

    “ICN can improve the end users' QoE through edge cache prefetching mechanisms that consider network monitoring for populating a cache as per the requirements/needs ahead of the client requests.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    As new use cases for AR and VR are introduced in the market, service providers will need to address bandwidth limitations, reduce end-to-end network latency, and improve the overall QoS/QoE for the streaming media services.

    “As new use cases for AR and VR are introduced in the market, service providers will need to address bandwidth limitations, reduce end-to-end network latency, and improve the overall QoS/QoE for the streaming media services.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § VI. QOE- MANAGEMENT APPROACHES USING EMERGING ARCHITECTURES · p. 20

    The introduction of emerging architectures such as MEC, fog/cloud computing and ICN can greatly benefit from SDN and NFV to provide interactive and immersive video services to consumers.

    “However, the introduction of emerging architectures such as MEC [14], fog/cloud computing [300], [301] and ICN can greatly benefit from SDN and NFV to provide interactive and immersive video services to consumers.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [14] [14] T. X. Tran, A. Hajisami, P. Pandey, and D. Pompili, 'Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges,' IEEE Communications Magazine, , vol. 55, pp. 54-61, April 2017. - source

      Not checked in the free run.

    • cites [300] [300] S. Yi, Z. Hao, Z. Qin, and Q. Li, 'Fog Computing: Platform and Applications,' in 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb) , pp. 73-78, Nov 2015. - source

      Not checked in the free run.

    • cites [301] [301] Y. Liu, J. E. Fieldsend, and G. Min, 'A framework of fog computing: Architecture, challenges, and optimization,' IEEE Access , vol. 5, pp. 25445-25454, Oct 2017. - source

      Not checked in the free run.

    • Rests on an assumption: MEC offers an environment characterized by high bandwidth and low latency for applications and content providers.
    • Rests on an assumption: Both Fog computing and MEC support virtualization functions.
    • Rests on an assumption: Cloud computing provides ubiquitous on-demand access to a shared pool of configurable computing resources with minimum management effort.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 19

    QoE-fairness and personalized QoE-centric control efficiently allocates network resources to ensure maximum users' QoE fairness is achieved.

    “Efficient network resources allocation to ensure that the maximum users' QoE fairness is achieved.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    The ISP may utilize the SDN and NFV paradigm for network management operations to drive collaborative QoE management using QoE related information provided by the OTTP.

    “The ISP may utilize the SDN and NFV paradigm for the network management operations to drive collaborative QoE management using QoE related information provided by the OTTP.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 21

    Fog/cloud computing promises a distributed computing paradigm that extends the services provided by the cloud to the edge of the network.

    “Fog/cloud computing [300], [301] promises a distributed computing paradigm that extends the services provided by the cloud to the edge of the network.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [300] [300] S. Yi, Z. Hao, Z. Qin, and Q. Li, 'Fog Computing: Platform and Applications,' in 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb) , pp. 73-78, Nov 2015. - source

      Not checked in the free run.

    • cites [301] [301] Y. Liu, J. E. Fieldsend, and G. Min, 'A framework of fog computing: Architecture, challenges, and optimization,' IEEE Access , vol. 5, pp. 25445-25454, Oct 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    ISPs may perform network-wide QoS monitoring and network policy implementation utilizing the SDN controller.

    “ISPs may perform network-wide QoS monitoring and network policy implementation utilizing the SDN controller.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § F. QoE-aware/driven Approaches using Full Adoption of SDN and NFV · p. 19

    The corrective and preventive actions to avoid existing or potential network problems that negatively affect the endusers' QoE can be performed by SDN/NFV sensors/actuators that monitor the network.

    “As envisaged by the SELFNET project, the corrective and preventive actions to avoid existing or potential network problems that negatively affect the endusers' QoE can be performed by SDN/NFV sensors/actuators that monitor the network.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites SELFNET project

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    Viewpointdependent streaming can be obtained using online transcoding operations, such as using foveate-based encoding, or by spatially tiling the video.

    “It is worth mentioning that viewpointdependent streaming can be obtained using online transcoding operations, such as using foveate-based encoding [287], or by spatially tiling the video [288].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [287] [287] J. Ryoo, K. Yun, D. Samaras, S. R. Das, and G. Zelinsky, 'Design and evaluation of a foveated video streaming service for commodity client devices,' in In Proceedings of the 7th International Conference on Multimedia Systems (MMSys'16) , (Klagenfurt, Austria), pp. 1-6, May 2016. - source

      Not checked in the free run.

    • cites [288] [288] F. Qian, L. Ji, B. Han, and V. Gopalakrishnan, 'Optimizing 360 video delivery over cellular networks,' in In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (ATC'16) , (New York, NY), pp. 1-6, May 2016. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § D. Summary · p. 23

    Multi-access edge decrease the content delivery latency and improve the utilization of the network resources.

    “Multi-access edge decrease the content delivery latency and improve the utilization of the network resources.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: MEC offers an environment characterized by high bandwidth and low latency for applications and content providers.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 21

    Fog computing represents the overall architecture of distributing resources across the networks and cannot operate in a standalone mode as it is tightly linked to the existence of a cloud.

    “However, unlike cloudlet [308] and MEC, fog computing represents the overall architecture of distributing resources across the networks and cannot operate in a standalone mode as it is tightly linked to the existence of a cloud.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [308] [308] M. Satyanarayanan, P. Bahl, R. Caceres, and N. Davies, 'The Case for VM-Based Cloudlets in Mobile Computing,' IEEE Pervasive Computing , vol. 8, no. 4, pp. 14-23, 2009. -

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given
    § G. Summary · p. 19

    The inclusion of SDN and/or NFV and their significant support in future networks such as 5G is an emerging area of active research which still has a vast scope for future research.

    “The inclusion of SDN and/or NFV and their significant support in future networks such as 5G is an emerging area of active research which still has a vast scope for future research.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 19

    The basic idea of QoE-fairness and personalized QoE-centric control is to avoid quality instability, unfair bandwidth sharing and network resource underutilization among DASH competing clients sharing the same bottleneck network link.

    “The basic idea is to avoid quality instability, unfair bandwidth sharing and network resource underuti- lization among DASH competing clients sharing the same bottleneck network link.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    The clients have full control over the streaming session and also the possibility to adapt the multimedia stream to its context (e.g. device capabilities, network conditions).

    “The clients have full control over the streaming session and also the possibility to adapt the multimedia stream to its context (e.g. device capabilities, network conditions) [313].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [313] [313] M. F. Majeed, S. H. Ahmed, S. Muhammad, H. Song, and D. B.Rawat, 'Multimedia streaming in information-centric networking: A survey and future perspectives,' Computer Networks , vol. 125, pp. 103-121, Oct 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § F. QoE-aware/driven Approaches using Full Adoption of SDN and NFV · p. 19

    The integration of SDN and NFV provides means for implementing advanced network QoE monitoring and management solutions.

    “The integration of SDN and NFV provides means for implementing advanced network QoE monitoring and management solutions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    QoE measurements has also been addressed in the context of AR systems because of their applications in various fields such as emergency response training and medical surgery.

    “QoE measurements has also been addressed in the context of AR systems [289], [290] because of their applications in various fields such as emergency response training and medical surgery.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [289] [289] J. Puig, A. Perkis, F. Lindseth, and T. Ebrahimi, 'Towards an efficient methodology for evaluation of quality of experience in augmented reality,' in 2012 Fourth International Workshop on Quality of Multimedia Experience , pp. 188-193, July 2012. - source

      Not checked in the free run.

    • cites [290] [290] M. Pallot, R. Eynard, B. Poussard, O. Christmann, and S. Richir, 'Augmented sport: Exploring collective user experience,' in In Proceedings of the Virtual Reality International Conference (VRIC'13) , (Laval, France), pp. 1-10, 2013. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    In ICN, contents are decoupled from the location at the network level such that when a client requests a specific content, it is identified by a Uniform Resource Identifier (URI) using a routable name scheme.

    “In ICN, contents are decoupled from the location at the network level such that when a client requests a specific content, it is identified by a Uniform Resource Identifier (URI) using a routable name scheme, for example, /example.com/video/ICNVideo.mp4.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    ICN is a disruptive network architecture that proposes to shift from the traditional host-centric approach model to a content-centric model by directly naming and operating on information objects.

    “ICN [310], [311] is a disruptive network architecture that proposes to shift from the traditional host-centric approach model to a content-centric model by directly naming and operating on information objects [312].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [310] [310] A. A. Barakabitze and T. Xiaoheng, 'Caching and Data Routing In Information Centric Networking (ICN): The Future Internet Perspective,' International Journal of Advanced Research in Computer Science and Software Engineering , vol. 4, pp. 26-36, Jan 2014. - source

      Not checked in the free run.

    • cites [311] [311] B. Ahlgren, C. Dannewitz, C. Imbrenda, D. Kutscher, and B. Ohlman, 'A survey of information-centric networking,' IEEE Communications Magazine, , vol. 50, no. 7, pp. 26-36, 2012. - source

      Not checked in the free run.

    • cites [312] [312] A. A. Barakabitze, T. Xiaoheng, and G. Tan, 'A Survey on Naming, Name Resolution and Data Routing in Information Centric Networking (ICN),' Int. J. Adv. Res. Comput. Commun. Eng , vol. 3, no. 10, pp. 8322-8330, 2014. - source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 19

    Server and network-based optimization strategies include bandwidth reservation, bitrate guidance, video stream prioritization, CDN orchestration and caching optimization, and server-assisted delivery.

    “Server and Network-Based Optimization | Bandwidth reservation [107], [196], [200] or bitrate guidance [7], [197], [108], [245] video stream prioritization [246], CDN or- chestration and caching optimization [247], server-assisted delivery [110]”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [107] [107] G. Cofano, L. D. Cicco, T. Zinner, A. Nguyen-Ngoc, P. Tran-Gia, and S. Mascolo., 'Design and Experimental Evaluation of Networkassisted Strategies for HTTP Adaptive Streaming,' ACM Transactions on Multimedia Computing, Communications, and Applications , vol. 35, pp. 1-24, Nov 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [196] [196] A. Bentaleb, A. C. Begen, and R. Zimmermann, 'QoE-Aware Bandwidth Broker for HTTP Adaptive Streaming Flows in an SDN-Enabled HFC Network,' IEEE Transactions on Broadcasting , vol. 64, pp. 575589, June 2018. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [200] [200] A. Mansy, M. Fayed, and M. Ammar., 'Network-Layer Fairness for Adaptive Video Streams,' IFIP Networking Conference (IFIP Networking) , pp. 1-9, May 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning
    § G. Summary · p. 19

    The discussion above clearly points toward a shift towards the adoption of SDN and NFV paradigms for QoE management and orchestration of network resources in future networks.

    “The discussion above clearly points toward a shift towards the adoption of SDN and NFV paradigms for QoE management and orchestration of network resources in future networks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § B. QoE-aware Adaptive Streaming over Cloud/Fog Computing · p. 22

    Data-Oriented Network Architecture (DONA), Content-Centric Networking (CCN) or Named Data Networking (NDN) are typical instantiations of the ICN paradigm.

    “Data-Oriented Network Architecture (DONA) [314], Content-Centric Networking (CCN) or Named Data Networking (NDN) [315] are typical instantiations of the ICN paradigm [310].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [314] [314] T. Koponen, M. Chawla, B. Chun, A. Ermolinskiy, K. Kim, S.Shenker, and I. Stoica, 'A data-oriented (and beyond) network architecture,' ACM SIGCOMM Computer Communication Review , vol. 37, pp. 181192, Aug 2007. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [315] [315] L. Zhang, A. Afanasyev, J. Burke, V. Jacobson, kc claffy, P. Crowley, C. Papadopoulos, L. Wang, and B. Zhang, 'Named data networking,' SIGCOMM Comput. Commun. Rev. , vol. 44, pp. 66-73, July 2014. - source

      Not checked in the free run.

    • cites [310] [310] A. A. Barakabitze and T. Xiaoheng, 'Caching and Data Routing In Information Centric Networking (ICN): The Future Internet Perspective,' International Journal of Advanced Research in Computer Science and Software Engineering , vol. 4, pp. 26-36, Jan 2014. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    The global market of VR related devices will reach 30 billion USD by 2020.

    “while the global market of VR related devices will reach 30 billion USD by 2020 11 .”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11] [11] B. Alcardo Alex and X. Tan, 'Performance Analysis of PAPR Reduction Using DFT-Spreading OFDMA Technique,' International Journal of Innovative Research in Computer and Communication Engineering , vol. 3, pp. 1401-1409, March 2015. -

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § G. Summary · p. 19

    The discussion above indicates the significance of these advanced technologies for improving the performance and the delivery of QoE-rich services to the end-users in future communication systems.

    “It also indicates the significance of these advanced technologies for improving the performance and the delivery of QoE-rich services to the end-users in future communication systems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    A study in [244] proposes a 5G network architecture for the network and service management of multimedia services by passive monitoring probe at the user terminal for exchange of information between OTTP and MNO.

    “Similary, the study conducted in [244] proposes 5G network architecture for the network and service management of the multimedia services by passive monitoring probe at the user terminal for exchange of information between OTTP and MNO.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [244] [244] A. Ahmad and L. Atzori, 'MNO-OTT Collaborative Video Streaming in 5G: The Zero-rated QoE Approach for Quality and Resource Management,' IEEE Transactions on Network and Service Management , 2019. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § E. Collaborative Service QoE Management by OTTP and ISP through SDN and NFV · p. 18

    The monitored KQIs of the active session is stored in the database (accessible to the ISP through RESTful API) by the OTTP.

    “The monitored KQIs of the active session is stored in the database (accessible to the ISP through RESTful API) by the OTTP.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 23

    These challenges not only impact the consumers' AR/VR experience today but remain an impediment to the delivery of more immersive experiences in real-time in the future.

    “These challenges not only impact the consumers' AR/VR experience today but remain an impediment to the delivery of more immersive experiences in real-time in the future.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning
    § F. Scalability, Resilience, and Optimization in Future Softwarized Networks · p. 29

    Placement planning of the controller or the VNFs separately could still affect the performance and reliability of the SDN/NFV-based system, which in turn can negatively degrade the end-users' QoE.

    “This is so because placement planning of the controller or the VNFs separately could still affect the performance and reliability of the SDN/NFV-based system, which in turn can negatively degrade the end-users' QoE.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE in Light Field Applications · p. 25

    A metric for quality evaluation of the rendered views that measures the variation of structural similarity on a set of viewpoints extracted from the light field is proposed.

    “A metric for quality evaluation of the rendered views that measures the variation of structural similarity on a set of viewpoints extracted from the light field is proposed [341].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [341] [341] C. Perra, 'Assessing the Quality of Experience in Viewing Rendered Decompressed Light Fields,' Multimedia Tools and Applications , vol. 77, pp. 21771-21790, August 2018. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning
    § H. Summary · p. 30

    There are still significant gaps in some areas of QoE-control and management challenges that need extensive research and investigations.

    “We note that despite the recent efforts towards overcoming QoE-control and management challenges today, and the rapid evolution of SDN and NFV towards future communication systems, there are still significant gaps in some areas that need extensive research and investigations as summarized in Table IX.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    QoE in emerging mulsemedia services, which involve different new media objects than traditional multimedia applications, has recently attracted much attention from the academia and industry.

    “QoE in emerging mulsemedia services, which involve different new media objects than traditional multimedia applications, has recently attracted much attention from the academia and industry [292], [293].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [292] [292] C. Alexandra, Z. Longhao, T. Irina, M. Gabriel-Miro, and G. Gheorghita, 'Is Multimedia Multisensorial? - A Review of Mulsemedia Systems,' ACM Computing Surveys (CSUR) , vol. 51, no. 5, 2018. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [293] [293] Y. Sulema, 'Mulsemedia vs. multimedia: State of the art and future trends,' in 2016 International Conference on Systems, Signals and Image Processing (IWSSIP) , pp. 1-5, May 2016. - source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning
    § C. QoE-oriented Business Models in Future Softwarized Network · p. 27

    SLAs used today are not enough as the means to provide QoE-related contracts between service providers and customers.

    “SLAs used today are not enough as the means to provide QoE-related contracts between service providers and customers.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given
    § D. Intelligent QoE-Based Big Data Strategies in Future Softwarized Networks · p. 28

    The relationship between SDN, NFV, and big data is not yet studied, especially in the perspective of future networks.

    “However, while it will be challenging to meet QoS and QoE requirements and orchestrate VNFs without big data analytics, we note that the relationship between SDN, NFV, and big data is not yet studied, especially in the perspective of future networks.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § B. OTT-ISP Collaborative Service Management in Softwarized Networks · p. 26

    If the passive monitoring probe at the user terminal operates at a higher frequency, the prediction of QoE may be more accurate but will have a negative impact on the user end device regarding utilization of device resources (e.g., CPU, RAM and battery power).

    “The primary reason is that if the passive monitoring probe at the user terminal operates at a higher frequency, the prediction of the QoE may be more accurate [82] but will have a negative impact on the user end device regarding utilization of the device resources (e.g., CPU, RAM and battery power) [240].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [82] [82] E. Liotou, D. Tsolkas, N. Passas, and L. Merakos, 'Quality of experience management in mobile cellular networks: key issues and design challenges,' IEEE Communications Magazine , vol. 53, no. 7, pp. 145153, 2015. - source

      Not checked in the free run.

    • cites [240] [240] A. Ahmad, L. Atzori, and M. G. Martini, 'Qualia: A multilayer solution for QoE passive monitoring at the user terminal,' in 2017 IEEE International Conference on Communications (ICC) , pp. 1-6, May 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § F. Scalability, Resilience, and Optimization in Future Softwarized Networks · p. 29

    Providing a reliable and scalable softwarized network would translate to service provisioning to the end-users with better quality.

    “Providing a reliable and scalable softwarized network would also translate to service provisioning to the end-users with better quality.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    The new 360 mulsemedia services would come at the cost of more bandwidth than the conventional applications and stringent delay requirements.

    “However, the new 360 mulsemedia services would come at the cost of more bandwidth than the conventional applications [298] and stringent delay requirements [299].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [298] [298] T.-M. Liu, C.-C. Ju, Y.-H. Huang, T.-S. Chang, K.-M. Yang, and Y.-T. Lin, 'A 360-degree 4K 2K panoramic video processing Over Smart-phones,' in 2017 IEEE International Conference on Consumer Electronics (ICCE) , pp. 247-249, Jan 2017. - source

      Not checked in the free run.

    • cites [299] [299] X. Corbillon, G. Simon, A. Devlic, and J. Chakareski, 'Viewportadaptive navigable 360-degree video delivery,' in 2017 IEEE International Conference on Communications (ICC) , (Paris, France), pp. 1-7, May 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § C. QoE-oriented Business Models in Future Softwarized Network · p. 27

    Current SLA modeling proposals are mostly confined and focused on QoS technical aspects.

    “Unfortunately, the current SLA modeling proposals are mostly confined and focused on QoS technical aspects.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisereasoning
    § C. QoE-oriented Business Models in Future Softwarized Network · p. 27

    Current SLA modeling proposals do not follow web principles and semantic approach for QoS specification of communication services using QoE parameters.

    “Moreover, they do not follow web principles and semantic approach for QoS specification of communication services using QoE parameters.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § B. QoE in Cloud Gaming Video Streaming Applications · p. 25

    There are several research works regarding objective and subjective quality assessment of gaming video content such as creation of gaming video datasets, evaluation of existing metrics and development of new no-reference metrics and models for gaming content.

    “In addition, there are several research works regarding objective and subjective quality assessment of gaming video content such as creation of gaming video datasets [331], evaluation of existing metrics [332]-[335] and development of new no-reference metrics and models [46], [336], [337] for gaming content.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [331] [331] N. Barman, S. Zadtootaghaj, S. Schmidt, M. G. Martini, and S. Möller, 'GamingVideoSET: A Dataset for Gaming Video Streaming Applications,' in 2018 16th Annual Workshop on Network and Systems Support for Games (NetGames) , pp. 1-6, June 2018. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [332]-[335]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [46] [46] N. Barman, E. Jammeh, S. A. Ghorashi, and M. G. Martini, 'NoReference Video Quality Estimation Based on Machine Learning for Passive Gaming Video Streaming Applications,' IEEE Access , vol. 7, pp. 74511-74527, June 2019. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § E. QoE-oriented Network Sharing and Slicing in Future Softwarized Networks · p. 28

    Dynamic resource sharing among slice tenants would make network resource utilization more efficient, but it needs intelligent scheduling algorithms to allocate resources among these slices.

    “Although the dynamic resource sharing among slice tenants would make network resource utilization more efficient, it needs intelligent scheduling algorithms to allocate resources among these slices.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § G. Multimedia Communications in Internet of Things (IoTs) · p. 29

    The imminent arrival of the IoT, consisting of interconnected devices, creates scalability, mobility, security and privacy, QoE resource management and multimedia network management challenges.

    “Inevitably, the imminent arrival of the IoT, consisting of interconnected devices, creates scalability, mobility, security and privacy, QoE resource management [399] and multimedia network management challenges [400], [401].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [399] [399] A. Floris and L. Atzori, 'Quality of Experience in the Multimedia Internet of Things: Definition and practical use-cases,' in 2015 IEEE International Conference on Communication Workshop (ICCW) , pp. 1747-1752, June 2015. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [400] [400] T. Ninikrishna, S. Sarkar, R. Tengshe, M. K. Jha, L. Sharma, V. Daliya, and S. K. Routray, 'Software Defined IoT: Issues and Challenges,' Proceedings of the IEEE 2017 International Conference on Computing Methodologies and Communication (ICCMC) , pp. 723-726, Feb 2017. - source

      Not checked in the free run.

    • cites [401] [401] N. Bizanis and F. A. Kuipers, 'SDN and Virtualization Solutions for the Internet of Things: A Survey,' IEEE Access , vol. 4, pp. 5591-5606, Sept 2016. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § F. Scalability, Resilience, and Optimization in Future Softwarized Networks · p. 29

    Centralized controller implementations suit a single network domain.

    “On the controller design viewpoint, the centralized controller implementations suit a single network domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE in Light Field Applications · p. 25

    Chen et al. measured the binocular quality perception in the context of blurriness and blockiness.

    “Chen et al. [340] measured the binocular quality perception in the context of blurriness and blockiness.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [340] [340] M.-J. Chen, L. K. Cormack, and A. C. Bovik, 'No-reference quality assessment of natural stereopairs,' IEEE Trans. Image Process , vol. 22, pp. 3379 -3391, Sep 2013. -

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § B. OTT-ISP Collaborative Service Management in Softwarized Networks · p. 27

    The current QoE models for delivery of adaptive video streams have three limitations: they are developed to capture the behavior of the average user and hence some are not personalized; they do not consider the context in which the streaming session takes place; and only the QoE model of the users is inserted into the control loop, but not the user herself.

    “The current QoE models for delivery of adaptive video streams have three limitations: (1) they are developed to capture the behavior of the”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [31] [31] S. Petrangeli, J. V. D. Hooft, T. Wauters, and F. D. Turck, 'Quality of Experience-Centric Management of Adaptive Video Streaming Services: Status and Challenges,' ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) , vol. 14, pp. 2 -28, May 2018. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given
    § A. QoE Management and Orchestration Challenges · p. 26

    Similar to NFV, WNV aim to provide efficient resource utilization, reduce CAPEX and OPEX to service providers and better QoE to the end-users in future cellular systems.

    “Similar to NFV concept, WNV aim to provide efficient resource utilization, reduces CAPEX and OPEX to service providers and better QoE to the end-users in future cellular systems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE in Light Field Applications · p. 25

    Wang et al. perform QoE measurement for light field 3D displays on Multi-layer light field displays (MLLFDs).

    “Wang et al. [338] perform QoE measurement for light field 3D displays on Multi-layer light field displays (MLLFDs).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [338] [338] S. Wang, K. S. Ong, P. Surman, J. Yuan, Y. Zheng, and X. W. Sun, 'Quality of experience measurement for light field 3D displays on multilayer LCDs,' Society for Information Display , vol. 24, no. 12, pp. 726-740, 2016. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § F. Scalability, Resilience, and Optimization in Future Softwarized Networks · p. 29

    The risk of becoming a Single Point of Failure (SPOF) increases with centralized controller implementations, which in turn compromises network reliability and performance as well as end-users' QoE.

    “However, the risk of becoming a Single Point of Failure (SPOF) increases, which in turn compromises the network reliability and its performance as well as the end-users' QoE.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    Mulsemedia enables the integration of other human senses (e.g., olfactory and haptic) into human-computer interaction.

    “Mulsemedia enables the integration of other human senses (e.g., olfactory and haptic) into human-computer interaction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given
    § A. QoE Management and Orchestration Challenges · p. 26

    Current proposals are only focused on NFV management and orchestration; there are no efforts on the management and orchestration of both SDN and NFV resources for future evolution, for example, considering 5G networks.

    “Despite these efforts, current proposals are only focused on NFV management and orchestration. There are no efforts given on the management and orchestration of both SDN and NFV resources for future evolution, for example, considering 5G networks.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The overall process of delivering VR video content from the source to clients is more complex than delivering common 4K videos.
    • Rests on an assumption: VR-video quality can be degraded by various faults that can be hard to separate or distinguish from.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § B. QoE in Cloud Gaming Video Streaming Applications · p. 25

    Two ITU-T recommendations are published: one covers identification of factors affecting QoE in gaming applications (G.1032) and the other describes definition of subjective methods for evaluating quality experienced during gaming activities (P.809).

    “Towards this end, two ITU-T recommendations are published [328]. One covers the identification of factors affecting QoE in gaming applications (G.1032) [329] while the other describes the definition of subjective methods for evaluating the quality experienced during gaming activities (P.809) [330].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [328] [328] S. Möller, S. Schmidt, and S. Zadtootaghaj, 'New ITU-T Standards for Gaming QoE Evaluation and Management,' in 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX) , pp. 1-6, May 2018. - source

      Not checked in the free run.

    • cites [329] [329] 'ITU-T Rec. G.1032: Influence Factors on Gaming Quality of Experience (QoE),' Oct 2017. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [330] [330] 'ITU-T Rec. P.809: Subjective evaluation methods for gaming quality,' June 2018. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE-oriented Business Models in Future Softwarized Network · p. 27

    The zero-rate QoE approach for radio resource management in 5G networks considering multimedia services outperforms the traditional zero-rated data rate approach in terms of network resource utilization, delivered QoE and QoE-aware fairness.

    “The approach outperforms the traditional zerorated data rate approach in terms of the network resource utilization, delivered QoE and QoE-aware fairness.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [244] [244] A. Ahmad and L. Atzori, 'MNO-OTT Collaborative Video Streaming in 5G: The Zero-rated QoE Approach for Quality and Resource Management,' IEEE Transactions on Network and Service Management , 2019. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § B. OTT-ISP Collaborative Service Management in Softwarized Networks · p. 27

    Higher operating frequency for information exchange may lead to improved service resilience while causing increased network overload issues.

    “Future research work in this direction is critically needed as the higher operating frequency for the information exchange may lead to improved service resilience while causing increased network overload issues.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE in Light Field Applications · p. 25

    Shao et al. proposed a new full-reference quality assessment model for stereoscopic images where binocular receptive field properties are learned and aligned with human visual perception.

    “A new full-reference quality assessment model for stereoscopic images is proposed by Shao et al. [339], where binocular receptive field properties are learned and aligned with human visual perception.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [339] [339] F. Shao, K. Li, W. Lin, G. Jiang, M. Yu, and Q. Dai, 'Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties,' IEEE Transactions on Image Processing , vol. 24, no. 10, pp. 2971 -2983, 2015. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning
    § A. QoE Management and Orchestration Challenges · p. 26

    QoE-aware/driven management schemes for multimedia delivery services over future softwarized infrastructures are not covered yet.

    “While existing projects are focusing on novel architectures that provide the needed flexibility and programmable networks using SDN/NFV, QoEaware/driven management schemes for multimedia delivery services over future softwarized infrastructures are not covered yet.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The overall process of delivering VR video content from the source to clients is more complex than delivering common 4K videos.
    • Rests on an assumption: VR-video quality can be degraded by various faults that can be hard to separate or distinguish from.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § A. QoE in Immersive AR/VR and Mulsemedia Applications · p. 24

    360 video applications could integrate additional 360 sensory media content (e.g., olfactory, haptic or thermoceptics media objects) that could eventually enable an even better quality of user experience.

    “Thus, 360 video applications, for example, could integrate additional 360 sensory media content (e.g., olfactory, haptic or thermoceptics media objects) that could eventually enable an even better quality of user experience [324].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [324] [324] L. Zou, I. Tal, A. Covaci, E. Ibarrola, G. Ghinea, and G.-M. Muntean, 'Can Multisensorial Media Improve Learner Experience?,' in Proceedings of the 8th ACM on Multimedia Systems Conference , MMSys'17, (Taipei, Taiwan), pp. 315-320, June 2017. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § C. QoE in Light Field Applications · p. 25

    Perra presents the QoE evaluation of light field applications when viewing rendered decompressed images.

    “Perra [341] presents the QoE evaluation of light field applications when viewing rendered decompressed images.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [341] [341] C. Perra, 'Assessing the Quality of Experience in Viewing Rendered Decompressed Light Fields,' Multimedia Tools and Applications , vol. 77, pp. 21771-21790, August 2018. -

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

136 of 136
  • The paper relies on this without support.

    Future networks are shifting towards the cloudification of network resources via Software Defined Networks (SDN) and Network Function Virtualization (NFV).

    “The future networks are shifting towards the cloudification of the network resources via Software Defined Networks (SDN) and Network Function Virtualization (NFV).”
  • The paper relies on this without support.

    Highly demanding Over-The-Top (OTT) multimedia applications pose increased challenges to Internet Service Providers (ISPs) for assuring a reasonable Quality of Experience (QoE) to their customers due to lack of flexibility, agility and scalability in traditional networks.

    “The highly demanding Over-The-Top (OTT) multimedia applications pose increased challenges to Internet Service Providers (ISPs) for assuring a reasonable Quality of Experience (QoE) to their customers due to lack of flexibility, agility and scalability in traditional networks.”
  • The paper relies on this without support.

    SDN and NFV will equip ISPs with cutting-edge technologies to provide service customization during service delivery and offer QoE which meets customers' needs via intelligent QoE control and management approaches.

    “This will equip ISPs with cutting-edge technologies to provide service customization during service delivery and offer QoE which meets customers' needs via intelligent QoE control and management approaches.”
  • The paper relies on this without support.

    QoS metrics are not explicitly and directly linked with a customer's satisfaction of a service.

    “As QoS metrics are not explicitly and directly linked with a customer's satisfaction of a service, user-centric Quality of Experience (QoE) metrics (e.g. Mean Opinion Scores) have been used in recent years to assess the quality of multimedia services, in addition to QoS metrics.”
  • The paper relies on this without support.

    User-centric QoE metrics have been used in recent years to assess the quality of multimedia services, in addition to QoS metrics.

    “As QoS metrics are not explicitly and directly linked with a customer's satisfaction of a service, user-centric Quality of Experience (QoE) metrics (e.g. Mean Opinion Scores) have been used in recent years to assess the quality of multimedia services, in addition to QoS metrics.”
  • The paper relies on this without support.

    MEC offers an environment characterized by high bandwidth and low latency for applications and content providers.

    “MEC promises to offer an environment characterized by high bandwidth and low latency for applications and content providers.”
  • The paper relies on this without support.

    Both Fog computing and MEC support virtualization functions.

    “Both Fog computing and MEC support virtualization functions.”
  • The paper relies on this without support.

    Cloud computing provides ubiquitous on-demand access to a shared pool of configurable computing resources with minimum management effort.

    “Cloud computing provides ubiquitous on-demand access to a shared pool of configurable computing resources (e.g., networks, servers, storage) with minimum management effort.”
  • The paper relies on this without support.

    The overall process of delivering VR video content from the source to clients is more complex than delivering common 4K videos.

    “This is so because the overall process of delivering the VR video content from the source to clients is more complex compared to that of common 4K videos.”
  • The paper relies on this without support.

    VR-video quality can be degraded by various faults that can be hard to separate or distinguish from.

    “The VR-video quality can be degraded by various faults which can be hard to separate or distinguish from.”
  • The paper relies on this without support.

    Cloud gaming is a delay-sensitive multimedia application.

    “Cloud gaming is a delay sensitive multimedia application.”
  • The paper relies on this without support.

    Passive gaming video streaming suffers from characteristics of traditional live/on-demand video streaming services.

    “Passive gaming video streaming suffers from characteristics of the traditional live/ondemand video streaming services.”
  • The paper relies on this without support.

    Cloud gaming and passive gaming video streaming have different network requirements and constraints, requiring different network management schemes.

    “Both services have different network requirements and constraints, which require different network management schemes.”
  • The paper relies on this without support.

    Light field videos usually have very high resolution (typically 50-80 megapixels) and hence have very high bandwidth requirement.

    “As compared to traditional Broadcast or streamed video content, light field videos usually have very high resolution (typically 50-80 megapixels) and hence have very high bandwidth requirement which calls for more efficient compression as well as higher network bandwidth.”
  • The paper relies on this without support.

    Light field 3D displays require different measurement procedures compared to conventional stereoscopic displays.

    “Additionally, light field 3D displays require different measurement procedures compared to the conventional stereoscopic displays as it includes the measurement of certain additional parameters.”
  • The paper relies on this without support.

    The exponential growth of Internet traffic due to the rising popularity of multimedia services over the Internet has created network resources management concern for ISPs and OTTP.

    “The exponential growth of Internet traffic due to the rising popularity of the multimedia services over the Internet has created network resources management concern for ISPs and OTTP.”
  • The paper relies on this without support.

    The network resources management concern is due to inefficient utilization of available network resources.

    “This is due to an inefficient utilization of available network resources, and the huge pressure on both the ISPs and OTTP to provide service with good quality to the end users.”
  • The paper relies on this without support.

    The network resources management concern is due to huge pressure on both the ISPs and OTTP to provide service with good quality to the end users.

    “This is due to an inefficient utilization of available network resources, and the huge pressure on both the ISPs and OTTP to provide service with good quality to the end users.”
  • The paper relies on this without support.

    The academia and the industry are embracing SDN and NFV as future technologies to help overcome these challenges.

    “The academia and the industry are embracing SDN and NFV as future technologies to help overcome these challenges.”
  • The paper relies on this without support.

    SDN and NFV promise to provide and implement new capabilities and solutions for enabling future networks (e.g., 5G) control to be adaptable, programmable and cost-effective.

    “SDN and NFV promise to provide and implement new capabilities and solutions for enabling future networks (e.g., 5G) control to be adaptable, programmable and cost-effective.”
  • The paper relies on this without support.

    Due to limited network resources, it is a challenge for the service providers to provide high-quality multimedia services to all their customers.

    “However, due to limited network resources, it is a challenge for the service providers to provide high-quality multimedia services to all their customers.”
21 of 21

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Surveys [14,15] focused on QoE in multimedia IoT applications, which is determined based on how such applications are consumed by users.

    “In surveys such as [14,15], authors have focussed on QoE in multimedia IoT applications, which is determined based on how such applications are consumed by users.”

    From QoE in IoT: a vision, survey and future directions (2021) · cites this paper as [14]

    The survey discusses QoE management for multimedia IoT applications in “Multimedia Communications in Internet of Things” (p. 29), and defines QoE in terms of users’ experience of an application or service in “Quality of Experience: Definition” (p. 4). But multimedia IoT is one subsection of a broader survey of multimedia streaming services, not the survey’s central focus. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Table X cites a buffer-starvation paper as controller-placement research

    Minor

    Table X lists [80] among works on SDN controller placement, but the reference list identifies [80] as an analysis of buffer starvation in streaming services.

  • Reference [10] is attributed to different authors and a different topic

    Minor

    The text identifies [10] as a survey by Liotou et al. on network-level QoE management, but the reference list identifies [10] as a paper by Liu et al. on device-to-device communications.

  • Reference [271] does not match the attributed WiFi-offloading study

    Minor

    The text attributes a WiFi-offloading resource-allocation scheme by Zhang et al. to [271]. The reference list instead identifies [271] as a 4K HTTP live-streaming paper by Ge et al.

3 of 3

Cites

Flagged first, then by citations

4 of the 343 references couldn’t be matched to a known paper.

Research works printed but not linked: 79

  1. lederer, 2013, Adaptive streaming over HTTP in content centric networks, Proc IEEE Int Conf Multimedia Expo (ICME), 1
  2. kitanov, 2016, Quality evaluation of cloud and fog orchestrated services in 5G mobile networks, Enabling Technologies and Architectures for Next-Generation Networking Capabilities, 1, 1
  3. 2015, HP OpenNFV Reference Architecture
  4. 2014, Cisco NFV Solution Enabling Rapid Service Innovation in the Era of Virtualization
  5. 2019, Intel Open Network Platform
  6. 2014, CloudBand With OpenStack as NFV Platform Strategic White Paper NFV Insights Series Alcatel Lucent RedHat Boulogne Billancourt France
  7. 2019, Alcatel-Lucent CloudBand
  8. 2015, Internet Research Task Force Network Function Virtualization Research Group (NFVRG)
  9. 2015, Broadcom Open NFV
  10. 2014, ETSI GS NFV-SWA 001 ETSI Industry Specification Group (ISG) NFV Network Functions Virtualisation (NFV) Virtual Network Functions Architecture
  11. 2015, The Internet Engineering Task Force (IETF) Service Function Chaining (SFC) Working Group (WG)
  12. 2015, CloudNFV
  13. 2015, Huawei NFV Open Lab
  14. 2015, Alliance for Telecommunications Industry Solutions Network Functions Virtualization Forum ATIS Network Functions Virtualization (NFV)
  15. 2015, ETSI GS NFV-REL 001 V1 1 1 Network Functions Virtualisation (NFV) Resiliency Requirements ETSI Industry Specification Group (ISG) Network Functions Virtualisation (NFV)
  16. 2014, ZOOM Project—Zero-Touch Orchestration Operations and Management
  17. 2015, Open Platform for NFV (OPNFV)
  18. 2015, The Broadband Forum Technical Work in Progress
  19. 2015, Broadband Forum
  20. 2015, Network Functions Virtualisation (NFV) Ecosystem Report on SDN Usage in NFV Architectural Framework
  21. lopez, 2015, OpenMANO: The data plane ready open source NFV MANO stack, Proceedings of ietf Meeting, 1
  22. 2014, ETSI GS NFV-SEC 003 V1 1 1 Network Functions Virtualisation (NFV) NFV Security Security and Trust Guidance Industry Specification Group (ISG) Network Functions Virtualisation (NFV)
  23. liu, 2017, A 360-degree 4K×2K panoramic video processing over smart-phones, Proc IEEE Int Conf Consum Electron (ICCE), 247
  24. 2014, ETSI NFV ISG ETSI GS NFV-PER 002 V1 1 2 Network Functions Virtualisation (NFV) Proof of Concepts Framework
  25. 2014, ETSI GS NFV 003 V1 2 1 Network Functions Virtualisation (NFV) Terminology for Main Concepts in NFV ETSI Industry Specification Group (ISG) Network Functions Virtualisation (NFV)
  26. 2013, ETSI GS NFV 001 V1 1 1 Network Function Virtualization Use Cases ETSI Industry Specification Group (ISG) Network Functions Virtualisation (NFV)
  27. 2013, Network Functions Virtualisation (NFV) Architectural Framework Technical Report ETSI GS NFV 002 v1 1 1
  28. 2014, ETSI GS NFV-MAN 001 V1 1 1 Network Functions Virtualisation (NFV) Management and orchestration ETSI Industry Specification Group (ISG) Network Functions Virtualisation (NFV)
  29. 2019, OpenStack
  30. 2019, Apache Cloudstack
  31. 2019, OpenDaylight
  32. hoßfeld, 2018, Quality and user experience, IEEE/ACM Trans Netw, 3, 1
  33. 2017, Preview Information Technology—Dynamic Adaptive Streaming Over HTTP (DASH)—Part 1 Media Presentation Description and Segment Formats
  34. doria, 2010, Internet Engineering Task Force (IETF) Forwarding and Control Element Separation (ForCES)
  35. smith, 2014, OpFlex Control Protocol Internet Draft
  36. 2019, Open Networking Foundation (ONF)
  37. taylor, 2014, A Guide to NFV and SDN White Paper
  38. 2019, VMware virtual platform technical white paper
  39. 2012, RYU network operating system
  40. 2012, Floodlight is A Java-Based OpenFlow Controller
  41. 10.1109/tmc.2015.2497238 · DOI
  42. 2013, HP SDN Controller Architecture
  43. 2019, Draft Standard for Software Defined Networking and Network Function Virtualization Security
  44. 2019, Draft Standard for Software Defined Networking and Network Function Virtualization Performance
  45. 2019, Standard for Software Defined Networking and Network Function Virtualization Reliability
  46. 0, Cisco Visual Networking Index Global Mobile Data Traffic Forecast Update 20122017 Cisco White Paper
  47. 2019, Metro Ethernet Forum (MEF)
  48. 2017, Information Technology—Dynamic Adaptive Streaming Over HTTP (DASH)—Part 5 Server and Network Assisted DASH (SAND)
  49. 2015, Per-Title Encode Optimization
  50. 2016, Global Internet Phenomena Report North America and Latin America
  51. aditya, 2013, SoftRAN: Software defined radio access network, Proc 2nd ACM SIGCOMM Workshop Hot Topics Softw Defined Netw, 25
  52. li, 2012, CellSDN: Software-defined cellular networks, European Workshop on Software Defined Networking (EWSDN), 6
  53. 2019, Google Edge Network
  54. 2016, Vocabulary for performance and quality of service Amendment 5 New definitions for inclusion
  55. kuzyakov, 0, Next-generation video encoding techniques for 360 video and VR
  56. 2019, AOMedia Video 1 (AV1)
  57. dryjanski, 2017, Towards 5G—Research Activities in Europe (HORIZON 2020 Projects
  58. 2019, Opensdncore research and testbed for the carrier-grade nfv/sdn environment
  59. 2019, Open5GCore—The Next Mobile Core Network Testbed Platform
  60. crippa, 2017, Resource sharing for a 5G multi-tenant and multi-service architecture, Proc Eur Wireless 23rd Eur Wireless Conf, 1
  61. 2016, Toward A Practical Perceptual Video Quality Metric
  62. 2008, Subjective video quality assessment methods for multimedia applications
  63. 2012, Methodology for the Subjective Assessment of the Quality of Television Pictures
  64. 2016, Methods for the Subjective Assessment of Video Quality Audio Quality and Audiovisual Quality of Internet Video and Distribution Quality Television in Any Environment
  65. staehle, 2010, YoMo: A YouTube application comfort monitoring tool, Proc EuroITV Workshop QoE Multimedia Content Sharing (QoEMCS)
  66. 2019, Huawei Technologies Virtual Reality/Augmented Reality White Paper
  67. barakabitze, 2014, Caching and data routing in information centric networking (ICN): The future Internet perspective, Int J Adv Res Comput Sci Softw Eng, 4, 26
  68. abbas, 2015, Evolution of LTE and related technologies towards IMT-advanced, Int J Adv Res Comput Sci Softw Eng, 5, 16
  69. 2019, RIFT Io
  70. 2019, Anssr Data-Engine
  71. 2019, A Linux Foundation Project
  72. 2019, OpenMano
  73. 2017, Apple HTTP Live Streaming
  74. 2019, ESTI NFV
  75. 2017, Adobe HTTP Dynamic Streaming
  76. 2019, AT & T Enhanced Control Orchestration Management and Policy (ECOMP) Architecture
  77. 2017, Microsoft Silverlight Smooth Streaming
  78. 2017, Influence factors on gaming quality of experience (QoE)
  79. 2018, Subjective evaluation methods for gaming quality

Cited by

Sorted by citations

Authors
Barakabitze, A. A., Barman, N., Ahmad, A., Zadtootaghaj, S., Sun, L., Martini, M. G., & Atzori, L.
Affiliations
  • University of Plymouth (GB)
  • Kingston University London (GB)
  • IS-Wireless (Poland) (PL)
  • Technische Universität Berlin (DE)
  • University of Cagliari (IT)
Venue
IEEE Communications Surveys & Tutorials
Published
2020
Volume
22
Issue
1
Pages
526-565
ISSN
  • 1553-877X (ISSN-L)
  • 2373-745X
OpenAlex
W2991779680
Cited by
239
References
343
Citations by year
2026: 20 · 2025: 40 · 2024: 31 · 2023: 44 · 2022: 44 · 2021: 44 · 2020: 15 · 2019: 1
FWCI
14.24
Type
journal article
Language
en
Open access
Locations
  • IEEE Communications Surveys & Tutorials (publishedVersion)
  • Research Repository (Kingston University London) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • PEARL (University of Plymouth) (submittedVersion)
  • UNICA IRIS Institutional Research Information System (University of Cagliari) (submittedVersion, other-oa)
  • arXiv (Cornell University) (cc-by)
Funders
  • European Union of Horizon2020 Research and Innovation Programme through Marie Skłodowska-Curie Innovative Training Networks (643072)
  • Network QoE-NET
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software-Defined Networks and 5G
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
Keywords
streaming media, over-the-top services, software-defined networking, network function virtualization, HTTP adaptive streaming, QoE monitoring, mobile edge computing, fog computing, information-centric networking, immersive virtual reality, video gaming, network slicing, network orchestration, softwarized networks, big data

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review