AI and 6G Into the Metaverse: Fundamentals, Challenges and Future Research Trends
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985 · cited 1×
“Similarly, uMTC and uHPC can be combined for a certain application if the needs of both services can be met simultaneously [103].”
BackgroundBiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation
Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., & Sang, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_20 · Cited by 2,968
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528 · cited 1×
“The objects and virtual entities can now also be generated through text description, thanks to recent Dall-E_2 [115] and Google’s Imagen [139].”
GPT-3: Its Nature, Scope, Limits, and Consequences
Floridi, L., & Chiriatti, M. (2020) · Minds and Machines · doi:10.1007/s11023-020-09548-1 · Cited by 2,519
Zero-shot text-to-image generation
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., & Sutskever, I. (2021) · arXiv · doi:10.48550/arxiv.2102.12092 · Cited by 2,417
Toward 6G Networks: Use Cases and Technologies
Giordani, M., Polese, M., Mezzavilla, M., Rangan, S., & Zorzi, M. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900411 · Cited by 2,241
Unified Perceptual Parsing for Scene Understanding
Xiao, T., Liu, Y., Zhou, B., Jiang, Y., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_26 · Cited by 2,201 · cited 1×
“…that does not need a green screen to get a person segmented in even a complex scene, such 16. https://www.youtube.com/watch?v=b-fvsi9YIP4 17. https://storyfile.com as FCN [120], UPerNet [121], BiSeNet [122], FPN [123], SFNet [124], SegFormer [125], FaPN [126], CondNet [127], and Lawin [128].”
BackgroundMystakidis, S. (2022) · Encyclopedia · doi:10.3390/encyclopedia2010031 · Cited by 1,977
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · cited 1×
“…the metaverse needs to support atleast thousands if not millions of remote devices that need to process and transmit huge amounts of data, the latency will be the core issue for current network environment as it is considered to be the bottleneck for adaptation of wide array of applications [149].”
BackgroundLee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2021) · arXiv · doi:10.48550/arxiv.2110.05352 · Cited by 1,088 · cited 7×
“Recently, there has been many surveys and research studies conducted to investigate the potential technology, its implementation, applications, and future research directions [1], [2], [3], [4], [6], [10], [30], [35], [36], [37], [38], [39], [40], [41], [42].”
BackgroundInfluentialEducational Applications of Metaverse: Possibilities and Limitations
Kye, B., Han, N., Kim, E., Park, Y., & Jo, S. (2021) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2021.18.32 · Cited by 1,076
Advertising in the metaverse: Research agenda
Kim, J. (2021) · Journal of Interactive Advertising · doi:10.1080/15252019.2021.2001273 · Cited by 645 · cited 1×
“Epic Games can potentially grow Metaverse growth with 1 billion dollar in funding from Sony in the future [285].”
BackgroundBlockchain for 5G and beyond networks: A state of the art survey
Nguyen, D. C., Pathirana, P. N., Ding, M., & Seneviratne, A. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102693 · Cited by 412
She, C., Sun, C., Gu, Z., Li, Y., Yang, C., Poor, H. V., & Vucetic, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3053601 · Cited by 405
Optimizing 360 video delivery over cellular networks
Qian, F., Ji, L., Han, B., & Gopalakrishnan, V. (2016) · Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges · doi:10.1145/2980055.2980056 · Cited by 402 · cited 1×
“…meets MEC for Transmission Efficiency in Wireless VR: Furthermore, several studies have indicated that introducing FOV into 360 ◦ video will reduce up to 80% of the bandwidth requirements compared to delivering 360 ◦ video, hence lowering the overall necessary transmission data rate [180], [181].”
BackgroundAugmented reality: Principles and practice
Schmalstieg, D., & Hollerer, T. (2017) · 2017 IEEE Virtual Reality (VR) · doi:10.1109/vr.2017.7892358 · Cited by 397
Impact of 5G Technologies on Industry 4.0
Rao, S. K., & Prasad, R. (2018) · Wireless Personal Communications · doi:10.1007/s11277-018-5615-7 · Cited by 369
Will Metaverse Be NextG Internet? Vision, Hype, and Reality
Cheng, R., Wu, N., Chen, S., & Han, B. (2022) · IEEE Network · doi:10.1109/mnet.117.2200055 · Cited by 280 · cited 1×
“Microsoft is constructing Microsoft Mesh, a business-focused Metaverse [286].”
MethodPropagation Modeling for Wireless Communications in the Terahertz Band
Han, C., & Chen, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700898 · Cited by 255
Moore, F. C., Obradovich, N., Lehner, F., & Baylis, P. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816541116 · Cited by 237 · cited 1×
“…billion social media posts that address the climate conditions but a recent study showed that the general public bases their idea of climate change with respect to normal weather, therefore, their perception is quite short-term, i.e., the affect that started to come in play since 2 - 8 years [276].”
BackgroundChen, T., Zhao, M., Shi, Q., Yang, Z., Liu, H., Sun, L., Ouyang, J., & Lee, C. (2018) · Nano Energy · doi:10.1016/j.nanoen.2018.06.022 · Cited by 89
Cited by
Toward immersive communications in 6G
Shen, X. (., Gao, J., Li, M., Zhou, C., Hu, S., He, M., & Zhuang, W. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1068478 · Cited by 124
Metadata
- Authors
- Zawish, M., Dharejo, F. A., Khowaja, S. A., Raza, S., Davy, S., Dev, K., & Bellavista, P.
- Venue
- IEEE Open Journal of the Communications Society
- Published
- 2024
- Volume
- 5
- Pages
- 730-778
- ISSN
- 2644-125X (ISSN-L)
- OpenAlex
- W4391305431
- Cited by
- 203
- References
- 26
- FWCI
- 19.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.