Virtual and Augmented Reality on the 5G Highway
Open accessAbstract
In recent years, virtual and augmented reality have begun to take advantage of the high speed capabilities of data streaming technologies and wireless networks. However, limitations like bandwidth and latency still prevent us from achieving high fidelity telepresence and collaborative virtual and augmented reality applications. Fortunately, both researchers and engineers are aware of these problems and have set out to design 5G networks to help us to move to the next generation of virtual interfaces. This paper reviews state of the art virtual and augmented reality communications technology and outlines current efforts to design an effective, ubiquitous 5G network to help to adapt to virtual application demands. We discuss application needs in domains like telepresence, education, healthcare, streaming media, and haptics, and provide guidelines and future directions for growth based on this new network infrastructure.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AR gained widespread public acceptance in the late 2000s through the entertainment sector, with games like Sony's Eyes of Judgement and Nintendo's Pokemon GO.
“AR gained widespread public acceptance in the late 2000s through the entertainment sector, with the help of games like Sony ' s Eyes of Judgement, which is regarded to be the fi rst AR game, and Nintendo ' s Pokemon GO, the most popular AR game to date (Orlosky, Kiyokawa, and Takemura 2017).”
From The route to immersion: a conceptual framework for cross-disciplinary immersive theatre and experiences (2023) · cites this paper as Orlosky, Kiyokawa, and Takemura 2017
Section 1.2, “A Brief History of Augmented Reality,” says AR became known to the general public through entertainment in the late 2000s and names The Eye of Judgement (2007), thought to be the first AR consumer game. It names the Nintendo 3DS—not Pokémon Go—as the other example in that historical account. Sections 1.2 and 2.1 describe Pokémon Go’s later popularity, but do not place it in the late-2000s adoption period or establish that it was the most popular AR game to date. (LLM, conf=0.88)
Experimental — accuracy not yet measuredIn the early years, the goal of utilizing AR was to help users perform the task at hand with less effort.
“In the early years, the goal of utilizing AR was to help users ' perform the task at hand with less effort ' (Orlosky, Kiyokawa, and Takemura 2017, 133 -134)”
From The route to immersion: a conceptual framework for cross-disciplinary immersive theatre and experiences (2023) · cites this paper as Orlosky, Kiyokawa, and Takemura 2017, 133-134
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008 · see citing works
Augmented reality: a class of displays on the reality-virtuality continuum
Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1995) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.197321 · Cited by 2,374 · see citing works
Self-citationMarker tracking and HMD calibration for a video-based augmented reality conferencing system
Kato, H., & Billinghurst, M. (2003) · doi:10.1109/iwar.1999.803809 · Cited by 2,214 · see citing works
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · see citing works
A head-mounted three dimensional display
Sutherland, I. E. (1968) · Proceedings of the December 9-11, 1968, fall joint computer conference, part I on - AFIPS '68 (Fall, part I) · doi:10.1145/1476589.1476686 · Cited by 2,065 · see citing works
Internet of Things in the 5G Era: Enablers, Architecture, and Business Models
Palattella, M. R., Dohler, M., Grieco, A., Rizzo, G., Torsner, J., Engel, T., & Ladid, L. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2525418 · Cited by 1,459 · see citing works
Augmented reality: an application of heads-up display technology to manual manufacturing processes
Caudell, T., & Mizell, D. (1992) · Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences · doi:10.1109/hicss.1992.183317 · Cited by 1,401 · see citing works
Dou, M., Khamis, S., Degtyarev, Y., Davidson, P., Fanello, S., Kowdle, A., Escolano, S. O., Rhemann, C., Kim, D., Taylor, J., et al. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925969 · Cited by 500 · see citing works
Investigating the effectiveness of tactile feedback for mobile touchscreens
Hoggan, E. E., Brewster, S. A., & Johnston, J. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357300 · Cited by 454 · see citing works
The Studierstube Augmented Reality Project
Schmalstieg, D., Fuhrmann, A. L., Hesina, G., Szalavári, Z., Encarnação, L. M., Gervautz, M., & Purgathofer, W. (2002) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474602317343640 · Cited by 391 · see citing works
Multiscale gigapixel photography
Brady, D. J., Gehm, M. E., Stack, R. A., Marks, D. L., Kittle, D. S., Golish, D. R., Vera, E. M., & Feller, S. D. (2012) · Nature · doi:10.1038/nature11150 · Cited by 332 · see citing works
Game design as marketing: How game mechanics create demand for virtual goods
Hamari, J., & Lehdonvirta, V. (2010) · International journal of business science & applied management. · doi:10.69864/ijbsam.5-1.48 · Cited by 328 · see citing works
DIVE A multi-user virtual reality system
Carlsson, C. P. O., & Hagsand, O. (2002) · doi:10.1109/vrais.1993.380753 · Cited by 320 · see citing works
ARQuake: an outdoor/indoor augmented reality first person application
Thomas, B. H., Close, B., Donoghue, J., et al. (2002) · International Symposium on Wearable Computers · doi:10.1109/iswc.2000.888480 · Cited by 301 · see citing works
Virtual and Augmented Reality Applications in Manufacturing
Nee, A. Y. C., & Ong, S. K. (2013) · IFAC Proceedings Volumes · doi:10.3182/20130619-3-ru-3018.00637 · Cited by 297 · see citing works
Augmented Reality in built environment: Classification and implications for future research
Wang, X., Kim, M. J., Love, P. E. D., & Kang, S.-C. (2013) · Automation in Construction · doi:10.1016/j.autcon.2012.11.021 · Cited by 293 · see citing works
Huang, F., Chen, K., & Wetzstein, G. (2015) · ACM Transactions on Graphics · doi:10.1145/2766922 · Cited by 273 · see citing works
Intelligent Augmented Reality Training for Motherboard Assembly
Westerfield, G., Mitrović, A., & Billinghurst, M. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0032-x · Cited by 244 · see citing works
Keefe, D. F., Feliz, D. A., Moscovich, T., et al. (2001) · ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D) · doi:10.1145/364338.364370 · Cited by 229 · see citing works
CAD model based virtual assembly simulation, planning and training
Leu, M. C., ElMaraghy, H. A., Nee, A. Y. C., et al. (2013) · CIRP Annals · doi:10.1016/j.cirp.2013.05.005 · Cited by 171 · see citing works
Leithinger, D., Follmer, S., Olwal, A., et al. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647377 · Cited by 164 · see citing works
Rise of Augmented Reality: Current and Future Application Areas
Alkhamisi, A. O., & Monowar, M. M. (2013) · International Journal of Internet and Distributed Systems · doi:10.4236/ijids.2013.14005 · Cited by 151 · see citing works
Shared space: An augmented reality approach for computer supported collaborative work
Billinghurst, M., Weghorst, S. J., & Furness, T. A. (1998) · Virtual Reality · doi:10.1007/bf01409795 · Cited by 113 · see citing works
Communication behaviors of co-located users in collaborative AR interfaces
Kiyokawa, K., Billinghurst, M., Hayes, S. E., et al. (2003) · doi:10.1109/ismar.2002.1115083 · Cited by 69 · see citing works
Self-citationSeamlessDesign for 3D object creation
Kiyokawa, K., Takemura, H., & Yokoya, N. (2000) · IEEE Multimedia · doi:10.1109/93.839308 · Cited by 66 · see citing works
Self-citationFurlan, R. (2016) · IEEE Spectrum · doi:10.1109/mspec.2016.7473143 · Cited by 58 · see citing works
The Google Art Project: A New Generation of Museums on the Web?
Proctor, N. (2011) · Curator The Museum Journal · doi:10.1111/j.2151-6952.2011.00083.x · Cited by 50 · see citing works
Reality Skins: Creating Immersive and Tactile Virtual Environments
Shapira, L., & Freedman, D. (2016) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2016.23 · Cited by 50 · see citing works
ModulAR: Eye-Controlled Vision Augmentations for Head Mounted Displays
Orlosky, J., Toyama, T., Kiyokawa, K., et al. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2459852 · Cited by 46 · see citing works
Self-citationReal-time modeling and tracking manual workflows from first-person vision
Petersen, N., Pagani, A., & Stricker, D. (2013) · International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2013.6671771 · Cited by 42 · see citing works
First-person tele-operation of a humanoid robot
Fritsche, L., Unverzag, F., Peters, J., & Calandra, R. (2015) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2015.7363475 · Cited by 41 · see citing works
Stathakarou, N., Zary, N., & Kononowicz, A. A. (2014) · PeerJ · doi:10.7717/peerj.672 · Cited by 34 · see citing works
How Low Should We Go? Understanding the Perception of Latency While Inking
Annett, M., Ng, A., Dietz, P., et al. (2020) · A K Peters/CRC Press eBooks · doi:10.1201/9781003059325-22 · Cited by 34 · see citing works
Itoh, Y., Orlosky, J., Kiyokawa, K., & Klinker, G. (2016) · Augmented Human International Conference · doi:10.1145/2875194.2875227 · Cited by 33 · see citing works
Self-citationOut and About — Real World Teleconferencing
Billinghurst, M., & Kato, H. (2000) · BT Technology Journal · doi:10.1023/a:1026582022824 · Cited by 32 · see citing works
Itoh, Y., & Klinker, G. J. (2015) · Augmented Human International Conference · doi:10.1145/2735711.2735787 · Cited by 27 · see citing works
Full body interaction in virtual reality with affordable hardware
Takala, T. M., & Matveinen, M. (2014) · IEEE Virtual Reality (VR) · doi:10.1109/vr.2014.6802099 · Cited by 22 · see citing works
Zhang, H., Cao, X. G., & Zhao, S. (2012) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/2207676.2208638 · Cited by 10 · see citing works
Bulling, A., Cakmakci, O., Kunze, K., et al. (2016) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dagrep.6.1.160 · Cited by 9 · see citing works
Kato, G., Kuroda, Y., Nisky, I., et al. (2015) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2015.7177745 · Cited by 8 · see citing works
A real-time, three-dimensional moving platform visualization tool
Zyda, M., McGhee, R. B., McConkle, C. M., et al. (1990) · Computers & Graphics · doi:10.1016/0097-8493(90)90044-x · Cited by 5 · see citing works
Improved outdoor augmented reality through “Globalization”
Sweeney, C., Höllerer, T., & Turk, M. (2013) · IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2013.6671820 · Cited by 5 · see citing works
Kanter, T. G., Fors, U., & Rahmani, R. (2016) · International Journal of Multimedia and Ubiquitous Engineering · doi:10.14257/ijmue.2016.11.6.05 · Cited by 4 · see citing works
A real-time x-ray mobile application using augmented reality and google street view
Silva, L. F. M. S., Viana, W., & Trinta, F. A. M. (2016) · doi:10.1145/2993369.2993370 · Cited by 4 · see citing works
The SIMNET Network and Protocol
Thorpe, J. A., Bloedorn, G. W., Taylor, R. A., et al. (1987) · Cited by 2 · see citing works
Envisioning augmented reality: smart technology for the future
Vate-U-Lan, P. (2012) · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 13
- [1]1. 5G Mobile Communications Systems for 2020 and beyond, 5GMF White Paper, Proc. 5th Generation Mobile Communications Promo- tion Forum (2016).
- [11]11. Cass, S.: Tiltbrush: The killer app for VR, IEEE Spectrum (2016).
- [13]13. Dou, M., Khamis, S., Degtyarev, Y., Davidson, P., Fanello, S.R., Kowdle, A., Escolano, S.O., Rhemann, C., Kim, D., Taylor, J., Kohli, P., Tankovich, V. and Izadi, S.: Fusion4D: Real-time performance capture of challenging scenes, ACM Trans. Graphics (TOG), Vol.35, No.4, p.114 (2016).
- [15]15. Fritsche, L., Unverzag, F., Peters, J. and Calandra, R.: First-person teleoperation of a humanoid robot, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), IEEE, pp.997-1002 (2015).
- [16]16. Fettweis, G.P.: A 5G wireless communications vision, Microwave Journal, Vol.55, No.12, pp.24-36 (2012).
- [18]18. Greenhalgh, C. and Benford, S.: MASSIVE: A Collaborative Vir- tual Environment for Teleconferencing, Transactions on Computer- Human Interaction (TOCHI), Vol.2, No.3, pp.239-261, ACM (1995).
- [20]20. Heilig, M.: Sensorama simulator, U.S. Patent 3,050,870 (1962).
- [22]22. Huang, F.C., Chen, K. and Wetzstein, G.: The Light Field Stereo- scope: Immersive Computer Graphics via Factored Near-eye Light Field Displays with Focus Cues, ACM Trans. Graphics (TOG), Vol.34, No.4, ACM (2015).
- [25]25. Itoh, Y., Orlosky, J., Kiyokawa, K. and Klinker, G.: Laplacian Vi- sion: Augmenting Motion Prediction via Optical See-Through Head- Mounted Displays, Proc. 7th Augmented Human International Con- ference, ACM (2016).
- [26]26. Leithinger, D., Follmer, S., Olwal, A. and Ishii, H.: Physical telep- resence: Shape capture and display for embodied, computer-mediated remote collaboration, Proc. 27th Annual ACM Symposium on User In- terface Software and Technology, pp.461-470, ACM (2014).
- [35]35. Mekni, M. and Lemieux, A.: Augmented reality: Applications, chal- lenges and future trends, Applied Computational Science-Proc. 13th International Conference on Applied Computer and Applied Compu- tational Science (ACACOS '14), Kuala Lumpur, Malaysia, pp.23-25 (2014).
- [43]43. Orts-Escolano, S., Rhemann, C., Fanello, S., Chang, W., Kowdle, A., Degtyarev, Y., Kim, D., Davidson, P.L., Khamis, S., Dou, M., Tankovich, V., Loop, C., Cai, Q., Chou, P.A., Mennicken, S., Valentin, J., Pradeep, V., Wang, S., Kang, S.B., Kohli, P., Lutchyn, Y., Keskin, C. and Izadi, S.: Holoportation: Virtual 3D Teleportation in Real-time, Proc. 29th Annual Symposium on User Interface Software and Tech- nology, pp.741-754, ACM (2016).
- [49]49. Soldani, D., Virette, D., Cordara, G. and Zhang, Q.: An Enriched Multimedia Experience for Wireless Networks in Horizon 2020 and Beyond, IEEE COMSOC MMTC E-Letter, Vol.7, No.8 (2012).
Cited by
Sorted by citations
Toward immersive communications in 6G
Shen, X. (., Gao, J., Li, M., Zhou, C., Hu, S., He, M., & Zhuang, W. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1068478 · Cited by 124 · see citing works
Punpeng, G., & Yodnane, P. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02485-1 · Cited by 15 · see citing works
“…Kiyokawa, and Takemura 2017, 133 – 134), such as when scientists at the Boeing Corporation developed an AR system to help workers put together wiring harnesses (Orlosky, Kiyokawa, and Takemura 2017; Bottani and Vignali 2019), and when it was used for image-guided surgery (Syed et al. 2023).”
- Authors
- Orlosky, J., Kiyokawa, K., & Takemura, H.
- Affiliations
- The University of Osaka (JP)
- Venue
- Journal of Information Processing
- Published
- 2017
- Volume
- 25
- Issue
- 0
- Pages
- 133-141
- ISSN
- 1882-6652 (ISSN-L)
- OpenAlex
- W2588283971
- Cited by
- 107
- References
- 46
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 13 · 2023: 18 · 2022: 16 · 2021: 13 · 2020: 13 · 2019: 16 · 2018: 5 · 2017: 4
- FWCI
- 8.08
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Journal of Information Processing (publishedVersion)
- Institutional Repositories DataBase (IRDB) (submittedVersion)
- NAIST Digital Library (Nara Institute of Science and Technology) (submittedVersion, cc-by-nc-nd)
- Funders
- Japan Society for the Promotion of Science (15J03023, 15H02738)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Computer Science › Computer Networks and Communications › Software-Defined Networks and 5G
- Keywords
- virtual reality, augmented reality, 5G, telepresence, bandwidth, latency, collaborative virtual reality, haptics, streaming media, wireless networks, network design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
