The Road to Immersive Communication
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Communication has seen enormous advances over the past 100 years including radio, television, mobile phones, video conferencing, and Internet-based voice and video calling. Still, remote communication remains less natural and more fatiguing than face-to-face. The vision of immersive communication is to enable natural experiences and interactions with remote people and environments in ways that suspend disbelief in being there. This paper briefly describes the current state-of-the-art of immersive communication, provides a vision of the future and the associated benefits, and considers the technical challenges in achieving that vision. The attributes of immersive communication are described, together with the frontiers of video and audio for achieving them. We emphasize that the success of these systems must be judged by their impact on the people who use them. Recent high-quality video conferencing systems are beginning to deliver a natural experience-when all participants are in custom-designed studios. Ongoing research aims to extend the experience to a broader range of environments. Augmented reality has the potential to make remote communication even better than being physically present. Future natural and effective immersive experiences will be created by drawing upon intertwined research areas including multimedia signal processing, computer vision, graphics, networking, sensors, displays and sound reproduction systems, haptics, and perceptual modeling and psychophysics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cocktail party phenomenon revisited: The importance of working memory capacity
Conway, A. R. A., Cowan, N., & Bunting, M. F. (2001) · Psychonomic Bulletin & Review · doi:10.3758/bf03196169 · Cited by 875
Social signal processing: Survey of an emerging domain
Vinciarelli, A., Pantic, M., & Bourlard, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.007 · Cited by 842
Hinterseer, P., Hirche, S., Chaudhuri, S., Steinbach, E., & Buss, M. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.906746 · Cited by 213
Research works printed but not linked: 77
- grmer, 2010, Efficient modeling of head movements and dynamic scenes in virtual acoustics
- gardner, 1997, 3-D audio using loudspeakers
- 10.1109/IROS.2004.1389720 · doi:10.1109/iros.2004.1389720
- 10.1162/pres.17.6.527 · DOI
- 10.1162/0899766054322964 · DOI · Paper page
- 0, Second Life
- begault, 1999, Auditory and non-auditory factors that potentially influence virtual acoustic imagery, Proc 16th Audio Eng Soc Int Conf Spatial Sound Reproduction
- 10.1109/JPROC.2010.2098830 · DOI · Paper page
- 10.1109/JPROC.2011.2182071 · doi:10.1109/jproc.2011.2182071
- 0, Yoda
- 2010, U S National Remote Working Survey
- 10.1109/MMSP.2009.5293268 · doi:10.1109/mmsp.2009.5293268
- 10.1109/JPROC.2010.2098351 · doi:10.1109/jproc.2010.2098351
- 10.1109/CVPRW.2008.4563159 · doi:10.1109/cvprw.2008.4563159
- 10.1109/MMSP.2010.5661996 · DOI
- 10.1109/JPROC.2011.2182073 · doi:10.1109/jproc.2011.2182073
- 10.1145/1618452.1618505 · DOI
- szeliski, 2011, Computer Vision Algorithms and Applications
- 10.1109/MSP.2007.905702 · doi:10.1109/msp.2007.905702
- chen, 2002, Leveraging the asymmetric sensitivity of eye contact for videoconferencing, Proc SIGHI Conf Human Factors Comput Syst, 10.1145/503376.503386 · DOI
- 10.1155/2008/659024 · DOI · Paper page
- 10.1109/ISM.2006.124 · doi:10.1109/ism.2006.124
- boyne, 2005, Auditory and visual facilitation: Cross-modal fusion of information in multi-modal displays, Meeting Proc - Visualisation Common Operational Picture, 19-1
- 10.1109/TIP.2011.2163895 · doi:10.1109/tip.2011.2163895
- 10.1117/2.1200702.0648 · doi:10.1117/2.1200702.0648
- 10.1109/TCSVT.2003.817350 · doi:10.1109/tcsvt.2003.817350
- 1996, Perceptual Constancy Why Things Look as They Do
- blascovich, 2011, Infinite Reality Avatars Eternal Life New Worlds and the Dawn of the Virtual Revolution
- 10.1016/j.patcog.2010.03.004 · DOI · Paper page
- reeves, 1996, The Media Equation How People Treat Computers Television and New Media Like Real People and Places
- 2011, Virtual Barber Shop
- 10.1109/MSP.2010.938756 · DOI
- clark, 2011, Faraway So Close Doing Global iPhone Dev from New Zealand
- friedman, 2007, The World is Flat A Brief History of the Twenty-First Century
- jones, 2009, Achieving eye contact in a one-to-many 3D video teleconferencing system, ACM Trans Graphics, 28, 10.1145/1531326.1531370 · DOI · Paper page
- ng, 2005, Light Field Photography with a Hand-Held Plenoptic Camera
- 10.1109/34.121783 · DOI · Paper page
- 10.1145/237170.237200 · DOI · Paper page
- 10.1145/237170.237199 · DOI · Paper page
- 10.1145/344779.344932 · DOI
- 10.1016/j.image.2003.07.001 · DOI · Paper page
- 10.1145/142750.142977 · DOI · Paper page
- 10.1145/1718918.1718969 · DOI
- geelhoed, 2009, Effects of latency on telepresence
- 1998, Relative Timing of Sound and Vision for Broadcasting
- 2003, One-Way Transmission Time
- pirenne, 1962, The Eye, 2
- moore, 2003, Psychology of Hearing
- 10.1109/5.241504 · DOI · Paper page
- 1996, Methods for Objective and Subjective Assessment of Quality
- nguyen, 2007, Multiview: Improving trust in group video conferencing through spatial faithfulness, Proc SIGHI Conf Human Factors Comput Syst, 10.1145/1240624.1240846 · DOI
- bell, 1891, Alexander Graham Bell Family Papers
- sutherland, 1965, The ultimate display, Proc IFIP Congr, 506
- 10.1109/JPROC.2004.839619 · DOI · Paper page
- 1928, S.F. man's invention to revolutionize television, San Francisco Chronicle, cxxxiii
- 10.1145/129888.129892 · DOI · Paper page
- fihlo, 2009, Image, appearance and vanity in the use of media spaces and videoconference systems, Proc of the International ACMSIGGROUP conference on Supporting Group Work
- lindbergh, 2004, The past present and future of video telephony A systems perspective
- jouppi, 2004, BiReality: Mutually-immersive telepresence, Proc ACM Int Conf Multimedia
- adelson, 1991, Computation Models of Visual Processing, 3
- 10.1117/12.852268 · doi:10.1117/12.852268
- 10.1889/JSID17.11.963 · doi:10.1889/jsid17.11.963
- 2010, Iceland volcano ash hits European flights again, Agence France-Presse
- pentland, 2008, Honest Signals How They Shape Our World, 10.7551/mitpress/8022.001.0001 · DOI · Paper page
- bailenson, 2003, Mutual gaze and task performance in shared virtual environments, Personality Social Psychol Bull, 1
- zimmerman, 1989, Human Physiology, 166, 10.1007/978-3-642-73831-9_7 · DOI
- minsky, 1980, Telepresence, OMNI Mag, 44
- hoang, 0, Terabit Networks
- 10.1145/108844.108932 · DOI · Paper page
- du maurier, 1878, Edison's telephonoscope (transmits light as well as sound), Punch's Almanack
- 10.1002/vis.297 · DOI · Paper page
- 10.1109/MSP.2010.938753 · DOI · Paper page
- 10.4135/9781412986038 · DOI · Paper page
- 10.1145/1753326.1753482 · DOI · Paper page
- 10.1109/JPROC.2004.839608 · DOI
- 10.1109/83.334981 · DOI · Paper page
- 10.1109/5.664280 · DOI
Cited by
Toward immersive communications in 6G
Shen, X. (., Gao, J., Li, M., Zhou, C., Hu, S., He, M., & Zhuang, W. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1068478 · Cited by 124
Teo, T., Khazaie, S., & Derakhshan, A. (2022) · Computers & Education · doi:10.1016/j.compedu.2021.104406 · Cited by 97
User Quality of Experience of Mulsemedia Applications
Yuan, Z., Chen, S., Ghinea, G., & Muntean, G.-M. (2014) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/2661329 · Cited by 72
Punpeng, G., & Yodnane, P. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02485-1 · Cited by 15
“There is transparency, fl uidity of interaction, a sense of presence ’ (Apostolopoulos et al. 2012, 975).”
Metadata
- Authors
- Apostolopoulos, J. G., Chou, P. A., Culbertson, B., Kalker, T., Trott, M. D., & Wee, S.
- Venue
- Proceedings of the IEEE
- Published
- 2012-04
- Volume
- 100
- Issue
- 4
- Pages
- 974-990
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2139621587
- Cited by
- 124
- References
- 3
- FWCI
- 17.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.