Admux: An Adaptive Multiplexer for Haptic–Audio–Visual Data Communication
Abstract
Research trends in multimedia strive to incorporate multiple modalities, such as audio, video, graphics, and haptics, into multimedia applications to enhance the user's experience. Researchers have made significant progress in advanced multimedia by incorporating virtual reality environments, haptics, and scent into the human computer interaction paradigm. However, the communication of multimedia data over the Internet (particularly the haptic media) remains a real challenge since each media has varying and sometimes conflicting communication requirements. This paper proposes Admux, an adaptive application layer multiplexing framework (including a communication protocol) for multimedia applications incorporating haptic, visual, auditory, and scent data for nondedicated networks. Being an application layer framework, Admux is highly adaptable to the application requirements, the media type (haptic, audio, video, etc.), and the network conditions. To facilitate the application-Admux communication, we used haptic application metalanguage descriptions. Second, Admux enhances the network throughput by adopting statistical multiplexing. Finally, Admux enables media prioritization based on the application events and QoS requirements. By simulating an interpersonal teleconferencing system (named the HugMe system), our results showed that Admux provides dynamic bandwidth allocation based on the network conditions, media type, and application events.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These requirements are driven by adding new applications into vehicles such as high-resolution cameras (4K and 8K) and sensors with high data rate volume.
“These requirements are driven by adding new applications into vehicles such as high-resolution cameras (4K and 8K) and sensors with high data rate volume [17].”
From The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards (2019) · cites this paper as [17]
Cites
A Taxonomy of Mixed Reality Visual Displays
Milgram, P., & Kishino, F. (1994) · IEICE Transactions on Information and Systems · Cited by 4,614 · see citing works
Ten myths of multimodal interaction
Oviatt, S. L. (1999) · Communications of the ACM · doi:10.1145/319382.319398 · Cited by 693 · see citing works
An experimental study on the role of touch in shared virtual environments
Basdogan, C., Ho, C., Srinivasan, M., & Slater, M. (2000) · ACM Trans. Comput. Hum. Interact. · doi:10.1145/365058.365082 · Cited by 519 · see citing works
Effects of network characteristics on human performance in a collaborative virtual environment
Park, K.-S., & Kenyon, R. V. (2003) · IEEE Virtual Reality (VR) · doi:10.1109/vr.1999.756940 · Cited by 227 · see citing works
Transatlantic Touch: A Study of Haptic Collaboration over Long Distance
Kim, J., Kim, H. K., Tay, B.-O. K., Muniyandi, M., Srinivasan, M., Jordan, J., Mortensen, J., Oliveira, M., & Slater, M. (2004) · Presence - Teleoperators and Virtual Environments · doi:10.1162/1054746041422370 · Cited by 161 · see citing works
Wiley encyclopedia of telecommunications
(2003) · Choice Reviews Online · doi:10.5860/choice.41-0055 · Cited by 137 · see citing works
Wiley Encyclopedia of Telecommunications
(2003) · Wiley eBooks · doi:10.1002/0471219282 · Cited by 95 · see citing works
A comparison of different haptic compression techniques
Shahabi, C., Ortega, A., & Kolahdouzan, M. R. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2002.1035867 · Cited by 90 · see citing works
End-to-end transmission control mechanisms for multiparty interactive applications on the Internet
Gautier, L., Diot, C., & Kurose, J. (1999) · doi:10.1109/infcom.1999.752168 · Cited by 89 · see citing works
Case Study: Observing a Volume Rendered Fetus within a Pregnant Patient
State, A., Chen, D., Tector, C., et al. (1994) · Cited by 82 · see citing works
A guided tour in haptic audio visual environments and applications
Eid, M. A., Orozco, M., & Saddik, A. E. (2007) · International Journal of Advanced Media and Communication · doi:10.1504/ijamc.2007.013918 · Cited by 68 · see citing works
Self-citationA haptic multimedia handwriting learning system
Eid, M. A., Mansour, M., Saddik, A. E., et al. (2007) · doi:10.1145/1290144.1290161 · Cited by 67 · see citing works
Self-citationObserving a volume rendered fetus within a pregnant patient
State, A., Chen, D., Tector, C., et al. (2002) · doi:10.1109/visual.1994.346295 · Cited by 66 · see citing works
Gvili, R., Kaplan, A., Ofek, E., et al. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.474052 · Cited by 64 · see citing works
Perception-Based Compression of Haptic Data Streams Using Kalman Filters
Hinterseer, P., Steinbach, E. G., & Chaudhuri, S. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1661315 · Cited by 47 · see citing works
A Psychophysically Motivated Compression Approach for 3D Haptic Data
Hinterseer, P., & Steinbach, E. G. (2006) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2006.15 · Cited by 44 · see citing works
Multipoint multimedia teleconference system with adaptive synchronization
Liu, C., Xie, Y. J., Lee, M. J., et al. (1996) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.536489 · Cited by 41 · see citing works
RTP/I-toward a common application level protocol for distributed interactive media
Mauve, M., Hilt, V., Kuhmünch, C., et al. (2001) · IEEE Transactions on Multimedia · doi:10.1109/6046.909602 · Cited by 40 · see citing works
Providing QoS for Networked Peers in Distributed Haptic Virtual Environments
Marshall, A., Yap, K. M., & Yu, W. M. (2008) · Advances in Multimedia · doi:10.1155/2008/841590 · Cited by 36 · see citing works
Characterizing stability in evolving frameworks
Mattsson, M., & Bosch, J. (2003) · Technology of Object-Oriented Languages and Systems · doi:10.1109/tools.1999.779005 · Cited by 34 · see citing works
A Psychophysically Motivated Compression Approach for 3D Haptic Data
Hinterseer, P., & Steinbach, E. G. (2006) · Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems · doi:10.1109/haptic.2006.1627068 · Cited by 28 · see citing works
Supermedia Transport for Teleoperations over Overlay Networks
Cen, Z., Mutka, M. W., Zhu, D., et al. (2005) · Lecture notes in computer science · doi:10.1007/11422778_126 · Cited by 27 · see citing works
Robust perception-based data reduction and transmission in telehaptic systems
Sakr, N., Zhou, J., Georganas, N. D., Zhao, J., & Petriu, E. M. (2009) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2009.4810839 · Cited by 24 · see citing works
Assembly Simulation on Collaborative Haptic Virtual Environments
Iglesias, R., Prada, E. L., Uribe-Quevedo, Á., García‐Alonso, A., Casado, S., & Gutiérrez, T. (2007) · Digital Library (University of West Bohemia) · Cited by 24 · see citing works
Haptic Applications Meta-Language
El-far, F. R., Eid, M. A., Orozco, M., et al. (2006) · Proceedings · doi:10.1109/ds-rt.2006.20 · Cited by 22 · see citing works
Self-citationMeasuring the human side of virtual reality
Whalen, T., Noël, S., & Stewart, J. (2003) · doi:10.1109/vecims.2003.1227022 · Cited by 21 · see citing works
Collaborative stretcher carrying: a case study
Hubbold, R. J. (2002) · doi:10.5555/509709.509711 · Cited by 20 · see citing works
Prediction-based Haptic Data Reduction and Compression in Tele-Mentoring Systems
Sakr, N., Zhou, J., Georganas, N. D., Zhao, J., & Shen, X. (2008) · Conference proceedings - IEEE Instrumentation/Measurement Technology Conference · doi:10.1109/imtc.2008.4547342 · Cited by 18 · see citing works
Quality of service for networked virtual environments
Gračanin, D., Zhou, Y., & DaSilva, L. A. (2004) · IEEE Communications Magazine · doi:10.1109/mcom.2004.1284928 · Cited by 17 · see citing works
QoS management of supermedia enhanced teleoperation via overlay networks
Cen, Z., Mutka, M. W., Liu, Y., et al. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545296 · Cited by 16 · see citing works
Transparency analysis and delay compensation scheme for haptic-based networked virtual environments
Lee, S., & Kim, J. (2009) · Computer Communications · doi:10.1016/j.comcom.2008.12.028 · Cited by 16 · see citing works
A network-adaptive transport scheme for haptic-based collaborative virtual environments
Lee, S.-H., Moon, S., & Kim, J. (2006) · doi:10.1145/1230040.1230078 · Cited by 13 · see citing works
Simulation analysis of a communication link with statistically multiplexed bursty noise sources
Saleh, M. A., Habib, I., & Saadawi, T. (1993) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.219556 · Cited by 13 · see citing works
Transport layer protocols for haptic virtual environments
Dodeller, S. (2004) · uO Research (University of Ottawa) · doi:10.20381/ruor-9719 · Cited by 9 · see citing works
Multimodal interaction in multimedia applications
MacLaverty, R., & Defee, I. (2002) · doi:10.1109/mmsp.1997.602608 · Cited by 8 · see citing works
An adaptive multiplexer for multi-modal data communication
Eid, M. A., Cha, J., & Saddik, A. E. (2009) · IEEE International Workshop on Haptic Audio visual Environments and Games · doi:10.1109/have.2009.5356121 · Cited by 8 · see citing works
Self-citationAn Adaptive Buffer Control using Moving Average Smoothing Technique for Haptic Media Synchronization
Wongwirat, O., Ohara, S., & Chotikakamthorn, N. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571332 · Cited by 5 · see citing works
Video multicoder with neural network control
Zajeganović, M., Reljin, I. S., & Reljin, B. D. (2008) · Symposium on Neural Network Applications in Electrical Engineering · doi:10.1109/neurel.2008.4685609 · Cited by 3 · see citing works
Modified round-robin scheduler for Pareto traffic streams
Rejin, I. S., Stanojević, M., & Reljin, B. D. (2002) · doi:10.1109/telsks.2001.954842 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Toward Haptic Communications Over the 5G Tactile Internet
Antonakoglou, K., Xu, X., Steinbach, E., Mahmoodi, T., & Dohler, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2851452 · Cited by 260 · see citing works
The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards
Holland, O., Steinbach, E., Prasad, R. V., Liu, Q., Dawy, Z., Aijaz, A., Pappas, N., Chandra, K., Rao, V. S., Oteafy, S., et al. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2885541 · Cited by 200 · see citing works
“The QoS requirements and the capabilities of HIC systems vary considerably with the dynamics of the interaction with the remote participant [26], [27], [44].”
BackgroundSelf-citationHaptic Codecs for the Tactile Internet
Steinbach, E., Strese, M., Eid, M., Liu, X., Bhardwaj, A., Liu, Q., Al-Ja'Afreh, M., Mahmoodi, T., Hassen, R., El Saddik, A., et al. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2867835 · Cited by 168 · see citing works
Self-citation
- Authors
- Eid, M., Cha, J., & El Saddik, A.
- Affiliations
- University of Ottawa (CA)
- ORCID
- Eid, Mohamad
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2011-01
- Volume
- 60
- Issue
- 1
- Pages
- 21-31
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W1993901936
- Cited by
- 74
- References
- 39
- Citations by year
- 2025: 4 · 2024: 4 · 2023: 6 · 2022: 4 · 2021: 9 · 2020: 10 · 2019: 5 · 2018: 6 · 2017: 5 · 2016: 3 · 2015: 4 · 2014: 5 · 2013: 1 · 2012: 8
- FWCI
- 5.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Instrumentation and Measurement (publishedVersion)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Social Sciences › Sociology and Political Science › Multimedia Communication and Technology
- Keywords
- haptic communication, application layer protocols, statistical multiplexing, quality of service, bandwidth allocation, olfactory communication, virtual reality, network throughput
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review