ViVo: visibility-aware mobile volumetric video streaming
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
In this paper, we perform a first comprehensive study of mobile volumetric video streaming. Volumetric videos are truly 3D, allowing six degrees of freedom (6DoF) movement for their viewers during playback. Such flexibility enables numerous applications in entertainment, healthcare, education, etc. However, volumetric video streaming is extremely bandwidth-intensive. We conduct a detailed investigation of each of the following aspects for point cloud streaming (a popular volumetric data format): encoding, decoding, segmentation, viewport movement patterns, and viewport prediction. Motivated by the observations from the above study, we propose ViVo, which is to the best of our knowledge the first practical mobile volumetric video streaming system with three visibility-aware optimizations. ViVo judiciously determines the video content to fetch based on how, what and where a viewer perceives for reducing bandwidth consumption of volumetric video streaming. Our evaluations over real wireless networks (including commercial 5G), mobile devices and users indicate that ViVo can save on average 40% of data usage (up to 80%) with virtually no drop in visual quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“We plan to investigate whether ViVo can benefit from deep learning (DL) such as long short-term memory (LSTM) [34] for more accurate viewport prediction, which will in turn improve the efficiency of the three visibility-aware optimizations.”
BackgroundImage quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · cited 3×
“Table 5 shows the average visual quality of viewport content using SSIM [64], yielded by the three optimizations.”
MethodInfluentialOn the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560 · cited 1×
“The MLP employs L-BFGS (Limited-memory Broyden-Fletcher-Goldfarb-Shanno) [47] for optimization.”
MethodStructure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433 · cited 1×
“Structure-from-motion [60] is another widely used technology for 3D reconstruction, and has the potential for volumetric video capturing as well.”
BackgroundQSplat: a multiresolution point rendering system for large meshes
Rusinkiewicz, S., & Levoy, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344940 · Cited by 969
Emerging MPEG Standards for Point Cloud Compression
Schwarz, S., Preda, M., Baroncini, V., Budagavi, M., Cesar, P., Chou, P. A., Cohen, R. A., Krivokuca, M., Lasserre, S., Li, Z., et al. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2885981 · Cited by 769 · cited 1×
“This is because PtCl encoding, which is still under active development by MPEG [61], is less mature than that of traditional video encoding.”
BackgroundImproving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE
Jiang, J., Sekar, V., & Zhang, H. (2012) · Proceedings of the 8th international conference on Emerging networking experiments and technologies · doi:10.1145/2413176.2413189 · Cited by 688 · cited 1×
“Subsequently, ViVo executes a lightweight throughput-based rate adaptation algorithm [38] to assess if the PDLs chosen by the optimizations can be satisfied by the estimated network capacity.”
MethodHoloportation: Virtual 3D Teleportation in Real-time
Orts-Escolano, S., Rhemann, C., Fanello, S., Chang, W., Kowdle, A., Degtyarev, Y., Kim, D., Davidson, P. L., Khamis, S., Dou, M., et al. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984517 · Cited by 662
Proceedings, 1989 International Conference on Robotics and Automation
(1989) · doi:10.1109/robot.1989 · Cited by 531
Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video
Mekuria, R., Blom, K., & Cesar, P. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2543039 · Cited by 431 · cited 2×
“Most existing schemes leverage either octree-based compression [31, 36, 39, 51, 59] or 𝑘 -d tree based compression [25, 27, 37, 46] for PtCls.”
Background
Cited by
Will Metaverse Be NextG Internet? Vision, Hype, and Reality
Cheng, R., Wu, N., Chen, S., & Han, B. (2022) · IEEE Network · doi:10.1109/mnet.117.2200055 · Cited by 280
“On the one hand, compared to traditional 2D videos, the bandwidth for transmitting up to 16K 360-degree panorama [6] or 3D volumetric content [7] to XR headsets could be high.”
Self-citationNetLLM: adapting large language models for networking
Wu, D., Wang, X., Qiao, Y., Wang, Z., Jiang, J., Cui, S., & Wang, F. (2024) · Proceedings of the ACM SIGCOMM 2024 Conference · doi:10.1145/3651890.3672268 · Cited by 167
“…(VP) serves as a fundamental building block of the emerging streaming systems of immersive videos (e.g., 360 ◦ videos [33] and volumetric videos [37]), where only the video content within the viewer’s viewport (the region visible to viewer) is streamed in high quality to reduce the bandwidth…”
Background
Metadata
- Authors
- Han, B., Liu, Y., & Qian, F.
- Venue
- Proceedings of the 26th Annual International Conference on Mobile Computing and Networking
- Publisher
- ACM
- Published
- 2020-04-16
- Pages
- 1-13
- ISSN
- 1543-5679 (ISSN-L)
- OpenAlex
- W3021314748
- Cited by
- 183
- References
- 30
- FWCI
- 11.48
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.