The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Edge Assisted Real-time Object Detection for Mobile Augmented Reality
Abstract
Most existing Augmented Reality (AR) and Mixed Reality (MR) systems are able to understand the 3D geometry of the surroundings but lack the ability to detect and classify complex objects in the real world. Such capabilities can be enabled with deep Convolutional Neural Networks (CNN), but it remains difficult to execute large networks on mobile devices. Offloading object detection to the edge or cloud is also very challenging due to the stringent requirements on high detection accuracy and low end-to-end latency. The long latency of existing offloading techniques can significantly reduce the detection accuracy due to changes in the user's view. To address the problem, we design a system that enables high accuracy object detection for commodity AR/MR system running at 60fps. The system employs low latency offloading techniques, decouples the rendering pipeline from the offloading pipeline, and uses a fast object tracking method to maintain detection accuracy. The result shows that the system can improve the detection accuracy by 20.2%-34.8% for the object detection and human keypoint detection tasks, and only requires 2.24ms latency for object tracking on the AR device. Thus, the system leaves more time and computational resources to render virtual elements for the next frame and enables higher quality AR/MR experiences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the frame regions containing small objects need a higher resolution to guarantee object detection accuracy according to the conclusion in [19]”
From Orchestrating Joint Offloading and Scheduling for Low-Latency Edge SLAM (2025) · cites this paper as [19]
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×
“Huang et al. [29] compare the speed and accuracy trade-offs for modern CNN object detection models, including Faster R-CNN [30], R-FCN [31] and SSD [32].”
MethodFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812 · cited 1×
“Huang et al. [29] compare the speed and accuracy trade-offs for modern CNN object detection models, including Faster R-CNN [30], R-FCN [31] and SSD [32].”
Method(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 1×
“Huang et al. [29] compare the speed and accuracy trade-offs for modern CNN object detection models, including Faster R-CNN [30], R-FCN [31] and SSD [32].”
MethodMobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · cited 1×
“There have been extensive works on how to efficiently run these CNN models on mobile devices [35–42].”
BackgroundOverview of the H.264/AVC video coding standard
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815165 · Cited by 8,184 · cited 1×
“To reduce the bandwidth consumption and streaming latency t stream , the raw frames are compressed to H.264 video streams on the device and decoded in the edge cloud [10].”
MethodHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149 · cited 2×
“Huang et al. [29] compare the speed and accuracy trade-offs for modern CNN object detection models, including Faster R-CNN [30], R-FCN [31] and SSD [32].”
MethodSpeed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 1×
“Huang et al. [29] compare the speed and accuracy trade-offs for modern CNN object detection models, including Faster R-CNN [30], R-FCN [31] and SSD [32].”
MethodNeural Adaptive Video Streaming with Pensieve
Mao, H., Netravali, R., & Alizadeh, M. (2017) · Proceedings of the Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3098822.3098843 · Cited by 1,357 · cited 1×
“Other video adaptation techniques [56–59] are also complementary to our work.”
Result
Research works printed but not linked: 2
- Kaiming He , Georgia Gkioxari , Piotr Dollár , and Ross Girshick . Maskr-cnn. In Computer Vision (ICCV) , 2017 IEEE International Conferenceon , pages 2980 -- 2988 . IEEE, 2017 . Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Maskr-cnn. In Computer Vision (ICCV), 2017 IEEE International Conferenceon, pages 2980--2988. IEEE, 2017.
- 10.5555/3154630.3154661 · doi:10.5555/3154630.3154661
Cited by
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
“, as used in [33]), with Nvidia-provided SDKs used to program the devices.”
BackgroundMethodConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Interest (RoI) encoding [140] to focus on target objects in video frames can further reduce the bandwidth consumption and data transmission delay.”
BackgroundSiriwardhana, Y., Porambage, P., Liyanage, M., & Ylianttila, M. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3061981 · Cited by 674
“Multi-access Edge Computing (MEC) brings the computations closer to the end devices, minimizing the latency of cloud offloading and facilitating the latency-critical applications [42]–[45].”
BackgroundXu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
“However, resources on the edge networks are limited, while the customization and communication resources used for AR adaptation are enormous [97], [98], [99].”
BackgroundJoint Task Offloading and Resource Allocation for Energy-Constrained Mobile Edge Computing
Jiang, H., Dai, X., Xiao, Z., & Iyengar, A. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3150432 · Cited by 411
“Based on this, MEC drives the development of many emerging applications, such as augmented reality (AR), natural language processing and realtime video analytics [1].”
Background
Metadata
- Authors
- Liu, L., Li, H., & Gruteser, M.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Venue
- The 25th Annual International Conference on Mobile Computing and Networking
- Publisher
- ACM
- Published
- 2019-08-05
- Pages
- 1-16
- ISSN
- 1543-5679 (ISSN-L)
- OpenAlex
- W2965289829
- Cited by
- 552
- References
- 47
- Citations by year
- 2026: 33 · 2025: 72 · 2024: 93 · 2023: 92 · 2022: 119 · 2021: 70 · 2020: 62 · 2019: 11
- FWCI
- 21.35
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Annual International Conference on Mobile Computing and Networking (MobiCom) (publishedVersion)
- Funders
- National Science Foundation (1329939, 1827923)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- mobile augmented reality, mixed reality, real-time object detection, edge computing, computation offloading, low latency, object tracking, human keypoint detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Edge Assisted Real-time Object Detection for Mobile Augmented Reality. https://app.cochat.ai/papers/10.1145/3300061.3300116
- The paper
- Liu, L., Li, H., & Gruteser, M. (2019). Edge Assisted Real-time Object Detection for Mobile Augmented Reality. The 25th Annual International Conference on Mobile Computing and Networking. https://doi.org/10.1145/3300061.3300116
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.