DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Deep learning shows great promise in providing more intelligence to augmented reality (AR) devices, but few AR apps use deep learning due to lack of infrastructure support. Deep learning algorithms are computationally intensive, and front-end devices cannot deliver sufficient compute power for real-time processing. In this work, we design a framework that ties together front-end devices with more powerful backend “helpers” (e.g., home servers) to allow deep learning to be executed locally or remotely in the cloud/edge. We consider the complex interaction between model accuracy, video quality, battery constraints, network data usage, and network conditions to determine an optimal offloading strategy. Our contributions are: (1) extensive measurements to understand the tradeoffs between video quality, network conditions, battery consumption, processing delay, and model accuracy; (2) a measurement-driven mathematical framework that efficiently solves the resulting combinatorial optimization problem; (3) an Android application that performs real-time object detection for AR applications, with experimental results that demonstrate the superiority of our approach.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
(2016) · Cited by 31,590
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 2×
“[15] compares the speed and accuracy tradeoffs of various CNN models.”
BackgroundMethodMAUI: making smartphones last longer with code offload
Cuervo, E., Balasubramanian, A., Cho, D.-K., Wolman, A., Saroiu, S., Chandra, R., & Bahl, P. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814441 · Cited by 2,281 · cited 1×
“Mobile offloading: [22] developed a general framework for deciding when to offload, while [23], [24] specifically study interactive visual applications.”
BackgroundA Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
Yin, X., Jindal, A., Sekar, V., & Sinopoli, B. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787486 · Cited by 1,016
Research works printed but not linked: 5
- ran, 0, Deepdecision A mobile deep learning framework for edge video analytics (technical report)
- 2017, Tensorfiow android camera demo
- 2017, libstreaming
- 2017, Xiph org Video Test Media
- irving, 2016, Horus wearable helps the blind navigate remember faces and read books
Cited by
Items 401–455 of 455
Clique: Spatiotemporal Object Re-identification at the City ScalePreprint
Xu, T., Shen, K., Fu, Y. L., Shi, H., & Lin, F. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09329 · Cited by 1
Multimedia Edge ComputingPreprint
Wang, Z., Zhu, W., Sun, L., Hu, H., Ma, G., Ma, M., Pang, H., Ye, J., & Li, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.02409
DVQShare: An Analytics System for DNN-based Video Queries
Fu, H., Tang, S., Yu, C., Li, Y., Sun, J., & Liu, Y. (2021) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid51090.2021.00026 · Cited by 2
Designing a construction safety system using artificial intelligence
Wang, Z. (2021) · International Conference on Mechatronics · doi:10.23977/icmit2021.017
Dupopt: A Redundancy Video Analysis Mechanism
Li, W., Zhao, Y., & Li, C. (2021) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc54389.2021.9674459
Energy-aware Preprocessing for Distributed Training in D2D Edge Network with Non-iid Data
Wu, J., Wu, J., Chen, L., & Sun, Y. (2021) · International Symposium on Parallel Architectures, Algorithms and Programming · doi:10.1109/paap54281.2021.9720440
Dong, L., Cai, X., & Yang, Z. (2021) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads53394.2021.00070
LinkStream: A Liquidity Modeling System on Large-Scale Video Stream in Oilfield
Yuan, H., Ma, Q., Hu, Z., Li, X., Wang, X., & Yang, Z. (2021) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads53394.2021.00103
Zhang, H. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/160371 · Cited by 1
Bayesian Online Learning for Sensory Data Analysis in Internet of Vehicles
Hu, S., Cai, X., Zhang, Y., Tian, M., & Fan, Y. (2022) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc55456.2022.9880820
Gao, X., & Xu, Y. (2022) · International Conference on Intelligent Mechanical and Human-Computer Interaction Technology (IHCIT) · doi:10.1117/12.2655514
Adaptive Acceleration of Inference Services at the Network Edge
Mofjeld, C., Peng, Y., & Qin, H. (2022) · IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud) · doi:10.1109/mobilecloud55333.2022.00009 · Cited by 1
Toward cooperative multi-agent video streaming perception
杨, 铮., 董, 亮., & 蔡, 新. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2021-0179
Efficient and Scalable Object Localization in 3D on Mobile Device
Gupta, N., & Khan, N. (2023) · doi:10.32920/22734395.v1
Efficient Context-Aware Edge Computing Algorithm in Mobile Cloud
Chang, J., Yang, M., Gong, Y., Liu, J., Tian, Y., & Li, Q. (2022) · International Conference on Computer Science and Management Technology (ICCSMT) · doi:10.1109/iccsmt58129.2022.00060
Joint Dataset Reconstruction and Power Control for Distributed Training in D2D Edge Network
Wu, J., Wu, J., Chen, L., Sun, Y., & Wu, Y. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3288738
A 3D Implementation of Convolutional Neural Network for Fast Inference
Miniskar, N. R., Vanna-Iampikul, P., Young, A. R., Lim, S. K., Liu, F., Yoo, J., Mills, C., Tran, N. V., Fahim, F., & Vetter, J. S. (2023) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas46773.2023.10181622
Latency-Critical Inference Serving for Deep Learning
Nigade, V. (2023) · doi:10.5463/thesis.308
Zheng, P., Du, W., Zhou, P., Peng, C., Kang, Z., Kong, D., Cheng, S., & Wang, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4706046
Arabic Sentiment Analysis with Federated Deep Learning
Al-refai, M., Alzu’bi, A., Yaseen, N. B., & Obeidat, T. (2024) · Advances in intelligent systems and computing · doi:10.1007/978-3-031-47508-5_3
HeteroPush: Communication-Efficient Video Analytics by Scheduling Heterogeneous Filters
Zhang, Y.-N., Zhang, L., Yuan, M., & Song, Q. (2023) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom61073.2023.00035 · Cited by 1
A Liquidity Analysis System for Large-scale Video Streams in the Oilfield
Ma, Q., Yuan, H., Hu, Z., Wang, X., & Yang, Z. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3649222
Adaptive Overlap Padding and Resolution Selection for Frame Split-based Edge Video Analytics
Zhu, H., Huang, Z., Guo, X., Liu, M., Chen, B., & Dong, F. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00326
Recent Advancements of Public Edge Platforms
Ma, X., Xu, M., Li, Q., Li, Y., Zhou, A., & Wang, S. (2024) · Springer eBooks · doi:10.1007/978-981-97-0213-8_2
Routing Edge-Cloud Requests via Multi-Objective Reinforcement Learning
Pichot, S., Conan, V., Khalifé, H., Beylot, A., & Jakllari, G. (2024) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc61514.2024.10592386
Optimized Deep Learning Classification Model for Intelligent Edge devices
Naveen, S., & Kounte, M. R. (2024) · Journal of Engineering Science and Technology Review · doi:10.25103/jestr.173.11 · Cited by 1
Xu, J., Yang, Z., Liu, Y., & Cao, H. (2024) · Springer eBooks · doi:10.1007/978-981-97-3573-0_8
Environment Understanding with EdgeSLAM
Xu, J., Yang, Z., Liu, Y., & Cao, H. (2024) · Springer eBooks · doi:10.1007/978-981-97-3573-0_7
EdgeSLAM 1.0: Architectural Innovations in Mobile Visual SLAM
Xu, J., Yang, Z., Liu, Y., & Cao, H. (2024) · Springer eBooks · doi:10.1007/978-981-97-3573-0_3
Poster: Adapting XR Perception Serving for Edge Server Scalability
Heo, J., & Gavrilovska, A. (2024) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec62691.2024.00064
SmartTBD: Smart Tracking for Resource-constrained Object Detection
Zhou, S., Hernandez, A. C., Gómez, C., Yin, W., & Björkman, M. (2025) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3703912 · Cited by 1
Adapt3D: Lightweight and Adaptive 3D Detection Framework for Mobile GPUs
Wang, P., Bagchi, S., Li, Y., & Chaterji, S. (2025) · International Conference on Communication Systems & Networks (COMSNETS) · doi:10.1109/comsnets63942.2025.10885676
Open Software Stack for Compression-Aware Adaptive Edge Offloading
Žádník, J., Bijl, R., Solanti, J., Joensuu, E., Makitalo, M. J., & Jääskeläinen, P. (2025) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc61545.2025.10978312
Laqista: Serverless Cloud-Fog-Dew Computing Platform for Deep Learning Applications
Makino, S., Okoshi, T., & Nakazawa, J. (2025) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp65954.2025.00055
Djupinlärningsbaserad schemaläggare för effektiv objektdetektering i en distribuerad arkitektur
Patkhullaev, D. (2023) · DiVA (Digitala Vetenskapliga Arkivet)
Edge computing techniques for classification based multi-task incremental learning
Dube, S. (2023) · Nottingham ePrints (University of Nottingham)
FCAC: Content-Aware Adaptive Configuration with Scene-Target Fusion in Edge Video Analytics
Li, Y., Yao, R., Cao, Z., & Shen, J. (2025) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads67057.2025.11322932
DEOF: Discerning and Elastic Offloading for Accuracy-Efficient Video Analytics
Pan, H., Chen, N., Wang, X., Xing, Y., Zhang, S., & Wu, J. (2025) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads67057.2025.11323028
Edge-Cloud Switched Low-Carbon Image Segmentation for Autonomous Vehicles
Zhou, S., Le, D. V., & Tan, R. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3655107
Edge-Assisted Real-Time Motion Capture System
Qian, C., Li, D., Xu, J., Yang, Z., & Ma, Q. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3656822
Li, Z., & Abdullah, S. N. H. S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6318568
Intelligent Computing Oriented Joint Model Deployment and Task Offloading in MEC Systems
Zheng, Y., Zhang, T., Wang, Z., Liu, Y., & Huang, R. (2026) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2026.3679675
Kim, R., Yoo, H., Kim, S., & Kim, Y. (2026) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2026.3686316
End-Edge-Cloud Orchestration for Video Analytics
Bai, T. (2025) · Textbooks in telecommunication engineering · doi:10.1007/978-3-032-14764-6_6
Online Outcome-Driven Configuration Selection With Adaptive Grouping for Live Video Streams
Dai, X., Zhang, L., Han, Z., Liu, X., Yang, P., & Lui, J. C. S. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3690872
Espinoza, R. S., Ramos, E. O., & Quispe, A. H. (2026) · C&T Riqchary Revista de investigación en ciencia y tecnología · doi:10.57166/riqchary/v8.n1.2026.4
Tackling the Imbalance in Video Analytics Pipelines with Hierarchical Embodied Intelligence
Zhou, W., Xie, L., Ning, J., Cao, S., Wu, H. W., Peng, Q., & Fan, L. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571610
DualEngine: A Thermal-Aware Vision Inference Framework via Mobile and Cloud Co-Execution
Choi, P., Kim, J., Kim, S., & Kwak, J. (2026) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/secon68281.2026.11579018
TOVAC: A Two-Timescale Framework for QoS-Aware Video Analytics With Hierarchical Edge Computing
Zhao, K., Ouyang, T., Liao, Z., Zhou, Z., & Chen, X. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3719192
Deep Learning Architectures for Advanced Video Understanding
Gayratovich, E. N., Ruslan, X., Ashirova, A. I., & Urozboev, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0965-9.ch003
Adaptive Edge-Cloud Offloading Strategies for Latency-Sensitive Intelligent Applications
Chidambaram, P., Natarajan, S., & Sivakumar, R. (2023) · Journal of Intelligent Systems and Future Computing · doi:10.5281/zenodo.22843880
Generative AI Driven Real-Time Open-Set Object Detection for Mobile AR Applications
Tan, J., Gao, Z., Yan, Y., & Zhang, Z. (2026) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml71097.2026.11686998
Low-Latency Foundation Models in Multi-Cloud Environments Using Neural Network
Bhasin, S., Venugopal, S., Khanna, D., & Sanikal, V. (2026) · Technology and Innovation Conference (TIC) · doi:10.1109/tic68483.2026.11702837
UniOVA: Universal On-demand Video Analytics with Edge-Cloud Collaborative Multimodal LLM
Xiao, K., Gao, Y., & Dong, W. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831640
Metadata
- Authors
- Ran, X., Chen, H., Zhu, X., Liu, Z., & Chen, J.
- Affiliations
- University of California, Riverside (US)
- William & Mary (US)
- Venue
- IEEE INFOCOM 2018 - IEEE Conference on Computer Communications
- Publisher
- IEEE
- Published
- 2018-04
- Pages
- 1421-1429
- OpenAlex
- W2792220137
- Cited by
- 450
- References
- 22
- Citations by year
- 2026: 20 · 2025: 35 · 2024: 50 · 2023: 73 · 2022: 95 · 2021: 83 · 2020: 61 · 2019: 27 · 2018: 6
- FWCI
- 36.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Conference on Computer Communications (INFOCOM) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
- Keywords
- edge computing, video analysis, mobile deep learning, model offloading, augmented reality, real-time object detection, battery consumption, processing delay, model accuracy, combinatorial optimization, Android application, cloud-edge collaboration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.