DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Deep learning shows great promise in providing more intelligence to augmented reality (AR) devices, but few AR apps use deep learning due to lack of infrastructure support. Deep learning algorithms are computationally intensive, and front-end devices cannot deliver sufficient compute power for real-time processing. In this work, we design a framework that ties together front-end devices with more powerful backend “helpers” (e.g., home servers) to allow deep learning to be executed locally or remotely in the cloud/edge. We consider the complex interaction between model accuracy, video quality, battery constraints, network data usage, and network conditions to determine an optimal offloading strategy. Our contributions are: (1) extensive measurements to understand the tradeoffs between video quality, network conditions, battery consumption, processing delay, and model accuracy; (2) a measurement-driven mathematical framework that efficiently solves the resulting combinatorial optimization problem; (3) an Android application that performs real-time object detection for AR applications, with experimental results that demonstrate the superiority of our approach.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
(2016) · Cited by 31,590
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 2×
“[15] compares the speed and accuracy tradeoffs of various CNN models.”
BackgroundMethodMAUI: making smartphones last longer with code offload
Cuervo, E., Balasubramanian, A., Cho, D.-K., Wolman, A., Saroiu, S., Chandra, R., & Bahl, P. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814441 · Cited by 2,281 · cited 1×
“Mobile offloading: [22] developed a general framework for deciding when to offload, while [23], [24] specifically study interactive visual applications.”
BackgroundA Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
Yin, X., Jindal, A., Sekar, V., & Sinopoli, B. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787486 · Cited by 1,016
Research works printed but not linked: 5
- ran, 0, Deepdecision A mobile deep learning framework for edge video analytics (technical report)
- 2017, Tensorfiow android camera demo
- 2017, libstreaming
- 2017, Xiph org Video Test Media
- irving, 2016, Horus wearable helps the blind navigate remember faces and read books
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“DeepDecision [112] formulates the knob-tunning problem as a multiple-choice multiple-constraint knapsack program and solves it with an improved brute-force search method.”
MethodDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
Self-citationConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“In [172], the proposed distributed infrastructure DeepDecision ties together powerful edge nodes with less powerful end devices.”
BackgroundAll one needs to know about fog computing and related edge computing paradigms: A complete survey
Yousefpour, A., Fung, C., Nguyen, T., Kadiyala, K., Jalali, F., Niakanlahiji, A., Kong, J., & Jue, J. P. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.02.009 · Cited by 1,368
Edge Assisted Real-time Object Detection for Mobile Augmented Reality
Liu, L., Li, H., & Gruteser, M. (2019) · The 25th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3300061.3300116 · Cited by 552
“DeepDeci-sion [9] designs a framework to decide whether to offload the object detection task to the edge cloud or do local inference based on current network conditions.”
BackgroundA Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 272
Edge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 256
Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics
Li, Y., Padmanabhan, A., Zhao, P., Wang, Y., Xu, G. H., & Netravali, R. (2020) · Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication · doi:10.1145/3387514.3405874 · Cited by 269
Deep learning for edge computing applications: A State-of-the-Art survey
Wang, F., Zhang, M., Wang, X., Ma, X., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2982411 · Cited by 259
Baroroh, D. K., Chu, C.-H., & Wang, L. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.10.017 · Cited by 237
Joint Configuration Adaptation and Bandwidth Allocation for Edge-based Real-time Video Analytics
Wang, C., Zhang, S., Chen, Y., Qian, Z., Wu, J., & Xiao, M. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications · doi:10.1109/infocom41043.2020.9155524 · Cited by 226
Baccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 186
Edge Intelligence: Architectures, Challenges, and Applications
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 120
Elf: accelerate high-resolution mobile deep vision with content-aware parallel offloading
Zhang, W., He, Z., Liu, L., Jia, Z., Liu, Y., Gruteser, M., Raychaudhuri, D., & Zhang, Y. (2021) · Proceedings of the 27th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3447993.3448628 · Cited by 172
Hermes: an efficient federated learning framework for heterogeneous mobile clients
Li, A., Sun, J., Li, P., Pu, Y., Li, H., & Chen, Y. (2021) · Proceedings of the 27th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3447993.3483278 · Cited by 168
Salh, A., Audah, L., Shah, N. S. M., Alhammadi, A., Abdullah, Q., Kim, Y. H., Al-Gailani, S. A., Hamzah, S. A., Esmail, B. A. F., & Almohammedi, A. A. (2021) · IEEE Access · doi:10.1109/access.2021.3069707 · Cited by 181
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160
“Another work [44] proposed to adaptively upload compressed data or deploy compressed model locally to jointly execute, but they didn’t look into and modify the deep model itself.”
BackgroundYao, S., Li, J., Liu, D., Wang, T., Liu, S., Shao, H., & Abdelzaher, T. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430898 · Cited by 209
Green Edge AI: A Contemporary Survey
Mao, Y., Yu, X., Huang, K., Zhang, Y. A., & Zhang, J. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3437365 · Cited by 187
Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions
Jedari, B., Premsankar, G., Illahi, G. K., Francesco, M. D., Mehrabi, A., & Ylä-Jääski, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3035427 · Cited by 155
Li, A., Sun, J., Zeng, X., Zhang, M., Li, H., & Chen, Y. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3485929 · Cited by 139
A Survey on Mobile Edge Computing for Video Streaming: Opportunities and Challenges
Khan, M. A., Baccour, E., Chkirbene, Z., Erbad, A., Hamila, R., Hamdi, M., & Gabbouj, M. (2022) · IEEE Access · doi:10.1109/access.2022.3220694 · Cited by 163
Scaling Video Analytics on Constrained Edge NodesPreprint
Canel, C., Kim, T., Zhou, G., Li, C., Lim, H., Andersen, D. G., Kaminsky, M., & Dulloor, S. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13536 · Cited by 206
Xu, M., Fu, Z., Ma, X., Zhang, L., Li, Y., Qian, F., Wang, S., Li, K., Yang, J., & Liu, X. (2021) · ACM Internet Measurement Conference (IMC) · doi:10.1145/3487552.3487815 · Cited by 133
Badidi, E., Moumane, K., & Ghazi, F. E. (2023) · IEEE Access · doi:10.1109/access.2023.3300658 · Cited by 154
A survey on deploying mobile deep learning applications: A systemic and technical perspective
Wang, Y., Wang, J., Zhang, W., Zhan, Y., Guo, S., Zheng, Q., & Wang, X. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.06.001 · Cited by 110
Networking Systems of AI: On the Convergence of Computing and Communications
Song, L., Hu, X., Zhang, G., Spachos, P., Plataniotis, K. N., & Wu, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3172270 · Cited by 143
Resource Management in Mobile Edge Computing: A Comprehensive Survey
Zhang, X., & Debroy, S. (2023) · ACM Computing Surveys · doi:10.1145/3589639 · Cited by 137
Dai, X., Xiao, Z. Q., Jiang, H., Alazab, M., Lui, J. C. S., Min, G., Dustdar, S., & Liu, J. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3186641 · Cited by 123
Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques
Xu, R., Razavi, S., & Zheng, R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323091 · Cited by 134
A survey of mobility-aware Multi-access Edge Computing: Challenges, use cases and future directions
Singh, R., Sukapuram, R., & Chakraborty, S. (2022) · Ad Hoc Networks · doi:10.1016/j.adhoc.2022.103044 · Cited by 124
Zhao, K., Zhou, Z., Chen, X., Zhou, R., Zhang, X., Yu, S., & Wu, D. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3189186 · Cited by 116
Frugal following: power thrifty object detection and tracking for mobile augmented reality
Apicharttrisorn, K., Ran, X., Chen, J., Krishnamurthy, S. V., & Roy–Chowdhury, A. K. (2019) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3356250.3360044 · Cited by 125
Self-citationEdge Assisted Mobile Semantic Visual SLAM
Xu, J., Cao, H., Li, D., Huang, K., Qian, C., Shangguan, L., & Yang, Z. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications · doi:10.1109/infocom41043.2020.9155438 · Cited by 101
Deng, C., Fang, X., & Wang, X. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3151619 · Cited by 103
Resource-Constrained EXtended Reality Operated With Digital Twin in Industrial Internet of Things
Kamdjou, H. M., Baudry, D., Havard, V., & Ouchani, S. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3356508 · Cited by 109
Edge-assisted Online On-device Object Detection for Real-time Video Analytics
Hanyao, M., Jin, Y., Qian, Z., Zhang, S., & Lu, S. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488741 · Cited by 103
Adaptive Configuration Selection and Bandwidth Allocation for Edge-Based Video Analytics
Zhang, S., Wang, C., Jin, Y., Wu, J., Qian, Z., Xiao, M., & Lu, S. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2021.3106937 · Cited by 97
AutoML for Video Analytics with Edge Computing
Galanopoulos, A., Ayala‐Romero, J. A., Leith, D. J., & Iosifidis, G. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488704 · Cited by 90
Moving Deep Learning to the Edge
Véstias, M. P., Duarte, R. P., de Sousa, J. T., & Neto, H. C. (2020) · Algorithms · doi:10.3390/a13050125 · Cited by 73
Heimdall: mobile GPU coordination platform for augmented reality applications
Yi, J., & Lee, Y. (2020) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3372224.3419192 · Cited by 100
CASVA: Configuration-Adaptive Streaming for Live Video Analytics
Zhang, M., Wang, F., & Liu, J. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796875 · Cited by 86
EagleEye: wearable camera-based person identification in crowded urban spaces
Yi, J., Choi, S., & Lee, Y. (2020) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3372224.3380881 · Cited by 88
FastVA: Deep Learning Video Analytics Through Edge Processing and NPU in Mobile
Tan, T., & Cao, G. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155476 · Cited by 76
EdgeDuet: Tiling Small Object Detection for Edge Assisted Autonomous Mobile Vision
Yang, Z., Wang, X., Wu, J., Zhao, Y., Ma, Q., Miao, X., Zhang, L., & Zhou, Z. (2022) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2022.3223412 · Cited by 82
Cloud Versus Edge Deployment Strategies of Real-Time Face Recognition Inference
Koubaa, A., Ammar, A., Kanhouch, A., & AlHabashi, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3055835 · Cited by 69
Network-Aware Optimization of Distributed Learning for Fog Computing
Tu, Y., Ruan, Y., Wagle, S., Brinton, C. G., & Joe-Wong, C. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications · doi:10.1109/infocom41043.2020.9155372 · Cited by 68
CNNPC: End-Edge-Cloud Collaborative CNN Inference With Joint Model Partition and Compression
Yang, S., Zhang, Z., Zhao, C., Song, X., Guo, S., & Li, H. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3177782 · Cited by 73
Network-Aware Optimization of Distributed Learning for Fog Computing
Wang, S., Ruan, Y., Tu, Y., Wagle, S., Brinton, C. G., & Joe‐Wong, C. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2021.3075432 · Cited by 73
Joint Optimization With DNN Partitioning and Resource Allocation in Mobile Edge Computing
Dong, C., Hu, S., Chen, X., & Wen, W. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3116665 · Cited by 70
EdgeDuet: Tiling Small Object Detection for Edge Assisted Autonomous Mobile Vision
Wang, X., Yang, Z., Wu, J., Zhao, Y., & Zhou, Z. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488843 · Cited by 73
User Preference Based Energy-Aware Mobile AR System with Edge Computing
Wang, H., & Xie, J. L. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155517 · Cited by 61
Guo, H., Yao, S., Yang, Z., Zhou, Q., & Nahrstedt, K. (2021) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3458305.3463381 · Cited by 76
Nimbus: Towards Latency-Energy Efficient Task Offloading for AR Services
Cozzolino, V., Tonetto, L., Mohan, N., Ding, A. Y., & Ott, J. (2022) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2022.3146615 · Cited by 70
Tu, X., Mallik, A., Chen, D., Han, K., Altintas, O., Wang, H., & Xie, J. L. (2023) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3583740.3628442 · Cited by 74
Efficient Execution of Deep Neural Networks on Mobile Devices with NPU
Tan, T., & Cao, G. (2021) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3412382.3458272 · Cited by 69
Multi-user augmented reality with communication efficient and spatially consistent virtual objects
Ran, X., Slocum, C., Tsai, Y.-Z., Apicharttrisorn, K., Gorlatova, M. A., & Chen, J. (2020) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3386367.3431312 · Cited by 54
Self-citationEnergy-Efficient Task Offloading of Edge-Aided Maritime UAV Systems
Li, H., Wu, S., Jiao, J., Lin, X., Zhang, N., & Zhang, Q. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3205127 · Cited by 54
Towards cloud-edge collaborative online video analytics with fine-grained serverless pipelines
Zhang, M., Wang, F., Zhu, Y., Liu, J., & Wang, Z. (2021) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3458305.3463377 · Cited by 61
OnSlicing: online end-to-end network slicing with reinforcement learning
Liu, Q., Choi, N., & Han, T. (2021) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3485983.3494850 · Cited by 64
Approximate query service on autonomous IoT cameras
Xu, M., Zhang, X., Liu, Y., Huang, G., Liu, X., & Lin, F. X. (2020) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3386901.3388948 · Cited by 61
Directed Search: A New Operator in NSGA-II for Task Scheduling in IoT Based on Cloud-Fog Computing
Mousavi, S., Mood, S. E., Souri, A., & Javidi, M. M. (2023) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2022.3188926 · Cited by 51
“IoT has brought about dramatic changes in human life in many areas, including commerce, healthcare, machine vision [1], smart transportation, smart homes, etc [2].”
BackgroundShareAR: Communication-Efficient Multi-User Mobile Augmented Reality
Ran, X., Slocum, C., Gorlatova, M. A., & Chen, J. (2019) · ACM Workshop on Hot Topics in Networks (HotNets) · doi:10.1145/3365609.3365867 · Cited by 51
Self-citationLiu, S., Wang, T., Li, J., Sun, D., Srivastava, M. B., & Abdelzaher, T. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548033 · Cited by 59
Jellyfish: Timely Inference Serving for Dynamic Edge Networks
Nigade, V., Bauszat, P., Bal, H. E., & Wang, L. (2022) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss55097.2022.00032 · Cited by 65
Joint Optimization of Video-Based AI Inference Tasks in MEC-Assisted Augmented Reality Systems
Pan, G., Zhang, H., Xu, S., Zhang, S., & Chen, X. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3235773 · Cited by 50
Intelligent Edge-Cloud Framework for Water Quality Monitoring in Water Distribution System
Shahra, E. Q., Wu, W., Basurra, S. S., & Aneiba, A. (2024) · Water · doi:10.3390/w16020196 · Cited by 54
Artificial Intelligence (AI) and Machine Learning for Multimedia and Edge Information Processing
Seng, J. K. P., Ang, K. L.-M., Peter, E., & Mmonyi, A. C. (2022) · Electronics · doi:10.3390/electronics11142239 · Cited by 55
Continuous, Real-Time Object Detection on Mobile Devices without Offloading
Liu, M., Ding, X., & Du, W. (2020) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00085 · Cited by 63
RESPIRE: Reducing Spatial–Temporal Redundancy for Efficient Edge-Based Industrial Video Analytics
Dai, X., Yang, P., Zhang, X., Dai, Z., & Yu, L. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3162598 · Cited by 48
Edge-Assisted On-Device Model Update for Video Analytics in Adverse Environments
Kong, Y., Yang, P., & Cheng, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612585 · Cited by 53
SEAR: Scaling Experiences in Multi-user Augmented Reality
Zhang, W., Han, B., & Hui, P. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3150467 · Cited by 48
Deep Learning Video Analytics Through Edge Computing and Neural Processing Units on Mobile Devices
Tan, T., & Cao, G. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3105953 · Cited by 51
LEAF + AIO: Edge-Assisted Energy-Aware Object Detection for Mobile Augmented Reality
Wang, H., Kim, B., Xie, J. L., & Han, Z. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3179943 · Cited by 42
Delay-Optimal Distributed Edge Computing in Wireless Edge Networks
Gong, X. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155272 · Cited by 46
Low-Latency Edge Video Analytics for On-Road Perception of Autonomous Ground Vehicles
Lin, J., Yang, P., Zhang, N., Lyu, F., Chen, X., & Yu, L. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3181986 · Cited by 50
Baccarelli, E., Scarpiniti, M., Momenzadeh, A., & Ahrabi, S. S. (2021) · IEEE Access · doi:10.1109/access.2021.3058021 · Cited by 43
Deep Learning on Mobile Devices Through Neural Processing Units and Edge Computing
Tan, T., & Cao, G. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796929 · Cited by 51
FedSEA: A Semi-Asynchronous Federated Learning Framework for Extremely Heterogeneous Devices
Sun, J., Li, A., Duan, L., Alam, S., Deng, X., Guo, X., Wang, H., Gorlatova, M. A., Zhang, M., Li, H. H., et al. (2022) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3560905.3568538 · Cited by 60
EdgeVision: Towards Collaborative Video Analytics on Distributed Edges for Performance Maximization
Gao, G., Dong, Y., Wang, R., & Zhou, X. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3385678 · Cited by 42
Characterizing task completion latencies in multi-point multi-quality fog computing systems
Gorlatova, M. A., İnaltekin, H., & Chiang, M. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107526 · Cited by 39
Supremo: Cloud-Assisted Low-Latency Super-Resolution in Mobile Devices
Yi, J., Kim, S., Kim, J., & Choi, S. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3025300 · Cited by 47
Optimizing the Learning Performance in Mobile Augmented Reality Systems With CNN
He, Y., Ren, J., Yu, G., & Cai, Y. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2992329 · Cited by 42
Li, H., Zheng, P., Wang, T., Wang, J., & Liu, T. (2022) · Cluster Computing · doi:10.1007/s10586-022-03809-7 · Cited by 37
PArtNNer: Platform-Agnostic Adaptive Edge-Cloud DNN Partitioning for Minimizing End-to-End Latency
Ghosh, S. K., Raha, A., Raghunathan, V., & Raghunathan, A. (2023) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3630266 · Cited by 44
Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU
Tan, T., & Cao, G. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3379501 · Cited by 42
Edge Assisted Mobile Semantic Visual SLAM
Cao, H., Xu, J., Li, D., Shangguan, L., Liu, Y., & Yang, Z. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3201000 · Cited by 43
Towards Real-Time Inference Offloading With Distributed Edge Computing: The Framework and Algorithms
Chen, Q., Guo, S., Wang, K., Xu, W., Li, J., Cai, Z., Gao, H., & Zomaya, A. Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3335051 · Cited by 35
Huang, Y., Qiao, X., Tang, J., Ren, P., Liu, L., Pu, C., & Chen, J. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155379 · Cited by 37
Self-citationSLAM-share: visual simultaneous localization and mapping for real-time multi-user augmented reality
Dhakal, A., Ran, X., Wang, Y., Chen, J., & Ramakrishnan, K. K. (2022) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3555050.3569142 · Cited by 34
Self-citationScheduling Massive Camera Streams to Optimize Large-Scale Live Video Analytics
Rong, C., Wang, J. H., Liu, J., Wang, J., Li, F., & Huang, X. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2021.3125359 · Cited by 40
Ahn, J.-W., Lee, J., Niyato, D. T., & Park, H.-S. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3020982 · Cited by 32
Yuan, Z., Azzino, T., Yu, H., Lyu, Y., Pei, H., Boldini, A., Mezzavilla, M., Beheshti, M., Porfiri, M., Hudson, T. E., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3157876 · Cited by 38
OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things
Qian, B., Wen, Z., Tang, J., Yuan, Y., Zomaya, A. Y., & Ranjan, R. K. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3193630 · Cited by 36
Edge-Assisted Real-Time Video Analytics With Spatial–Temporal Redundancy Suppression
Wang, Z., He, X., Zhang, Z., Zhang, Y., Cao, Z. Z., Cheng, W., Wang, W., & Cui, Y. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3224750 · Cited by 34
An Empirical Study of 5G: Effect of Edge on Transport Protocol and Application Performance
Lim, H., Lee, J., Lee, J., Sathyanarayana, S. D., Kim, J., Nguyen, A. T., Kim, K. T., Im, Y., Chiang, M., Grunwald, D. C., et al. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3274708 · Cited by 32
Collaborative cloud-edge computation for personalized driving behavior modeling
Zhang, X., Qiao, M., Liu, L., Xu, Y., & Shi, W. (2019) · Proceedings of the 4th ACM/IEEE Symposium on Edge Computing · doi:10.1145/3318216.3363310 · Cited by 30
“[27] propose an edge cloud collaborative framework for video analysis, where a small model is implemented on the edge while a large model is implemented on the cloud.”
BackgroundA Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental LearningPreprint
Zhang, H., Shen, M., Huang, Y., Wen, Y., Luo, Y., Gao, G., & Guan, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03012 · Cited by 31
Metadata
- Authors
- Ran, X., Chen, H., Zhu, X., Liu, Z., & Chen, J.
- Affiliations
- University of California, Riverside (US)
- William & Mary (US)
- Venue
- IEEE INFOCOM 2018 - IEEE Conference on Computer Communications
- Publisher
- IEEE
- Published
- 2018-04
- Pages
- 1421-1429
- OpenAlex
- W2792220137
- Cited by
- 450
- References
- 22
- Citations by year
- 2026: 20 · 2025: 35 · 2024: 50 · 2023: 73 · 2022: 95 · 2021: 83 · 2020: 61 · 2019: 27 · 2018: 6
- FWCI
- 36.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Conference on Computer Communications (INFOCOM) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
- Keywords
- edge computing, video analysis, mobile deep learning, model offloading, augmented reality, real-time object detection, battery consumption, processing delay, model accuracy, combinatorial optimization, Android application, cloud-edge collaboration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.