IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Current wisdom to run computation-intensive deep neural network (DNN) on resource-constrained mobile devices is allowing the mobile clients to make DNN queries to central cloud servers, where the corresponding DNN models are pre-installed. Unfortunately, this centralized, cloud-based DNN offloading is not appropriate for emerging decentralized cloud infrastructures (e.g., cloudlet, edge/fog servers), where the client may send computation requests to any nearby server located at the edge of the network. To use such a generic edge server for DNN execution, the client should first upload its DNN model to the server, yet it can seriously delay query processing due to long uploading time. This paper proposes IONN (Incremental Offloading of Neural Network), a partitioning-based DNN offloading technique for edge computing. IONN divides a client's DNN model into a few partitions and uploads them to the edge server one by one. The server incrementally builds the DNN model as each DNN partition arrives, allowing the client to start offloading partial DNN execution even before the entire DNN model is uploaded. To decide the best DNN partitions and the uploading order, IONN uses a novel graph-based algorithm. Our experiments show that IONN significantly improves query performance in realistic hardware configurations and network conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compared to the approach that uploads the entire model, IONN significantly improves query performance and energy consumption during DNN model uploading.”
From Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing (2019) · cites this paper as [82]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157 · cited 1×
“For example, SENet [17], one of the winners of ILSVRC 2017, consists of more than 900 layers and has a model size of ∼ 440 MB.”
Background(2017) · Cited by 11,625
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“In recent years, Deep Neural Network (DNN) has shown remarkable achievements in the field of computer vision [22], natural language processing [35], speech recognition [11] and artificial intelligence [34].”
BackgroundFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
The case for vm-based cloudlets in mobile computing
Satyanarayanan, M., Bahl, P., Caceres, R., & Davies, N. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.82 · Cited by 3,660
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
The emergence of edge computing
Satyanarayanan, M. (2017) · Computer · doi:10.1109/mc.2017.9 · Cited by 2,832 · cited 3×
“Also, it is known that the multi-hop transmission to distant cloud datacenters causes high jitters, which may hurt the real-time user experience [32].”
BackgroundPervasive computing: vision and challenges
Satyanarayanan, M. (2001) · IEEE Personal Communications · doi:10.1109/98.943998 · Cited by 2,419
MAUI: making smartphones last longer with code offload
Cuervo, E., Balasubramanian, A., Cho, D.-K., Wolman, A., Saroiu, S., Chandra, R., & Bahl, P. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814441 · Cited by 2,281 · cited 1×
“MAUI [6] partitions the application execution using static program analysis as well as dynamic profiling, which is a method used by other researchers [21] [5].”
MethodProceedings of the 13th International Conference on Neural Information Processing Systems
Leen, T. K., Dietterich, T. G., & Tresp, V. (2000) · Cited by 2,190
(2011) · doi:10.1145/1966445.1966473 · Cited by 1,870
ThinkAir: Dynamic resource allocation and parallel execution in the cloud for mobile code offloading
Kosta, S., Aucinas, A., Hui, P., Mortier, R., & Zhang, X. (2012) · 2012 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2012.6195845 · Cited by 1,186
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.00567 · Cited by 741
EESEN: End-to-end speech recognition using deep RNN models and WFST-based decoding
Miao, Y., Gowayyed, M., & Metze, F. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404790 · Cited by 707
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
Reclik, T. M. (2024) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.13270696 · Cited by 594
Regressing Robust and Discriminative 3D Morphable Models with a Very Deep Neural Network
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.163 · Cited by 503
Towards wearable cognitive assistance
Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594383 · Cited by 476
Han, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
End-to-End 3D Face Reconstruction with Deep Neural Networks
Dou, P., Shah, S. K., & Kakadiaris, I. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.164 · Cited by 254
Live Service Migration in Mobile Edge Clouds
Machen, A., Wang, S., Leung, K. K., Ko, B. J., & Salonidis, T. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1700011 · Cited by 250
Containers and Clusters for Edge Cloud Architectures -- A Technology Review
Pahl, C., & Lee, B. (2015) · 2015 3rd International Conference on Future Internet of Things and Cloud · doi:10.1109/ficloud.2015.35 · Cited by 246
Multi-User Computation Partitioning for Latency Sensitive Mobile Cloud Applications
Yang, L., Cao, J., Cheng, H., & Ji, Y. (2015) · IEEE Transactions on Computers · doi:10.1109/tc.2014.2366735 · Cited by 244
EESEN: End-to-End Speech Recognition using Deep RNN Models and WFST-based DecodingPreprint
Miao, Y., Gowayyed, M., & Metze, F. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08240 · Cited by 164
Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural NetworkPreprint
Tran, A. T., Hassner, T., Masi, I., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04904 · Cited by 12
Research works printed but not linked: 9
- Aho Alfred V, 1986, Compilers, Principles, Techniques. Addison Wesley, 7, 9
- Alchemy, 2009, Retrieved
- Goodrich Michael T., 1996, Retrieved
- 2008, Retrieved
- Graves Alex, 2013, Acoustics, speech and signal processing (icassp)
- NVIDIA., 2008, Retrieved
- Packard Hewlett, 2013, Retrieved
- Roy Rob, 2017, Retrieved
- Sutskever Ilya, Proceedings of the 27th International Conference on Neural Information Processing Systems -, 2
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“IONN [82] propose an incremental offloading technique for EI application.”
MethodInfluentialConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“offloading system IONN is proposed in [175].”
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“In [26], instead of uploading the entire model to the cloud, the layers are incrementally uploaded for collaborative inference, which significantly improves the energy cost and performance.”
MethodShakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
Metadata
- Authors
- Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M.
- Affiliations
- Seoul National University (KR)
- Venue
- Proceedings of the ACM Symposium on Cloud Computing
- Publisher
- ACM
- Published
- 2018-10-11
- Pages
- 401-411
- OpenAlex
- W2892952080
- Cited by
- 143
- References
- 33
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 9 · 2023: 35 · 2022: 25 · 2021: 22 · 2020: 22 · 2019: 8
- FWCI
- 10.74
- Type
- conference paper
- Language
- fr
- Open access
- closed
- Locations
- ACM Symposium on Cloud Computing (SoCC) (publishedVersion)
- Funders
- National Research Foundation of Korea (NRF-2017R1A2B2005562)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Keywords
- edge computing, model partitioning, mobile devices, fog computing, cloudlets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.