IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Current wisdom to run computation-intensive deep neural network (DNN) on resource-constrained mobile devices is allowing the mobile clients to make DNN queries to central cloud servers, where the corresponding DNN models are pre-installed. Unfortunately, this centralized, cloud-based DNN offloading is not appropriate for emerging decentralized cloud infrastructures (e.g., cloudlet, edge/fog servers), where the client may send computation requests to any nearby server located at the edge of the network. To use such a generic edge server for DNN execution, the client should first upload its DNN model to the server, yet it can seriously delay query processing due to long uploading time. This paper proposes IONN (Incremental Offloading of Neural Network), a partitioning-based DNN offloading technique for edge computing. IONN divides a client's DNN model into a few partitions and uploads them to the edge server one by one. The server incrementally builds the DNN model as each DNN partition arrives, allowing the client to start offloading partial DNN execution even before the entire DNN model is uploaded. To decide the best DNN partitions and the uploading order, IONN uses a novel graph-based algorithm. Our experiments show that IONN significantly improves query performance in realistic hardware configurations and network conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compared to the approach that uploads the entire model, IONN significantly improves query performance and energy consumption during DNN model uploading.”
From Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing (2019) · cites this paper as [82]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157 · cited 1×
“For example, SENet [17], one of the winners of ILSVRC 2017, consists of more than 900 layers and has a model size of ∼ 440 MB.”
Background(2017) · Cited by 11,625
Research works printed but not linked: 9
- Aho Alfred V, 1986, Compilers, Principles, Techniques. Addison Wesley, 7, 9
- Alchemy, 2009, Retrieved
- Goodrich Michael T., 1996, Retrieved
- 2008, Retrieved
- Graves Alex, 2013, Acoustics, speech and signal processing (icassp)
- NVIDIA., 2008, Retrieved
- Packard Hewlett, 2013, Retrieved
- Roy Rob, 2017, Retrieved
- Sutskever Ilya, Proceedings of the 27th International Conference on Neural Information Processing Systems -, 2
Cited by
Items 101–147 of 147
CoActo: CoActive Neural Network Inference Offloading with Fine-grained and Concurrent Execution
Bin, K., Park, J.-K., Park, C., Kim, S., & Lee, K. (2024) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3643832.3661885 · Cited by 13
Tian, J., Li, X., & Qin, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651115 · Cited by 6
DENNI: Distributed Neural Network Inference on Severely Resource Constrained Edge Devices
Sahu, R., Toepfer, R., Sinclair, M. D., & Duwe, H. (2021) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc51483.2021.9679448 · Cited by 8
Embedded Distributed Inference of Deep Neural Networks: A Systematic Review
Peccia, F. N., & Bringmann, O. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.03360 · Cited by 7
Identity-Aware Attribute Recognition via Real-Time Distributed Inference in Mobile Edge Clouds
Xu, Z., Wu, J., Xia, Q., Zhou, P., Ren, J., & Liang, H. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414048 · Cited by 6
runData: Re-distributing Data via Piggybacking for Geo-distributed Data Analytics over Edges
Jin, Y., Qian, Z., Guo, S., Zhang, S., Jiao, L., & Lu, S. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3086274 · Cited by 9
Moby: Empowering 2D Models for Efficient Point Cloud Analytics on the Edge
Li, J., Cai, Y. H., Liu, L., Mao, Y. P., Xue, C. J., & Xu, H. L. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612158 · Cited by 7
Intelligence Inference on IoT Devices
Zhang, Q., Li, Y., Zhang, D., Murturi, I., Pujol, V. C., Dustdar, S., & Wang, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-50514-0_9 · Cited by 7
Review of Collaborative Inference in Edge Intelligence: Emphasis on DNN Partition
Liu, N., Dai, F., Chai, X., Liu, G., Wu, X., & Huang, B. (2024) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/cyberscitech64112.2024.00014 · Cited by 5
Edge Computing for Artificial Intelligence
Wang, X., Han, Y., Leung, V. C. M., Niyato, D. T., Yan, X., & Chen, X. (2020) · Springer eBooks · doi:10.1007/978-981-15-6186-3_7 · Cited by 5
Automated Deep Learning Model Partitioning for Heterogeneous Edge Devices
Mukherjee, A., & Dey, S. (2022) · International Conference on AI-ML Systems (AIMLSystems) · doi:10.1145/3564121.3564796 · Cited by 5
Partitioning multi-layer edge network for neural network collaborative computing
Li, Q., Zhou, M., Ren, T.-F., Jiang, C.-B., & Chen, Y. (2023) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-023-02284-x · Cited by 5
Adaptive Offloading of Transformer Inference for Weak Edge Devices with Masked Autoencoders
Liu, T., Li, P., Gu, Y., Liu, P., & Wang, H. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3639824 · Cited by 4
Rawlley, O., Gupta, S. R., Mahajan, K., Shrivastava, A., & Jain, E. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107817 · Cited by 5
Toward Building Edge Learning Pipelines
Gounaris, A., Michailidou, A.-V., & Dustdar, S. (2023) · IEEE Internet Computing · doi:10.1109/mic.2022.3171643 · Cited by 5
Energy-Aware Satellite-Ground Co-Inference via Layer-Wise Processing Schedule Optimization
Chen, Y., Zhang, Q., Xing, R., Li, Y., Ma, X., Yu, C., Zhang, Y., Zhou, A., & Wang, S. (2024) · Asia-Pacific Symposium on Internetware · doi:10.1145/3671016.3674811 · Cited by 7
MistNet: A superior edge-cloud privacy-preserving training framework with one-shot communication
Guo, W., Cui, J., Li, X., Qu, L., Li, H., Hu, A., & Cai, T. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100975 · Cited by 4
Ju, B., Liu, Y., Liu, J., Sun, P., & Song, L. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111374 · Cited by 3
A Novel Adaptive Computation Offloading Strategy for Collaborative DNN Inference over Edge Devices
Zhang, Y., Liu, X., Jia, X., Yuan, D., & Li, X. (2022) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom57177.2022.00055 · Cited by 4
FLAME: A Self-Adaptive Auto-labeling System for Heterogeneous Mobile ProcessorsPreprint
Liu, J., Liu, J., Xie, Z., & Li, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01762 · Cited by 7
Edge-PRUNE: A Dataflow-Based Framework for Distributed Signal Processing and Machine Learning
Boutellier, J. J., Tan, B., Nurmi, J., & Bhattacharyya, S. S. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3598453 · Cited by 2
Cotter, J., Castiñeiras, I., O’Shea, D., & Cionca, V. (2023) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc56721.2023.10293778 · Cited by 2
Enabling Lightweight Split Inference for Real-Time Detection in Embedded Traffic Cameras
Duc, M. V., Truong, T. D., Cao, A. T. M., Nguyen, A. T., Vu, H., & Thanh, N. H. (2025) · Asian Internet Engineering Conference · doi:10.1145/3763400.3763445 · Cited by 1
Yang, Z., Ji, W., Guo, Q., Zhao, J., Zhao, C., Zhang, X., Zhang, Y., Li, Z., & You, Y. (2026) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3803806 · Cited by 23
Li, P., Wang, Q., Li, J., Wang, W., & Zou, S. (2026) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2026.104492 · Cited by 1
A Cascade Collaborative Offloading Framework for Video Analytics Based on Online Learning
li, Y., luo, B., Zhang, Y., Sun, Z., & Liu, Y. (2020) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings-greencom-cpscom-smartdata-cybermatics50389.2020.00138 · Cited by 1
Primitives Enhancing GPU Runtime Support for Improved DNN Performance
Dhakal, A., Kulkarni, S. G., & Ramakrishnan, K. K. (2021) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud53861.2021.00018 · Cited by 1
Hybrid Partitioning for Embedded and Distributed CNNs Inference on Edge Devices
Kaboubi, N., Letondeur, L., Coupaye, T., Desprez, F., & Trystram, D. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-28180-8_12 · Cited by 1
AdapCP: Collaborative Inference with Adaptive CNN Partition on Distributed Edge Servers
Zhao, S., Yao, D., Wan, Y., Wu, G., & Jin, H. (2025) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3765961 · Cited by 2
Lightweight Offloading System For Edge Cloud Environments
정혁진 (2020) · Seoul National University Open Repository (Seoul National University)
Dynamic Edge Computation Offloading and Scheduling for Model Task in Energy Capture Network
Tian, X., Chen, J., Zhao, Z., & Meng, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85928-2_34
DeepSlicing: Collaborative and Adaptive CNN Inference With Low Latency
Zhang, S., Chen, Y., Zhang, S., & Chen, Z. (2023) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-0230-9.ch006
Accelerating point cloud analytics on resource-constrained edge devices
Li, J., Cai, Y. H., Liu, L., Mao, Y. P., Xue, C. J., & Xu, H. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111382
DNN Tasks Offloading and Bandwidth Optimization for Satellite-Terrestrial Collaborative Intelligence
Lei, H., Qu, Y., Zhang, L., Zhao, L., Yu, L. J., Cheng, J., Li, G., & Wu, Q. (2024) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn63567.2024.00061
Sun, J., Hao, H., Shi, H., Su, Z., & Zhang, W. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9961-2_33
OSLCNN: On-Demand Scheduling for Large-Scale CNN Inference Acceleration on Heterogeneous DevicesPreprint
Yang, L., zhong, D., Liu, S., Zheng, C., Li, R., & 程, 鑫. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5859191
DNN offloading and resource management over edge computing systems
Orfeas, F. (2024) · DSpace - NTUA (National Technical University of Athens) · doi:10.26240/heal.ntua.26977
Lee, J., Shin, Y.-J., & Kang, S. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343299
Hybrid Partitioning System for Embedded and Distributed CNNs Inference on Edge Devices.
Kaboubi, N. (2023) · theses.fr (ABES) · doi:10.70675/b1e891ddz8b9cz4c57zb475z9bf0adff96d4
Distributed computing at the smart device edge
Feltin, T. (2023) · theses.fr (ABES) · doi:10.70675/2f7e1eb6zdb29z4aa3zb2d2za399e1df734b · Cited by 1
End-Edge-Cloud Orchestration for Video Analytics
Bai, T. (2025) · Textbooks in telecommunication engineering · doi:10.1007/978-3-032-14764-6_6
Profiling Neural Network Partitioning Strategies for Inference across the Computing Continuum
Papadakis, N., Angourakis, A., Magoutis, K., & Bouloukakis, G. (2026) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge72783.2026.00029
FlexPie: Accelerate Distributed Inference on Edge Devices with Flexible Combinatorial Optimization
Zhang, R., Jiang, H., Geng, J., Ma, Y., Zhu, C., & Wang, H. H. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-3827-0_2
DynoPipe: Heterogeneous Edge-Cloud LLM Serving with Dynamically Orchestrated Pipeline Boundaries
Lin, Y., Chen, B., Zhang, X., Xu, C., & Ye, K. (2026) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca66397.2026.00077
Communication-Budgeted Chunk-Aware Mixed Model Parallelism for Collaborative Inference
Chen, Y., Qiu, C., Wang, X., Liu, Z., Zhao, Y., Wang, Y., & Luo, T. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3723098
Fine-Grained DNN Partitioning and Offloading with Cold Start Mitigation in Vehicular Edge Computing
Nie, Y., Zhang, Y., Jin, H., & Zhang, P. (2026) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse72781.2026.00024
Sandur, A. (2022) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Metadata
- Authors
- Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M.
- Affiliations
- Seoul National University (KR)
- Venue
- Proceedings of the ACM Symposium on Cloud Computing
- Publisher
- ACM
- Published
- 2018-10-11
- Pages
- 401-411
- OpenAlex
- W2892952080
- Cited by
- 143
- References
- 33
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 9 · 2023: 35 · 2022: 25 · 2021: 22 · 2020: 22 · 2019: 8
- FWCI
- 10.74
- Type
- conference paper
- Language
- fr
- Open access
- closed
- Locations
- ACM Symposium on Cloud Computing (SoCC) (publishedVersion)
- Funders
- National Research Foundation of Korea (NRF-2017R1A2B2005562)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Keywords
- edge computing, model partitioning, mobile devices, fog computing, cloudlets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.