The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
CoEdge: Cooperative DNN Inference With Adaptive Workload Partitioning Over Heterogeneous Edge Devices
Open accessAbstract
Recent advances in artificial intelligence have driven increasing intelligent applications at the network edge, such as smart home, smart factory, and smart city. To deploy computationally intensive Deep Neural Networks (DNNs) on resource-constrained edge devices, traditional approaches have relied on either offloading workload to the remote cloud or optimizing computation at the end device locally. However, the cloud-assisted approaches suffer from the unreliable and delay-significant wide-area network, and the local computing approaches are limited by the constrained computing capability. Towards high-performance edge intelligence, the cooperative execution mechanism offers a new paradigm, which has attracted growing research interest recently. In this paper, we propose CoEdge, a distributed DNN computing system that orchestrates cooperative DNN inference over heterogeneous edge devices. CoEdge utilizes available computation and communication resources at the edge and dynamically partitions the DNN inference workload adaptive to devices' computing capabilities and network conditions. Experimental evaluations based on a realistic prototype show that CoEdge outperforms status-quo approaches in saving energy with close inference latency, achieving up to 25.5% ~ 66.9% energy reduction for four widely-adopted CNN models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 3×
“Meanwhile, advances in Deep Neural Networks (DNNs) have shown unprecedented ability in learning abstract representation and extracting high-level features, promoting significant improvement in processing human-centric contents [7].”
BackgroundA Bridging Model for Parallel Computation
Valiant, L. G. (1990) · ACM eBooks · doi:10.1145/3749740.3749753 · Cited by 3,664
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · cited 1×
“To tackle these challenges, a promising approach is to exploit available computation resources in the proximity to the data source with the emerging edge intelligence paradigm [13].”
BackgroundSelf-citationA deep convolutional neural network model to classify heartbeats
Acharya, U. R., Oh, S. L., Hagiwara, Y., Tan, J. H., Adam, M., Gertych, A., & Tan, R. S. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.022 · Cited by 1,421
A review of internet of things for smart home: challenges and solutions
Risteska Stojkoska, B. L., & Trivodaliev, K. V. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.10.006 · Cited by 1,397
Deng, L., Hinton, G., & Kingsbury, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,178
(2014) · arXiv (Cornell University) · Cited by 942
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
Li, E., Zeng, L., Zhou, Z., & Chen, X. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946140 · Cited by 929
Self-citationShrouf, F., Ordieres, J., & Miragliotta, G. (2014) · 2014 IEEE International Conference on Industrial Engineering and Engineering Management · doi:10.1109/ieem.2014.7058728 · Cited by 909
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.226 · Cited by 843
Internet of vehicles: From intelligent grid to autonomous cars and vehicular clouds
Gerla, M., Lee, E.-K., Pau, G., & Lee, U. (2014) · 2014 IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2014.6803166 · Cited by 828
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3093337.3037698 · Cited by 806
Energy efficiency of mobile clients in cloud computing
Miettinen, A., & Nurminen, J. K. (2010) · Cited by 759
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
Follow Me at the Edge: Mobility-Aware Dynamic Service Placement for Mobile Edge Computing
Ouyang, T., Zhou, Z., & Chen, X. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2869954 · Cited by 519
Self-citationDeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters
Zhao, Z., Barijough, K. M., & Gerstlauer, A. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2858384 · Cited by 502
Energy-optimal mobile application execution: Taming resource-poor mobile devices with cloud clones
Wen, Y., Zhang, W., & Luo, H. (2012) · 2012 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2012.6195685 · Cited by 394
Rahmani, A.-M., Thanigaivelan, N. K., Gia, T. N., Granados, J., Negash, B., Liljeberg, P., & Tenhunen, H. (2015) · 2015 12th Annual IEEE Consumer Communications and Networking Conference (CCNC) · doi:10.1109/ccnc.2015.7158084 · Cited by 367
Han, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
MoDNN: Local distributed mobile computing system for Deep Neural Network
Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331
Self-citationDistributed Inference Acceleration with Adaptive DNN Partitioning and Offloading
Mohammed, T., Joe-Wong, C., Babbar, R., & Francesco, M. D. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications · doi:10.1109/infocom41043.2020.9155237 · Cited by 211
Towards energy-proportional datacenter memory with mobile DRAM
Malladi, K. T., Lee, B. C., Nothaft, F. A., Kozyrakis, C., Periyathambi, K., & Horowitz, M. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2366231.2337164 · Cited by 203
ThriftyEdge: Resource-Efficient Edge Computing for Intelligent IoT Applications
Chen, X., Shi, Q., Yang, L., & Xu, J. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700145 · Cited by 201
Self-citationLinear Programming and Extensions.
Azpeitia, A. G., & Dantzig, G. B. (1965) · The American Mathematical Monthly · doi:10.2307/2313733 · Cited by 191
Yao, S., Zhao, Y., Shao, H., Liu, S., Liu, D., Su, L., & Abdelzaher, T. (2018) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3274783.3274840 · Cited by 169
Zeng, L., Li, E., Zhou, Z., & Chen, X. (2019) · IEEE Network · doi:10.1109/mnet.001.1800506 · Cited by 159
Self-citationTowards energy-proportional datacenter memory with mobile DRAM
Malladi, K. T., Nothaft, F. A., Periyathambi, K., Lee, B. C., Kozyrakis, C., & Horowitz, M. (2012) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2012.6237004 · Cited by 156
Toward Collaborative Inferencing of Deep Neural Networks on Internet-of-Things Devices
Hadidi, R., Cao, J., Ryoo, M. S., & Kim, H. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2972000 · Cited by 154
Kim, Y., Kim, J., Chae, D., Kim, D., & Kim, J. (2019) · European Conference on Computer Systems · doi:10.1145/3302424.3303950 · Cited by 152
Network Offloading Policies for Cloud Robotics: A Learning-Based Approach
Chinchali, S., Sharma, A., Harrison, J., Elhafsi, A., Kang, D. D., Pergament, E., Cidon, E., Katti, S., & Pavone, M. (2019) · Autonomous Robots · doi:10.1007/s10514-021-09987-4 · Cited by 147
IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M. (2018) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3267809.3267828 · Cited by 143
Adaptive parallel execution of deep neural networks on heterogeneous edge devices
Zhou, L., Samavatian, M. H., Bacha, A., Majumdar, S., & Teodorescu, R. (2019) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3318216.3363312 · Cited by 134
Distributed Perception by Collaborative Robots
Hadidi, R., Cao, J., Woodward, M., Ryoo, M. S., & Kim, H. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2856261 · Cited by 97
Software Defined Cooperative Offloading for Mobile Cloudlets
Cui, Y., Song, J., Ren, K., Li, M., Li, Z., Ren, Q., & Zhang, Y. (2017) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2017.2650964 · Cited by 75
Fast and Accurate Streaming CNN Inference via Communication Compression on the Edge
Hu, D., & Krishnamachari, B. (2020) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi49375.2020.00023 · Cited by 64
Distributed Deep Learning-based Task Offloading for UAV-enabled Mobile Edge Computing
Mukherjee, M., Kumar, V., Lat, A., Guo, M., Matam, R., & Lv, Y. (2020) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps50562.2020.9162899 · Cited by 50
ReForm: Static and Dynamic Resource-Aware DNN Reconfiguration Framework for Mobile Device
Xu, Z., Yu, F., Liu, C., & Chen, X. (2019) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3316781.3324696 · Cited by 47
Self-citationNeural Networks Meet Physical Networks: Distributed Inference Between Edge Devices and the Cloud
Chinchali, S. P., Cidon, E., Pergament, E., Chu, T., & Katti, S. (2018) · Proceedings of the 17th ACM Workshop on Hot Topics in Networks · doi:10.1145/3286062.3286070 · Cited by 46
Xu, S., Liu, Q., Gong, B., Qi, F., Guo, S., Qiu, X., & Yang, C. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002427 · Cited by 46
RILaaS: Robot Inference and Learning as a Service
Tanwani, A. K., Anand, R., Gonzalez, J. E., & Goldberg, K. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2998414 · Cited by 35
A portable, automatic data qantizer for deep neural networks
Oh, Y. H., Quan, Q., Kim, D.-Y., Kim, S., Heo, J., Jung, S., Jang, J.-Y., & Lee, J. W. (2018) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3243176.3243180 · Cited by 29
Ballotta, L., Schenato, L., & Carlone, L. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.3008337 · Cited by 18
Carpool for Big Data: Enabling Efficient Crowd Cooperation in Data Market for Pervasive AI
Shi, Q., & Chen, X. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2990979 · Cited by 6
Self-citation
Cited by
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“CoEdge [376] reduces the redundant calculation by nonoverlapping partitioning with an added data transmission cost.”
BackgroundPipeBERT: High-throughput BERT Inference for ARM Big.LITTLE Multi-core Processors
Chang, H.-Y., Mozafari, S. H., Chen, C., Clark, J. J., Meyer, B. H., & Gross, W. J. (2023) · Journal of Signal Processing Systems · doi:10.1007/s11265-022-01814-y · Cited by 14
Metadata
- Authors
- Zeng, L., Chen, X., Zhou, Z., Yang, L., & Zhang, J.
- Venue
- IEEE/ACM Transactions on Networking
- Published
- 2021-04
- Volume
- 29
- Issue
- 2
- Pages
- 595-608
- ISSN
- 1063-6692 (ISSN-L)
- 1558-2566
- OpenAlex
- W3110777925
- Cited by
- 313
- References
- 50
- FWCI
- 12.02
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.