The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systems
Open accessAbstract
The emergence of various intelligent mobile applications demands the deployment of powerful deep learning models at resource-constrained mobile devices. The device-edge co-inference framework provides a promising solution by splitting a neural network at a mobile device and an edge computing server. In order to balance the on-device computation and the communication overhead, the splitting point needs to be carefully picked, while the intermediate feature needs to be compressed before transmission. Existing studies decoupled the design of model splitting, feature compression, and communication, which may lead to excessive resource consumption of the mobile device. In this paper, we introduce an end-to-end architecture, named BottleNet++, that consists of an encoder, a non-trainable channel layer, and a decoder for more efficient feature compression and transmission. The encoder and decoder essentially implement joint source-channel coding via lightweight convolutional neural networks (CNNs), while explicitly considering the effect of channel noise. By exploiting the strong sparsity and the fault-tolerant property of the intermediate feature in deep neural network (DNNs), BottleNet++ achieves a much higher compression ratio than existing methods. Compared with merely transmitting intermediate data without feature compression, BottleNet++ achieves up to 64× bandwidth reduction over the additive white Gaussian noise channel and up to 256× bit compression ratio in the binary erasure channel, with less than 2% reduction in accuracy of classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It was first tested in vertical edge inference via end-to-end training with joint source-channel coding in [233], which helps to reduce both the communication overhead and on-device computation cost.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [233]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2444095 · Cited by 8,630
Region-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Deep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Kurka, D. B., & Gündüz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,598
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3093337.3037698 · Cited by 840
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Abrishami, M. S., & Pedram, M. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2947893 · Cited by 398
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 214
Deep Feature Compression for Collaborative Object Detection
Choi, H., & Bajić, I. V. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451100 · Cited by 161
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160
Scalable Distributed Computing Hierarchy: Cloud, Fog and Dew Computing
Skala, K., Davidović, D., Afgan, E., Sović, I., & Šojat, Z. (2015) · Institutional Repository of the Ruđer Bošković Institute (Ruđer Bošković Institute) · doi:10.19210/1002.2.1.16 · Cited by 155
Ko, J. H., Na, T., Amir, M. F., & Mukhopadhyay, S. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639121 · Cited by 153
Shokrollahi, A. (2004) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-7865-4_5 · Cited by 141
Neural Joint Source-Channel CodingPreprint
Choi, K., Tatwawadi, K., Grover, A., Weissman, T., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07557 · Cited by 104
Emmerson, M. D., & Damper, R. I. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.248456 · Cited by 101
Distilled Split Deep Neural Networks for Edge-Assisted Real-Time Systems
Matsubara, Y., Baidya, S., Callegaro, D., Levorato, M., & Singh, S. (2019) · doi:10.1145/3349614.3356022 · Cited by 101
Improving Device-Edge Cooperative Inference of Deep Learning via 2-Step Pruning
Shi, W., Hou, Y., Zhou, S., Niu, Z., Zhang, Y., & Geng, L. (2019) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps47286.2019.9093772 · Cited by 86
Near-Lossless Deep Feature Compression for Collaborative Intelligence
Choi, H., & Bajić, I. V. (2018) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2018.8547134 · Cited by 80
Joint Source-Channel Coding for Video Communications
Zhai, F., Eisenberg, Y., & Katsaggelos, A. K. (2005) · Elsevier eBooks · doi:10.1016/b978-012119792-6/50124-8 · Cited by 68
Improving Device-Edge Cooperative Inference of Deep Learning via 2-Step PruningPreprint
Shi, W., Hou, Y., Zhou, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03472 · Cited by 13
JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Abrishami, M. S., & Pedram, M. (2018) · arXiv · doi:10.48550/arxiv.1801.08618
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · arXiv · doi:10.48550/arxiv.1902.01000
Cited by
Sorted by citations
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gündüz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 577
Communication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488
Self-citationDistributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 439
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach
Shao, J., Mao, Y., & Zhang, J. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126087 · Cited by 381
Self-citation
Metadata
- Authors
- Shao, J., & Zhang, J.
- Affiliations
- Hong Kong Polytechnic University (HK)
- Venue
- 2020 IEEE International Conference on Communications Workshops (ICC Workshops)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 1-6
- ISSN
- 2164-7038 (ISSN-L)
- OpenAlex
- W2982333655
- Cited by
- 200
- References
- 25
- Citations by year
- 2026: 17 · 2025: 37 · 2024: 43 · 2023: 33 · 2022: 27 · 2021: 33 · 2020: 10
- FWCI
- 21.60
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE International Conference on Communications workshops (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Keywords
- feature compression, joint source-channel coding, model splitting, end-to-end architecture, encoder-decoder architecture, channel noise, bandwidth reduction, resource-constrained mobile devices, lightweight convolutional neural network, binary erasure channel, AWGN channel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review