A Locally Distributed Mobile Computing Framework for DNN based Android Applications
The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
In recent years, with the development of deep neural network (DNN), more and more applications (e.g., image classification, target recognition and audio processing) are supported by it. However, the disadvantage of its own large model makes it difficult to apply on resource-constrained devices such as mobile devices. In order to solve this problem, the existing research and technology mainly focus on the DNN model compression and the segmentation migration of the model. The former is generally at the expense of reducing accuracy, and the segmentation of the model has no unified migration tool for the DNN model of different applications. In this work, we propose a universal neural network layer segmentation tool, which enables the trained DNN model to be migrated, and migrates the segmentation layer to the nodes in the current network in accordance with the dynamic optimal allocation algorithm proposed in this paper. The experimental results show that the tool can adapt to various neural networks with different structures and perform optimal allocation of layers through algorithm. When the number of working nodes increases from 1 to 5, this method can speed up DNN 2-2.5 times, and shows a good acceleration effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
Scaling Distributed Machine Learning with the Parameter Server
Li, M. (2014) · Proceedings of the 2014 International Conference on Big Data Science and Computing · doi:10.1145/2640087.2644155 · Cited by 979
Compressing Neural Networks with the Hashing Trick
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974 · cited 1×
“In [2], Chen introduces a low-cost hash function to group weights into hash bucket for parameter sharing.”
BackgroundNeurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673 · cited 1×
“Themost direct way is to migrate huge computing costs to external devices such as cloud servers: In [6], Hauswald presents a data unloading scheme in pipelined machine learning architecture; In [7], Kang designed a system to analyze the optimal cut points between cloud and mobile edges.”
MethodHan, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
MoDNN: Local distributed mobile computing system for Deep Neural Network
Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331 · cited 1×
“Due to communication overhead, the total execution time does not decrease linearlywith the increase ofworking nodes [12].”
BackgroundSelf-citationDeep Convolutional Neural Networks for pedestrian detection
Tomè, D., Monti, F., Baroffio, L., Bondi, L., Tagliasacchi, M., & Tubaro, S. (2016) · Signal Processing: Image Communication · doi:10.1016/j.image.2016.05.007 · Cited by 225
DjiNN and Tonic: DNN as a service and its implications for future warehouse scale computers
Hauswald, J., Kang, Y., Laurenzano, M. A., Chen, Q., Li, C., Mudge, T., Dreslinski, R. G., Mars, J., & Tang, L. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2749472 · Cited by 161
Noise-enhanced convolutional neural networks
Audhkhasi, K., Osoba, O., & Kosko, B. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.09.014 · Cited by 129
Accurate and compact large vocabulary speech recognition on mobile devices
Lei, X., Senior, A., Gruenstein, A., & Sorensen, J. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-189 · Cited by 119
DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices
Li, D., Wang, X., & Kong, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11876 · Cited by 94
A hybrid approach to offloading mobile image classification
Hauswald, J., Manville, T., Zheng, Q., Dreslinski, R., Chakrabarti, C., & Mudge, T. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6855235 · Cited by 54
2006 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2006)
(2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.850390 · Cited by 31
Research works printed but not linked: 3
- Chen Wenlin, 2015, Proceedings of the 32Nd International Conference on International Conference on Machine Learning -, 37
- Han Song, 2015, Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. Fiber, 56, 3
- 10.5555/3130379.3130709 · doi:10.5555/3130379.3130709
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“, GPUs, CPUs) on the end device [154], 2) distributed edge nodes [155], [156], or 3) collaborative “end-edge-cloud” architecture [12], [49], [157], [158].”
BackgroundSelf-citationEfficient Computer Vision on Edge Devices with Pipeline-Parallel Hierarchical Neural Networks
Goel, A., Tung, C., Hu, X., Thiruvathukal, G. K., Davis, J. C., & Lu, Y.-H. (2022) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac52403.2022.9712574 · Cited by 24
An Efficient and Robust Cloud-Based Deep Learning With Knowledge Distillation
Tao, Z., Xia, Q., Chen, S., & Li, Q. (2022) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2022.3160129 · Cited by 22
Self-citationHuang, Y., Yao, T., Lin, Z., Shang, X., Yuan, Y., Cui, L., & Yang, Y. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3475590 · Cited by 15
Sen, T., & Shen, H. (2022) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs54860.2022.00062 · Cited by 12
Metadata
- Authors
- Zhang, J., Chen, S., Liu, B., Ma, Y., & Chen, X.
- Affiliations
- Fuzhou University (CN)
- Tsinghua University (CN)
- Venue
- Proceedings of the Tenth Asia-Pacific Symposium on Internetware
- Publisher
- ACM
- Published
- 2018-09-16
- Pages
- 1-6
- OpenAlex
- W2896769682
- Cited by
- 7
- References
- 17
- Citations by year
- 2024: 1 · 2022: 3 · 2020: 3
- FWCI
- 0.23
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Asia-Pacific Symposium on Internetware (publishedVersion)
- Funders
- the National Key R&D Program of China,Natural Science Foundation of China,Guiding Project of Fujian Province under (2018YFB1004800,61672159,2018H0017)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Keywords
- deep neural network, Android application, mobile computing, layer segmentation, distributed computing, resource-constrained devices, model compression, inference acceleration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.