MoDNN: Local distributed mobile computing system for Deep Neural Network
The DOI matches its Crossref record; 19 of the 20 references it cites were found in a registry or an index.
Abstract
Although Deep Neural Networks (DNN) are ubiquitously utilized in many applications, it is generally difficult to deploy DNNs on resource-constrained devices, e.g., mobile platforms. Some existing attempts mainly focus on client-server computing paradigm or DNN model compression, which require either infrastructure supports or special training phases, respectively. In this work, we propose MoDNN - a local distributed mobile computing system for DNN applications. MoDNN can partition already trained DNN models onto several mobile devices to accelerate DNN computations by alleviating device-level computing cost and memory usage. TWo model partition schemes are also designed to minimize non-parallel data delivery time, including both wakeup time and transmission time. Experimental results show that when the number of worker nodes increases from 2 to 4, MoDNN can accelerate the DNN computation by 2.17-4.28 X. Besides the parallel execution, the performance speedup also partially comes from the reduction of the data delivery time, e.g., 30.02% w.r.t. conventional 2D-grids partition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“MoDNN, proposed in [177], executes DL in a local distributed mobile computing system over a Wireless Local Area Network (WLAN).Each layer of DNNs is partitioned into slices to increase parallelism and to reduce memory footprint, and these slices are executed layerby-layer.By the execution parallelism among multiple end devices, the DL computation can be significantly accelerated.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [177]
In the citing paper
“The experiment shows that with two to four worker nodes, MoDNN accelerates the DNN model inference by 2.17-4.28×.”
From Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing (2019) · cites this paper as [85]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 4×
“A representative example is V GG [1], which demonstrates state-of-the-art performance in ImageNet Large Scale Visual Recognition Challenge 2014 (ILSVRC14).”
BackgroundMethodInfluentialGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“1 depicts our measurement results of the computing time and the memory usage of different network layers from three popular DNN models running on smartphones – Lenet [9], Inception - BN [10], and V GG [1].”
BackgroundBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“1 depicts our measurement results of the computing time and the memory usage of different network layers from three popular DNN models running on smartphones – Lenet [9], Inception - BN [10], and V GG [1].”
BackgroundMapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476 · cited 1×
“MapReduce is a programming model for simplifying parallel data processing in distributed systems [7].”
BackgroundBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
A tutorial on spectral clustering
von Luxburg, U. (2007) · Statistics and Computing · doi:10.1007/s11222-007-9033-z · Cited by 10,349
Some simplified NP-complete graph problems
Garey, M. R., Johnson, D. S., & Stockmeyer, L. (1976) · Theoretical Computer Science · doi:10.1016/0304-3975(76)90059-1 · Cited by 2,059 · cited 1×
“If we consider the weight matrix as an undirected graph, generating k clusters with minimal connections between them is a NP hard problem [14].”
BackgroundMXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819 · cited 2×
“We modified and recompiled the MXNet libraries so that it can support Android systems with ARM architecture through JAVA Native Interface (JNI) [17].”
MethodCo-clustering documents and words using bipartite spectral graph partitioning
Dhillon, I. S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502550 · Cited by 1,697 · cited 1×
“Therefore, spectral co-clustering algorithm is introduced to address this drawback by normalizing the original connection matrix A to A norm and performing Singular Value Decomposition (SVD) on A norm [16].”
MethodScaling distributed machine learning with the parameter server
Li, M., Andersen, D. G., Park, J. W., Smola, A. J., Ahmed, A. A., Josifovski, V., Long, J. E., Shekita, E. J., & Su, B.-Y. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685095 · Cited by 1,021
Research works printed but not linked: 2
- han, 2015, Deep compression: Compressing deep neural network with pruning, trained quantization and huffman coding, Computing ResearchRepository, 2
- 0, Wifi Alliance Wifi Direct Specifications
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“Note that DNN layers are partitioned horizontally in MoDNN and MeDNN, whereas DeepThings [86] employs a fused tile partitioning method that partitions the DNN layers vertically to reduce the memory footprint.”
MethodInfluentialSelf-citationDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
“[107] J. Mao, X. Chen, K. W. Nixon, C. Krieger, and Y. Chen, “MoDNN: Local distributed mobile computing system for deep neural network,” in Proc.”
MethodInfluentialConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“MoDNN, proposed in [177], executes DL in a local distributed mobile computing system”
MethodSelf-citationEdge Machine Learning for AI-Enabled IoT Devices: A Review
Merenda, M., Porcaro, C., & Iero, D. (2020) · Sensors · doi:10.3390/s20092533 · Cited by 523
Metadata
- Authors
- Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y.
- Affiliations
- University of Pittsburgh (US)
- George Mason University (US)
- University of Maryland, College Park (US)
- Venue
- Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017
- Publisher
- IEEE
- Published
- 2017-03
- Pages
- 1396-1401
- OpenAlex
- W2612193523
- Cited by
- 331
- References
- 20
- Citations by year
- 2026: 21 · 2025: 35 · 2024: 47 · 2023: 62 · 2022: 43 · 2021: 51 · 2020: 38 · 2019: 17 · 2018: 11 · 2017: 6
- FWCI
- 15.69
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Design, Automation, and Test in Europe (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network, mobile computing, distributed computing, model partitioning, resource-constrained devices, computational acceleration, parallel execution, memory reduction, worker nodes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.