MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Deep Neural Networks (DNNs) are pervasively used in a significant number of applications and platforms. To enhance the execution efficiency of large-scale DNNs, previous attempts focus mainly on client-server paradigms, relying on powerful external infrastructure, or model compression, with complicated pre-processing phases. Though effective, these methods overlook the optimization of DNNs on distributed mobile devices. In this work, we design and implement MeDNN, a local distributed mobile computing system with enhanced partitioning and deployment tailored for large-scale DNNs. In MeDNN, we first propose Greedy Two Dimensional Partition (GTDP), which can adaptively partition DNN models onto several mobile devices w.r.t. individual resource constraints. We also propose Structured Model Compact Deployment (SMCD), a mobile-friendly compression scheme which utilizes a structured sparsity pruning technique to further accelerate DNN execution. Experimental results show that, GTDP can accelerate the original DNN execution time by 1.86-2.44x with 2-4 worker nodes. By utilizing SMCD, 26.5% of additional computing time and 14.2% of extra communication time are saved, on average, with negligible effect on the model accuracy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“MeDNN improves the DNN model inference by 1.86-2.44×with two to four worker nodes and saves 26.5% of additional computing time and 14.2% of extra communication time.”
From Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing (2019) · cites this paper as [84]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“Three DNN models of incremental scale are analyzed: Lenet [15], AlexNet [16], and VGG [17].”
MethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 3×
“To deploy the test bench on mobile devices without loss of generality, we adopt CaffeNet, an optimized implementation of AlexNet with state-of-the-art performance for image classification tasks [16].”
MethodGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“Three DNN models of incremental scale are analyzed: Lenet [15], AlexNet [16], and VGG [17].”
MethodGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476 · cited 1×
“MapReduce is considered an excellent distributed architecture for simplifying parallel data processing for DNN execution [7].”
MethodCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · cited 1×
“In the experiments, the performance of the proposed MeDNN is evaluated with five distinct convolutional layers at different scales [21].”
MethodMXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819 · cited 1×
“The implementation of the MeDNN schemes is based on MXNet, which is a deep learning framework developed by the Distributed Machine Learning Community (DMLC) team using C++ [19].”
MethodOpen MPI: Goals, Concept, and Design of a Next Generation MPI Implementation
Gabriel, E., Fagg, G. E., Bosilca, G., Angskun, T., Dongarra, J. J., Squyres, J. M., Sahay, V., Kambadur, P., Barrett, B., Lumsdaine, A., et al. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30218-6_19 · Cited by 1,591 · cited 1×
“Because there is no existing Open MPI and SSH libraries for Android system, we implemented an Android/ARM custumized version and integrated it into the MeDNN framework [20].”
MethodGoing Deeper with Embedded FPGA Platform for Convolutional Neural Network
Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., Song, S., et al. (2016) · Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2847263.2847265 · Cited by 1,252 · cited 4×
“1: procedure INT PARTITION(M) 2: if N <= 1 then 3: return 0 4: if N == 2 then 5: Split the feature map by the shorter edge and assign them to P[Idx[1]] and P[Idx[2]] with the ratio of Ccomp[Idx[1]] Ccomp[Idx[2]] .”
BackgroundInfluentialScaling distributed machine learning with the parameter server
Li, M., Andersen, D. G., Park, J. W., Smola, A. J., Ahmed, A. A., Josifovski, V., Long, J. E., Shekita, E. J., & Su, B.-Y. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685095 · Cited by 1,021
Research works printed but not linked: 1
- han, 2015, Deep compression: Compressing deep neural network with pruning, trained quantization and huffman coding, CoRR, abs 1510 149
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
Self-citationDistributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
“The model partitioning includes three types: partition between servers and devices [57], [176], [177], the partition between devices horizontally [178], [179] and vertically [180].”
BackgroundSPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
“Simultaneously, various works [50, 51, 85] have examined the case where the client device can offload to other devices in the local network.”
BackgroundEdge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 256
“More works of DNN partition proved that it is a promising way in the future of DNN inference, which will significantly accelerate the inference process [125], [126],”
Tang, X., Chen, X., Zeng, L., Yu, S., & Chen, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3010258 · Cited by 157
“Besides, model compression methods are model specific that highly depend on the architecture of DNN [19].”
MethodSelf-citation
Metadata
- Authors
- Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K. W., Chen, X., Li, H., & Chen, Y.
- Affiliations
- Duke University (US)
- University of Pittsburgh (US)
- George Mason University (US)
- Venue
- 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD)
- Publisher
- IEEE
- Published
- 2017-11
- Pages
- 751-756
- ISSN
- 1933-7760 (ISSN-L)
- OpenAlex
- W4249516033
- Cited by
- 97
- References
- 21
- Citations by year
- 2026: 3 · 2025: 16 · 2024: 6 · 2023: 15 · 2022: 22 · 2021: 16 · 2020: 11 · 2019: 6 · 2018: 2
- FWCI
- 1.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Computer Aided Design (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- distributed deep neural networks, mobile edge computing, model partitioning, model deployment, model compression, resource-constrained mobile devices, communication overhead
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs. https://app.cochat.ai/papers/10.1109/iccad.2017.8203852
- The paper
- Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K. W., Chen, X., Li, H., & Chen, Y. (2017). MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs. 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD). https://doi.org/10.1109/iccad.2017.8203852
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.