The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Open accessAbstract
Deep learning models are being deployed in many mobile intelligent applications. End-side services, such as intelligent personal assistants, autonomous cars, and smart home services often employ either simple local models on the mobile or complex remote models on the cloud. However, recent studies have shown that partitioning the DNN computations between the mobile and cloud can increase the latency and energy efficiencies. In this paper, we propose an efficient, adaptive, and practical engine, JointDNN, for collaborative computation between a mobile device and cloud for DNNs in both inference and training phase. JointDNN not only provides an energy and performance efficient method of querying DNNs for the mobile side but also benefits the cloud server by reducing the amount of its workload and communications compared to the cloud-only approach. Given the DNN architecture, we investigate the efficiency of processing some layers on the mobile device and some layers on the cloud server. We provide optimization formulations at layer granularity for forward- and backward-propagations in DNNs, which can adapt to mobile battery limitations and cloud server load constraints and quality of service. JointDNN achieves up to 18 and 32 times reductions on the latency and mobile energy consumption of querying DNNs compared to the status-quo approaches, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(2011) · Cited by 6,993
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 2×
“Recent studies show representing the parameters of DNNs with only 4-bits affect the accuracy not more than 1% [38].”
BackgroundLarge Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,199
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
MAUI: making smartphones last longer with code offload
Cuervo, E., Balasubramanian, A., Cho, D.-K., Wolman, A., Saroiu, S., Chandra, R., & Bahl, P. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814441 · Cited by 2,281
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
(2011) · doi:10.1145/1966445.1966473 · Cited by 1,870
Quality-of-service routing for supporting multimedia applications
Wang, Z., & Crowcroft, J. (1996) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.536364 · Cited by 1,626
A Survey on Deep Learning: Algorithms, Techniques, and Applications
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2019) · ACM Computing Surveys · doi:10.1145/3234150 · Cited by 1,403
A close examination of performance and power characteristics of 4G LTE networks
Huang, J., Qian, F., Gerber, A., Mao, Z. M., Sen, S., & Spatscheck, O. (2012) · Proceedings of the 10th international conference on Mobile systems, applications, and services · doi:10.1145/2307636.2307658 · Cited by 995
cuDNN: Efficient Primitives for Deep Learning
Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J. J., Catanzaro, B., & Shelhamer, E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.0759 · Cited by 943
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.226 · Cited by 843
A Survey of Computation Offloading for Mobile Systems
Kumar, K., Liu, J., Lu, Y.-H., & Bhargava, B. (2013) · Mobile Networks and Applications · doi:10.1007/s11036-012-0368-0 · Cited by 840
Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing)
Cover, T. M., & Thomas, J. A. (2006) · Wiley-Interscience eBooks · Cited by 813
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
Learning to generate chairs with convolutional neural networks
Dosovitskiy, A., Springenberg, J. T., & Brox, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298761 · Cited by 640
Deep visual foresight for planning robot motion
Finn, C., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989324 · Cited by 599
An integrated GPU power and performance model
Hong, S., & Kim, H. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815998 · Cited by 483
GPU implementation of neural networks
Oh, K.-S., & Jung, K. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.01.013 · Cited by 420
Odessa: enabling interactive perception applications on mobile devices
Ra, M.-R., Sheth, A., Mummert, L., Pillai, P., Wetherall, D., & Govindan, R. (2011) · Proceedings of the 9th international conference on Mobile systems, applications, and services · doi:10.1145/1999995.2000000 · Cited by 361
COMET: code offload by migrating execution transparently
Gordon, M. S., Jamshidi, D. A., Mahlke, S. A., Mao, Z. M., & Xu, C. (2012) · doi:10.5555/2387880.2387890 · Cited by 357
Realtime facial animation with on-the-fly correctives
Li, H., Yu, J., Ye, Y., & Bregler, C. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462019 · Cited by 282
Agile Autonomous Driving using End-to-End Deep Imitation Learning
Pan, Y., Cheng, C.-A., Saigol, K., Lee, K., Yan, X., Theodorou, E., & Boots, B. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.056 · Cited by 257
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · 2019 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 196
Self-citationScalable Distributed Computing Hierarchy: Cloud, Fog and Dew Computing
Skala, K., Davidović, D., Afgan, E., Sović, I., & Šojat, Z. (2015) · Institutional Repository of the Ruđer Bošković Institute (Ruđer Bošković Institute) · doi:10.19210/1002.2.1.16 · Cited by 156
Paleo: A Performance Model for Deep Neural Networks
Qi, H., Sparks, E., & Talwalkar, A. (2017) · International Conference on Learning Representations · Cited by 154
An integrated GPU power and performance model
Hong, S., & Kim, H. (2010) · ACM SIGARCH Computer Architecture News · doi:10.1145/1816038.1815998 · Cited by 131
Eshratifar, A. E., & Pedram, M. (2018) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3194554.3194565 · Cited by 115
Self-citationLookNN: Neural network with no multiplication
Samragh, M., Imani, M., Koushanfar, F., & Rosing, T. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7927280 · Cited by 88
Ahmad, R. W., Gani, A., Hamid, S. H. A., Xia, F., & Shiraz, M. (2015) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2015.09.002 · Cited by 60
Refactoring android Java code for on-demand computation offloading
Zhang, Y., Huang, G., Liu, X., Zhang, W., Mei, H., & Yang, S. (2012) · ACM SIGPLAN Notices · doi:10.1145/2398857.2384634 · Cited by 53
Towards Collaborative Intelligence Friendly Architectures for Deep Learning
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2019.8697647 · Cited by 34
Self-citationLearning to Generate Chairs, Tables and Cars with Convolutional NetworksPreprint
Dosovitskiy, A., Springenberg, J. T., Tatarchenko, M., & Brox, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.5928 · Cited by 19
(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Cited by
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
Li, E., Zeng, L., Zhou, Z., & Chen, X. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946140 · Cited by 929
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges
Matsubara, Y., Levorato, M., & Restuccia, F. (2023) · ACM Computing Surveys · doi:10.1145/3527155 · Cited by 304
Metadata
- Authors
- Eshratifar, A. E., Abrishami, M. S., & Pedram, M.
- Venue
- IEEE Transactions on Mobile Computing
- Published
- 2021-02-01
- Volume
- 20
- Issue
- 2
- Pages
- 565-576
- ISSN
- 1536-1233 (ISSN-L)
- 1558-0660
- 2161-9875
- OpenAlex
- W2785025328
- Cited by
- 381
- References
- 38
- FWCI
- 21.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.