CoChat

JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution

Open access
Li, Hongshan, Hu, Chenghao, Jiang, Jingyan, Wang, Zhi, Wen, Yonggang, Zhu, Wenwu · 2018 · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS)

The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.

Abstract

Recent years have witnessed a rapid growth of deep-network based services and applications. A practical and critical problem thus has emerged: how to effectively deploy the deep neural network models such that they can be executed efficiently. Conventional cloud-based approaches usually run the deep models in data center servers, causing large latency because a significant amount of data has to be transferred from the edge of network to the data center. In this paper, we propose JALAD, a joint accuracy- and latency-aware execution framework, which decouples a deep neural network so that a part of it will run at edge devices and the other part inside the conventional cloud, while only a minimum amount of data has to be transferred between them. Though the idea seems straightforward, we are facing challenges including i)how to find the best partition of a deep structure; ii)how to deploy the component at an edge device that only has limited computation power; and iii)how to minimize the overall execution latency. Our answers to these questions are a set of strategies in JALAD, including 1)A normalization based in-layer data compression strategy by jointly considering compression rate and model accuracy; 2)A latency-aware deep decoupling strategy to minimize the overall execution latency; and 3)An edge-cloud structure adaptation strategy that dynamically changes the decoupling for different network conditions. Experiments demonstrate that our solution can significantly reduce the execution latency: it speeds up the overall inference execution with a guaranteed model accuracy loss.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/padsw.2018.8645013

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 44 references

Research works printed but not linked: 5

  1. roman, 2016, Mobile edge computing: a survey and analysis of security threats and challenges, arXiv preprint arXiv 1602 00484
  2. index, 0, Global mobile data traffic forecast update 2014-2019 white paper c11-520862
  3. han, 2015, Learning both weights and connections for efficient neural network, Advances in neural information processing systems, 1115
  4. 0, Apple moves to third-generation siri back-end built on open-source mesos platform
  5. 0, Google Supercharges Machine Learning Tasks with TPU Custom Chip

Cited by

See all 181

Metadata

Authors
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W.
Affiliations
  • Tsinghua University (CN)
  • Tsinghua Shenzhen International Graduate School (CN)
  • Jilin University (CN)
  • Nanyang Technological University (SG)
Venue
2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS)
Publisher
IEEE
Published
2018-12
Pages
671-678
OpenAlex
W2949628230
Cited by
160
References
45
Citations by year
2026: 10 · 2025: 21 · 2024: 23 · 2023: 31 · 2022: 29 · 2021: 25 · 2020: 17 · 2019: 4
FWCI
9.50
Type
conference paper
Language
en
Open access
Locations
  • IEEE International Conference on Parallel and Distributed Systems (ICPADS) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DR-NTU (Nanyang Technological University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
Keywords
deep neural network deployment, edge-cloud computing, model partitioning, inference latency reduction, accuracy-latency trade-off, edge devices, dynamical decoupling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution. https://app.cochat.ai/papers/10.1109/padsw.2018.8645013
The paper
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018). JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution. 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). https://doi.org/10.1109/padsw.2018.8645013

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.