CoChat

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

Open access
Wang, Shiqiang, Tuor, Tiffany, Salonidis, Theodoros, Leung, Kin K., Makaya, Christian, He, Ting, Chan, Kevin · 2019 · IEEE Journal on Selected Areas in Communications

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.

Abstract

Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jsac.2019.2904348

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 6

  1. bonawitz, 2016, Practical secure aggregation for federated learning on user-held data, Proc NIPS Workshop Private Multi-Party Mach Learn
  2. kelly, 2015, Internet of Things data to top 1 6 zettabytes by 2020
  3. goodfellow, 2016, Deep Learning
  4. mcmahan, 2017, Communication-efficient learning of deep networks from decentralized data, Proc Int Conf Artif Intell Statist (AISTATS), 54, 1273
  5. 2019, Convolutional neural network
  6. hsieh, 2017, Gaia: Geo-distributed machine learning approaching LAN speeds, Proc USENIX Symp Netw Syst Design Implem (NSDI), 629

Cited by

See all 2,232

Metadata

Authors
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K.
Affiliations
  • IBM Research - Thomas J. Watson Research Center (US)
  • Imperial College London (GB)
  • Pennsylvania State University (US)
  • DEVCOM Army Research Laboratory (US)
Venue
IEEE Journal on Selected Areas in Communications
Published
2019-06
Volume
37
Issue
6
Pages
1205-1221
ISSN
  • 0733-8716 (ISSN-L)
  • 1558-0008
OpenAlex
W2963318081
Cited by
2,232
References
41
Citations by year
2026: 189 · 2025: 317 · 2024: 341 · 2023: 369 · 2022: 366 · 2021: 374 · 2020: 234 · 2019: 39
FWCI
115.53
Type
journal article
Language
en
Open access
Locations
  • IEEE Journal on Selected Areas in Communications (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Spiral (Imperial College London) (submittedVersion)
  • arXiv (Cornell University)
Funders
Army Research Laboratory (W911NF-16-3-0001)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Keywords
adaptive federated learning, edge computing, resource-constrained systems, distributed gradient descent, convergence bounds, parameter aggregation, local updates, resource budget, privacy-preserving machine learning, Internet of Things

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.