Cited by 47Privacy-Preserving Technologies in DataStochastic Gradient Optimization TechniquesDistributed Control Multi-Agent Systems

BACombo—Bandwidth-Aware Decentralized Federated Learning

Open access
Jiang, Jingyan, Hu, Liang, Hu, Chenghao, Liu, Jiate, Wang, Zhi·2020·Electronics

Abstract

The emerging concern about data privacy and security has motivated the proposal of federated learning. Federated learning allows computing nodes to only synchronize the locally- trained models instead of their original data in distributed training. Conventional federated learning architecture, inherited from the parameter server design, relies on highly centralized typologies and large nodes-to-server bandwidths. However, in real-world federated learning scenarios, the network capacities between nodes are highly uniformly distributed and smaller than that in data centers. As a result, how to efficiently utilize network capacities between computing nodes is crucial for conventional federated learning. In this paper, we propose Bandwidth Aware Combo (BACombo), a model segment level decentralized federated learning, to tackle this problem. In BACombo, we propose a segmented gossip aggregation mechanism that makes full use of node-to-node bandwidth for speeding up the communication time. Besides, a bandwidth-aware worker selection model further reduces the transmission delay by greedily choosing the bandwidth-sufficient worker. The convergence guarantees are provided for BACombo. The experimental results on various datasets demonstrate that the training time is reduced by up to 18 times that of baselines without accuracy degrade.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/electronics9030440

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Decentralized training is more efficient than centralized training when running federated systems in low-bandwidth or high-latency networks.

    “Decentralized training has also been shown to be more efficient than centralized training when running federated systems in low-bandwidth or high-latency networks (Xiao et al. 2020;Liu et al. 2020;Jiang et al. 2020).”

    From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as Jiang et al. 2020

    The Introduction and Conclusions say BACombo is designed to avoid centralized-server congestion on poor network connections and report reduced training time. However, §6.1.3 lists only decentralized Gossip and Combo as experimental baselines; the paper does not demonstrate a training-time advantage over a centralized system or specifically test high-latency networks. It supports the low-bandwidth rationale, not the full comparative claim. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. McMahan, H.B.; Moore, E.; Ramage, D.; Hampson, S.; Arcas, B.A.y. Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 20-22 April 2017; pp. 1273-1282.
  2. Vulimiri, A.; Curino, C.; Godfrey, B.; Jungblut, T.; Padhye, J.; Varghese, G. Global analytics in the face of bandwidth and regulatory constraints. In Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), Santa Clara, CA, USA, 13 January 2015; pp. 323-336.
  3. Li, H.; Kadav, A.; Kruus, E.; Ungureanu, C. MALT: Distributed data-parallelism for existing ML applications. In Proceedings of the Tenth European Conference on Computer Systems, Bordeaux, France, 21-25 April 2015; p. 3.
  4. Watcharapichat, P.; Morales, V.L.; Fernandez, R.; Pietzuch, P.R. Ako: Decentralised Deep Learning with Partial Gradient Exchange. In Proceedings of the Tenth European Conference on Computer Systems, Bordeaux, France, 21-24 April 2016; pp. 84-97.
  5. Hsieh, K.; Harlap, A.; Vijaykumar, N.; Konomis, D.; Ganger, G.R.; Gibbons, P.B.; Mutlu, O. Gaia: Geo-distributed machine learning approaching {LAN} speeds. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), Boston, MA, USA, 27-29 March 2017; pp. 629-647.
  6. Zhang, B.; Jin, X.; Ratnasamy, S.; Wawrzynek, J.; Lee, E.A. Awstream: Adaptive wide-area streaming analytics. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, Budapest, Hungary, 20-25 August 2018; pp. 236-252.

Cited by

Sorted by citations

Authors
Jiang, J., Hu, L., Hu, C., Liu, J., & Wang, Z.
Affiliations
  • Jilin University (CN)
  • Tsinghua Shenzhen International Graduate School (CN)
  • Peng Cheng Laboratory (CN)
Corresponding author
Wang, Zhi
Venue
Electronics
Publisher
MDPI AG
Published
2020-03-05
Volume
9
Issue
3
Pages
440
ISSN
2079-9292 (ISSN-L)
OpenAlex
W3009426715
Cited by
47
References
22
Citations by year
2026: 4 · 2025: 10 · 2024: 4 · 2023: 12 · 2022: 12 · 2021: 2 · 2020: 3
FWCI
2.85
Type
journal article
Language
en
Open access
Locations
  • Electronics (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
  • Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Control Multi-Agent Systems
Keywords
decentralized federated learning, model segmentation, worker selection, network capacity, communication efficiency, convergence guarantees, data privacy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review