CoChat

Communication-efficient federated learning

Open access
Chen, Mingzhe, Shlezinger, Nir, Poor, H. Vincent, Eldar, Yonina C., Cui, Shuguang · 2021 · Proceedings of the National Academy of Sciences

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

Significance Federated learning (FL) is an emerging paradigm that enables multiple devices to collaborate in training machine learning (ML) models without having to share their possibly private data. FL requires a multitude of devices to frequently exchange their learned model updates, thus introducing significant communication overhead, which imposes a major challenge in FL over realistic networks that are limited in computational and communication resources. In this article, we propose a communication-efficient FL framework that enables edge devices to efficiently train and transmit model parameters, thus significantly improving FL performance and convergence speed. Our proposed FL framework paves the way to collaborative ML in large-scale networking systems such as Internet of Things networks. Federated learning (FL) enables edge devices, such as Internet of Things devices (e.g., sensors), servers, and institutions (e.g., hospitals), to collaboratively train a machine learning (ML) model without sharing their private data. FL requires devices to exchange their ML parameters iteratively, and thus the time it requires to jointly learn a reliable model depends not only on the number of training steps but also on the ML parameter transmission time per step. In practice, FL parameter transmissions are often carried out by a multitude of participating devices over resource-limited communication networks, for example, wireless networks with limited bandwidth and power. Therefore,…

Overview

Integrity signals

Registry

Crossref · 10.1073/pnas.2024789118

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 45 references

Research works printed but not linked: 2

  1. T. Chen, G. Giannakis, T. Sun, W. Yin, Lag, “Lazily aggregated gradient for communication-efficient distributed learning” in Proceedings of Advances in Neural Information Processing Systems, S. Bengio et al., Eds. (Neural Information Processing Systems Foundation, 2018), p. 2440.
  2. S. U. Stich, “Local SGD converges fast and communicates little” in Proceedings of the International Conference on Learning Representations (ICLR, 2019).

Cited by

See all 397

Metadata

Authors
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S.
Affiliations
  • Princeton University (US)
  • Ben-Gurion University of the Negev (IL)
  • Weizmann Institute of Science (IL)
  • Shenzhen Research Institute of Big Data (CN)
Venue
Proceedings of the National Academy of Sciences
Published
2021-04-22
Volume
118
Issue
17
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W3156841666
Cited by
397
References
45
Citations by year
2026: 48 · 2025: 99 · 2024: 91 · 2023: 81 · 2022: 47 · 2021: 31
FWCI
21.89
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
Keywords
federated learning, communication efficiency, parameter quantization, wireless resource allocation, convergence time, edge devices, Internet of Things, communication delay, privacy-preserving machine learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Communication-efficient federated learning. https://app.cochat.ai/papers/10.1073/pnas.2024789118
The paper
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S. (2021). Communication-efficient federated learning. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2024789118

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.