CoChat

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis

Open access
Zhu, Guangxu, Du, Yuqing, Gunduz, Deniz, Huang, Kaibin · 2021 · IEEE Transactions on Wireless Communications

The DOI matches its Crossref record; 35 of the 37 references it cites were found in a registry or an index.

Abstract

Federated edge learning (FEEL) is a popular framework for model training at an edge server using data distributed at edge devices (e.g., smart-phones and sensors) without compromising their privacy. In the FEEL framework, edge devices periodically transmit high-dimensional stochastic gradients to the edge server, where these gradients are aggregated and used to update a global model. When the edge devices share the same communication medium, the multiple access channel (MAC) from the devices to the edge server induces a communication bottleneck. To overcome this bottleneck, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients (or local models) via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation (OBDA). The new scheme features one-bit gradient quantization followed by digital quadrature amplitude modulation (QAM) at edge devices and over-the-air majority-voting based decoding at edge server. We provide a comprehensive analysis of the effects of wireless channel hostilities (channel noise, fading, and channel estimation errors) on the convergence rate of the proposed FEEL scheme. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, we show that all the negative effects vanish as the number of participating devices grows, but at a different rate for each type of channel hostility.

Overview

Integrity signals

Registry

Crossref · 10.1109/twc.2020.3039309

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Research works printed but not linked: 2

  1. arunabha, 2010, Fundamentals of LTE
  2. 2010, Timing Advance (TA) in LTE

Cited by

See all 435

Metadata

Authors
Zhu, G., Du, Y., Gunduz, D., & Huang, K.
Affiliations
  • Shenzhen Research Institute of Big Data (CN)
  • University of Hong Kong (HK)
Venue
IEEE Transactions on Wireless Communications
Published
2021-03
Volume
20
Issue
3
Pages
2120-2135
ISSN
  • 1536-1276 (ISSN-L)
  • 1558-2248
OpenAlex
W3108590825
Cited by
376
References
37
Citations by year
2026: 30 · 2025: 45 · 2024: 61 · 2023: 93 · 2022: 68 · 2021: 58
FWCI
23.57
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Wireless Communications (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
  • Spiral (Imperial College London) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (62001310)
  • National Key Research and Development Program of China (2018YFB1800800)
  • Guangdong Province Key Area Research and Development Program (2018B030338001)
  • Shenzhen Peacock Plan (KQTD2015033114415450)
  • European Research Council (ERC) through the Starting Grant BEACON (677854)
  • U.K. EPSRC (EP/T023600/1)
  • Guangdong Basic and Applied Basic Research Foundation (2019B1515130003)
  • Hong Kong Research Grants Council (17208319, 17209917)
  • Innovation and Technology Fund (GHP/016/18GD)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
Keywords
federated edge learning, over-the-air aggregation, 1-bit quantization, convergence analysis, channel estimation error, fading, channel noise, communication bottleneck, edge devices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.