Cited by 112Privacy-Preserving Technologies in DataIoT and Edge/Fog ComputingDomain Adaptation and Few-Shot Learning

Accelerating Federated Learning for IoT in Big Data Analytics With Pruning, Quantization and Selective Updating

Open access
Xu, Wenyuan, Fang, Weiwei, Ding, Yi, Zou, Meixia, Xiong, Naixue·2021·IEEE Access

Abstract

The ever-increasing number of Internet of Things (IoT) devices are continuously generating huge masses of data, but the current cloud-centric approach for IoT big data analysis has raised public concerns on both data privacy and network cost. Federated learning (FL) recently emerges as a promising technique to accommodate these concerns, by means of learning a global model by aggregating local updates from multiple devices without sharing the privacy-sensitive data. However, IoT devices usually have constrained computation resources and poor network connections, making it infeasible or very slow to train deep neural networks (DNNs) by following the FL pattern. To address this problem, we propose a new efficient FL framework called FL-PQSU in this paper. It is composed of 3-stage pipeline: structured pruning, weight quantization and selective updating, that work together to reduce the costs of computation, storage, and communication to accelerate the FL training process. We study FL-PQSU using popular DNN models (AlexNet, VGG16) and publicly available datasets (MNIST, CIFAR10), and demonstrate that it can well control the training overhead while still guaranteeing the learning performance.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2021.3063291

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 26 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. S. Han, H. Mao, and W. J. Dally, ''Deep compression: Compressing deep neural network with pruning, trained quantization and Huffman coding,'' in Proc. 4th Int. Conf. Learn. Represent., 2016, pp. 1-14.
  2. S. Han, J. Pool, J. Tran, and W. Dally, ''Learning both weights and con- nections for efficient neural network,'' in Proc. Adv. Neural Inf. Process. Syst., 2015, pp. 1135-1143.
  3. P. Singh, V. Kumar Verma, P. Rai, and V. P. Namboodiri, ''Play and prune: Adaptive filter pruning for deep model compression,'' in Proc. 28th Int. Joint Conf. Artif. Intell., Aug. 2019, pp. 3460-3466.
  4. S. Lym, E. Choukse, S. Zangeneh, W. Wen, S. Sanghavi, and M. Erez, ''PruneTrain: Fast neural network training by dynamic sparse model recon- figuration,'' in Proc. Int. Conf. High Perform. Comput., Netw., Storage Anal., Nov. 2019, pp. 1-13.

Cited by

Sorted by citations

Authors
Xu, W., Fang, W., Ding, Y., Zou, M., & Xiong, N.
Affiliations
  • Beijing Jiaotong University (CN)
  • Beijing Wuzi University (CN)
  • Tianjin University (CN)
Venue
IEEE Access
Published
2021
Volume
9
Pages
38457-38466
ISSN
2169-3536 (ISSN-L)
OpenAlex
W3133504636
Cited by
112
References
26
Citations by year
2026: 11 · 2025: 23 · 2024: 37 · 2023: 17 · 2022: 17 · 2021: 7
FWCI
6.89
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Greater South Information System
Funders
  • Beijing Municipal Natural Science Foundation (L191019)
  • Open Project of Key Laboratory of Industrial Internet of Things & Networked Control, Ministry of Education (2019FF03)
  • Open Project of Beijing Intelligent Logistics System Collaborative Innovation Center (BILSCIC-2019KF-10)
  • CERNET Innovation Project (NGII20190308)
  • Traffic Control Technology Innovation Fund (9907006515)
  • Research Base Project of Beijing Municipal Social Science Foundation (18JDGLB026)
  • Science and Technique General Program of Beijing Municipal Commission of Education (KM201910037003)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
federated learning, Internet of Things, structured pruning, weight quantization, deep neural network, resource-constrained devices, communication cost reduction, privacy preservation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review