Helios: Heterogeneity-Aware Federated Learning with Dynamically Balanced Collaboration
Open accessAbstract
In this paper, we propose Helios, a heterogeneity-aware FL framework to tackle the straggler issue. Helios identifies individual devices' heterogeneous training capability, and therefore the expected neural network model training volumes regarding the collaborative training pace. For straggling devices, a "soft-training" method is proposed to dynamically compress the original identical training model into the expected volume through a rotating neuron training approach. With extensive algorithm analysis and optimization schemes, the stragglers can be accelerated while retaining the convergence for local training as well as federated collaboration.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ELFISH improves training speed by 2× through resource optimization.
“It is worth noting that although ELFISH improves the training speed by 2× through resource optimization, the idea of ELFISH is to make all stragglers work synchronously, the synchronous aggregation of which may not able to handle extreme situations.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [218]
[218] improves model accuracy by 4% and accelerates training by 2×.
“Training acceleration: 2×; Model accuracy improvement: 4%”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [218]
Cited by
Sorted by citations
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · see citing works
“It is worth noting that although ELFISH improves the training speed by 2× through resource optimization, the idea of ELFISH is to make all stragglers work synchronously, the synchronous aggregation of which may not able to handle extreme situations.”
BackgroundSelf-citationFederated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503 · see citing works
- Authors
- Xu, Z., Yu, F., Xiong, J., & Chen, X.
- Affiliations
- George Mason University (US)
- IBM Research - Thomas J. Watson Research Center (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 997-1002
- ISSN
- 0738-100X (ISSN-L)
- arXiv
- 1912.01684
- OpenAlex
- W3211786132
- Cited by
- 72
- References
- 0
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 18 · 2023: 19 · 2022: 12 · 2021: 6 · 2020: 2
- FWCI
- 6.35
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM/IEEE Design Automation Conference (DAC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2003211)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, heterogeneous devices, computational power, parameter aggregation, training acceleration, convergence accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
