Secure Distributed On-Device Learning Networks with Byzantine Adversaries
Open accessThe DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Privacy concerns exist when the central server has copies of datasets. Hence, there is a paradigm shift for learning networks to change from centralized in-cloud learning to distributed on-device learning. Benefitting from parallel computing, on-device learning networks have a lower bandwidth requirement than in-cloud learning networks. Moreover, on-device learning networks also have several desirable characteristics such as privacy preserving and flexibility. However, on-device learning networks are vulnerable to the malfunctioning terminals across the networks. The worst-case malfunctioning terminals are the Byzantine adversaries, that can perform arbitrary harmful operations to compromise the learned model based on the full knowledge of the networks. Hence, the design of secure learning algorithms becomes an emerging topic in the on-device learning networks with Byzantine adversaries. In this article, we present a comprehensive overview of the prevalent secure learning algorithms for the two promising on-device learning networks: Federated-Learning networks and decentralized-learning networks. We also review several future research directions in the Federated- Learning and decentralized-learning networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the learned global model can be colluded by malicious attackers [40], [165]”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [40]
Citations
Cites
The Byzantine generals problem
Lamport, L., Shostak, R., & Pease, M. (1982) · ACM Transactions on Programming Languages and Systems · doi:10.1145/357172.357176 · Cited by 6,023 · cited 1×
“• Choose arbitrarily bad action from the full malicious action space to compromise the prediction accuracy of the networks [12].”
Background(2017) · neural information processing systems · Cited by 1,413
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Yin, D., Chen, Y., Ramchandran, K., & Bartlett, P. (2018) · arXiv · doi:10.48550/arxiv.1803.01498 · Cited by 1,130 · cited 4×
“proposed two aggregation rules [5]: component-wise median (CwMed) and component-wise trimmed mean (CwTM).”
BackgroundMethodInfluentialThe Hidden Vulnerability of Distributed Learning in Byzantium
Mhamdi, E. M. E., Guerraoui, R., & Rouault, S. (2018) · arXiv · doi:10.48550/arxiv.1802.07927 · Cited by 648
Federated Optimization:Distributed Optimization Beyond the Datacenter
Konečný, J., McMahan, B., & Ramage, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03575 · Cited by 544
Li, L., Xu, W., Chen, T., Giannakis, G. B., & Ling, Q. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011544 · Cited by 373
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed LearningPreprint
Chen, T., Giannakis, G. B., Sun, T., & Yin, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09965 · Cited by 329
Distributed Optimization Under Adversarial Nodes
Sundaram, S., & Gharesifard, B. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2836919 · Cited by 274
Distributed Statistical Machine Learning in Adversarial Settings: Byzantine Gradient Descent
Chen, Y., Su, L., & Xu, J. (2018) · Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems · doi:10.1145/3219617.3219655 · Cited by 228
Byzantine Stochastic Gradient Descent
Alistarh, D., Allen-Zhu, Z., & Li, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08917 · Cited by 163
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“…issue by keeping datasets locally, the shared model updates still cause extreme privacy leakage (e.g., model inversion attack), the learned global model can be colluded by malicious attackers [40], [165], and the edge devices may be adversarial at-tackers (e.g., data or model poisoning).”
BackgroundCommunication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488
Fraga-Lamas, P., Lopes, S. I., & Fernández-Caramés, T. M. (2021) · Sensors · doi:10.3390/s21175745 · Cited by 405
Hashemi, H., Wang, Y., & Annavaram, M. (2021) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3466752.3480112 · Cited by 81
Shkalenko, A. V., & Nazarenko, A. V. (2024) · Risks · doi:10.3390/risks12060087 · Cited by 67
Metadata
- Authors
- Dong, Y., Cheng, J., Hossain, M. J., & Leung, V. C. M.
- Affiliations
- University of British Columbia (CA)
- Venue
- IEEE Network
- Published
- 2019-11
- Volume
- 33
- Issue
- 6
- Pages
- 180-187
- ISSN
- 0890-8044 (ISSN-L)
- 1558-156X
- OpenAlex
- W2966325922
- Cited by
- 28
- References
- 16
- Citations by year
- 2025: 5 · 2024: 5 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 6 · 2019: 2
- FWCI
- 1.73
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Network (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Killam Trusts
- University of British Columbia
- Shenzhen University
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Keywords
- on-device learning, Byzantine adversaries, federated learning, decentralized learning, privacy preservation, model robustness, distributed learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Secure Distributed On-Device Learning Networks with Byzantine Adversaries. https://app.cochat.ai/papers/10.1109/mnet.2019.1900025
- The paper
- Dong, Y., Cheng, J., Hossain, M. J., & Leung, V. C. M. (2019). Secure Distributed On-Device Learning Networks with Byzantine Adversaries. IEEE Network. https://doi.org/10.1109/mnet.2019.1900025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.