Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning
Open accessThe DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Abstract
Wireless connectivity is instrumental in enabling scalable federated learning (FL), yet wireless channels bring challenges for model training, in which channel randomness perturbs each worker’s model update while multiple workers’ updates incur significant interference under limited bandwidth. To address these challenges, in this work we formulate a novel constrained optimization problem, and propose an FL framework harnessing wireless channel perturbations and interference for improving privacy, bandwidth-efficiency, and scalability. The resultant algorithm is coinedanalog federated ADMM (A-FADMM)based on analog transmissions and the alternating direction method of multipliers (ADMM). In A-FADMM, all workers upload their model updates to the parameter server (PS) using a single channel via analog transmissions, during which all models are perturbed and aggregated over-the-air. This not only saves communication bandwidth, but also hides each worker’s exact model update trajectory from any eavesdropper including the honest-but-curious PS, thereby preserving data privacy against model inversion attacks. We formally prove the convergence and privacy guarantees of A-FADMM for convex functions under time-varying channels, and numerically show the effectiveness of A-FADMM under noisy channels and stochastic non-convex functions, in terms of convergence speed and scalability, as well as communication bandwidth and energy efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“An adversary could use targeted attacks to create vulnerabilities to specific types of adversarial examples [115, 214] or use untargeted attacks to degrade the effectiveness of adversarial training.”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [214]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Such methods are motivated by previous studies which showed empirically that poisoned data designed to introduce a backdoor often triggers so-called 'backdoor neurons' [214].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [214]
Experimental — accuracy not yet measuredIn the citing paper
“The resulting inherent noisy model aggregation scheme can limit the privacy disclosure of local datasets at the edge server for free while keeping the learning performance unchanged [41], [166].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [166]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationFederated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Message-passing algorithms for compressed sensing
Donoho, D. L., Maleki, A., & Montanari, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0909892106 · Cited by 2,416
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134012 · Cited by 1,377
Energy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Glowinski, R., & Marroco, A. (1975) · Revue française d'automatique, informatique, recherche opérationnelle. Analyse numérique · doi:10.1051/m2an/197509r200411 · Cited by 1,105
Federated Learning over Wireless Networks: Optimization Model Design and Analysis
Tran, N. H., Bao, W., Zomaya, A., Nguyen, M. N. H., & Hong, C. S. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737464 · Cited by 1,013
Cross-Layer Combining of Adaptive Modulation and Coding With Truncated ARQ Over Wireless Links
Liu, Q., Zhou, S., & Giannakis, G. B. (2004) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2004.833474 · Cited by 928
Broadband Analog Aggregation for Low-Latency Federated Edge Learning
Zhu, G., Wang, Y., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946245 · Cited by 761
Channel estimation for wireless ofdm systems
Ozdemir, M., & Arslan, H. (2007) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2007.382406 · Cited by 641
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
Federated Learning Over Wireless Fading Channels
Amiri, M. M., & Gunduz, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2974748 · Cited by 625
Fundamentals of wireless communications
King, C. (2014) · 2014 67th Annual Conference for Protective Relay Engineers · doi:10.1109/cpre.2014.6799022 · Cited by 532
Local Differential Privacy-Based Federated Learning for Internet of Things
Zhao, Y., Zhao, J., Yang, M., Wang, T., Wang, N., Lyu, L., Niyato, D., & Lam, K.-Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3037194 · Cited by 456
Parallel Multi-Block ADMM with o(1 / k) Convergence
Deng, W., Lai, M.-J., Peng, Z., & Yin, W. (2017) · Journal of Scientific Computing · doi:10.1007/s10915-016-0318-2 · Cited by 455
Adaptive modulation and MIMO coding for broadband wireless data networks
Catreux, S., Erceg, V., Gesbert, D., & Heath, R. W. (2002) · IEEE Communications Magazine · doi:10.1109/mcom.2002.1007416 · Cited by 434
Zhu, G., Du, Y., Gunduz, D., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3039309 · Cited by 376
Wireless Edge Computing With Latency and Reliability Guarantees
Elbamby, M. S., Perfecto, C., Liu, C., Park, J., Samarakoon, S., Chen, X., & Bennis, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2917084 · Cited by 207
Self-citationADMM Based Privacy-Preserving Decentralized Optimization
Zhang, C., Ahmad, M., & Wang, Y. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2855169 · Cited by 206
On Analog Gradient Descent Learning Over Multiple Access Fading Channels
Sery, T., & Cohen, K. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2989580 · Cited by 172
Energy-Aware Analog Aggregation for Federated Learning with Redundant Data
Sun, Y., Zhou, S., & Gunduz, D. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148853 · Cited by 111
Wireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Self-citationOver-the-Air Machine Learning at the Wireless Edge
Amiri, M. M., & Gündüz, D. (2019) · 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815402 · Cited by 60
GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning
Elgabli, A., Park, J., Bedi, A. S., Bennis, M., & Aggarwal, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00047 · Cited by 42
Self-citationGADMM: Fast and Communication Efficient Framework for Distributed Machine Learning
Elgabli, A., Park, J., Bedi, A. S., Bennis, M., & Aggarwal, V. (2020) · Own your potential (DEAKIN) · Cited by 29
Self-citationCommunication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
Park, J., Samarakoon, S., Elgabli, A., Kim, J., Bennis, M., Kim, S.-L., & Debbah, M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3055679 · Cited by 25
Self-citationCommunication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMMPreprint
Issaid, C. B., Elgabli, A., Park, J., & Bennis, M. (2020) · arXiv.org · doi:10.48550/arxiv.2009.06459 · Cited by 13
Self-citation
Research works printed but not linked: 3
- 30. L. Torgo, "Regression datasets," 2014. [Online]. Available: https: //www.dcc.fc.up.pt/~ltorgo/Regression/DataSets.html
- 26. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde- Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," in Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Q. Weinberger, Eds., vol. 27. Curran Associates, Inc., 2014. [Online]. Available: https://proceedings.neurips.cc/paper/2014/ file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf
- 2017, 5G NR Physical channels and modulation
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
Federated Learning via Intelligent Reflecting Surface
Wang, Z., Qiu, J., Zhou, Y., Shi, Y., Fu, L., Chen, W., & Letaief, K. B. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3099505 · Cited by 205
Wireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · doi:10.1561/9781638280071 · Cited by 57
Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
Fan, D., Yuan, X., & Zhang, Y. A. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118348 · Cited by 34
Metadata
- Authors
- Elgabli, A., Park, J., Issaid, C. B., & Bennis, M.
- Affiliations
- University of Oulu (FI)
- Deakin University (AU)
- Venue
- IEEE Transactions on Communications
- Published
- 2021-08
- Volume
- 69
- Issue
- 8
- Pages
- 5194-5208
- ISSN
- 0090-6778 (ISSN-L)
- 1558-0857
- OpenAlex
- W3038145895
- Cited by
- 14
- References
- 37
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 2 · 2021: 8
- FWCI
- 1.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IEEE Transactions on Communications (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Deakin Research Online (Deakin University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Academy of Finland 6G Flagship (318927)
- project SMARTER, projects EU-ICT IntellIoT (957218)
- EUCHISTERA LearningEdge, Infotech-NOOR
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Wireless Communication Security Techniques
- Keywords
- federated learning, wireless channels, channel randomness, interference, privacy preservation, model inversion attacks, over-the-air aggregation, analog signal transmission, alternating direction method of multipliers, spectral efficiency, scalability, honest-but-curious server, eavesdropping, convergence analysis, non-convex optimization, energy efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.