Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Federated Learning (FL) refers to distributed protocols that avoid direct raw data exchange among the participating devices while training for a common learning task. This way, FL can potentially reduce the information on the local data sets that is leaked via communications. In order to provide formal privacy guarantees, however, it is generally necessary to put in place additional masking mechanisms. When FL is implemented in wireless systems via uncoded transmission, the channel noise can directly act as a privacy-inducing mechanism. This paper demonstrates that, as long as the privacy constraint level, measured via differential privacy (DP), is below a threshold that decreases with the signal-to-noise ratio (SNR), uncoded transmission achieves privacy “for free”, i.e., without affecting the learning performance. More generally, this work studies adaptive power allocation (PA) for distributed gradient descent in wireless FL with the aim of minimizing the learning optimality gap under privacy and power constraints. Both orthogonal multiple access (OMA) and non-orthogonal multiple access (NOMA) transmission with “over-the-air-computing” are studied, and solutions are obtained in closed form for an offline optimization setting. Furthermore, heuristic online methods are proposed that leverage iterative one-step-ahead optimization. The importance of dynamic PA and the potential benefits of NOMA versus OMA are demonstrated through extensive simulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The additive channel noise in model aggregation can also serve as an inherent privacy-preserving mechanism to guarantee differential-privacy levels for each edge device without sacrificing learning performance [41].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [41]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“An adaptive power control method was further developed in [41] to control the differential-privacy levels in this over-the-air FL system, while avoiding the learning performance degradation.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [41]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The additive noise and signal superposition properties in the wireless channel can be naturally harnessed as the privacy-preserving mechanism [41].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [41]
In the citing paper
“The resulting inherent noisy model aggregation scheme can limit the privacy disclosure of local datasets at the edge server for free while keeping the learning performance unchanged [41], [166].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [41]
In the citing paper
“The optimality gap can be further controlled by transmit power allocation [41], [173], [176], model aggregation receiver beamforming design [31], [177], [178], and device scheduling [31], [178], [179].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [41]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Optimization Methods for Large-Scale Machine Learning
Bottou, L., Curtis, F. E., & Nocedal, J. (2018) · SIAM Review · doi:10.1137/16m1080173 · Cited by 3,128
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Federated Learning with Non-IID Data
Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., & Chandra, V. (2018) · arXiv · doi:10.48550/arxiv.1806.00582 · Cited by 2,077
Exploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Alistarh, D., Grubic, D., Li, J., Tomioka, R., & Vojnović, M. (2016) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · doi:10.48550/arxiv.1610.02132 · Cited by 859
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition
Karimi, H., Nutini, J., & Schmidt, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46128-1_50 · Cited by 824
Broadband Analog Aggregation for Low-Latency Federated Edge Learning
Zhu, G., Wang, Y., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946245 · Cited by 761
Computation Over Multiple-Access Channels
Nazer, B., & Gastpar, M. (2007) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.904785 · Cited by 753
Toward an Intelligent Edge: Wireless Communication Meets Machine Learning
Zhu, G., Liu, D., Du, Y., You, C., Zhang, J., & Huang, K. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900103 · Cited by 606
Self-citationFedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
Reisizadeh, A., Mokhtari, A., Hassani, H., Jadbabaie, A., & Pedarsani, R. (2019) · arXiv · doi:10.48550/arxiv.1909.13014 · Cited by 587 · cited 1×
“data sets in federated learning [31]–[33].”
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548
signSGD: Compressed Optimisation for Non-Convex Problems
Bernstein, J., Wang, Y.-X., Azizzadenesheli, K., & Anandkumar, A. (2018) · arXiv · doi:10.48550/arxiv.1802.04434 · Cited by 541
Zhu, G., Du, Y., Gunduz, D., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3039309 · Cited by 376
Hybrid deterministic-stochastic methods for data fitting
Friedlander, M. P., & Schmidt, M. (2011) · Cited by 314
Hybrid Deterministic-Stochastic Methods for Data Fitting
Friedlander, M. P., & Schmidt, M. (2012) · SIAM Journal on Scientific Computing · doi:10.1137/110830629 · Cited by 254
Optimized Power Control for Over-the-Air Computation in Fading Channels
Cao, X., Zhu, G., Xu, J., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3012287 · Cited by 248
Protection Against Reconstruction and Its Applications in Private Federated Learning
Bhowmick, A., Duchi, J. C., Freudiger, J., Kapoor, G., & Rogers, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00984 · Cited by 240
Stochastic Optimization with Importance Sampling for Regularized Loss Minimization
Zhao, P., & Zhang, T. (2015) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 228
Wireless Federated Learning with Local Differential Privacy
Seif, M., Tandon, R., & Li, M. (2020) · 2020 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174426 · Cited by 200
cpSGD: Communication-efficient and differentially-private distributed SGD
Agarwal, N., Suresh, A. T., Yu, F., Kumar, S., & McMahan, H. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10559 · Cited by 180
On Analog Gradient Descent Learning Over Multiple Access Fading Channels
Sery, T., & Cohen, K. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2989580 · Cited by 172
Gradient Statistics Aware Power Control for Over-the-Air Federated Learning
Zhang, N., & Tao, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3065748 · Cited by 153
Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergences
Balle, B., Barthe, G., & Gaboardi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01647 · Cited by 146
The Value of Collaboration in Convex Machine Learning with Differential Privacy
Wu, N., Farokhi, F., Smith, D., & Kaafar, M. A. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00025 · Cited by 122
Time Synchronization in 5G Wireless Edge: Requirements and Solutions for Critical-MTC
Mahmood, A., Ashraf, M. I., Gidlund, M., Torsner, J., & Sachs, J. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900379 · Cited by 117
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning
Du, Y., Yang, S., & Huang, K. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2983166 · Cited by 116
Wireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
vqSGD: Vector Quantized Stochastic Gradient Descent
Gandikota, V., Kane, D., Maity, R. K., & Mazumdar, A. (2019) · arXiv · doi:10.48550/arxiv.1911.07971 · Cited by 80
Why gradient clipping accelerates training: A theoretical justification for adaptivity
Sra, S., He, T., Sra, S., & Jadbabaie, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11881 · Cited by 79
Differentially Private Aircomp Federated Learning with Power Adaptation Harnessing Receiver Noise
Koda, Y., Yamamoto, K., Nishio, T., & Morikura, M. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322199 · Cited by 68
vqSGD: Vector Quantized Stochastic Gradient Descent
Gandikota, V., Kane, D., Maity, R. K., & Mazumdar, A. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3161620 · Cited by 62
Understanding Gradient Clipping in Private SGD: A Geometric Perspective
Chen, X., Wu, Z. S., & Hong, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15429 · Cited by 57
Communication Efficient Federated Learning over Multiple Access Channels
Chang, W.-T., & Tandon, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08737 · Cited by 43
RMS Delay Spread vs. Coherence Bandwidth from 5G Indoor Radio Channel Measurements at 3.5 GHz Band
Debaenst, W., Feys, A., Cuiñas, Í., Sánchez, M. G., & Verhaevert, J. (2020) · Sensors · doi:10.3390/s20030750 · Cited by 38
Efficient On-Device Models using Neural Projections
Ravi, S. (2019) · International Conference on Machine Learning · Cited by 27
Wireless Federated Learning with Local Differential PrivacyPreprint
Seif, M., Tandon, R., & Li, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05151 · Cited by 25
Efficient Federated Learning over Multiple Access Channel with Differential Privacy ConstraintsPreprint
Sonee, A., & Rini, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07776 · Cited by 20
Doppler Shift and Coherence Time of 5G Vehicular Channels at 3.5 GHz
Wang, S., Guan, K., He, D., Li, G., Lin, X., Ai, B., & Zhong, Z. D. (2018) · Digest - IEEE Antennas and Propagation Society. International Symposium · doi:10.1109/apusncursinrsm.2018.8608340 · Cited by 20
Gradient Statistics Aware Power Control for Over-the-Air Federated LearningPreprint
Zhang, N., & Tao, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02089 · Cited by 15
Zhu, G., Du, Y., Gündüz, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.05713 · Cited by 9
The Value of Collaboration in Convex Machine Learning with Differential PrivacyPreprint
Wu, N., Farokhi, F., Smith, D. B., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09679 · Cited by 6
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Federated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z., Chen, M., Wong, K.-K., Poor, H. V., & Cui, S. (2022) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 374
What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligence
Lan, Q., Wen, D., Zhang, Z., Zeng, Q., Chen, X., Popovski, P., & Huang, K. (2021) · Journal of Communications and Information Networks · doi:10.23919/jcin.2021.9663101 · Cited by 255
Zhu, G., Lyu, Z., Jiao, X., Liu, P., Chen, M., Xu, J., Cui, S., & Zhang, P. (2023) · Science China Information Sciences · doi:10.1007/s11432-022-3652-2 · Cited by 239
Metadata
- Authors
- Liu, D., & Simeone, O.
- Affiliations
- King's College London (GB)
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-01
- Volume
- 39
- Issue
- 1
- Pages
- 170-185
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3111192549
- Cited by
- 234
- References
- 49
- Citations by year
- 2026: 17 · 2025: 37 · 2024: 40 · 2023: 58 · 2022: 47 · 2021: 34
- FWCI
- 13.76
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.gla.ac.uk
- Locations
- IEEE Journal on Selected Areas in Communications (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- arXiv (Cornell University) (submittedVersion)
- Research Portal (King's College London) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- European Research Council (ERC) under the European Unions Horizon 2020 Research and Innovation Programme (725731)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Wireless Communication Security Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Technologies
- Keywords
- wireless federated learning, differential privacy, uncoded transmission, adaptive power control, power allocation, non-orthogonal multiple access, orthogonal multiple access, distributed gradient descent, signal-to-noise ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.