The DOI matches its DataCite record; 2 of the 4 references it cites were found in a registry or an index, and 2 are not checked yet.
Learning Differentially Private Recurrent Language Models
Open accessAbstract
We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep networks on user-partitioned data and privacy accounting for stochastic gradient descent. In particular, we add user-level privacy protection to the federated averaging algorithm, which makes "large step" updates from user-level data. Our work demonstrates that given a dataset with a sufficiently large number of users (a requirement easily met by even small internet-scale datasets), achieving differential privacy comes at the cost of increased computation, rather than in decreased utility as in most prior work. We find that our private LSTM language models are quantitatively and qualitatively similar to un-noised models when trained on a large dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This proved that, with sufficient devices participating in federated training, privacy protection could be achieved with a small additional overhead.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Simultaneously, both approaches guaranteed high model accuracy.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Therefore, federated learning has a promising application in NLP like virtual keyboard prediction [7, 39, 70].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [70]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 14
- Martin Abadi, Andy Chu, Ian Goodfellow, Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. Deep learning with differential privacy. In 23rd ACM Conference on Computer and Communications Security (ACM CCS) , 2016a.
- Rami Al-Rfou, Marc Pickett, Javier Snaider, Yun-Hsuan Sung, Brian Strope, and Ray Kurzweil. Conversational contextual cues: The case of personalization and history for response ranking. CoRR , abs/1606.00372, 2016. URL http://arxiv.org/abs/1606.00372 . · arXiv
- R. Bassily, K. Nissim, U. Stemmer, and A. Thakurta. Practical locally private heavy hitters. ArXiv e-prints , July 2017. URL https://arxiv.org/abs/1707.04982 . · arXiv
- N. Carlini, C. Liu, J. Kos, ´ U. Erlingsson, and D. Song. The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets. ArXiv e-prints , February 2018. URL https://arxiv. org/abs/1802.08232 .
- T-H Hubert Chan, Mingfei Li, Elaine Shi, and Wenchang Xu. Differentially private continual monitoring of heavy hitters from distributed streams. In International Symposium on Privacy Enhancing Technologies Symposium , pages 140-159. Springer, 2012.
- Yarin Gal and Zoubin Ghahramani. A theoretically grounded application of dropout in recurrent neural networks. In Advances in Neural Information Processing Systems , pages 1019-1027, 2016.
- Edouard Grave, Armand Joulin, and Nicolas Usunier. Improving neural language models with a continuous cache. arXiv preprint arXiv:1612.04426 , 2016. · arXiv
- Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. Pointer sentinel mixture models. arXiv preprint arXiv:1609.07843 , 2016. · arXiv
- Nicolas Papernot, Mart´ ın Abadi, ´ Ulfar Erlingsson, Ian Goodfellow, and Kunal Talwar. Semi-supervised knowledge transfer for deep learning from private training data. In Proceedings of the International Conference on Learning Representations , 2017. URL https://arxiv.org/abs/1610.05755 . · arXiv
- Ofir Press and Lior Wolf. Using the output embedding to improve language models. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers , pages 157-163. Association for Computational Linguistics, 2017.
- Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. Membership inference attacks against machine learning models. In IEEE Symposium on Security and Privacy, Oakland , 2017. To Appear.
- Martin Sundermeyer, Ralf Schl¨ uter, and Hermann Ney. LSTM neural networks for language modeling. In Interspeech , pages 194-197, 2012.
- Xi Wu, Fengan Li, Arun Kumar, Kamalika Chaudhuri, Somesh Jha, and Jeffrey F. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In Proceedings of SIGMOD , 2017.
- Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning requires rethinking generalization. 2017. URL https://arxiv.org/abs/1611.03530 . · arXiv
Cited by
Sorted by citations
Items 201–300 of 852
Federated Learning Under Importance Sampling
Rizk, E., Vlaski, S., & Sayed, A. H. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3210365 · Cited by 52
A survey on vulnerability of federated learning: A learning algorithm perspective
Xie, X., Hu, C. X., Ren, H., & Deng, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127225 · Cited by 55
A Critical Evaluation of Privacy and Security Threats in Federated Learning
Asad, M., Moustafa, A., & Yu, C. (2020) · Sensors · doi:10.3390/s20247182 · Cited by 55
Pokhrel, S. R. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3060185 · Cited by 51
Federated Learning with Personalized Local Differential Privacy
Yang, G., Wang, S., & Wang, H. (2021) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs52626.2021.9449232 · Cited by 51
FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learning
Fereidooni, H., Pegoraro, A., Rieger, P., Dmitrienko, A., & Sadeghi, A. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.24620 · Cited by 56
RevFRF: Enabling Cross-Domain Random Forest Training With Revocable Federated Learning
Liu, Y., Ma, Z., Yang, Y., Liu, X., Ma, J., & Ren, K. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3104842 · Cited by 49
Natural Language Understanding with Privacy-Preserving BERT
Qu, C., Kong, W., Yang, L., Zhang, M., Bendersky, M., & Najork, M. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482281 · Cited by 73
TextHide: Tackling Data Privacy in Language Understanding Tasks
Huang, Y., Song, Z., Chen, D., Li, K., & Arora, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.123 · Cited by 55
FLASH: Heterogeneity-Aware Federated Learning at Scale
Yang, C., Xu, M., Wang, Q., Chen, Z., Huang, K., Ma, Y., Bian, K., Huang, G., Liu, Y., Jin, X., et al. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3214234 · Cited by 48
Personalized Federated Learning with Gaussian ProcessesPreprint
Achituve, I., Shamsian, A., Navon, A., Chechik, G., & Fetaya, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15482 · Cited by 52
Enhanced Security and Privacy via Fragmented Federated Learning
Jebreel, N., Domingo‐Ferrer, J., Blanco-Justicia, A., & Sánchez, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3212627 · Cited by 50
Scaling Federated Learning for Fine-Tuning of Large Language Models
Hilmkil, A., Callh, S., Barbieri, M., Sütfeld, L. R., Zec, E. L., & Mogren, O. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-80599-9_2 · Cited by 47
Deep Learning with Label Differential PrivacyPreprint
Ghazi, B., Golowich, N., Kumar, R., Manurangsi, P., & Zhang, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06062 · Cited by 59
Wu, B., Zhao, S., Sun, G., Zhang, X., Su, Z., Zeng, C., & Liu, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00220 · Cited by 44
Chen, L., Ding, X., Bao, Z., Zhou, P., & Jin, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3379001 · Cited by 50
Dispersed Federated Learning: Vision, Taxonomy, and Future Directions
Khan, L. U., Saad, W., Han, Z., & Hong, C. S. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.011.2100003 · Cited by 46
Stochastic-Sign SGD for Federated Learning with Theoretical GuaranteesPreprint
Jin, R., Huang, Y., He, X., Dai, H., & Wu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10940 · Cited by 87
Does Differential Privacy Really Protect Federated Learning From Gradient Leakage Attacks?
Hu, J., Du, J., Wang, Z., Pang, X., Zhou, Y., Sun, P., & Ren, K. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3417930 · Cited by 49
Toward Verifiable and Privacy Preserving Machine Learning Prediction
Niu, C., Wu, F., Tang, S., Ma, S., & Chen, G. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.3035591 · Cited by 49
Artificial Identification: A Novel Privacy Framework for Federated Learning Based on Blockchain
Ouyang, L., Wang, F., Tian, Y., Jia, X., Qi, H., & Wang, G. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3226861 · Cited by 46
PRECODE - A Generic Model Extension to Prevent Deep Gradient Leakage
Scheliga, D., Mäder, P., & Seeland, M. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00366 · Cited by 44
Decentralized Stochastic Optimization With Inherent Privacy Protection
Wang, Y., & Poor, H. V. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3174187 · Cited by 45
Security and Privacy Issues in Deep Learning: A Brief Review
Ha, T., Dang, T. K., Le, T. H., & Truong, T. A. (2020) · SN Computer Science · doi:10.1007/s42979-020-00254-4 · Cited by 46
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models
Shi, W., Shea, R., Chen, S., Zhang, C., Jia, R., & Zhou, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.425 · Cited by 43
Source Inference Attacks: Beyond Membership Inference Attacks in Federated Learning
Hu, H., Zhang, X., Salcic, Z. A., Sun, L., Choo, K. R., & Dobbie, G. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2023.3321565 · Cited by 47
Beyond Traditional Threats: A Persistent Backdoor Attack on Federated Learning
Liu, T., Zhang, Y., Zhu, F., Yang, Z. Q., Xu, C. G., Man, D., & Yang, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30131 · Cited by 46
The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems
Hu, S., Li, Y., Liu, X., Li, Q., Wu, Z., & He, B. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3510540 · Cited by 58
Hybrid differential privacy based federated learning for Internet of Things
Liu, W., Cheng, J., Wang, X., Lu, X., & Yin, J. (2022) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2022.102418 · Cited by 43
Learning and Evaluating a Differentially Private Pre-trained Language Model
Hoory, S., Feder, A., Tendler, A., Erell, S., Cohen, A., Laish, I., Nakhost, H., Stemmer, U., Benjamini, A., Hassidim, A., et al. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.102 · Cited by 43
Federated learning architecture: Design, implementation, and challenges in distributed AI systems
Shanmugam, L., Tillu, R., & Tomar, M. (2023) · Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online) · doi:10.60087/jklst.vol2.n2.p384 · Cited by 42
Xu, J. J., Zhang, W., & Fei, W. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107796 · Cited by 42
Multi-Stage Asynchronous Federated Learning With Adaptive Differential Privacy
Li, Y., Yang, S., Ren, X., Shi, L., & Zhao, C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3332428 · Cited by 45
Stripelis, D., Thompson, P. M., & Ambite, J. L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3524885 · Cited by 57
Are We There Yet? Timing and Floating-Point Attacks on Differential Privacy Systems
Jin, J., McMurtry, E., Rubinstein, B. I. P., & Ohrimenko, O. (2022) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46214.2022.9833672 · Cited by 46
Maintaining Privacy in Face Recognition Using Federated Learning Method
Woubie, A., Solomon, E., & Attieh, J. (2024) · IEEE Access · doi:10.1109/access.2024.3373691 · Cited by 41
Privacy for Free: Communication-Efficient Learning with Differential Privacy Using SketchesPreprint
Li, T., Liu, Z., Sekar, V., & Smith, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00972 · Cited by 40
Security of Federated Learning: Attacks, Defensive Mechanisms, and Challenges
Benmalek, M., Benrekia, M. A., & Challal, Y. (2022) · Revue d intelligence artificielle · doi:10.18280/ria.360106 · Cited by 39
A Survey and Guideline on Privacy Enhancing Technologies for Collaborative Machine Learning
Soykan, E. Ü., Karaçay, L., Karakoç, F., & Tomur, E. (2022) · IEEE Access · doi:10.1109/access.2022.3204037 · Cited by 45
Liu, C., Chen, B., Shao, W., Zhang, W., Wong, K. K. L., & Zhang, Y. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3377730 · Cited by 45
Asad, M., Moustafa, A., & Aslam, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107235 · Cited by 39
On Large-Cohort Training for Federated LearningPreprint
Charles, Z., Garrett, Z., Huo, Z., Shmulyian, S., & Smith, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07820 · Cited by 50
Securing Distributed SGD Against Gradient Leakage Threats
Wei, W., Liu, L., Zhou, J., Chow, K.-H., & Wu, Y. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3273490 · Cited by 43
Federated learning meets remote sensing
Moreno‐Álvarez, S., Paoletti, M. E., Sanchez‐Fernandez, A. J., Rico‐Gallego, J., Han, L., & Haut, J. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124583 · Cited by 46
Mitigating privacy risks in Retrieval-Augmented Generation via locally private entity perturbation
He, L., Tang, P., Zhang, Y., Zhou, P., & Su, S. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104150 · Cited by 49
Challenges of Privacy-Preserving Machine Learning in IoT
Zheng, M., Xu, D., Jiang, L., Gu, C., Tan, R., & Cheng, P. (2019) · International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things (AIChallengeIoT) · doi:10.1145/3363347.3363357 · Cited by 41
BayBFed: Bayesian Backdoor Defense for Federated Learning
Kumari, K., Rieger, P., Fereidooni, H., Jadliwala, M., & Sadeghi, A.-R. (2023) · 2023 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46215.2023.10179362 · Cited by 37
Privacy accounting and quality control in the sage differentially private ML platform
Lécuyer, M., Spahn, R., Vodrahalli, K., Geambasu, R., & Hsu, D. (2019) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3341301.3359639 · Cited by 40
An Efficient Approach for Cross-Silo Federated Learning to Rank
Wang, Y., Tong, Y., Shi, D., & Xu, K. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00102 · Cited by 38
Privacy-Preserving Probabilistic Voltage Forecasting in Local Energy Communities
Toubeau, J., Teng, F., Morstyn, T., Krannichfeldt, L. V., & Wang, Y. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3187557 · Cited by 37
Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble ArchitecturePreprint
Tang, X., Mahloujifar, S., Song, L., Shejwalkar, V., Nasr, M., Houmansadr, A., & Mittal, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08324 · Cited by 43
Task-Oriented Communication Design in Cyber-Physical Systems: A Survey on Theory and Applications
Mostaani, A., Vu, T. X., Sharma, S. K., Nguyen, V., Liao, Q., & Chatzinotas, S. (2022) · IEEE Access · doi:10.1109/access.2022.3231039 · Cited by 51
PrivAim: A Dual-Privacy Preserving and Quality-Aware Incentive Mechanism for Federated Learning
Wang, D., Ren, J., Wang, Z., Wang, Y., & Zhang, Y. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3230904 · Cited by 36
Fei, W., Hugh, E., & Li, B. (2024) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2024.3377655 · Cited by 36
Strategies for Enhancing Training and Privacy in Blockchain Enabled Federated Learning
Kumar, S., Dutta, S., Chatturvedi, S., & Bhatia, M. P. S. (2020) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm50055.2020.00058 · Cited by 36
Compression Boosts Differentially Private Federated Learning
Kerkouche, R., Ács, G., Castelluccia, C., & Genevès, P. (2021) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp51992.2021.00029 · Cited by 36
Selective Differential Privacy for Language Modeling
Shi, W., Cui, A., Li, E., Jia, R., & Zhou, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.205 · Cited by 68
X-Secure T-Private Federated Submodel Learning With Elastic Dropout Resilience
Jia, Z., & Jafar, S. A. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3165400 · Cited by 35
Gati, N. J., Yang, L. T., Feng, J., Nie, X., Ren, B., & Tarus, S. K. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.04.017 · Cited by 35
He, Y. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/67 · Cited by 40
Bayesian Differential Privacy for Machine LearningPreprint
Triastcyn, A., & Faltings, B. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09697 · Cited by 41
Faster On-Device Training Using New Federated Momentum AlgorithmPreprint
Huo, Z., Yang, Q., Gu, B., & Huang, L. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02090 · Cited by 50
FORESEEN: Towards Differentially Private Deep Inference for Intelligent Internet of Things
Lyu, L., Bezdek, J. C., Jin, J., & Yang, Y. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3000374 · Cited by 34
FedFog: Network-Aware Optimization of Federated Learning Over Wireless Fog-Cloud Systems
Nguyen, V., Chatzinotas, S., Ottersten, B., & Duong, T. Q. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3167263 · Cited by 38
FL-ODP: An Optimized Differential Privacy Enabled Privacy Preserving Federated Learning
Iqbal, M., Tariq, A., Adnan, M., Din, I. U., & Qayyum, T. (2023) · IEEE Access · doi:10.1109/access.2023.3325396 · Cited by 40
Private Wireless Federated Learning with Anonymous Over-the-Air Computation
Hasırcıoglu, B., & Gündüz, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413624 · Cited by 34
Biodiagnostics in an era of global pandemics—From biosensing materials to data management
Broza, Y. Y., & Haick, H. (2021) · Open Research (University of Surrey) · doi:10.1002/viw.20200164 · Cited by 33
FedCKE: Cross-Domain Knowledge Graph Embedding in Federated Learning
Huang, W. X., Liu, J., Li, T., Ji, S., Wang, D., & Huang, T. (2022) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3205705 · Cited by 39
Distribution-Regularized Federated Learning on Non-IID Data
Wang, Y., Tong, Y., Zhou, Z., Zhang, R., Pan, S. J., Fan, L., & Yang, Q. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00164 · Cited by 37
Wang, D., & Guan, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102796 · Cited by 33
Concentrated Differentially Private Federated Learning With Performance Analysis
Hu, R., Guo, Y., & Gong, Y. (2021) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2021.3099108 · Cited by 37
Blockchain-Based Swarm Learning for the Mitigation of Gradient Leakage in Federated Learning
Madni, H. A., Umer, R. M., & Foresti, G. L. (2023) · IEEE Access · doi:10.1109/access.2023.3246126 · Cited by 36
BlockFLow: An Accountable and Privacy-Preserving Solution for Federated LearningPreprint
Mugunthan, V., Rahman, R., & Kagal, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03856 · Cited by 51
CaPC Learning: Confidential and Private Collaborative LearningPreprint
Choquette-Choo, C. A., Dullerud, N., Dziedzic, A., Zhang, Y., Jha, S., Papernot, N., & Wang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05188 · Cited by 49
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-SharingPreprint
Khodak, M., Tu, R., Li, T., Li, L., Balcan, M.-F., Smith, V., & Talwalkar, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04502 · Cited by 33
On the Outsized Importance of Learning Rates in Local Update Methods
Charles, Z., & Konečný, J. (2020) · arXiv · doi:10.48550/arxiv.2007.00878 · Cited by 32
ElRobrini, F., Bukhari, S. M. S., Zafar, M. H., Al-Tawalbeh, N., Akhtar, N., & Sanfilippo, F. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100438 · Cited by 33
Hamad, N. A., Bakar, K. A. A., Qamar, F., Jubair, A. M., Mohamed, R. R., & Mohamed, M. A. (2025) · IEEE Access · doi:10.1109/access.2025.3574672 · Cited by 41
Benchmarking Differential Privacy and Federated Learning for BERT ModelsPreprint
Basu, P., Roy, T. S., Naidu, R., Müftüoğlu, Z., Singh, S., & Mireshghallah, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13973 · Cited by 61
How to Democratise and Protect AI: Fair and Differentially Private Decentralised Deep Learning
Lyu, L., Li, Y., Nandakumar, K., Yu, J., & Ma, X. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.3006287 · Cited by 31
A novel local differential privacy federated learning under multi-privacy regimes
Liu, C., Tian, Y., Tang, J., Dang, S., & Chen, G. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120266 · Cited by 33
Boenisch, F., Dziedzic, A., Schuster, R., Shamsabadi, A. S., Shumailov, I., & Papernot, N. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00023 · Cited by 38
FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphs
Zhang, T., Mai, C., Chang, Y., Chen, C., Shu, L., & Zheng, Z. (2023) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3624017 · Cited by 32
Zhang, C. B. C., Hu, X., Xie, Y., Gong, M., & Yu, B. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00112 · Cited by 32
An Efficient DP-SGD Mechanism for Large Scale NLU Models
Dupuy, C., Arava, R., Gupta, R., & Rumshisky, A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746975 · Cited by 43
Rajotte, J.-F., Mukherjee, S., Robinson, C., Ortiz, A., West, C., Ferres, J. M. L., & Ng, R. T. (2021) · Proceedings of the Conference on Information Technology for Social Good · doi:10.1145/3462203.3475875 · Cited by 34
Federated Inverse Reinforcement Learning for Smart ICUs With Differential Privacy
Gong, W., Cao, L. J., Zhu, Y., Zuo, F., He, X., & Zhou, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3281347 · Cited by 30
Rizk, E., Vlaski, S., & Sayed, A. H. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154327 · Cited by 33
Kapoor, A., & Kumar, D. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3434510 · Cited by 32
Privacy and Security Challenges in Federated Learning for UAV Systems: A Systematic Review
Farsi, A. A., Khan, A., Mughal, M. R., & Bait‐Suwailam, M. M. (2025) · IEEE Access · doi:10.1109/access.2025.3570538 · Cited by 42
Privacy enabled Financial Text Classification using Differential Privacy and Federated Learning
Basu, P., Roy, T. S., Naidu, R., & Müftüoğlu, Z. (2021) · Workshop on Economics and Natural Language Processing (ECONLP) · doi:10.18653/v1/2021.econlp-1.7 · Cited by 44
Differentially private recommender system with variational autoencoders
Fang, L., Du, B., & Wu, C. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109044 · Cited by 29
A Novel Transmission Line Defect Detection Method Based on Adaptive Federated Learning
Deng, F., Zeng, Z., Mao, W., Wei, B., & Li, Z. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3244227 · Cited by 29
Enhancing the Privacy of Federated Learning with SketchingPreprint
Liu, Z., Li, T., Smith, V., & Sekar, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.01812 · Cited by 29
Asynchronous Federated Learning with Differential Privacy for Edge IntelligencePreprint
Li, Y., Yang, S., Ren, X., & Zhao, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.07902 · Cited by 42
CGIR: Conditional Generative Instance Reconstruction Attacks Against Federated Learning
Xu, X., Liu, P., Wang, W., Ma, H., Wang, B., Han, Z., & Han, Y. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3228302 · Cited by 32
Tang, Z., Wong, H., & Yu, Z. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3305685 · Cited by 34
Personalized and privacy-enhanced federated learning framework via knowledge distillation
Yu, F., Wang, L., Zeng, B., Zhao, K., & Yu, R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127290 · Cited by 28
FRAMU: Attention-Based Machine Unlearning Using Federated Reinforcement Learning
Shaik, T., Tao, X., Li, L., Xie, H., Cai, T., Zhu, X., & Li, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3382726 · Cited by 33
Recent advances and future challenges in federated recommender systems
Harasic, M., Keese, F.-S., Mattern, D., & Paschke, A. (2023) · International Journal of Data Science and Analytics · doi:10.1007/s41060-023-00442-4 · Cited by 33
Metadata
- Authors
- McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1710.06963
- OpenAlex
- W2784621220
- Cited by
- 849
- References
- 0
- Citations by year
- 2026: 2 · 2025: 66 · 2024: 162 · 2023: 130 · 2022: 116 · 2021: 183 · 2020: 134 · 2019: 44 · 2018: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Keywords
- differential privacy, FedAvg, LSTM, privacy-utility trade-off, stochastic gradient descent, privacy accounting, large-scale datasets, privacy-preserving deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
