The DOI matches its DataCite record; 2 of the 4 references it cites were found in a registry or an index, and 2 are not checked yet.
Learning Differentially Private Recurrent Language Models
Open accessAbstract
We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep networks on user-partitioned data and privacy accounting for stochastic gradient descent. In particular, we add user-level privacy protection to the federated averaging algorithm, which makes "large step" updates from user-level data. Our work demonstrates that given a dataset with a sufficiently large number of users (a requirement easily met by even small internet-scale datasets), achieving differential privacy comes at the cost of increased computation, rather than in decreased utility as in most prior work. We find that our private LSTM language models are quantitatively and qualitatively similar to un-noised models when trained on a large dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This proved that, with sufficient devices participating in federated training, privacy protection could be achieved with a small additional overhead.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Simultaneously, both approaches guaranteed high model accuracy.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Therefore, federated learning has a promising application in NLP like virtual keyboard prediction [7, 39, 70].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [70]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 14
- Martin Abadi, Andy Chu, Ian Goodfellow, Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. Deep learning with differential privacy. In 23rd ACM Conference on Computer and Communications Security (ACM CCS) , 2016a.
- Rami Al-Rfou, Marc Pickett, Javier Snaider, Yun-Hsuan Sung, Brian Strope, and Ray Kurzweil. Conversational contextual cues: The case of personalization and history for response ranking. CoRR , abs/1606.00372, 2016. URL http://arxiv.org/abs/1606.00372 . · arXiv
- R. Bassily, K. Nissim, U. Stemmer, and A. Thakurta. Practical locally private heavy hitters. ArXiv e-prints , July 2017. URL https://arxiv.org/abs/1707.04982 . · arXiv
- N. Carlini, C. Liu, J. Kos, ´ U. Erlingsson, and D. Song. The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets. ArXiv e-prints , February 2018. URL https://arxiv. org/abs/1802.08232 .
- T-H Hubert Chan, Mingfei Li, Elaine Shi, and Wenchang Xu. Differentially private continual monitoring of heavy hitters from distributed streams. In International Symposium on Privacy Enhancing Technologies Symposium , pages 140-159. Springer, 2012.
- Yarin Gal and Zoubin Ghahramani. A theoretically grounded application of dropout in recurrent neural networks. In Advances in Neural Information Processing Systems , pages 1019-1027, 2016.
- Edouard Grave, Armand Joulin, and Nicolas Usunier. Improving neural language models with a continuous cache. arXiv preprint arXiv:1612.04426 , 2016. · arXiv
- Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. Pointer sentinel mixture models. arXiv preprint arXiv:1609.07843 , 2016. · arXiv
- Nicolas Papernot, Mart´ ın Abadi, ´ Ulfar Erlingsson, Ian Goodfellow, and Kunal Talwar. Semi-supervised knowledge transfer for deep learning from private training data. In Proceedings of the International Conference on Learning Representations , 2017. URL https://arxiv.org/abs/1610.05755 . · arXiv
- Ofir Press and Lior Wolf. Using the output embedding to improve language models. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers , pages 157-163. Association for Computational Linguistics, 2017.
- Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. Membership inference attacks against machine learning models. In IEEE Symposium on Security and Privacy, Oakland , 2017. To Appear.
- Martin Sundermeyer, Ralf Schl¨ uter, and Hermann Ney. LSTM neural networks for language modeling. In Interspeech , pages 194-197, 2012.
- Xi Wu, Fengan Li, Arun Kumar, Kamalika Chaudhuri, Somesh Jha, and Jeffrey F. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In Proceedings of SIGMOD , 2017.
- Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning requires rethinking generalization. 2017. URL https://arxiv.org/abs/1611.03530 . · arXiv
Cited by
Sorted by citations
Items 301–400 of 852
Secure Federated Submodel Learning
Niu, C., Wu, F., Tang, S., Hua, L., Jia, R., Lv, C., Wu, Z., & Chen, G. (2019) · arXiv · doi:10.48550/arxiv.1911.02254 · Cited by 28
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated LearningPreprint
So, J., Güler, B., & Avestimehr, A. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04156 · Cited by 28
On the (In)security of Peer-to-Peer Decentralized Machine Learning
Pasquini, D., Raynal, M., & Troncoso, C. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179291 · Cited by 42
Privacy-Encoded Federated Learning Against Gradient-Based Data Reconstruction Attacks
Liu, H., Li, B., Gao, C., Xie, P., & Zhao, C. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3309095 · Cited by 27
Das, S. K., Mudi, R., Rahman, M. S., Rabie, K. M., & Li, X. (2024) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2024.3466858 · Cited by 27
Federated learning with workload-aware client scheduling in heterogeneous systems
Li, L., Liu, D., Duan, M., Zhang, Y., Ren, A., Chen, X., Tan, Y., & Wang, C. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.07.030 · Cited by 28
Generating Privacy Preserving Synthetic Medical Data
Faisal, F., Mohammed, N., Leung, C. K.-S., & Wang, Y. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032429 · Cited by 27
Efficient Federated Learning With Enhanced Privacy via Lottery Ticket Pruning in Edge Computing
Shi, Y., Wei, K., Shen, L., Li, J., Wang, X., Yuan, B., & Guo, S. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3370967 · Cited by 29
Broadening Differential Privacy for Deep Learning Against Model Inversion Attacks
Zhang, Q., Ma, J., Xiao, Y., Lou, J., & Xiong, L. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378274 · Cited by 28
FedCRI: Federated Mobile Cyber-Risk Intelligence
Fereidooni, H., Dmitrienko, A., Rieger, P., Miettinen, M., Sadeghi, A., & Madlener, F. (2022) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23153 · Cited by 29
Adaptive Batch Homomorphic Encryption for Joint Federated Learning in Cross-Device Scenarios
Han, J., & Li, Y. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3323358 · Cited by 25
Batch-Aggregate: Efficient Aggregation for Private Federated Learning in VANETs
Feng, X., Liu, H., Yang, H., Xie, Q., & Wang, L. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3364371 · Cited by 28
Jatain, D., Sıngh, V., & Dahiya, N. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.05.016 · Cited by 25
Data Privacy Security Guaranteed Network Intrusion Detection System Based on Federated Learning
Shi, J., Ge, B., Liu, Y., Yan, Y., & Li, S. (2021) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps51825.2021.9484545 · Cited by 25
Sybil Attacks and Defense on Differential Privacy based Federated Learning
Jiang, Y., Li, Y., Zhou, Y., & Zheng, X. (2021) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom53373.2021.00062 · Cited by 25
Utility Optimization of Federated Learning with Differential Privacy
Zhao, J., Mao, K., Huang, C., & Zeng, Y. (2021) · Discrete Dynamics in Nature and Society · doi:10.1155/2021/3344862 · Cited by 26
FL-PATE: Differentially Private Federated Learning with Knowledge Transfer
Pan, Y., Ni, J., & Su, Z. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685079 · Cited by 25
Backdoor Attacks in Federated Learning by Rare Embeddings and Gradient Ensembling
Yoo, K., & Kwak, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.6 · Cited by 31
Fei, W., Hugh, E., & Li, B. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228919 · Cited by 25
Alrubayyi, H., Alshareef, M. S., Nadeem, Z., Abdelmoniem, A. M., & Jaber, M. (2024) · Future Internet · doi:10.3390/fi16030085 · Cited by 25
Differentially-Private "Draw and Discard" Machine Learning
Pihur, V., Korolova, A., Liu, F., Sankuratripati, S., Yung, M., Huang, D., & Zeng, R. (2018) · arXiv · doi:10.48550/arxiv.1807.04369 · Cited by 25
Membership Inference Attack Susceptibility of Clinical Language ModelsPreprint
Jagannatha, A., Rawat, B. P. S., & Yu, H. Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08305 · Cited by 93
Against Backdoor Attacks In Federated Learning With Differential Privacy
Lu, M., Yang, W., Hu, R., Lü, L., & Huang, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747653 · Cited by 24
Improving Deep Learning with Differential Privacy using Gradient Encoding and DenoisingPreprint
Nasr, M., Shokri, R., & Houmansadr, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11524 · Cited by 24
Training Data Leakage Analysis in Language ModelsPreprint
Inan, H. A., Ramadan, O., Wutschitz, L., Jones, D., Rühle, V., Withers, J., & Sim, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05405 · Cited by 71
Federated $f$-Differential PrivacyPreprint
Zheng, Q., Chen, S., Long, Q., & Su, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11158 · Cited by 24
Toderean, L., Daian, M., Cioara, T., Anghel, I. M., Michalakopoulos, V., Sarantinopoulos, E., & Sarmas, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-96443-3 · Cited by 23
Differentially private graph publishing with degree distribution preservation
Zhang, S., Ni, W., & Fu, N. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102285 · Cited by 23
Generative Adversarial Networks: A Survey Towards Private and Secure ApplicationsPreprint
Cai, Z., Xiong, Z., Xu, H., Wang, P., Li, W., & Pan, Y. F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03785 · Cited by 28
Wainakh, A., Zimmer, E., Subedi, S., Keim, J., Grube, T., Karuppayah, S., Guinea, A. S., & Mühlhäuser, M. (2022) · Sensors · doi:10.3390/s23010031 · Cited by 26
Privacy-Preserving High-dimensional Data Collection with Federated Generative Autoencoder
Jiang, X., Zhou, X., & Großklags, J. (2021) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2022-0024 · Cited by 24
Scaling Language Model Size in Cross-Device Federated Learning
Ro, J., Breiner, T., McConnaughey, L., Chen, M., Suresh, A., Kumar, S., & Mathews, R. (2022) · doi:10.18653/v1/2022.fl4nlp-1.2 · Cited by 35
Vithana, S., & Ulukuş, Ş. (2023) · IEEE Transactions on Information Theory · doi:10.1109/tit.2023.3292187 · Cited by 24
Low-Overhead Clustered Federated Learning for Personalized Stress Monitoring
Jiang, S., Firouzi, F., & Chakrabarty, K. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3299736 · Cited by 26
Privacy-preserving federated learning based on noise addition
Wu, X., Chen, Y., Yu, H., & Yang, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126228 · Cited by 23
PrivEdge: From Local to Distributed Private Training and Prediction
Shamsabadi, A. S., Gascón, A., Haddadi, H., & Cavallaro, A. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988132 · Cited by 22
Chen, Z., Li, D., Zhao, M., Zhang, S., & Zhu, J. (2020) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc45663.2020.9120453 · Cited by 22
A comprehensive survey and taxonomy on privacy-preserving deep learning
Tran, A.-T., Luong, T.-D., & Huynh, V.-N. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127345 · Cited by 21
Privacy-Preserving Machine Learning Using Federated Learning and Secure Aggregation
Lia, D., & Togan, M. (2020) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai50035.2020.9223127 · Cited by 22
Accurate Differentially Private Deep Learning on the Edge
Han, R., Li, D., Ouyang, J., Liu, C. H., Wang, G., Wu, D. O., & Chen, L. Y. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3064345 · Cited by 23
Zhao, Y., Xiao, W., Shuai, L., Luo, J., Yao, S., & Zhang, M. (2021) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc54389.2021.9674514 · Cited by 21
PPT: A privacy-preserving global model training protocol for federated learning in P2P networks
Chen, Q., Wang, Z., Zhang, W., & Lin, X. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102966 · Cited by 23
Towards federated learning: An overview of methods and applications
Silva, P. R., Vinagre, J., & da Gama, J. M. P. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1486 · Cited by 27
Differentially Private Vertical Federated Clustering
Li, Z., Wang, T., & Li, N. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3583140.3583146 · Cited by 22
A Survey of Differential Privacy Techniques for Federated Learning
Wang, X., Jiaqian, L., Xueshuang, D., Zhang, H., & Lianshan, S. (2024) · IEEE Access · doi:10.1109/access.2024.3523909 · Cited by 28
Investigating the Impact of Pre-trained Word Embeddings on Memorization in Neural Networks
Thomas, A., Adelani, D. I., Davody, A., Mogadala, A., & Klakow, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58323-1_30 · Cited by 21
A Privacy-Preserving Graph Neural Network for Network Intrusion Detection
Pei, X., Deng, X., Tian, S., Jiang, P., Zhao, Y., & Xue, K. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3417853 · Cited by 20
Artificial intelligence security and privacy: a survey
He, X., Xu, G., Han, X., Wang, Q., Zhao, L., Shen, C., Lin, C., Zhao, Z., Li, Q., Yang, L., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-025-4388-5 · Cited by 24
VADAF: Visualization for Abnormal Client Detection and Analysis in Federated Learning
Meng, L., Wei, Y., Pan, R., Zhou, S., Zhang, J., & Chen, W. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3426866 · Cited by 25
ATLAS: GAN-Based Differentially Private Multi-Party Data Sharing
Wang, Z., Cheng, X., Su, S., Liang, J., & Yang, H.-C. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3277716 · Cited by 20
Learning to Generate Image Embeddings with User-Level Differential Privacy
Xu, Z., Collins, M. D., Wang, Y., Panait, L., Oh, S., Augenstein, S., Liu, T., Schroff, F., & McMahan, H. B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00770 · Cited by 31
Self-citationCommunication-Efficient and Privacy-Preserving Aggregation in Federated Learning With Adaptability
Sun, X., Yuan, Z., Kong, X., Xue, L., He, L., & Ying, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3396217 · Cited by 20
Federated Learning in Practice: Reflections and Projections
Daly, K., Eichner, H., Kairouz, P., McMahan, H. B., Ramage, D., & Xu, Z. (2024) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa62245.2024.00026 · Cited by 45
Self-citationInformation Compression in the AI Era: Recent Advances and Future Challenges
Chen, J., Fang, Y., Khisti, A. J., Özgür, A., & Shlezinger, N. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3560359 · Cited by 20
Federated Learning for Privacy-Preserving Speaker Recognition
Woubie, A., & Bäckström, T. (2021) · IEEE Access · doi:10.1109/access.2021.3124029 · Cited by 23
Hybrid Differentially Private Federated Learning on Vertically Partitioned DataPreprint
Wang, C., Liang, J., Huang, M., Bai, B., Bai, K., & Li, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.02763 · Cited by 47
D2P-Fed: Differentially Private Federated Learning With Efficient CommunicationPreprint
Wang, L., Jia, R., & Song, D. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13039 · Cited by 20
Han, Z., Hu, C., Li, T., Qi, Q., Tang, P., & Guo, S. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106574 · Cited by 19
Multimodal Federated Learning in AIoT Systems: Existing Solutions, Applications, and Challenges
Anagnostopoulos, C., Γκίλλας, Α., Mavrokefalidis, C., Pikoulis, E., Piperigkos, N., & Lalos, A. S. (2024) · IEEE Access · doi:10.1109/access.2024.3508030 · Cited by 24
Wei, J., Bao, E., Xiao, X., & Yang, Y. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560562 · Cited by 22
FedNP: Towards Non-IID Federated Learning via Federated Neural Propagation
Wu, X., Huang, H., Ding, Y., Wang, H., Wang, Y., & Xu, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26237 · Cited by 19
Training Data Extraction From Pre-trained Language Models: A Survey
Ishihara, S. (2023) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2023.trustnlp-1.23 · Cited by 45
Byzantine-Robust Federated Learning with Variance Reduction and Differential Privacy
Zhang, Z., & Hu, R. (2023) · IEEE Conference on Communications and Network Security · doi:10.1109/cns59707.2023.10288938 · Cited by 19
Tanim, S. A., Aurnob, A. R., Mridha, M. F., Safran, M., Alfarhood, S., & Che, D. (2024) · IEEE Access · doi:10.1109/access.2024.3454690 · Cited by 21
Distributed Learning Applications in Power Systems: A Review of Methods, Gaps, and Challenges
Gholizadeh, N., & Musı́lek, P. (2021) · Energies · doi:10.3390/en14123654 · Cited by 20
Differentially Private Federated Learning for Resource-Constrained Internet of ThingsPreprint
Hu, R., Guo, Y., Ratazzi, E. P., & Gong, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12705 · Cited by 19
Federated Neural Architecture SearchPreprint
Yuan, J., Xu, M., Zhao, Y., Bian, K., Huang, G., Liu, X., & Wang, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06352 · Cited by 40
Learning discrete distributions: user vs item-level privacyPreprint
Liu, Y., Suresh, A. T., Yu, F., Kumar, S., & Riley, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13660 · Cited by 20
Privacy-Preserving Graph Convolutional Networks for Text Classification
Igamberdiev, T., & Habernal, I. (2022) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2yjj5b8j5mzn · Cited by 25
Differentially Private Medical Texts Generation Using Generative Neural Networks
Aziz, M. M. A., Ahmed, T., Faequa, T., Jiang, X., Yao, Y. Y., & Mohammed, N. (2021) · ACM Transactions on Computing for Healthcare · doi:10.1145/3469035 · Cited by 22
Maliakel, P. J., Ilager, S., & Brandić, I. (2024) · International Workshop on Edge Systems, Analytics and Networking (EdgeSys) · doi:10.1145/3642968.3654813 · Cited by 18
Secure Weighted Aggregation for Federated LearningPreprint
Guo, J., Liu, Z., Lam, K., Zhao, J., Chen, Y., & Xing, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08730 · Cited by 25
Enhancing Differential Privacy for Federated Learning at Scale
Baek, C., Kim, S., Nam, D., & Park, J. (2021) · IEEE Access · doi:10.1109/access.2021.3124020 · Cited by 17
Differentially Private Normalizing Flows for Synthetic Tabular Data Generation
Lee, J. W., Kim, M., Jeong, Y., & Ro, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20697 · Cited by 20
Securing Federated Sensitive Topic Classification against Poisoning Attacks
Chu, T., García-Recuero, Á., Iordanou, C., Smaragdakis, G., & Laoutaris, N. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.23112 · Cited by 19
Attacking-Distance-Aware Attack: Semi-targeted Model Poisoning on Federated Learning
Sun, Y., Ochiai, H., & Sakuma, J. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3280155 · Cited by 19
Zhang, Z., Wen, J., & Huang, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.709 · Cited by 34
Mixed Quantization Enabled Federated Learning to Tackle Gradient Inversion Attacks
Ovi, P. R., Dey, E., Roy, N., & Gangopadhyay, A. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00533 · Cited by 17
Preserving Node-level Privacy in Graph Neural Networks
Xiang, Z., Wang, T., & Wang, D. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00270 · Cited by 23
Universal Neural-Cracking-Machines: Self-Configurable Password Models from Auxiliary Data
Pasquini, D., Ateniese, G., & Troncoso, C. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00032 · Cited by 19
DDLPF: A Practical Decentralized Deep Learning Paradigm for Internet-of-Things Applications
Wu, Y., Mendis, G. J., & Wei, J. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3033482 · Cited by 17
Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic TrainingPreprint
Park, S. J., Kim, G., Kim, J., Kim, B., & Ye, J. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.01338 · Cited by 30
Inference attacks based on GAN in federated learning
Ha, T., & Dang, T. K. (2022) · International Journal of Web Information Systems · doi:10.1108/ijwis-04-2022-0078 · Cited by 16
Cooperative Swarm Learning for Distributed Cyclic Edge Intelligent Computing
Xu, R., Jin, W., Khan, A. N., Lim, S., & Kim, D. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100783 · Cited by 17
Privacy as a Resource in Differentially Private Federated Learning
Yuan, J., Wang, S., Wang, S., Li, Y., Ma, X., Zhou, A., & Xu, M. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228953 · Cited by 18
Differentially Private Federated Learning With Importance Client Sampling
Chen, L., Ding, X., Li, M., & Jin, H. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3338464 · Cited by 16
Siren+: Robust Federated Learning With Proactive Alarming and Differential Privacy
Guo, H., Wang, H., Song, T., Yang, H., Ma, R., Jin, X., Xue, Z., & Guan, H. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3362534 · Cited by 17
Improving Privacy-Preserving Vertical Federated Learning by Efficient Communication with ADMM
Xie, C., Chen, P., Li, Q., Nourian, A., Zhang, C., & Li, B. (2024) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00029 · Cited by 16
Joachims, T., London, B., Su, Y., Swaminathan, A., & Wang, L. (2021) · AI Magazine · doi:10.1609/aimag.v42i3.18141 · Cited by 16
Xu, M., Song, C., Tian, Y., Agrawal, N., Granqvist, F., van Dalen, R., Zhang, X. L., Argueta, A., Han, S., Deng, Y., et al. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096570 · Cited by 25
Next - Location Prediction Using Federated Learning on a Blockchain
Halim, S. M., Khan, L., & Thuraisingham, B. (2020) · 2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi50398.2020.00038 · Cited by 16
Federated Learning of N-gram Language ModelsPreprint
Chen, M., Suresh, A. T., Mathews, R., Wong, A., Allauzen, C., Beaufays, F., & Riley, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03432 · Cited by 16
Federated Learning of User Authentication ModelsPreprint
Hosseini, H., Yun, S., Park, H., Louizos, C., Soriaga, J. B., & Welling, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04618 · Cited by 19
Layer-wise Characterization of Latent Information Leakage in Federated LearningPreprint
Mo, F., Borovykh, A., Malekzadeh, M., Haddadi, H., & Demetriou, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08762 · Cited by 31
Semi-Synchronous Federated Learning.Preprint
Stripelis, D., & Ambite, J. L. (2021) · arXiv (Cornell University) · Cited by 16
Learning with User-Level PrivacyPreprint
Levy, D., Sun, Z., Amin, K., Kale, S., Kulesza, A., Mohri, M., & Suresh, A. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11845 · Cited by 22
Shadow defense against gradient inversion attack in federated learning
Le, J., Ma, L., & Yang, G. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103673 · Cited by 18
Futuristic Technologies in Agriculture Challenges and Future Prospects
Kaur, U., Kaur, M., & Khang, A. (2023) · Advances in environmental engineering and green technologies book series · doi:10.4018/978-1-6684-9231-4.ch020 · Cited by 15
Banerjee, S., Roy, S., Ahamed, S. F., Quinn, D., Vucovich, M., Nandakumar, D., Choi, K., Rahman, A., Bowen, E., & Shetty, S. S. (2024) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/icnc59896.2024.10556313 · Cited by 19
Local differential privacy federated learning based on heterogeneous data multi-privacy mechanism
Wang, J., Zhang, Z., Tian, J., & Li, H. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110822 · Cited by 18
Metadata
- Authors
- McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1710.06963
- OpenAlex
- W2784621220
- Cited by
- 849
- References
- 0
- Citations by year
- 2026: 2 · 2025: 66 · 2024: 162 · 2023: 130 · 2022: 116 · 2021: 183 · 2020: 134 · 2019: 44 · 2018: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Keywords
- differential privacy, FedAvg, LSTM, privacy-utility trade-off, stochastic gradient descent, privacy accounting, large-scale datasets, privacy-preserving deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
