The DOI matches its DataCite record; 2 of the 4 references it cites were found in a registry or an index, and 2 are not checked yet.
Learning Differentially Private Recurrent Language Models
Open accessAbstract
We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep networks on user-partitioned data and privacy accounting for stochastic gradient descent. In particular, we add user-level privacy protection to the federated averaging algorithm, which makes "large step" updates from user-level data. Our work demonstrates that given a dataset with a sufficiently large number of users (a requirement easily met by even small internet-scale datasets), achieving differential privacy comes at the cost of increased computation, rather than in decreased utility as in most prior work. We find that our private LSTM language models are quantitatively and qualitatively similar to un-noised models when trained on a large dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This proved that, with sufficient devices participating in federated training, privacy protection could be achieved with a small additional overhead.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Simultaneously, both approaches guaranteed high model accuracy.”
From Survey: federated learning data security and privacy-preserving in edge-Internet of Things (2024) · cites this paper as McMahan et al. 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Therefore, federated learning has a promising application in NLP like virtual keyboard prediction [7, 39, 70].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [70]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 14
- Martin Abadi, Andy Chu, Ian Goodfellow, Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. Deep learning with differential privacy. In 23rd ACM Conference on Computer and Communications Security (ACM CCS) , 2016a.
- Rami Al-Rfou, Marc Pickett, Javier Snaider, Yun-Hsuan Sung, Brian Strope, and Ray Kurzweil. Conversational contextual cues: The case of personalization and history for response ranking. CoRR , abs/1606.00372, 2016. URL http://arxiv.org/abs/1606.00372 . · arXiv
- R. Bassily, K. Nissim, U. Stemmer, and A. Thakurta. Practical locally private heavy hitters. ArXiv e-prints , July 2017. URL https://arxiv.org/abs/1707.04982 . · arXiv
- N. Carlini, C. Liu, J. Kos, ´ U. Erlingsson, and D. Song. The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets. ArXiv e-prints , February 2018. URL https://arxiv. org/abs/1802.08232 .
- T-H Hubert Chan, Mingfei Li, Elaine Shi, and Wenchang Xu. Differentially private continual monitoring of heavy hitters from distributed streams. In International Symposium on Privacy Enhancing Technologies Symposium , pages 140-159. Springer, 2012.
- Yarin Gal and Zoubin Ghahramani. A theoretically grounded application of dropout in recurrent neural networks. In Advances in Neural Information Processing Systems , pages 1019-1027, 2016.
- Edouard Grave, Armand Joulin, and Nicolas Usunier. Improving neural language models with a continuous cache. arXiv preprint arXiv:1612.04426 , 2016. · arXiv
- Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. Pointer sentinel mixture models. arXiv preprint arXiv:1609.07843 , 2016. · arXiv
- Nicolas Papernot, Mart´ ın Abadi, ´ Ulfar Erlingsson, Ian Goodfellow, and Kunal Talwar. Semi-supervised knowledge transfer for deep learning from private training data. In Proceedings of the International Conference on Learning Representations , 2017. URL https://arxiv.org/abs/1610.05755 . · arXiv
- Ofir Press and Lior Wolf. Using the output embedding to improve language models. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers , pages 157-163. Association for Computational Linguistics, 2017.
- Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. Membership inference attacks against machine learning models. In IEEE Symposium on Security and Privacy, Oakland , 2017. To Appear.
- Martin Sundermeyer, Ralf Schl¨ uter, and Hermann Ney. LSTM neural networks for language modeling. In Interspeech , pages 194-197, 2012.
- Xi Wu, Fengan Li, Arun Kumar, Kamalika Chaudhuri, Somesh Jha, and Jeffrey F. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In Proceedings of SIGMOD , 2017.
- Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning requires rethinking generalization. 2017. URL https://arxiv.org/abs/1611.03530 . · arXiv
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
The future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
A review of applications in federated learning
Li, L., Fan, Y., Tse, M., & Lin, K.-Y. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106854 · Cited by 1,559
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542
How to backdoor federated learning
Bagdasaryan, E., Veit, A., Hua, Y., Estrin, D., & Shmatikov, V. (2018) · arXiv · doi:10.48550/arxiv.1807.00459 · Cited by 1,495
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Federated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2018) · NORA - Norwegian Open Research Archives · Cited by 1,012
Liang, J., Hu, D., & Feng, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08546 · Cited by 869
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
A Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774
Inverting Gradients -- How easy is it to break privacy in federated learning?Preprint
Geiping, J., Bauermeister, H., Dröge, H., & Moeller, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.14053 · Cited by 848
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727
Personalized Federated Learning with Moreau EnvelopesPreprint
Dinh, C. T., Tran, N. H. K., & Nguyen, T. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08848 · Cited by 697
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_9 · Cited by 609
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
Reisizadeh, A., Mokhtari, A., Hassani, H., Jadbabaie, A., & Pedarsani, R. (2019) · arXiv · doi:10.48550/arxiv.1909.13014 · Cited by 587
Membership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z. A., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 662
Privacy and Robustness in Federated Learning: Attacks and Defenses
Lyu, L., Yu, H., Ma, X., Chen, C., Sun, L., Zhao, J., Yang, Q., & Yu, P. S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3216981 · Cited by 548
Federated Learning With Blockchain for Autonomous Vehicles: Analysis and Design Challenges
Pokhrel, S. R., & Choi, J. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2990686 · Cited by 531
Local Differential Privacy-Based Federated Learning for Internet of Things
Zhao, Y., Zhao, J., Yang, M., Wang, T., Wang, N., Lyu, L., Niyato, D., & Lam, K.-Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3037194 · Cited by 456
Lyu, L., Yu, H., Zhao, J., & Yang, Q. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_1 · Cited by 444
Synthetic Data for Deep Learning
Nikolenko, S. (2021) · Springer optimization and its applications · doi:10.1007/978-3-030-75178-4 · Cited by 474
Attack of the tails: Yes, you really can backdoor federated learning
Wang, H., Sreenivasan, K., Rajput, S., Vishwakarma, H., Agarwal, S., Sohn, J.-Y., Lee, K., & Papailiopoulos, D. (2020) · arXiv · doi:10.48550/arxiv.2007.05084 · Cited by 406
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 439
A state-of-the-art survey on solving non-IID data in Federated Learning
Ma, X., Zhu, J., Lin, Z., Chen, S., & Qin, Y. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.003 · Cited by 435
Personalized Federated Learning: A Meta-Learning ApproachPreprint
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv.org · doi:10.48550/arxiv.2002.07948 · Cited by 751
Privacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381
Survey of Personalization Techniques for Federated Learning
Kulkarni, V., Kulkarni, M., & Pant, A. (2020) · World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4) · doi:10.1109/worlds450073.2020.9210355 · Cited by 381
From distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 397
Can You Really Backdoor Federated Learning?
Sun, Z., Kairouz, P., Suresh, A. T., & McMahan, H. B. (2019) · arXiv · doi:10.48550/arxiv.1911.07963 · Cited by 348
Self-citationTurbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054610 · Cited by 318
VeriFL: Communication-Efficient and Fast Verifiable Aggregation for Federated Learning
Guo, X., Liu, Z., Li, J., Gao, J., Hou, B., Dong, C., & Baker, T. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3043139 · Cited by 319
Federated Learning in Smart City Sensing: Challenges and Opportunities
Jiang, J. C., Kantarcı, B., Oktuğ, S., & Soyata, T. (2020) · Sensors · doi:10.3390/s20216230 · Cited by 332
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
A Survey on Intelligent Internet of Things: Applications, Security, Privacy, and Future Directions
Aouedi, O., Vu, T.-H., Sacco, A., Nguyen, D. C., Piamrat, K., Marchetto, G., & Pham, Q. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3430368 · Cited by 345
Does learning require memorization? a short tale about a long tail
Feldman, V. (2020) · Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing · doi:10.1145/3357713.3384290 · Cited by 287
A Survey of Privacy Attacks in Machine Learning
Rigaki, M., & Garcia, S. (2024) · ACM Computing Surveys · doi:10.1145/3624010 · Cited by 285
Profit Allocation for Federated Learning
Song, T., Tong, Y., & Wei, S. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006327 · Cited by 285
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X. J., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 296
Shejwalkar, V., Houmansadr, A., Kairouz, P., & Ramage, D. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833647 · Cited by 292
Self-citationProtection Against Reconstruction and Its Applications in Private Federated LearningPreprint
Bhowmick, A., Duchi, J. C., Freudiger, J., Kapoor, G., & Rogers, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00984 · Cited by 420
LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy
Sun, L., Qian, J., & Chen, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/217 · Cited by 267
Towards Fair and Privacy-Preserving Federated Deep Models
Lyu, L., Yu, J., Nandakumar, K., Li, Y., Ma, X., Jin, J., Yu, H., & Ng, K. S. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2996273 · Cited by 250
Information Leakage in Embedding Models
Song, C., & Raghunathan, A. (2020) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3372297.3417270 · Cited by 287
Artificial Intelligence in Medical Sensors for Clinical Decisions
Haick, H., & Tang, N. (2021) · ACS Nano · doi:10.1021/acsnano.1c00085 · Cited by 231
Threats to federated learning A survey
Lyu, L., Yu, H., & Yang, Q. (2020) · arXiv · doi:10.48550/arxiv.2003.02133 · Cited by 221
Differential Privacy Has Disparate Impact on Model Accuracy
Bagdasaryan, E., & Shmatikov, V. (2019) · arXiv · doi:10.48550/arxiv.1905.12101 · Cited by 219
Privacy preserving vertical federated learning for tree-based models
Wu, Y., Cai, S., Xiao, X., Chen, G., & Ooi, B. C. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407811 · Cited by 263
VFChain: Enabling Verifiable and Auditable Federated Learning via Blockchain Systems
Peng, Z., Xu, J., Chu, X., Gao, S., Yao, Y., Gu, R., & Tang, Y. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3050781 · Cited by 219
Federated Learning with Bayesian Differential Privacy
Triastcyn, A., & Faltings, B. V. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9005465 · Cited by 220
A Federated Learning Approach to Anomaly Detection in Smart Buildings
Abdel-Sater, R., & Hamza, A. B. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3467981 · Cited by 220
DeepSight: Mitigating Backdoor Attacks in Federated Learning Through Deep Model Inspection
Rieger, P., Nguyen, T. D., Miettinen, M., & Sadeghi, A.-R. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23156 · Cited by 202
Local and Central Differential Privacy for Robustness and Privacy in Federated Learning
Naseri, M., Hayes, J., & De Cristofaro, E. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23054 · Cited by 188
Personalized Federated Learning using HypernetworksPreprint
Shamsian, A., Navon, A., Fetaya, E., & Chechik, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04628 · Cited by 198
Federated Visual Classification with Real-World Data Distribution
Hsu, T.-M. H., Qi, H., & Brown, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_5 · Cited by 194
Decentralized Federated Learning: A Survey on Security and Privacy
Hallaji, E., Razavi‐Far, R., Saif, M., Wang, B., & Yang, Q. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3362191 · Cited by 204
Federated Learning with Buffered Asynchronous AggregationPreprint
Nguyen, J., Malik, K., Zhan, H., Yousefpour, A., Rabbat, M., Esmaeili, M. M., & Huba, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06639 · Cited by 182
Privacy Threat and Defense for Federated Learning With Non-i.i.d. Data in AIoT
Xiong, Z., Cai, Z., Takabi, D., & Li, W. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3073925 · Cited by 181
A Field Guide to Federated OptimizationPreprint
Wang, J., Charles, Z., Xu, Z., Joshi, G., McMahan, H. B., y Arcas, B. A., Al-Shedivat, M., Andrew, G., Avestimehr, S., Daly, K., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06917 · Cited by 467
Self-citationSun, J., Li, A., Wang, B., Yang, H., Li, H. H., & Chen, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00919 · Cited by 205
Differentially Private Learning with Adaptive ClippingPreprint
Andrew, G., Thakkar, O. D., McMahan, H. B., & Ramaswamy, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03871 · Cited by 226
Self-citationDynamic Digital Twin and Federated Learning With Incentives for Air-Ground Networks
Sun, W. Y., Xu, N., Wang, L., Zhang, H., & Zhang, Y. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.3048137 · Cited by 174
Salvaging Federated Learning by Local AdaptationPreprint
Yu, T., Bagdasaryan, E., & Shmatikov, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04758 · Cited by 220
Deep Learning With Gaussian Differential Privacy
Bu, Z., Dong, J., Long, Q., & Wei-Jie, S. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.cfc5dd25 · Cited by 186
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy
Ponomareva, N., Hazimeh, H., Kurakin, A., Xu, Z., Denison, C., McMahan, H. B., Vassilvitskii, S., Chien, S., & Thakurta, A. G. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14649 · Cited by 166
Self-citationHandling privacy-sensitive medical data with federated learning: Challenges and future directions
Aouedi, O., Sacco, A., Piamrat, K., & Marchetto, G. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3185673 · Cited by 165
POSEIDON: Privacy-Preserving Federated Neural Network Learning
Sav, S., Pyrgelis, A., Troncoso-Pastoriza, J. R., Froelicher, D., Bossuat, J.-P., Sousa, J. S., & Hubaux, J.-P. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24119 · Cited by 162
Feng, J., Rong, C., Sun, F., Guo, D., & Li, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3381006 · Cited by 165
EPPDA: An Efficient Privacy-Preserving Data Aggregation Federated Learning Scheme
Song, J., Wang, W., Gadekallu, T. R., Cao, J., & Liu, Y. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3153519 · Cited by 150
Rodríguez-Barroso, N., Stipcich, G., Jiménez-López, D., Ruiz-Millán, J. A., Martínez-Cámara, E., González-Seco, G., Luzón, M. V., Veganzones, M. A., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.009 · Cited by 148
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147
Adversary Instantiation: Lower Bounds for Differentially Private Machine Learning
Nasr, M., Song, S., Thakurta, A., Papernot, N., & Carlini, N. (2021) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40001.2021.00069 · Cited by 181
Privacy-Preserving Aggregation in Federated Learning: A Survey
Liu, Z., Guo, J., Yang, W., Fan, J., Lam, K., & Zhao, J. (2022) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3190835 · Cited by 163
Privacy-preserving federated learning for residential short-term load forecasting
Fernández, J. D., Menci, S. P., Lee, C. M., Rieger, A., & Fridgen, G. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119915 · Cited by 157
Liu, Y., Liu, Y., Liu, Z., Liang, Y., Meng, C., Zhang, J., & Zheng, Y. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2020.2992755 · Cited by 141
SEAR: Secure and Efficient Aggregation for Byzantine-Robust Federated Learning
Zhao, L., Jiang, J., Feng, B. Y., Wang, Q., Shen, C. Q., & Li, Q. L. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3093711 · Cited by 154
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered DropoutPreprint
Horváth, S., Laskaridis, S., Almeida, M., Leontiadis, I., Venieris, S. I., & Lane, N. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13451 · Cited by 151
Hu, R., Guo, Y., & Gong, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3343288 · Cited by 147
Zhan, Y., Li, P., & Guo, S. (2020) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00033 · Cited by 136
The Value of Collaboration in Convex Machine Learning with Differential Privacy
Wu, N., Farokhi, F., Smith, D. B., & Kâafar, M. A. (2020) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40000.2020.00025 · Cited by 132
VerSA: Verifiable Secure Aggregation for Cross-Device Federated Learning
Hahn, C., Kim, H.-D., Kim, M., & Hur, J. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3126323 · Cited by 135
Nguyen, T. D., Nguyen, T., Nguyen, P. L., Pham, H. H., Doan, K. D., & Wong, K.-S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107166 · Cited by 130
Edge Intelligence: Architectures, Challenges, and ApplicationsPreprint
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 204
Meta-HAR: Federated Representation Learning for Human Activity Recognition
Li, C., Niu, D., Jiang, B., Zuo, X., & Yang, J. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450006 · Cited by 133
CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learning
So, J., Güler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3053220 · Cited by 128
Shielding Collaborative Learning: Mitigating Poisoning Attacks through Client-Side Detection
Zhao, L., Hu, S., Wang, Q., Jiang, J., Chao, S., Luo, X., & Hu, P. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.2986205 · Cited by 132
Towards asynchronous federated learning for heterogeneous edge-powered internet of things
Chen, Z., Liao, W., Hua, K., Lu, C., & Yu, W. (2021) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.04.001 · Cited by 126
A comprehensive survey on federated learning techniques for healthcare informatics
Dasaradharami Reddy, K., & Gadekallu, T. R. (2023) · Computational Intelligence and Neuroscience · doi:10.1155/2023/8393990 · Cited by 126
Differentially Private Federated Learning with Local Regularization and Sparsification
Cheng, A., Wang, P., Zhang, X. S., & Cheng, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00988 · Cited by 131
Efficient Decentralized Deep Learning by Dynamic Model Averaging
Kamp, M., Adilova, L., Sicking, J., Hüger, F., Schlicht, P., Wirtz, T., & Wrobel, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10925-7_24 · Cited by 125
Federated Latent Dirichlet Allocation: A Local Differential Privacy Based Framework
Wang, Y., Tong, Y., & Shi, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6096 · Cited by 122
Federated Learning with Quantization Constraints
Shlezinger, N., Chen, M., Eldar, Y. C., Poor, H. V., & Cui, S. R. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054168 · Cited by 123
Federated Learning for Privacy-Preserving: A Review of PII Data Analysis in Fintech
Dash, B., Sharma, P., & Ali, A. (2022) · International Journal of Software Engineering & Applications · doi:10.5121/ijsea.2022.13401 · Cited by 118
Metadata
- Authors
- McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1710.06963
- OpenAlex
- W2784621220
- Cited by
- 849
- References
- 0
- Citations by year
- 2026: 2 · 2025: 66 · 2024: 162 · 2023: 130 · 2022: 116 · 2021: 183 · 2020: 134 · 2019: 44 · 2018: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Keywords
- differential privacy, FedAvg, LSTM, privacy-utility trade-off, stochastic gradient descent, privacy accounting, large-scale datasets, privacy-preserving deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
