The DOI matches its OpenAlex record; 149 of the 149 references it cites were found in a registry or an index.
FedML: A Research Library and Benchmark for Federated Machine Learning
Open accessAbstract
Federated learning (FL) is a rapidly growing research field in machine learning. However, existing FL libraries cannot adequately support diverse algorithmic development; inconsistent dataset and model usage make fair algorithm comparison challenging. In this work, we introduce FedML, an open research library and benchmark to facilitate FL algorithm development and fair performance comparison. FedML supports three computing paradigms: on-device training for edge devices, distributed computing, and single-machine simulation. FedML also promotes diverse algorithmic research with flexible and generic API design and comprehensive reference baseline implementations (optimizer, models, and datasets). We hope FedML could provide an efficient and reproducible means for developing and evaluating FL algorithms that would benefit the FL research community. We maintain the source code, documents, and user community at https://fedml.ai.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationFederated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
Self-citationFederated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · cited 6×
“To tackle the challenge of statistical heterogeneity, distributed optimization methods such as Adaptive Federated Optimizer [2], FedNova [3], FedProx [4], and FedMA [5] have been proposed.”
BackgroundMethodInfluentialPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956
The Future of Digital Health with Federated Learning
Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B., Maier-Hein, K., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.08119 · Cited by 3,495
NUS-WIDE: a real-world web image database from National University of Singapore
Chua, T.-S., Tang, J., Hong, R., Li, H., Luo, Z., & Zheng, Y. (2009) · Proceedings of the ACM International Conference on Image and Video Retrieval · doi:10.1145/1646396.1646452 · Cited by 3,025
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Zhu, L., & Han, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_2 · Cited by 1,906
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2019) · arXiv · doi:10.48550/arxiv.1910.06378 · Cited by 1,734
Exploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734
On the Convergence of FedAvg on Non-IID Data
Li, X., Huang, K., Yang, W., Wang, S., & Zhang, Z. (2019) · arXiv · doi:10.48550/arxiv.1907.02189 · Cited by 1,575
How to backdoor federated learning
Bagdasaryan, E., Veit, A., Hua, Y., Estrin, D., & Shmatikov, V. (2018) · arXiv · doi:10.48550/arxiv.1807.00459 · Cited by 1,495 · cited 3×
“…existing research focuses on developing new adversarial attack and defense techniques to make federated learning robust [13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 22], and proposing methods such as differential privacy (DP) and secure multiparty computation (SMPC) to protect privacy [25, 26,…”
Background(2017) · neural information processing systems · Cited by 1,413
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134012 · Cited by 1,377
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148 · cited 1×
“Promising application domains include, but are not limited to, computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105,…”
BackgroundDeep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Yin, D., Chen, Y., Ramchandran, K., & Bartlett, P. (2018) · arXiv · doi:10.48550/arxiv.1803.01498 · Cited by 1,130
Differentially Private Federated Learning: A Client Level Perspective
Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052
Client-Edge-Cloud Hierarchical Federated Learning
Liu, L., Zhang, J., Song, S. H., & Letaief, K. B. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148862 · Cited by 1,033
A Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357370 · Cited by 1,029
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Y., Qin, X., Wang, J., Yu, C., & Gao, W. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988604 · Cited by 1,005 · cited 1×
“…computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105, 106, 107], robotics [108, 109], and smart cities [110, 111].”
BackgroundSelf-citationDBA: Distributed Backdoor Attacks against Federated Learning
Xie, C., Huang, K., Chen, P., & Li, B. (2020) · International Conference on Learning Representations · Cited by 997
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2007.07481 · Cited by 927 · cited 2×
“We will keep following the latest algorithm to be published at top-tier machine learning conferences, and will continuously add new FL algorithms such as Adaptive Federated Optimizer [2], FedNova [3], FedProx [4], and FedMA [5] in near future.”
MethodSelf-citationLEAF: A Benchmark for Federated Settings
Caldas, S., Duddu, S. M. K., Wu, P., Li, T., Konečný, J., McMahan, H. B., Smith, V., & Talwalkar, A. (2018) · arXiv · doi:10.48550/arxiv.1812.01097 · Cited by 894
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881
Adaptive Federated Optimization
Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B. (2020) · arXiv · doi:10.48550/arxiv.2003.00295 · Cited by 840 · cited 5×
“In this setting, we consider three data sets: MNIST [132], Federated EMINST [4], and Synthetic ( α , β ) [3], with the logistic regression model as the benchmark.”
MethodInfluentialRobust Aggregation for Federated Learning
Pillutla, K., Kakade, S. M., & Harchaoui, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3153135 · Cited by 801
Distributed learning of deep neural network over multiple agents
Gupta, O., & Raskar, R. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.05.003 · Cited by 726
Self-citationPrivacy-Preserving Traffic Flow Prediction: A Federated Learning Approach
Liu, Y., Yu, J. J. Q., Kang, J., Niyato, D., & Zhang, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991401 · Cited by 712 · cited 1×
“…but are not limited to, computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105, 106, 107], robotics [108, 109], and…”
BackgroundSelf-citationFederated learning with hierarchical clustering of local updates to improve training on non-IID data
Briggs, C., Fan, Z., & Andras, P. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207469 · Cited by 676
SecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2021) · IEEE Intelligent Systems · doi:10.1109/mis.2021.3082561 · Cited by 669
Self-citationSecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2019) · arXiv · doi:10.48550/arxiv.1901.08755 · Cited by 668
Self-citationA secure federated transfer learning framework
Liu, Y., Kang, Y., Xing, C., Chen, T., & Yang, Q. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988525 · Cited by 645
Self-citationSecure Federated Transfer Learning
Liu, Y., Kang, Y., Xing, C., Chen, T., & Yang, Q. (2018) · arXiv · doi:10.48550/arxiv.1812.03337 · Cited by 645
Self-citationPachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_9 · Cited by 609
Privacy-Preserving Federated Brain Tumour Segmentation
Li, W., Milletarì, F., Xu, D., Rieke, N., Hancox, J., Zhu, W., Baust, M., Cheng, Y., Ourselin, S., Cardoso, M. J., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32692-0_16 · Cited by 578
Split learning for health: Distributed deep learning without sharing raw patient data
Vepakomma, P., Gupta, O., Swedish, T., & Raskar, R. (2018) · arXiv · doi:10.48550/arxiv.1812.00564 · Cited by 513 · cited 2×
“Split learning is computing and memory-efficient variant of FL introduced in [41, 42] where the model is split at a layer and the parts of the model preceding and suc-ceeding this layer are shared across the worker and server, respectively.”
BackgroundSelf-citationFair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2019) · arXiv · doi:10.48550/arxiv.1905.10497 · Cited by 475
Horovod: fast and easy distributed deep learning in TensorFlow
Sergeev, A., & Balso, M. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05799 · Cited by 472
FetchSGD: Communication-Efficient Federated Learning with SketchingPreprint
Rothchild, D., Panda, A., Ullah, E., Ivkin, N. P., Stoica, I. G., Braverman, V., Gonzalez, J. E., & Arora, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07682 · Cited by 466
Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1811.11479 · Cited by 465
Luo, S., Chen, X., Wu, Q., Zhou, Z., & Yu, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3003744 · Cited by 455
FedMD: Heterogenous Federated Learning via Model Distillation
Li, D., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03581 · Cited by 450
Self-citationHardy, S., Henecka, W., Ivey-Law, H., Nock, R., Patrini, G., Smith, G., & Thorne, B. (2017) · arXiv · doi:10.48550/arxiv.1711.10677 · Cited by 431
Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
EMNIST: an extension of MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05373 · Cited by 419
The Non-IID Data Quagmire of Decentralized Machine LearningPreprint
Hsieh, K., Phanishayee, A., Mutlu, O., & Gibbons, P. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.00189 · Cited by 414
Attack of the tails: Yes, you really can backdoor federated learning
Wang, H., Sreenivasan, K., Rajput, S., Vishwakarma, H., Agarwal, S., Sohn, J.-Y., Lee, K., & Papailiopoulos, D. (2020) · arXiv · doi:10.48550/arxiv.2007.05084 · Cited by 406
Self-citationLian, X., Zhang, C., Zhang, H., Hsieh, C., Zhang, W., & Liu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09056 · Cited by 395
Mitigating Sybils in Federated Learning Poisoning
Fung, C., Yoon, C. J. M., & Beschastnikh, I. (2018) · arXiv · doi:10.48550/arxiv.1808.04866 · Cited by 385
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381 · cited 1×
“In terms of network topology, a variety of network typologies such as vertical FL [34, 35, 36, 37, 38, 39, 40], split learning [41, 42], decentralized FL [43, 44, 45, 46], hierarchical FL [47, 48, 49, 50, 51, 52], and meta FL [53, 54, 55] have been proposed.”
BackgroundMohri, M., Sivek, G., & Suresh, A. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00146 · Cited by 373
Can You Really Backdoor Federated Learning?
Sun, Z., Kairouz, P., Suresh, A. T., & McMahan, H. B. (2019) · arXiv · doi:10.48550/arxiv.1911.07963 · Cited by 348 · cited 4×
“To accelerate generating benchmark results on new types of adversarial attacks in FL, we include the latest robust aggregation methods presented in literature i.e. (i) norm difference clipping [23]; weak differential private (DP) [23]; (ii) RFA (geometric median) [118]; (iii) K RUM and (iv) M ULTI -”
BackgroundMethodInfluentialPersonalized Federated Learning: A Meta-Learning Approach
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07948 · Cited by 345
A generic framework for privacy preserving deep learning
Ryffel, T., Trask, A., Dahl, M., Wagner, B., Mancuso, J., Rueckert, D., & Passerat-Palmbach, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04017 · Cited by 335
HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., & Ludwig, H. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357371 · Cited by 327
A generic communication scheduler for distributed DNN training acceleration
Peng, Y., Zhu, Y., Chen, Y., Bao, Y., Yi, B., Lan, C., Wu, C., & Guo, C. (2019) · Proceedings of the 27th ACM Symposium on Operating Systems Principles · doi:10.1145/3341301.3359642 · Cited by 321
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054610 · Cited by 318
Self-citationLim, W. Y. B., Huang, J., Xiong, Z., Kang, J., Niyato, D., Hua, X.-S., Leung, C., & Miao, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3056341 · Cited by 318
Byzantine-Resilient Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041404 · Cited by 313 · cited 1×
“To tackle the challenge of trustworthiness, existing research focuses on developing new defense techniques for adversarial attacks to make FL robust [15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 24, 27, 28], and proposing methods such as differential privacy (DP) and secure multiparty computation (SMPC) to protect…”
BackgroundSelf-citationFedVision: An Online Visual Object Detection Platform Powered by Federated Learning
Liu, Y., Huang, A., Luo, Y., Huang, H., Liu, Y., Chen, Y., Feng, L., Chen, T., Yu, H., & Yang, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i08.7021 · Cited by 310
Self-citationFederated Learning for Keyword Spotting
Leroy, D., Coucke, A., Lavril, T., Gisselbrecht, T., & Dureau, J. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683546 · Cited by 291
Energy Demand Prediction with Federated Learning for Electric Vehicle Networks
Saputra, Y. M., Hoang, D. T., Nguyen, D. N., Dutkiewicz, E., Mueck, M. D., & Srikanteswara, S. (2019) · 2019 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/globecom38437.2019.9013587 · Cited by 277
Federated Learning with Compression: Unified Analysis and Sharp GuaranteesPreprint
Haddadpour, F., Kamani, M. M., Mokhtari, A., & Mahdavi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01154 · Cited by 258
PaddlePaddle: An Open-Source Deep Learning Platform from Industrial Practice
Ma, Y., Yu, D., Wu, T., & Wang, H. (2019) · doi:10.11871/jfdc.issn.2096.742x.2019.01.011 · Cited by 255
Self-citationFederated Learning in Vehicular Networks
Elbir, A. M., Soner, B., Çöleri, S., Gündüz, D., & Bennis, M. (2022) · IEEE International Mediterranean Conference on Communications and Networking (MeditCom) · doi:10.1109/meditcom55741.2022.9928621 · Cited by 248
Liu, B., Wang, L., & Liu, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2931179 · Cited by 242 · cited 1×
“…computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105, 106, 107], robotics [108, 109], and smart cities [110, 111].”
BackgroundOn the Convergence of Federated Optimization in Heterogeneous Networks.Preprint
Sahu, A. K., Li, T., Sanjabi, M., Zaheer, M., Talwalkar, A., & Smith, V. (2018) · arXiv (Cornell University) · Cited by 237
Communication Compression for Decentralized Training
Tang, H., Gan, S., Zhang, C., Zhang, T., & Liu, J. (2018) · arXiv · doi:10.48550/arxiv.1803.06443 · Cited by 206
Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System
Ammad-ud-din, M., Ivannikova, E., Khan, S. A., Oyomno, W., Fu, Q., Tan, K. E., & Flanagan, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09888 · Cited by 203
MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets
Hardy, C., Le Merrer, E., & Sericola, B. (2019) · 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2019.00095 · Cited by 201
Federated Learning with Bayesian Differential Privacy
Triastcyn, A., & Faltings, B. (2019) · 2019 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata47090.2019.9005465 · Cited by 199
Analyzing Federated Learning through an Adversarial Lens
Bhagoji, A. N., Chakraborty, S., Mittal, P., & Calo, S. B. (2019) · International Conference on Machine Learning · Cited by 188
Federated Transfer Reinforcement Learning for Autonomous Driving
Liang, X., Liu, Y., Chen, T., Liu, M., & Yang, Q. (2022) · Adaptation, learning, and optimization · doi:10.1007/978-3-031-11748-0_15 · Cited by 182
Self-citationFederated Learning With Quantized Global Model UpdatesPreprint
Amiri, M. M., Gündüz, D., Kulkarni, S. R., & Poor, H. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10672 · Cited by 182
Federated Visual Classification with Real-World Data Distribution
Hsu, T.-M. H., Qi, H., & Brown, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58607-2_5 · Cited by 178
Practical Secure Aggregation for Federated Learning on User-Held Data
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04482 · Cited by 177
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge
He, C., Annavaram, M., & Avestimehr, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14513 · Cited by 177
Self-citationFedCoin: A Peer-to-Peer Payment System for Federated Learning
Liu, Y., Ai, Z., Sun, S., Zhang, S., Liu, Z., & Yu, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63076-8_9 · Cited by 177
Self-citationMiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation
He, C., Ye, H., Shen, L., & Zhang, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01201 · Cited by 167
Self-citationYang, S., Ren, B., Zhou, C., & Liu, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09824 · Cited by 160
Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data
Ahn, J.-H., Simeone, O., & Kang, J. (2019) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2019.8904164 · Cited by 150
Detailed comparison of communication efficiency of split learning and federated learning
Singh, A., Vepakomma, P., Gupta, O., & Raskar, R. (2019) · arXiv · doi:10.48550/arxiv.1909.09145 · Cited by 148
Self-citationSecure and Efficient Federated Transfer Learning
Sharma, S., Xing, C., Liu, Y., & Kang, Y. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006280 · Cited by 147
Self-citationFederated Transfer Reinforcement Learning for Autonomous Driving
Liang, X., Liu, Y., Chen, T., Liu, M., & Yang, Q. (2019) · arXiv · doi:10.48550/arxiv.1910.06001 · Cited by 131 · cited 1×
“…to, computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105, 106, 107], robotics [108, 109], and smart cities…”
BackgroundSelf-citationLAGRANGE CODED COMPUTING: OPTIMAL DESIGN FOR RESILIENCY, SECURITY, AND PRIVACY
Avestimehr, S., Kalan, M. M., Raviv, N., Soltanolkotabi, M., Li, S., & Yu, Q. (2019) · International Conference on Artificial Intelligence and Statistics · Cited by 130
Self-citationFedNER: Privacy-preserving Medical Named Entity Recognition with Federated LearningPreprint
Ge, S., Wu, F., Wu, C., Qi, T., Huang, Y., & Xie, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09288 · Cited by 107
Privacy in Deep Learning: A Survey
Mireshghallah, F., Taram, M., Vepakomma, P., Singh, A., Raskar, R., & Esmaeilzadeh, H. (2020) · arXiv · doi:10.48550/arxiv.2004.12254 · Cited by 106 · cited 2×
“While the FL framework facilitates data privacy [89] by keeping data locally available to the users and only requiring communication for model updates, users may still be concerned about partial leakage of their data which may be inferred from the communicated model (see, e.g. , [112]).”
BackgroundSelf-citationGenerative Models for Effective ML on Private, Decentralized Datasets
Augenstein, S., McMahan, H. B., Ramage, D., Ramaswamy, S., Kairouz, P., Chen, M., Mathews, R., & Arcas, B. A. Y. (2019) · arXiv · doi:10.48550/arxiv.1911.06679 · Cited by 103
A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic RegressionPreprint
Yang, K., Fan, T., Chen, T., Shi, Y., & Yang, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00513 · Cited by 103
Self-citationFederated Learning with Only Positive LabelsPreprint
Yu, F. X., Rawat, A. S., Menon, A. K., & Kumar, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10342 · Cited by 102
Federated Multi-view Matrix Factorization for Personalized Recommendations
Flanagan, A., Oyomno, W., Grigorievskiy, A., Tan, K. E., Khan, S. A., & Ammad-ud-din, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67661-2_20 · Cited by 100
Acceleration for Compressed Gradient Descent in Distributed and Federated OptimizationPreprint
Li, Z., Kovalev, D. A., Qian, X., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11364 · Cited by 99
CINIC-10 Is Not ImageNet or CIFAR-10Preprint
Darlow, L. N., Crowley, E. J., Antoniou, A., & Storkey, A. (2018) · arXiv (Cornell University) · doi:10.7488/ds/2448 · Cited by 97
A Framework for Evaluating Gradient Leakage Attacks in Federated LearningPreprint
Wei, W., Liu, L., Loper, M. L., Chow, K. H., Gürsoy, M. E., Truex, S., & Wu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10397 · Cited by 92
Practical Privacy Preserving POI Recommendation
Chen, C., Zhou, J., Wu, B., Fang, W., Wang, L., Qi, Y., & Zheng, X. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3394138 · Cited by 92
Wireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Exploiting Unlabeled Data in Smart Cities using Federated Edge Learning
Albaseer, A., Ciftler, B. S., Abdallah, M., & Al-Fuqaha, A. (2020) · 2020 International Wireless Communications and Mobile Computing (IWCMC) · doi:10.1109/iwcmc48107.2020.9148475 · Cited by 84
Triastcyn, A., & Faltings, B. V. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2993966 · Cited by 81
An Overview of Federated Deep Learning Privacy Attacks and Defensive Strategies
Enthoven, D., & Al-Ars, Z. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-70604-3_8 · Cited by 81
Saputra, Y. M., Nguyen, D. N., Hoang, D. T., Vu, T. X., Dutkiewicz, E., & Chatzinotas, S. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3045987 · Cited by 76
$\texttt{DeepSqueeze}$: Decentralization Meets Error-Compensated CompressionPreprint
Tang, H., Lian, X., Qiu, S., Yuan, L., Zhang, C., Zhang, T., & Liu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.07346 · Cited by 73
Enhancing Privacy via Hierarchical Federated Learning
Wainakh, A., Guinea, A. S., Grube, T., & Mühlhäuser, M. (2020) · IEEE European Symposium on Security and Privacy Workshops (EuroS&PW) · doi:10.1109/eurospw51379.2020.00053 · Cited by 69
Entity Resolution and Federated Learning get a Federated ResolutionPreprint
Nock, R., Hardy, S., Henecka, W., Ivey-Law, H., Patrini, G., Smith, G., & Thorne, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04035 · Cited by 68
Multi-Participant Multi-Class Vertical Federated Learning
Feng, S., & Yu, H. (2020) · arXiv · doi:10.48550/arxiv.2001.11154 · Cited by 66 · cited 1×
“As demonstrated in Figure 3, FL has various topology definitions, such as vertical FL [34, 35, 36, 37, 38, 39, 40], split learning [41, 42], decentralized FL [43, 44, 45, 46], and Hierarchical FL [47, 48, 49, 50, 51, 52].”
BackgroundFadl Federated-autonomous deep learning for distributed electronic health record
Liu, D., Miller, T., Sayeed, R., & Mandl, K. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11400 · Cited by 65
(2020) · arXiv (Cornell University) · Cited by 64
Communication-Efficient Multimodal Split Learning for mmWave Received Power Prediction
Koda, Y., Park, J., Bennis, M., Yamamoto, K., Nishio, T., Morikura, M., & Nakashima, K. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2020.2978824 · Cited by 63
Cheng, Y., Liu, Y., & Yang, Q. (2019) · Cited by 62
Self-citationCentral Server Free Federated Learning over Single-sided Trust Social Networks
He, C., Tan, C., Tang, H., Qiu, S., & Liu, J. (2019) · arXiv · doi:10.48550/arxiv.1910.04956 · Cited by 60
Self-citationFederated Recommendation System via Differential Privacy
Li, T. K., Song, L., & Fragouli, C. (2020) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174297 · Cited by 57
Gradient-Leaks: Understanding and Controlling Deanonymization in Federated LearningPreprint
Orekondy, T., Oh, S. J., Zhang, Y., Schiele, B., & Fritz, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.05838 · Cited by 55
A Communication Efficient Collaborative Learning Framework for Distributed FeaturesPreprint
Liu, Y., Kang, Y., Zhang, X., Li, L., Cheng, Y. J., Chen, T., Hong, M., & Yang, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11187 · Cited by 53
Self-citationFederating recommendations using differentially private prototypes
Ribero, M., Henderson, J., Williamson, S. A., & Vikalo, H. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108746 · Cited by 52
Multi-consensus Decentralized Accelerated Gradient DescentPreprint
Ye, H., Luo, L., Zhou, Z., & Zhang, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00797 · Cited by 52
Federated Neural Architecture SearchPreprint
Yuan, J., Xu, M., Zhao, Y., Bian, K., Huang, G., Liu, X., & Wang, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06352 · Cited by 47
Ju, C., Zhao, R., Sun, J., Wei, X., Zhao, B., Liu, Y., Li, H., Chen, T., Zhang, X., Gao, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10517 · Cited by 46
Self-citationFederated pretraining and fine tuning of BERT using clinical notes from multiple silosPreprint
Liu, D., & Miller, T. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08562 · Cited by 45
Robust Federated Recommendation SystemPreprint
Chen, C., Zhang, J., Tung, A. K. H., Kankanhalli, M., & Chen, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08259 · Cited by 44
Backdoor attacks and defenses in feature-partitioned collaborative learning
Liu, Y., Yi, Z., & Chen, T. (2020) · arXiv · doi:10.48550/arxiv.2007.03608 · Cited by 38
Self-citationFrom Local SGD to Local Fixed-Point Methods for Federated LearningPreprint
Malinovsky, G., Kovalev, D. A., Gasanov, E., Condat, L., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.01442 · Cited by 29
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated LearningPreprint
So, J., Güler, B., & Avestimehr, A. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04156 · Cited by 28
Self-citationAsymmetrical Vertical Federated LearningPreprint
Liu, Y., Zhang, X., & Wang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07427 · Cited by 28
Self-citationFederated Semi-Supervised Learning with Inter-Client Consistency.Preprint
Jeong, W., Yoon, J., Yang, E., & Hwang, S. J. (2020) · arXiv (Cornell University) · Cited by 26
Backdoor Attacks on Federated Meta-Learning
Chen, C.-L., Golubchik, L., & Paolieri, M. (2020) · arXiv · doi:10.48550/arxiv.2006.07026 · Cited by 22 · cited 2×
“…on developing new adversarial attack and defense techniques to make federated learning robust [13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 22], and proposing methods such as differential privacy (DP) and secure multiparty computation (SMPC) to protect privacy [25, 26, 27, 28, 29, 30, 31,…”
BackgroundYin, F., Lin, Z., Xu, Y., Kong, Q., Li, D., Theodoridis, S., Shuguang, & Cui (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03697 · Cited by 22
Group Knowledge Transfer: Collaborative Training of Large CNNs on the Edge.Preprint
He, C., Annavaram, M., & Avestimehr, S. (2020) · arXiv (Cornell University) · Cited by 22
Self-citationArtemis: tight convergence guarantees for bidirectional compression in Federated Learning.Preprint
Philippenko, C., & Dieuleveut, A. (2020) · arXiv (Cornell University) · Cited by 21
Decentralized Bayesian Learning over Graphs
Lalitha, A., Wang, X., Kilinc, O., Lu, Y., Javidi, T., & Koushanfar, F. (2019) · arXiv · doi:10.48550/arxiv.1905.10466 · Cited by 20
Self-citationFederated Learning of N-gram Language ModelsPreprint
Chen, M., Suresh, A. T., Mathews, R., Wong, A., Allauzen, C., Beaufays, F., & Riley, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03432 · Cited by 16
FedRec: Privacy-Preserving News Recommendation with Federated LearningPreprint
Qi, T., Wu, F., Wu, C., Huang, Y., & Xie, X. (2020) · arXiv (Cornell University) · Cited by 16
Liu, B., Wang, L., Liu, M., & Xu, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00895 · Cited by 15
ExpertMatcher: Automating ML Model Selection for Clients using Hidden RepresentationsPreprint
Sharma, V., Vepakomma, P., Swedish, T. B., Chang, K., Kalpathy–Cramer, J., & Raskar, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03731 · Cited by 13
Self-citationDifferentially-private Federated Neural Architecture SearchPreprint
Singh, I., Zhou, H., Yang, K., Ding, M., Lin, B., & Xie, P. (2020) · doi:10.36227/techrxiv.12503420.v1 · Cited by 13
Exploiting Unlabeled Data in Smart Cities using Federated LearningPreprint
Albaseer, A. M., Çiftler, B. S., Abdallah, M. M., & Al‐Fuqaha, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04030 · Cited by 11
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer SelectionPreprint
Tang, Z., Shi, S., & Chu, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09692 · Cited by 10
Coded Computing for Federated Learning at the EdgePreprint
Prakash, S., Dhakal, S., Akdeniz, M. R., Avestimehr, A. S., & Himayat, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03273 · Cited by 10
Neural Architecture Search over Decentralized Data
Xu, M., Zhao, Y., Bian, K., Huang, G., Mei, Q., & Liu, X. (2020) · Cited by 8
Federated Learning Meets Contract Theory: Energy-Efficient Framework for Electric Vehicle NetworksPreprint
Saputra, Y. M., Nguyen, D. N., Hoang, D. T., Vu, T. X., Dutkiewicz, E., & Chatzinotas, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.01828 · Cited by 8
Cloud-based federated boosting for mobile crowdsensing
Wang, Z., Yang, Y., Liu, Y., Liu, X., Gupta, B. B., & Ma, J. (2020) · arXiv · doi:10.48550/arxiv.2005.05304 · Cited by 6
Self-citationFederated Hierarchical Hybrid Networks for Clickbait DetectionPreprint
Liao, F., Zhuo, H. H., Huang, X., & Zhang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00638 · Cited by 5
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationModel-Contrastive Federated Learning
Li, Q., He, B., & Song, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01057 · Cited by 1,534
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Federated Learning on Non-IID Data Silos: An Experimental Study
Li, Q., Diao, Y., Chen, Q., & He, B. (2022) · 2022 IEEE 38th International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00077 · Cited by 1,132
Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Metadata
- Authors
- He, C., Li, S., So, J., Zeng, X., Zhang, M., Wang, H., Wang, X., Vepakomma, P., Singh, A., Qiu, H., Zhu, X., Wang, J., Shen, L., Zhao, P., Kang, Y., Liu, Y., Raskar, R., Yang, Q., Annavaram, M., & Avestimehr, S.
- Venue
- arXiv (Cornell University)
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2007.13518
- OpenAlex
- W3044211235
- Cited by
- 314
- References
- 149
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.