FederatedScope: A Flexible Federated Learning Platform for Heterogeneity
Open accessAbstract
Although remarkable progress has been made by existing federated learning (FL) platforms to provide infrastructures for development, these platforms may not well tackle the challenges brought by various types of heterogeneity. To fill this gap, in this paper, we propose a novel FL platform, named FederatedScope, which employs an event-driven architecture to provide users with great flexibility to independently describe the behaviors of different participants. Such a design makes it easy for users to describe participants with various local training processes, learning goals and backends, and coordinate them into an FL course with synchronous or asynchronous training strategies. Towards an easy-to-use and flexible platform, FederatedScope enables rich types of plug-in operations and components for efficient further development, and we have implemented several important components to better help users with privacy protection, attack simulation and auto-tuning. We have released FederatedScope at https://github.com/alibaba/FederatedScope to promote academic research and industrial deployment of federated learning in a wide range of scenarios.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
FedOT protects model providers' intellectual property and clients' data privacy while using distributed data to adapt LLMs to specific domains.
“Fe-dOT safeguards both the intelligent property of the model providers and the data privacy of the clients, while leveraging the distributed data for adapting LLMs to specific domains.”
From FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning (2024) · cites this paper as [64]
Cites
(2012) · Cited by 8,009 · see citing works
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · see citing works
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,195 · see citing works
Self-citationHarris, Z. S. (1954) · <i>WORD</i> · doi:10.1080/00437956.1954.11659520 · Cited by 4,807 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856 · see citing works
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400 · see citing works
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334 · see citing works
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542 · see citing works
BadNets: Evaluating Backdooring Attacks on Deep Neural Networks
Gu, T., Liu, K., Dolan-Gavitt, B., & Garg, S. (2019) · IEEE Access · doi:10.1109/access.2019.2909068 · Cited by 1,238 · see citing works
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · arXiv · doi:10.48550/arxiv.1902.04885 · Cited by 600 · see citing works
Event-Driven Architecture Overview
Michelson, B. (2006) · doi:10.1571/bda2-2-06cc · Cited by 217 · see citing works
Yang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2020) · Synthesis lectures on artificial intelligence and machine learning · doi:10.1007/978-3-031-01585-4 · Cited by 210 · see citing works
Federated Learning with Differential Privacy: Algorithms and Performance AnalysisPreprint
Wei, K., Li, J., Ding, M., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00222 · Cited by 86 · see citing works
Federated matrix factorization with privacy guarantee
Li, Z., Ding, B., Zhang, C., Li, N., & Zhou, J. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3503585.3503598 · Cited by 33 · see citing works
Self-citationpFL-Bench: A Comprehensive Benchmark for Personalized Federated LearningPreprint
Chen, D., Gao, D., Kuang, W., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.03655 · Cited by 23 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
Martínez Beltrán, E. T., Pérez, M. Q., Sánchez, P. M. S., Bernal, S. L., Bovet, G., Pérez, M. G., Pérez, G. M., & Celdrán, A. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315746 · Cited by 625 · see citing works
Kuang, W., Qian, B., Li, Z., Chen, D., Gao, D., Pan, X., Xie, Y., Li, Y., Ding, B., & Zhou, J. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671573 · Cited by 142 · see citing works
Self-citationOn the Convergence of Zeroth-Order Federated Tuning for Large Language Models
Ling, Z., Chen, D., Yao, L., Li, Y., & Shen, Y. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671865 · Cited by 21 · see citing works
Self-citation
- Authors
- Xie, Y., Wang, Z., Gao, D., Chen, D., Yao, L., Kuang, W., Li, Y., Ding, B., & Zhou, J.
- Affiliations
- Alibaba Group (China) (CN)
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2023-01
- Volume
- 16
- Issue
- 5
- Pages
- 1059-1072
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W4323343894
- Cited by
- 84
- References
- 17
- Citations by year
- 2026: 7 · 2025: 28 · 2024: 31 · 2023: 18
- FWCI
- 7.92
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the VLDB Endowment (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- heterogeneity, event-driven architecture, participant modeling, privacy preservation, attack simulation, auto-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review