The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
An adaptive federated learning scheme with differential privacy preserving
Abstract
Abstract Driven by the upcoming development of the sixth-generation communication system (6G), the distributed machine learning schemes represented by federated learning has shown advantages in data efficient utilization and multi-party cooperative modeling. The total communication cost of federated learning is related to the number of communication rounds, the communication consumption of each participant, the setting of reasonable learning rate and the guarantee of calculation fairness have important influence on the control of total cost. In addition, the simple data isolation strategy in the federated learning framework cannot completely guarantee the privacy security of users. Motivated by the above problems, this paper proposed a federated learning scheme combined with the adaptive gradient descent strategy and differential privacy mechanism, which is suitable for multi-party collaborative modeling scenarios. To ensure that federated learning scheme can train efficiently with limited communications costs, the learning rate adaptive algorithm is innovatively used to adjust the gradient descent process to avoid model overfitting and fluctuation phenomena, so as to improve the modeling efficiency and model performance in multi-party calculation scenarios. Furthermore, aiming at adapting to the ultra-large-scale distributed secure computing scenario, this research introduces a differential privacy mechanism to resist various background attacks. Experimental results demonstrate that the proposed adaptive federated learning model performs better than the traditional models at fixed communication costs. This novel modeling scheme also shows robustness to different super-parameter settings and provides stronger quantifiable privacy preserving for federated learning process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Self-citationFederated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
(2013) · Cited by 5,372
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT
Lu, Y., Huang, X., Dai, Y., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2942190 · Cited by 1,245
Self-citationHogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
Niu, F., Recht, B., Re, C., & Wright, S. J. (2011) · arXiv · doi:10.48550/arxiv.1106.5730 · Cited by 1,211
Differentially Private Federated Learning: A Client Level Perspective
Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052
Federated Learning for Wireless Communications: Motivation, Opportunities, and Challenges
Niknam, S., Dhillon, H. S., & Reed, J. H. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900461 · Cited by 820
A secure federated transfer learning framework
Liu, Y., Kang, Y., Xing, C., Chen, T., & Yang, Q. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988525 · Cited by 645
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · arXiv · doi:10.48550/arxiv.1902.04885 · Cited by 600
Fair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2019) · arXiv · doi:10.48550/arxiv.1905.10497 · Cited by 475
Self-Balancing Federated Learning With Global Imbalanced Data in Mobile Systems
Duan, M., Liu, D., Chen, X., Liu, R., Tan, Y., & Liang, L. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3009406 · Cited by 432
Hardy, S., Henecka, W., Ivey-Law, H., Nock, R., Patrini, G., Smith, G., & Thorne, B. (2017) · arXiv · doi:10.48550/arxiv.1711.10677 · Cited by 431
Wang, X., Wang, C., Li, X., Leung, V. C. M., & Taleb, T. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2986803 · Cited by 402
Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach
Ye, D., Yu, R., Pan, M., & Han, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2968399 · Cited by 378
Personalized Federated Learning With Differential Privacy
Hu, R., Guo, Y., Li, H., Pei, Q., & Gong, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991416 · Cited by 350
A Secure Federated Learning Framework for 5G Networks
Liu, Y., Peng, J., Kang, J., Iliyasu, A. M., Niyato, D., & El-Latif, A. A. A. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.01.1900525 · Cited by 290
Blockchain-Secured Smart Manufacturing in Industry 4.0: A Survey
Leng, J., Ye, S., Zhou, M., Zhao, J. L., Liu, Q., Guo, W., Cao, W., & Fu, L. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3040789 · Cited by 284
Blockchain Security: A Survey of Techniques and Research Directions
Leng, J., Zhou, M., Zhao, J. L., Huang, Y., & Bian, Y. (2022) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2020.3038641 · Cited by 279
Lin, B., Zhu, F., Zhang, J., Chen, J., Chen, X., Xiong, N. N., & Lloret Mauri, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2905659 · Cited by 236
Self-citationPreserving Data Privacy via Federated Learning: Challenges and Solutions
Li, Z., Sharma, V., & P. Mohanty, S. (2020) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2019.2959108 · Cited by 226
Deep Matrix Factorization With Implicit Feedback Embedding for Recommendation System
Yi, B., Shen, X., Liu, H., Zhang, Z., Zhang, W., Liu, S., & Xiong, N. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2893714 · Cited by 226
Self-citationCell-Free Massive MIMO for Wireless Federated Learning
Vu, T. T., Ngo, D. T., Tran, N. H., Ngo, H. Q., Dao, M. N., & Middleton, R. H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3002988 · Cited by 194
A Dimensionality Reduction-Based Multi-Step Clustering Method for Robust Vessel Trajectory Analysis
Li, H., Liu, J., Liu, R., Xiong, N., Wu, K., & Kim, T.-H. (2017) · Sensors · doi:10.3390/s17081792 · Cited by 186
Self-citationAdaptive Fuzzy Bounded Control for Consensus of Multiple Strict-Feedback Nonlinear Systems
Wang, W., & Tong, S. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2645763 · Cited by 180
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition
Ge, R., Huang, F., Jin, C., & Yang, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02101 · Cited by 173
Rodríguez-Barroso, N., Stipcich, G., Jiménez-López, D., Ruiz-Millán, J. A., Martínez-Cámara, E., González-Seco, G., Luzón, M. V., Veganzones, M. A., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.009 · Cited by 148
Preserving Privacy with Probabilistic Indistinguishability in Weighted Social Networks
Liu, Q., Wang, G., Li, F., Yang, S., & Wu, J. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2615020 · Cited by 147
Enabling Verifiable and Dynamic Ranked Search over Outsourced Data
Liu, Q., Tian, Y., Wu, J., Peng, T., & Wang, G. (2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2922177 · Cited by 141
Federated Learning Based Proactive Content Caching in Edge Computing
Yu, Z., Hu, J., Min, G., Lu, H., Zhao, Z., Wang, H., & Georgalas, N. (2018) · 2018 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2018.8647616 · Cited by 140
Fang, W. W., Yao, X., Zhao, X., Yin, J., & Xiong, N. N. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2606400 · Cited by 138
Self-citationA Structure Fidelity Approach for Big Data Collection in Wireless Sensor Networks
Wu, M., Tan, L., & Xiong, N. N. (2014) · Sensors · doi:10.3390/s150100248 · Cited by 103
Self-citationIntelligent route planning on large road networks with efficiency and privacy
Liu, Q., Hou, P., Wang, G., Peng, T., & Zhang, S. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.06.012 · Cited by 101
Qu, Y., & Xiong, N. N. (2012) · Proceedings of the International Conference on Parallel Processing · doi:10.1109/icpp.2012.3 · Cited by 100
Self-citationTraining of Deep Neural Networks based on Distance Measures using RMSPropPreprint
Kurbiel, T., & Khaleghian, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.01911 · Cited by 98
Information Entropy As a Basic Building Block of Complexity Theory
Gao, J., Liu, F., Zhang, J., Hu, J., & Cao, Y. (2013) · Entropy · doi:10.3390/e15093396 · Cited by 66
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes, from any initializationPreprint
Ward, R., Wu, X., & Bottou, L. (2018) · arXiv (Cornell University) · Cited by 59
Self-citationDynamic allocation strategy of VM resources with fuzzy transfer learning method
Wu, X., Wang, H., Tan, W. W., et al. (2020) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-020-00885-7 · Cited by 52
Self-citationA Randomized Block-Coordinate Adam online learning optimization algorithm
Zhou, Y., Zhang, M., Zhu, J., Zheng, R., & Wu, Q. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04718-9 · Cited by 45
A differential privacy DNA motif finding method based on closed frequent patterns
Wu, X., Wei, Y., Mao, Y., & Wang, L. (2018) · Cluster Computing · doi:10.1007/s10586-017-1691-9 · Cited by 34
Self-citationJS-Reduce: Defending Your Data from Sequential Background Knowledge Attacks
Riboni, D., Pareschi, L., & Bettini, C. (2012) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2012.19 · Cited by 26
On-Device Federated Learning via Second-Order Optimization with Over-the-Air Computation
Hua, S., Yang, K., & Shi, Y. (2019) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2019.8891310 · Cited by 13
DNA Motif Finding Method Without Protection Can Leak User Privacy
Wu, X., Wang, H., Shi, M., Wang, A., & Xia, K. (2019) · IEEE Access · doi:10.1109/access.2019.2947261 · Cited by 13
Self-citation
Cited by
A survey on federated learning: challenges and applications
Wen, J., Zhang, Z., Lan, Y., Cui, Z., Cai, J., & Zhang, W. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01647-y · Cited by 883
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
Wu, X., Zou, B., Lu, C., Wang, L., Zhang, Y., & Wang, H. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3560036 · Cited by 65
Self-citationPapadopoulos, C., Kollias, K.-F., & Fragulis, G. F. (2024) · Future Internet · doi:10.3390/fi16110415 · Cited by 35
Metadata
- Authors
- Wu, X., Zhang, Y., Shi, M., Li, P., Li, R., & Xiong, N. N.
- Venue
- Future Generation Computer Systems
- Publisher
- Elsevier BV
- Published
- 2022-02
- Volume
- 127
- Pages
- 362-372
- ISSN
- 0167-739X (ISSN-L)
- OpenAlex
- W3200400919
- Cited by
- 283
- References
- 48
- FWCI
- 12.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.