Sparsified SGD with Memory

Federated Learning in Mobile Edge Networks: A Comprehensive Survey

Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565 · see citing works

Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing

Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · see citing works

SCAFFOLD: Stochastic Controlled Averaging for Federated Learning

Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2019) · arXiv · doi:10.48550/arxiv.1910.06378 · Cited by 1,734 · see citing works

Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data

Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944481 · Cited by 1,725 · see citing works

On the Convergence of FedAvg on Non-IID Data

Li, X., Huang, K., Yang, W., Wang, S., & Zhang, Z. (2019) · arXiv · doi:10.48550/arxiv.1907.02189 · Cited by 1,575 · see citing works

Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy Constraints

Sattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355 · see citing works

Local SGD Converges Fast and Communicates LittlePreprint

Stich, S. U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09767 · Cited by 679 · see citing works

Distributed Learning in Wireless Networks: Recent Progress and Future Challenges

Chen, M., Gündüz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 558 · see citing works

Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks

Hoefler, T., Alistarh, D., Ben-Nun, T., Dryden, N., & Peste, A. (2021) · ETH Zurich · doi:10.3929/ethz-b-000519202 · Cited by 423 · see citing works

From distributed machine learning to federated learning: a survey

Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 374 · see citing works

Autonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain

Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 289 · see citing works

Qsparse-local-SGD: Distributed SGD with quantization, sparsification, and local computations

Basu, D., Data, D., Karakus, C., & Diggavi, S. N. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2985917 · Cited by 256 · see citing works

A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesPreprint

Koloskova, A., Loizou, N., Boreiri, S., Jaggi, M., & Stich, S. U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10422 · Cited by 258 · see citing works

Sparse Binary Compression: Towards Distributed Deep Learning with minimal Communication

Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852172 · Cited by 240 · see citing works

On the Convergence of FedAvg on Non-IID Data

Li, X., Huang, K., Yang, W., Wang, S., & Zhang, Z. (2020) · International Conference on Learning Representations · Cited by 275 · see citing works

FetchSGD: Communication-Efficient Federated Learning with SketchingPreprint

Rothchild, D., Panda, A., Ullah, E., Ivkin, N. P., Stoica, I. G., Braverman, V., Gonzalez, J. E., & Arora, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07682 · Cited by 234 · see citing works

Over-the-Air Federated Learning From Heterogeneous Data

Sery, T., Shlezinger, N., Cohen, K., & Eldar, Y. C. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3090323 · Cited by 247 · see citing works

To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices

Li, L., Shi, D., Hou, R.-H., Li, H., Pan, M., & Han, Z. (2020) · IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488839 · Cited by 198 · see citing works

A Field Guide to Federated OptimizationPreprint

Wang, J., Charles, Z., Xu, Z., Joshi, G., McMahan, H. B., y Arcas, B. A., Al-Shedivat, M., Andrew, G., Avestimehr, S., Daly, K., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06917 · Cited by 181 · see citing works

Federated Learning: A signal processing perspective

Gafni, T., Shlezinger, N., Cohen, K., Eldar, Y. C., & Poor, H. V. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3125282 · Cited by 179 · see citing works

PowerSGD: Practical Low-Rank Gradient Compression for Distributed OptimizationPreprint

Vogels, T., Karimireddy, S. P., & Jaggi, M. (2019) · Neural Information Processing Systems · doi:10.48550/arxiv.1905.13727 · Cited by 497 · see citing works

A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

Shi, S., Wang, Q., Zhao, K., Tang, Z., Wang, Y., Huang, X. L., & Chu, X. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00220 · Cited by 170 · see citing works

Applications of Federated Learning; Taxonomy, Challenges, and Research Trends

Shaheen, M., Farooq, M. S., Umer, T., & Kim, B.-S. (2022) · Electronics · doi:10.3390/electronics11040670 · Cited by 157 · see citing works

Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated LearningPreprint

Yang, H., Fang, M., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11203 · Cited by 150 · see citing works

Adaptive Federated Learning on Non-IID Data With Resource Constraint

Zhang, J., Guo, S., Qu, Z., Zeng, D., Zhan, Y., Liu, Q., & Akerkar, R. A. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3099723 · Cited by 144 · see citing works

Federated Learning with Compression: Unified Analysis and Sharp GuaranteesPreprint

Haddadpour, F., Kamani, M. M., Mokhtari, A., & Mahdavi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01154 · Cited by 140 · see citing works

Communication-efficient distributed learning: An overview

Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139 · see citing works

Federated Learning Over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis

Xing, H., Simeone, O., & Bi, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118400 · Cited by 130 · see citing works

Efficient sparse collective communication and its application to accelerate distributed deep learning

Fei, J., Ho, C.-Y., Sahu, A. N., Canini, M., & Sapio, A. (2021) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3452296.3472904 · Cited by 126 · see citing works

Dynamic Model Pruning with Feedback

Lin, T., Stich, S. U., Barba, L., Dmitriev, D., & Jaggi, M. (2020) · arXiv · doi:10.48550/arxiv.2006.07253 · Cited by 126 · see citing works

Adaptive Control of Local Updating and Model Compression for Efficient Federated Learning

Xu, Y., Liao, Y., Xu, H., Ma, Z., Wang, L., & Liu, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3186936 · Cited by 120 · see citing works

Decentralized Deep Learning with Arbitrary Communication CompressionPreprint

Koloskova, A., Lin, T., Stich, S. U., & Jaggi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09356 · Cited by 118 · see citing works

A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services

Katare, D., Perino, D., Nurmi, J., Warnier, M., Janssen, M., & Ding, A. Y. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3302474 · Cited by 119 · see citing works

Joint Model Pruning and Device Selection for Communication-Efficient Federated Edge Learning

Liu, S., Yu, G., Yin, R., Yuan, J., Shen, L., & Liu, C. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3124961 · Cited by 106 · see citing works

Federated Accelerated Stochastic Gradient DescentPreprint

Yuan, H., & Ma, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08950 · Cited by 106 · see citing works

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning

Sun, J., Chen, T., Giannakis, G. B., Yang, Q., & Yang, Z. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3033286 · Cited by 102 · see citing works

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Wang, L., Xu, Y., Xu, H., Chen, M., & Huang, L. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3178378 · Cited by 96 · see citing works

Trusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning

Ma, C., Li, J., Wei, K., Liu, B., Ding, M., Yuan, L., Han, Z., & Vincent Poor, H. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3306773 · Cited by 96 · see citing works

IoT Device Friendly and Communication-Efficient Federated Learning via Joint Model Pruning and Quantization

Prakash, P., Ding, J., Chen, R., Qin, X., Shu, M., Cui, Q., Guo, Y., & Pan, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3145865 · Cited by 95 · see citing works

Communication-Efficient Distributed Deep Learning: A Comprehensive SurveyPreprint

Tang, Z.-H., Shi, S.-H., Wang, W., Li, B., & Chu, X. (2020) · arXiv.org · doi:10.48550/arxiv.2003.06307 · Cited by 54 · see citing works

Wireless Network Intelligence at the Edge

Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92 · see citing works

The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed CommunicationPreprint

Stich, S. U., & Karimireddy, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05350 · Cited by 91 · see citing works

HiveMind: Towards Cellular Native Machine Learning Model Splitting

Wang, S., Zhang, X., Uchiyama, H., & Matsuda, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118403 · Cited by 90 · see citing works

Communication-efficient distributed SGD with SketchingPreprint

Ivkin, N. P., Rothchild, D., Ullah, E., Braverman, V., Stoica, I. G., & Arora, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.04488 · Cited by 86 · see citing works

Fast Convergence Rates of Distributed Subgradient Methods With Adaptive Quantization

Doan, T. T., Maguluri, S. T., & Romberg, J. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3014095 · Cited by 83 · see citing works

vqSGD: Vector Quantized Stochastic Gradient Descent

Gandikota, V., Kane, D. M., Maity, R. K., & Mazumdar, A. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3161620 · Cited by 80 · see citing works

Towards efficient communications in federated learning: A contemporary survey

Zhao, Z., Mao, Y., Liu, Y., Song, L., Ouyang, Y., Chen, X., & Ding, W. (2023) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2022.12.053 · Cited by 80 · see citing works

Communication-Efficient Distributed Blockwise Momentum SGD with Error-FeedbackPreprint

Zheng, S., Huang, Z., & Kwok, J. T.-Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10936 · Cited by 78 · see citing works

Layer-Wise Adaptive Model Aggregation for Scalable Federated Learning

Lee, S., Zhang, T., & Avestimehr, A. S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26023 · Cited by 84 · see citing works

Federated Learning Via Inexact ADMM

Zhou, S.-L., & Li, G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243080 · Cited by 104 · see citing works

Joint Optimization of Communications and Federated Learning Over the Air

Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3130111 · Cited by 74 · see citing works

Stochastic Distributed Learning with Gradient Quantization and Variance ReductionPreprint

Horváth, S., Kovalev, D. A., Mishchenko, K., Stich, S. U., & Richtárik, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05115 · Cited by 75 · see citing works

Learned Gradient Compression for Distributed Deep Learning

Abrahamyan, L., Chen, Y., Bekoulis, G., & Deligiannis, N. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084806 · Cited by 77 · see citing works

Acceleration for Compressed Gradient Descent in Distributed and Federated OptimizationPreprint

Li, Z., Kovalev, D. A., Qian, X., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11364 · Cited by 72 · see citing works

GRACE: A Compressed Communication Framework for Distributed Machine Learning

Xu, H., Ho, C.-Y., Abdelmoniem, A. M., Dutta, A., Bergou, E. H., Karatsenidis, K., Canini, M., & Kalnis, P. (2021) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00060 · Cited by 71 · see citing works

On Maintaining Linear Convergence of Distributed Learning and Optimization Under Limited Communication

Magnússon, S., Shokri‐Ghadikolaei, H., & Li, N. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3031073 · Cited by 71 · see citing works

Understanding Top-k Sparsification in Distributed Deep LearningPreprint

Shi, S., Chu, X., Cheung, K. C., & See, S. C. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08772 · Cited by 71 · see citing works

Communication optimization strategies for distributed deep neural network training: A survey

Ouyang, S., Dong, D., Xu, Y., & Xiao, L. (2020) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2020.11.005 · Cited by 73 · see citing works

1-Bit Compressive Sensing for Efficient Federated Learning Over the Air

Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3209190 · Cited by 67 · see citing works

FedLab: A Flexible Federated Learning FrameworkPreprint

Zeng, D., Liang, S., Hu, X., Wang, H., & Xu, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11621 · Cited by 71 · see citing works

Optimal Rate Adaption in Federated Learning with Compressed Communications

Cui, L., Su, X., Zhou, Y., & Liu, J. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796982 · Cited by 63 · see citing works

Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints

Ribero, M., Vikalo, H., & Veciana, G. A. D. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3224590 · Cited by 60 · see citing works

On the Convergence of Communication-Efficient Local SGD for Federated Learning

Gao, H., Xu, A. P., & Huang, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16920 · Cited by 59 · see citing works

A federated learning framework for healthcare IoT devices

Yuan, B., Ge, S., & Xing, W. (2020) · arXiv · doi:10.48550/arxiv.2005.05083 · Cited by 59 · see citing works

Time-Correlated Sparsification for Communication-Efficient Federated Learning

Özfatura, E., Özfatura, K., & Gündüz, D. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518221 · Cited by 58 · see citing works

A Compressed Gradient Tracking Method for Decentralized Optimization With Linear Convergence

Liao, Y., Li, Z., Huang, K., & Pu, S. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3180695 · Cited by 59 · see citing works

Secure Federated Averaging Algorithm with Differential Privacy

Li, Y., Chang, T., & Chi, C. (2020) · Machine learning for signal processing ... · doi:10.1109/mlsp49062.2020.9231531 · Cited by 56 · see citing works

Continuous Training and Deployment of Deep Learning Models

Prapas, I., Derakhshan, B., Mahdiraji, A. R., & Markl, V. (2021) · Datenbank-Spektrum · doi:10.1007/s13222-021-00386-8 · Cited by 55 · see citing works

Communication-Efficient Design for Quantized Decentralized Federated Learning

Chen, L., Liu, W., Chen, Y., & Wang, W. (2024) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2024.3363887 · Cited by 55 · see citing works

Unified Optimal Analysis of the (Stochastic) Gradient MethodPreprint

Stich, S. U. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04232 · Cited by 55 · see citing works

SQuARM-SGD: Communication-Efficient Momentum SGD for Decentralized Optimization

Singh, N., Data, D., George, J., & Diggavi, S. N. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9517986 · Cited by 54 · see citing works

Partial Synchronization to Accelerate Federated Learning Over Relay-Assisted Edge Networks

Qu, Z., Guo, S., Wang, H., Ye, B., Wang, Y., Zomaya, A. Y., & Tang, B. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3083154 · Cited by 54 · see citing works

SPARQ-SGD: Event-Triggered and Compressed Communication in Decentralized Optimization

Singh, N., Data, D., George, J., & Diggavi, S. N. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3145576 · Cited by 53 · see citing works

Elastic Aggregation for Federated Optimization

Chen, D., Hu, J., Tan, V. J., Wei, X., & Wu, E. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01173 · Cited by 53 · see citing works

Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning

Elgabli, A., Park, J., Bedi, A. S., Issaid, C. B., Bennis, M., & Aggarwal, V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3026398 · Cited by 55 · see citing works

Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates

Cui, L., Su, X., Zhou, Y., & Pan, Y. F. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087262 · Cited by 53 · see citing works

Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse GradientsPreprint

Mitra, A., Jaafar, R. H., Pappas, G. J., & Hassani, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07053 · Cited by 53 · see citing works

Shuffled Model of Federated Learning: Privacy, Accuracy and Communication Trade-Offs

Girgis, A. M., Data, D., Diggavi, S. N., Kairouz, P., & Suresh, A. T. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3056102 · Cited by 52 · see citing works

Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning

Qiao, L., Gao, Z., Mashhadi, M. B., & Gündüz, D. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431572 · Cited by 73 · see citing works

A Comprehensive Survey on Training Acceleration for Large Machine Learning Models in IoT

Wang, H., Qu, Z., Zhou, Q., Zhang, H., Luo, B., Xu, W., Guo, S., & Li, R. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111624 · Cited by 50 · see citing works

A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!Preprint

Kovalev, D. A., Koloskova, A., Jaggi, M., Richtárik, P., & Stich, S. U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01697 · Cited by 47 · see citing works

An Efficient Statistical-based Gradient Compression Technique for Distributed Training SystemsPreprint

Abdelmoniem, A. M., Elzanaty, A., Alouini, M., & Canini, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.10761 · Cited by 48 · see citing works

Communication-Efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling

Zhang, M., Zhu, G., Wang, S., Jiang, J., Liao, Q., Zhong, C., & Cui, S. R. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3166941 · Cited by 47 · see citing works

Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems

Xu, Y., Jiang, Z., Xu, H., Wang, Z., Qian, C., & Qiao, C. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3309497 · Cited by 47 · see citing works

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression

Jiang, Z., Xu, Y., Xu, H., Wang, Z., & Qian, C. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229029 · Cited by 47 · see citing works

A Communication-Efficient Federated Learning Scheme for IoT-Based Traffic Forecasting

Zhang, C., Cui, L., Yu, S., & Yu, J. J. Q. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3132363 · Cited by 46 · see citing works

Stochastic-Sign SGD for Federated Learning with Theoretical GuaranteesPreprint

Jin, R., Huang, Y., He, X., Dai, H., & Wu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10940 · Cited by 46 · see citing works

On Model Transmission Strategies in Federated Learning With Lossy Communications

Su, X., Zhou, Y., Cui, L., & Liu, J. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3240883 · Cited by 47 · see citing works

On the Effectiveness of Partial Variance Reduction in Federated Learning with Heterogeneous Data

Li, B., Schmidt, M. N., Alstrøm, T. S., & Stich, S. U. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00386 · Cited by 45 · see citing works

rTop-<i>k</i>: A Statistical Estimation Approach to Distributed SGD

Barnes, L. P., Inan, H. A., Isik, B., & Ozgur, A. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.3042094 · Cited by 44 · see citing works

Adaptive Network Pruning for Wireless Federated Learning

Liu, S., Yu, G., Yin, R., & Yuan, J. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3074605 · Cited by 43 · see citing works

Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approach

Zhang, J.-S., Li, N., & Dedeoglu, M. (2021) · IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488818 · Cited by 47 · see citing works

A Fast Blockchain-Based Federated Learning Framework With Compressed Communications

Cui, L., Su, X., & Zhou, Y. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3213345 · Cited by 43 · see citing works

AC-SGD: Adaptively Compressed SGD for Communication-Efficient Distributed Learning

Yan, G., Li, T. K., Huang, S., Lan, T., & Song, L. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3192050 · Cited by 40 · see citing works

Federated Learning Over Wireless Networks: Challenges and Solutions

Beitollahi, M., & Lu, N. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3285868 · Cited by 40 · see citing works

YOGA: Adaptive Layer-Wise Model Aggregation for Decentralized Federated Learning

Liu, J., Liu, J., Xu, H., Liao, Y., Wang, Z., & Ma, Q. (2023) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2023.3329005 · Cited by 40 · see citing works

Gradient Compression and Correlation Driven Federated Learning for Wireless Traffic Prediction

Zhang, C., Zhang, H., Dang, S., Shihada, B., & Alouini, M. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3524183 · Cited by 40 · see citing works

Design of a Quantization-Based DNN Delta Compression Framework for Model Snapshots and Federated Learning

Jin, H., Wu, D., Zhang, S., Zou, X., Jin, S., Tao, D., Liao, Q., & Xia, W. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3230840 · Cited by 39 · see citing works

On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Federated Learning

Hashemi, A., Acharya, A., Das, R., Vikalo, H., Sanghavi, S., & Dhillon, I. S. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3138977 · Cited by 47 · see citing works

Gradient Obfuscation Gives a False Sense of Security in Federated Learning

Yue, K., Jin, R., Wong, C.-W., Baron, D., & Dai, H. (2022) · arXiv · doi:10.48550/arxiv.2206.04055 · Cited by 26 · see citing works

Convex Optimization using Sparsified Stochastic Gradient Descent with Memory

Cordonnier, J.-B. (2018) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 4 · see citing works

A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification

Shi, S., Zhao, K., Wang, Q., Tang, Z., & Chu, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/473 · Cited by 75 · see citing works

Gradient Sparsification for Communication-Efficient Distributed OptimizationPreprint

Wangni, J., Wang, J., Ji, L. H., & Zhang, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09854 · Cited by 306 · see citing works

Efficient Distributed Stochastic Gradient Descent Through Gaussian Averaging

Hu, K., Wu, C., & Zhu, E. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78609-0_4

Distributed Sparse SGD with Majority VotingPreprint

Özfatura, K., Özfatura, E., & Gündüz, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06495 · Cited by 3 · see citing works