GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works

Learning Multiple Layers of Features from Tiny Images

Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works

Reducing the dimensionality of data with neural networks

Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works

A fast learning algorithm for deep belief nets

Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · see citing works

Greedy layer-wise training of deep networks

Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · see citing works

Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 4,749 · see citing works

Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion

(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051 · see citing works

Large Scale Distributed Deep Networks

Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,189 · see citing works

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294 · see citing works

Adaptive Algorithms and Stochastic Approximations

Benveniste, A., Métivier, M., & Priouret, P. (1990) · Springer eBooks · doi:10.1007/978-3-642-75894-2 · Cited by 2,045 · see citing works

MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems

Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819 · see citing works

Going Deeper with Convolutions

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · see citing works

One weird trick for parallelizing convolutional neural networksPreprint

Krizhevsky, A. (2014) · arXiv.org · doi:10.48550/arxiv.1404.5997 · Cited by 1,435 · see citing works

Machine Learning: An Algorithmic Perspective

Marsland, S. (2009) · Cited by 1,075 · see citing works

Theano: new features and speed improvements

Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005 · see citing works

Large Batch Training of Convolutional NetworksPreprint

You, Y., Gitman, I., & Ginsburg, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03888 · Cited by 992 · see citing works

Rethinking the Inception Architecture for Computer Vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.00567 · Cited by 741 · see citing works

Project Adam: building an efficient and scalable deep learning training system

Chilimbi, T. M., Suzue, Y., Apacible, J., & Kalyanaraman, K. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685094 · Cited by 614 · see citing works

More Effective Distributed ML via a Stale Synchronous Parallel Parameter Server

Ho, Q., Cipar, J., Cui, H., Kim, J. K., Lee, S., Gibbons, P. B., Gibson, G. A., Ganger, G. R., & Xing, E. P. (2013) · PubMed · doi:10.1184/r1/6475898 · Cited by 586 · see citing works

On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures

Bianchini, M., & Scarselli, F. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293637 · Cited by 500 · see citing works

Torch: a modular machine learning software library

Collobert, R., Bengio, S., & Mariéthoz, J. (2002) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 443 · see citing works

Deep Image: Scaling up Image RecognitionPreprint

Wu, R., Yan, S., Shan, Y., Dang, Q., & Sun, G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.02876 · Cited by 345 · see citing works

GeePS: scalable deep learning on distributed GPUs with a GPU-specialized parameter server

Cui, H.-G., Zhang, H., Ganger, G., Gibbons, P. B., & Xing, E. (2016) · European Conference on Computer Systems · doi:10.1145/2901318.2901323 · Cited by 339 · see citing works

An Introduction to Computational Networks and the Computational Network Toolkit

Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 334 · see citing works

Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate DatasetsPreprint

Liu, Y., Racah, E., Prabhat, Correa, J., Khosrowshahi, A., Lavers, D. A., Kunkel, K. E., Wehner, M. F., & Collins, W. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01156 · Cited by 300 · see citing works

Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 MinutesPreprint

Akiba, T., Suzuki, S., & Fukuda, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04325 · Cited by 277 · see citing works

Characterizing the Influence of System Noise on Large-Scale Applications by Simulation

Hoefler, T., Schneider, T., & Lumsdaine, A. (2010) · doi:10.1109/sc.2010.12 · Cited by 223 · see citing works

There goes the neighborhood

Bhatele, A. S., Mohror, K., Langer, S. H., & Isaacs, K. E. (2013) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/2503210.2503247 · Cited by 172 · see citing works

Distributed Deep Learning Using Synchronous Stochastic Gradient DescentPreprint

Das, D., Avancha, S., Mudigere, D., Vaidynathan, K., Sridharan, S., Kalamkar, D. D., Kaul, B., & Dubey, P. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06709 · Cited by 141 · see citing works

S-Caffe

Awan, A. A., Hamidouche, K., Hashmi, J. M., & Panda, D. K. D. (2017) · ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/3018743.3018769 · Cited by 128 · see citing works

SparkNet: Training Deep Networks in SparkPreprint

Moritz, P., Nishihara, R., Stoica, I. G., & Jordan, M. I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06051 · Cited by 126 · see citing works

Petuum

Xing, E. P., Ho, Q., Dai, W., Kim, J.-K., Wei, J., Lee, S., Zheng, X., Xie, P., Kumar, A., & Yu, Y. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783323 · Cited by 117 · see citing works

How to scale distributed deep learning?

Jin, P. H., Yuan, Q., Iandola, F., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1611.04581 · Cited by 85 · see citing works

Gossip training for deep learning

Blot, M., Picard, D., Cord, M., & Thome, N. (2016) · arXiv · doi:10.48550/arxiv.1611.09726 · Cited by 77 · see citing works

Poseidon: A System Architecture for Efficient GPU-based Deep Learning on Multiple MachinesPreprint

Zhang, H., Hu, Z., Wei, J., Xie, P., Kim, G., Ho, Q., & Xing, E. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.06216 · Cited by 39 · see citing works

ImageNet Training in MinutesPreprint

You, Y., Zhang, Z., Hsieh, C., Demmel, J. W., & Keutzer, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05011 · Cited by 38 · see citing works

Distributed TensorFlow with MPIPreprint

Vishnu, A., Siegel, C. M., & Daily, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.02339 · Cited by 34 · see citing works

Asynchronous Stochastic Gradient Descent with Delay Compensation for Distributed Deep Learning.Preprint

Zheng, S., Meng, Q., Wang, T., Chen, W., Yu, N., Ma, Z.-M., & Liu, T. (2016) · arXiv (Cornell University) · Cited by 25 · see citing works

Pipeline-based processing of the deep learning framework caffe

Ayae, I., Takefusa, A., Nakada, H., & Oguchi, M. (2017) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/3022227.3022323 · Cited by 5 · see citing works

Scaling Up Distributed Stochastic Gradient Descent Using Variance Reduction.Preprint

De, S., Taylor, G., & Goldstein, T. (2015) · arXiv (Cornell University) · Cited by 1 · see citing works

Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing

Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · see citing works

A survey on security and privacy of federated learning

Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480 · see citing works

Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence

Deng, S., Zhao, H., Fang, W. J., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,218 · see citing works

Demystifying Parallel and Distributed Deep Learning

Ben‐Nun, T., & Hoefler, T. (2019) · ACM Computing Surveys · doi:10.1145/3320060 · Cited by 747 · see citing works

Communication-efficient edge ai: algorithms and systems

Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488 · see citing works

Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks

Savazzi, S., Nicoli, M., & Rampa, V. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2964162 · Cited by 431 · see citing works

Privacy preservation in federated learning: An insightful survey from the GDPR perspective

Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399 · see citing works

A generic communication scheduler for distributed DNN training acceleration

Peng, Y., Zhu, Y., Chen, Y., Bao, Y., Yi, B., Lan, C., Wu, C., & Guo, C. (2019) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3341301.3359642 · Cited by 327 · see citing works

Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency AnalysisPreprint

Ben‐Nun, T., & Hoefler, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09941 · Cited by 204 · see citing works

Opportunities of Federated Learning in Connected, Cooperative, and Automated Industrial Systems

Savazzi, S., Nicoli, M., Bennis, M., Kianoush, S., & Barbieri, L. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000200 · Cited by 181 · see citing works

GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication

Tang, Z., Shi, S., Li, B., & Chu, X. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3230938 · Cited by 170 · see citing works

Decentralized Federated Learning: A Segmented Gossip ApproachPreprint

Hu, C., Jiang, J., & Wang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07782 · Cited by 184 · see citing works

Priority-based Parameter Propagation for Distributed DNN TrainingPreprint

Jayarajan, A., Wei, J., Gibson, G. A., Fedorova, A., & Pekhimenko, G. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03960 · Cited by 114 · see citing works

Decentralized federated learning for extended sensing in 6G connected vehicles

Barbieri, L., Savazzi, S., Brambilla, M., & Nicoli, M. (2021) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100396 · Cited by 109 · see citing works

A Review of Privacy-Preserving Federated Learning for the Internet-of-Things

Briggs, C., Fan, Z., & Andras, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-70604-3_2 · Cited by 101 · see citing works

Edge Intelligence: Concepts, Architectures, Applications, and Future Directions

Mendez, J., Bierzynski, K., Cuéllar, M. P., & Morales, D. P. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3486674 · Cited by 108 · see citing works

Communication-Efficient Distributed Deep Learning: A Comprehensive SurveyPreprint

Tang, Z.-H., Shi, S.-H., Wang, W., Li, B., & Chu, X. (2020) · arXiv.org · doi:10.48550/arxiv.2003.06307 · Cited by 54 · see citing works

Distributed Learning in the Nonconvex World: From batch data to streaming and beyond

Chang, T., Hong, M., Wai, H.-T., Zhang, X., & Lu, S. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2970170 · Cited by 85 · see citing works

Decentralised federated learning with adaptive partial gradient aggregation

Jiang, J., & Hu, L. (2020) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2020.0082 · Cited by 55 · see citing works

Taming unbalanced training workloads in deep learning with partial collective operations

Li, S., Ben-Nun, T., Girolamo, S. D., Alistarh, D., & Hoefler, T. (2020) · Proceedings of the 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/3332466.3374528 · Cited by 57 · see citing works

BACombo—Bandwidth-Aware Decentralized Federated Learning

Jiang, J., Hu, L., Hu, C., Liu, J., & Wang, Z. (2020) · Electronics · doi:10.3390/electronics9030440 · Cited by 47 · see citing works

BrainyEdge: An AI-enabled framework for IoT edge computing

Le, K.-H., Le-Minh, K.-H., & Thai, H.-T. (2021) · ICT Express · doi:10.1016/j.icte.2021.12.007 · Cited by 48 · see citing works

Deep data plane programming and AI for zero-trust self-driven networking in beyond 5G

Hireche, O., Benzaïd, C., & Taleb, T. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108668 · Cited by 45 · see citing works

FedDual: Pair-Wise Gossip Helps Federated Learning in Large Decentralized Networks

Chen, Q., Wang, Z., Wang, H., & Lin, X. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3222935 · Cited by 41 · see citing works

Accelerating Gossip-Based Deep Learning in Heterogeneous Edge Computing Platforms

Han, R., Li, S., Wang, X., Liu, C. H., Xin, G., & Chen, L. Y. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3046440 · Cited by 37 · see citing works

Privacy-preserving model training architecture for intelligent edge computing

Qu, X., Hu, Q., & Wang, S. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.07.045 · Cited by 36 · see citing works

When machine learning meets Network Management and Orchestration in Edge-based networking paradigms

Shahraki, A., Ohlenforst, T., & Kreyß, F. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103558 · Cited by 34 · see citing works

CE-Fed: Communication efficient multi-party computation enabled federated learning

Kanagavelu, R., Wei, Q., Li, Z., Zhang, H., Samsudin, J., Yang, Y., Goh, R. S. M., & Wang, S. (2022) · Array · doi:10.1016/j.array.2022.100207 · Cited by 31 · see citing works

A Framework of Decentralized Federated Learning With Soft Clustering and 1-Bit Compressed Sensing for Vehicular Networks

Tan, G., Yuan, H., Hu, H., Zhou, S., & Zhang, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3385913 · Cited by 25 · see citing works

A Joint Decentralized Federated Learning and Communications Framework for Industrial Networks

Savazzi, S., Kianoush, S., Rampa, V., & Bennis, M. (2020) · IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD) · doi:10.1109/camad50429.2020.9209305 · Cited by 21 · see citing works

Preemptive Switch Memory Usage to Accelerate Training Jobs with Shared In-Network Aggregation

Wang, H., Qin, Y., Lao, C., Le, Y., Wu, W., & Chen, K. (2023) · IEEE International Conference on Network Protocols (ICNP) · doi:10.1109/icnp59255.2023.10355574 · Cited by 20 · see citing works

Peer-to-peer deep learning with non-IID data

Šajina, R., Tanković, N., & Ipšić, I. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119159 · Cited by 19 · see citing works

Federated Learning with Mutually Cooperating Devices: A Consensus Approach Towards Server-Less Model Optimization

Savazzi, S., Nicoli, M., Rampa, V., & Kianoush, S. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054055 · Cited by 19 · see citing works

Clustered Hierarchical Distributed Federated Learning

Gou, Y., Wang, R., Li, Z., Imran, M. A., & Zhang, L. (2022) · International Conference on Communications · doi:10.1109/icc45855.2022.9838880 · Cited by 16 · see citing works

Game of Threads

Vicarte, J. R. S., Schreiber, B., Paccagnella, R., & Fletcher, C. W. (2020) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3373376.3378462 · Cited by 14 · see citing works

A Review of Privacy Preserving Federated Learning for Private IoT Analytics.Preprint

Briggs, C. C., Fan, Z., & András, P. (2020) · arXiv (Cornell University) · Cited by 15 · see citing works

NetReduce: RDMA-Compatible In-Network Reduction for Distributed DNN Training AccelerationPreprint

Liu, S., Wang, Q., Zhang, J., Lin, Q., Liu, Y., Xu, M., Chueng, R. C. C., & He, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09736 · Cited by 19 · see citing works

i-WSN League: Clustered Distributed Learning in Wireless Sensor Networks

Mertens, J. S., Galluccio, L., & Morabito, G. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3280843 · Cited by 13 · see citing works

Glint: Decentralized Federated Graph Learning with Traffic Throttling and Flow Scheduling

Liu, T., Li, P., & Gu, Y. (2021) · International Workshop on Quality of Service · doi:10.1109/iwqos52092.2021.9521331 · Cited by 13 · see citing works

Accelerating Deep Learning Systems via Critical Set Identification and Model Compression

Han, R., Liu, C. H., Li, S., Wen, S., & Liu, X. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2970917 · Cited by 13 · see citing works

A Decentralized Communication-Efficient Federated Analytics Framework for Connected Vehicles

Zhao, L., Valero, M., Pouriyeh, S., Li, F., Guo, L., & Han, Z. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3380582 · Cited by 12 · see citing works

Communication Scheduling for Gossip SGD in a Wide Area Network

Oguni, H., & Shudo, K. (2021) · IEEE Access · doi:10.1109/access.2021.3083639 · Cited by 12 · see citing works

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group AveragingPreprint

Li, S., Ben‐Nun, T., Nadiradze, G., Girolamo, S. D., Alistarh, D., & Hoefler, T. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000462545 · Cited by 12 · see citing works

p2pGNN: A Decentralized Graph Neural Network for Node Classification in Peer-to-Peer Networks

Krasanakis, E., Papadopoulos, S., & Kompatsiaris, I. Y. (2022) · IEEE Access · doi:10.1109/access.2022.3159688 · Cited by 11 · see citing works

MGM-4-FL: Combining federated learning and model gossiping in WSNs

Mertens, J. S., Galluccio, L., & Morabito, G. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109144 · Cited by 11 · see citing works

Distributed Learning on Mobile Devices: A New Approach to Data Mining in the Internet of Things

Zhang, X., Zhu, X., Bao, W., Yang, L. T., Wang, J., Yan, H., & Chen, H. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030783 · Cited by 11 · see citing works

Performance Evaluation of Decentralized Federated Learning: Impact of Fully and K-Connected Topologies, Heterogeneous Computing Resources, and Communication Bandwidth

Truong, V. V., Quan, P. K., Park, D.-H., & Kim, T. (2025) · IEEE Access · doi:10.1109/access.2025.3542772 · Cited by 8 · see citing works

EventGraD: Event-triggered communication in parallel machine learning

Ghosh, S., Aquino, B., & Gupta, V. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.143 · Cited by 8 · see citing works

Communication-Efficient Semihierarchical Federated Analytics in IoT Networks

Zhao, L., Valero, M., Pouriyeh, S., Li, L., & Sheng, Q. Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3137757 · Cited by 8 · see citing works

Deep Learning at Scale

Viviani, P., Drocco, M., Baccega, D., Colonnelli, I., & Aldinucci, M. (2019) · Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/empdp.2019.8671552 · Cited by 8 · see citing works

DistMind: Efficient Resource Disaggregation for Deep Learning Workloads

Jin, X., Bai, Z., Zhang, Z., Zhu, Y., Zhong, Y., & Liu, X. (2024) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2024.3355010 · Cited by 8 · see citing works

Decentralized Edge Workload Forecasting With Gossip Learning

Tundo, A., Filippini, F., Regonesi, F., Ciavotta, M., & Savi, M. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3570450 · Cited by 7 · see citing works

EventGraD: Event-Triggered Communication in Parallel Stochastic Gradient Descent

Ghosh, S., & Gupta, V. (2020) · doi:10.1109/mlhpcai4s51975.2020.00008 · Cited by 7 · see citing works

Detection of Insider Attacks in Distributed Projected Subgradient Algorithms

Wu, S. X., Li, G., Zhang, S., & Lin, X. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3105554 · Cited by 8 · see citing works

Voting Consensus-Based Decentralized Federated Learning

Gou, Y., Weng, S., Imran, M. A., & Zhang, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3355853 · Cited by 6 · see citing works

Edge Cloud as an Enabler for Distributed AI in Industrial IoT Applications: the Experience of the IoTwins Project.

Bellavista, P., & Mora, A. (2019) · Cited by 6 · see citing works

A Blockchain-Enabled Decentralized Gossip Federated Learning Framework

Janjua, A., Dhalla, S., Gupta, S., & Singh, S. (2023) · International Conference on Networking and Communications (ICNWC) · doi:10.1109/icnwc57852.2023.10127450 · Cited by 6 · see citing works

Rate-Adapted Decentralized Learning Over Wireless Networks

Sato, K., & Sugimura, D. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3074908 · Cited by 6 · see citing works

GCN-Based Topology Design for Decentralized Federated Learning in IoV

Li, Y., Xie, Q., Wang, W., Zhou, X., & Li, K. (2022) · Asia-Pacific Network Operations and Management Symposium (APNOMS) · doi:10.23919/apnoms56106.2022.9919905 · Cited by 6 · see citing works

Secure Distributed/Federated Learning: Prediction-Privacy Trade-Off for Multi-Agent System

Znaidi, M. R., Gupta, G., & Bogdan, P. (2022) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit50566.2022.9834840 · Cited by 5 · see citing works

Lessons Learned on MPI+Threads Communication

Zambre, R., & Chandramowlishwaran, A. M. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00082 · Cited by 5 · see citing works

FLAGS framework for comparative analysis of Federated Learning algorithms

Lodhi, A. H., Akgün, B., & Özkasap, Ö. (2022) · Internet of Things · doi:10.1016/j.iot.2022.100638 · Cited by 5 · see citing works

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging

Li, S., Ben‐Nun, T., Nadiradze, G., Girolamo, S. D., Dryden, N., Alistarh, D., & Hoefler, T. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3040606 · Cited by 4 · see citing works

An asynchronous distributed training algorithm based on Gossip communication and Stochastic Gradient Descent

Tu, J., Zhou, J., & Ren, D. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.010 · Cited by 4 · see citing works

Decentralized trustless gossip training of deep neural networks

Šajina, R., Tanković, N., & Etinger, D. (2020) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro48935.2020.9245248 · Cited by 4 · see citing works

On the Limit Performance of Floating Gossip

Rizzo, G., Palma, N. P., Marsan, M. A., & Mancuso, V. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228865 · Cited by 3 · see citing works

Decentralized Federated Learning Algorithm Under Adversary Eavesdropping

Xu, L., Xu, D., Yi, X., Deng, C., Chai, T., & Yang, T. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.125079 · Cited by 4 · see citing works

IDEC: Intelligent Distributed Edge Computing System Architecture Enabling Deep Learning across Heterogeneous IoT Devices

Qu, W., Ding, X., Yang, K., Bao, Y., & Chen, W. (2020) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc51575.2020.9345083 · Cited by 3 · see citing works

Addressing the Heterogeneity of A Wide Area Network for DNNs

Oguni, H., & Shudo, K. (2021) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc49032.2021.9369585 · Cited by 3 · see citing works

State-of-the-art Techniques in Deep Edge IntelligencePreprint

Lodhi, A. H., Akgün, B., & Özkasap, Ö. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00824 · Cited by 3 · see citing works

Efficient Asynchronous GCN Training on a GPU Cluster

Zhang, Y., & Goswami, D. (2021) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads53394.2021.00086 · Cited by 2 · see citing works

Distributed Deep Learning on Heterogeneous Computing Resources Using Gossip Communication

Georgiev, D., & Gurov, T. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41032-2_25 · Cited by 2 · see citing works

BitTorrent-based Gossip Learning

Carl, O., & Weis, T. (2024) · International Conference on the Internet of Things (IoT) · doi:10.1145/3703790.3703813 · Cited by 1 · see citing works

A Graph Network Model for Distributed Learning with Limited Bandwidth Links and Privacy Constraints

Parras, J., & Zazo, S. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053067 · Cited by 1 · see citing works

Optimising Cost vs Accuracy of Decentralised Analytics in Fog Computing Environments

Valerio, L., Passarella, A., & Conti, M. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3101986 · Cited by 1 · see citing works

Priority-based parameter propagation for distributed deep neural network training

Jayarajan, A. (2019) · cIRcle (University of British Columbia) · doi:10.14288/1.0380523 · Cited by 1 · see citing works

Detection of Insider Attacks in Distributed Projected Subgradient AlgorithmsPreprint

Wu, S. X., Li, G., Zhang, S., & Lin, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06917 · Cited by 1 · see citing works

Community-Structured Decentralized Learning for Resilient EI

Kuttivelil, H. S., & Obraczka, K. (2021) · ResilientFL · doi:10.1145/3477114.3488764

Toward Quality of Information Aware Distributed Machine Learning

Xiao, H., & Wang, S. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3522591

Secure and Efficient Gossip Learning with Adversarial Nodes

Li, G., Wu, H., Li, H., Zhu, Y., Zhang, J., Zhang, Y., & Gao, J. (2022) · IEEE International Conference on Computation, Communication and Engineering (ICCCE) · doi:10.1109/iccce55785.2022.10036238

Crossover‐SGD: A gossip‐based communication in distributed deep learning for alleviating large mini‐batch problem and enhancing scalability

Yeo, S., Bae, M., Jeong, M., Kwon, O., & Oh, S. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.7508 · Cited by 4 · see citing works

Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent

Shen, S., Xu, L., Liu, J., Liang, X., & Cheng, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/637 · Cited by 25 · see citing works

Communication-Efficient Distributed Stochastic Gradient Descent with Pooling OperatorPreprint

Cai, Z., Chen, A., Luo, Y., & Li, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4327869

Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs

Shi, S., Wang, Q., Chu, X., Li, B., Qin, Y., Liu, R., & Zhao, X. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155269 · Cited by 70 · see citing works

Efficient Distributed Stochastic Gradient Descent Through Gaussian Averaging

Hu, K., Wu, C., & Zhu, E. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78609-0_4