On the Linear Convergence of the ADMM in Decentralized Consensus Optimization
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the neighbors. To this end, one can first obtain a problem reformulation and then apply the alternating direction method of multipliers (ADMM). The method applies iterative computation at the individual agents and information exchange between the neighbors. This approach has been observed to converge quickly and deemed powerful. This paper establishes its linear convergence rate for the decentralized consensus optimization problem with strongly convex local objective functions. The theoretical convergence rate is explicitly given in terms of the network topology, the properties of local objective functions, and the algorithm parameter. This result is not only a performance guarantee but also a guideline toward accelerating the ADMM convergence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The augmented Lagrangian based primal-dual methods have linear convergence under strong convexity and Lipschitz gradient assumptions [4,30] or under the positive-definite bounded Hessian assumption [12,13].”
From EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization (2015) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Under the strong convexity assumption, the decentralized ADMM has been shown to have linear convergence for time-invariant undirected graphs [63].”
From Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs (2017) · cites this paper as [63]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chung, F. (1996) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/092 · Cited by 5,524
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
Algebraic connectivity of graphs
Fiedler, M. (1973) · Czechoslovak Mathematical Journal · doi:10.21136/cmj.1973.101168 · Cited by 3,977
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719 · cited 3×
“they do not rely on any predefined structures. Subgradient descent and dual ave raging work well for asynchronous networks but suffer from slow convergence. Indeed, for subgradient descent algorithms [15] and [16] establish the convergence rate of O(1/k), where k is the number of iterations, to a neighborhood of the op…”
BackgroundMethodInfluentialInformation consensus in multivehicle cooperative control
(2007) · IEEE Control Systems · doi:10.1109/mcs.2007.338264 · Cited by 3,156
Distributed average consensus with least-mean-square deviation
Xiao, L., Boyd, S., & Kim, S.-J. (2007) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2006.08.010 · Cited by 1,107
Optimal decentralized protocol for electric vehicle charging
Gan, L., Topcu, U., & Low, S. H. (2013) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2210288 · Cited by 997
Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
Duchi, J. C., Agarwal, A., & Wainwright, M. J. (2012) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2011.2161027 · Cited by 947
Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
Duchi, J. C., Agarwal, A., & Wainwright, M. J. (2010) · Cited by 884
On the $O(1/n)$ Convergence Rate of the Douglas–Rachford Alternating Direction Method
He, B., & Yuan, X. (2012) · SIAM Journal on Numerical Analysis · doi:10.1137/110836936 · Cited by 881
Cited by
Items 101–200 of 952
A simple effective heuristic for embedded mixed-integer quadratic programming
Takapoui, R., Moehle, N., Boyd, S., & Bemporad, A. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7526551 · Cited by 83
Wang, Z., & Ong, C. J. (2017) · Automatica · doi:10.1016/j.automatica.2017.03.027 · Cited by 83
ExtraPush for Convex Smooth Decentralized Optimization over Directed Networks
Zeng, J., & Yin, W. (2017) · Journal of Computational Mathematics · doi:10.4208/jcm.1606-m2015-0452 · Cited by 82
Self-citationAccelerating ADMM for efficient simulation and optimization
Zhang, J., Peng, Y., Ouyang, W., & Deng, B. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356491 · Cited by 81
Doan, T. T., Maguluri, S. T., & Romberg, J. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3031018 · Cited by 81
A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization Over Directed Networks
Lü, Q., Liao, X., Li, H., & Huang, T. (2020) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2019.2960770 · Cited by 79
Sl-edge: network slicing at the edge
D’Oro, S., Bonati, L., Restuccia, F., Polese, M., Zorzi, M., & Melodia, T. (2020) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3397166.3409133 · Cited by 79
Chang, T., Liao, W.-C., Hong, M., & Wang, X. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2537261 · Cited by 78
Distributed stochastic variance reduced gradient methods by sampling extra data with replacement
Lee, J. D., Lin, Q., Ma, T., & Yang, T. (2017) · Journal of Machine Learning Research · Cited by 78
Variance-Reduced Stochastic Learning by Networked Agents Under Random Reshuffling
Yuan, K., Ying, B., Liu, J., & Sayed, A. H. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2872003 · Cited by 67
Self-citationA Linearly Convergent Proximal Gradient Algorithm for Decentralized OptimizationPreprint
Alghunaim, S. A., Yuan, K., & Sayed, A. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07996 · Cited by 76
Self-citationA Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!Preprint
Kovalev, D. A., Koloskova, A., Jaggi, M., Richtárik, P., & Stich, S. U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01697 · Cited by 75
A Decentralized Parallel Algorithm for Training Generative Adversarial NetsPreprint
Liu, M., Zhang, W., Mroueh, Y., Cui, X., Ross, J., Yang, T., & Das, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12999 · Cited by 75
Robust and communication-efficient collaborative learning
Reisizadeh, A., Taheri, H., Mokhtari, A., Hassani, H., & Pedarsani, R. (2019) · arXiv · doi:10.48550/arxiv.1907.10595 · Cited by 73
“The most popular first-order choices for the convex setting are distributed gradient descent-type methods (Nedic and Ozdaglar, 2009; Jakovetic et al., 2014; Yuan et al., 2016; Qu and Li, 2017), augmented Lagrangian algorithms (Shi et al., 2015a,b; Mokhtari and Ribeiro, 2016), distributed variants of the alternating dir…”
MethodDecomposition of Nonconvex Optimization via Bi-Level Distributed ALADIN
Engelmann, A., Jiang, Y., Houska, B., & Faulwasser, T. (2020) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2020.3005079 · Cited by 73
Linear convergence of primal–dual gradient methods and their performance in distributed optimization
Alghunaim, S. A., & Sayed, A. H. (2020) · Automatica · doi:10.1016/j.automatica.2020.109003 · Cited by 72
Privacy-Preserving Decentralized Aggregation for Federated Learning
Jeon, B., Ferdous, S. M., Rahman, M. R., & Walid, A. (2021) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps51825.2021.9484437 · Cited by 72
Wang, X., Hong, Y., Yi, P., Ji, H., & Kang, Y. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2703945 · Cited by 71
A Survey of Distributed Optimization Methods for Multi-Robot SystemsPreprint
Halsted, T., Shorinwa, O., Yu, J., & Schwager, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12840 · Cited by 71
Advancements in Federated Learning: Models, Methods, and Privacy
Chen, H., Wang, H., Long, Q., Jin, D., & Li, Y. (2025) · ACM Computing Surveys · doi:10.1145/3664650 · Cited by 44
Shi, C., & Yang, G. (2018) · Automatica · doi:10.1016/j.automatica.2018.04.010 · Cited by 70
Newton-like Method with Diagonal Correction for Distributed Optimization
Bajović, D., Jakovetić, D., Krejić, N., & Jerinkić, N. K. (2017) · SIAM Journal on Optimization · doi:10.1137/15m1038049 · Cited by 69
Zhang, J., Nabavi, S., Chakrabortty, A., & Xin, Y. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2547939 · Cited by 68
Distributed Algorithms for Robust Convex Optimization via the Scenario Approach
You, K., Tempo, R., & Xie, P. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2828093 · Cited by 68
Privacy-Preserving Distributed Optimization via Subspace Perturbation: A General Framework
Li, Q., Heusdens, R. R., & Christensen, M. G. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3029887 · Cited by 68
Differentially Private Federated Stochastic Primal-Dual Learning for Internet of Vehicles
Li, Y., Wang, S., & Chang, T. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3534982 · Cited by 68
Decentralized Contingency-Constrained Tie-Line Scheduling for Multi-Area Power Grids
Li, Z., Wu, W., Zeng, B., Shahidehpour, M., & Zhang, B. (2016) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2016.2539278 · Cited by 67
Analysis and Design of First-Order Distributed Optimization Algorithms Over Time-Varying Graphs
Sundararajan, A., Scoy, B. V., & Lessard, L. (2020) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2020.2988009 · Cited by 67
Primal–Dual Methods for Large-Scale and Distributed Convex Optimization and Data Analytics
Jakovetić, D., Bajović, D., Xavier, J., & Moura, J. M. F. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3007395 · Cited by 67
ExtraPush for convex smooth decentralized optimization over directed networks
Zeng, J., & Yin, W. (2015) · arXiv · doi:10.48550/arxiv.1511.02942 · Cited by 65
Self-citationPrivacy-Preserving Distributed Machine Learning via Local Randomization and ADMM Perturbation
Wang, X., Ishii, H., Du, L., Cheng, P., & Chen, J. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3009007 · Cited by 65
ADMM for multiaffine constrained optimization
Gao, W., Goldfarb, D., & Curtis, F. E. (2019) · Optimization methods & software · doi:10.1080/10556788.2019.1683553 · Cited by 64
A Comprehensive Survey on Training Acceleration for Large Machine Learning Models in IoT
Wang, H., Qu, Z., Zhou, Q., Zhang, H., Luo, B., Xu, W., Guo, S., & Li, R. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111624 · Cited by 65
Distributed Coupled Multiagent Stochastic Optimization
Alghunaim, S. A., & Sayed, A. H. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2906495 · Cited by 63
A Bregman Splitting Scheme for Distributed Optimization Over Networks
Xu, J., Zhu, S., Soh, Y. C., & Xie, L. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2805260 · Cited by 62
Accelerated $AB$/Push–Pull Methods for Distributed Optimization Over Time-Varying Directed Networks
Nguyen, D. T. A., Nguyen, D. T., & Nedić, A. (2023) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2023.3338236 · Cited by 63
Distributed Learning for Wireless Communications: Methods, Applications and Challenges
Qian, L., Yang, P., Xiao, M., Dobre, O. A., Renzo, M. D., Li, J., Han, Z., Qin, Y., & Zhao, J. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3156756 · Cited by 60
Quantized consensus ADMM for multi-agent distributed optimization
Zhu, S., Hong, M., & Chen, B. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472455 · Cited by 60
Cao, X., Zhang, J., & Poor, H. V. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2827302 · Cited by 58
Proximal ADMM for nonconvex and nonsmooth optimization
Yang, Y., Jia, Q., Xu, Z., Guan, X., & Spanos, C. J. (2022) · Automatica · doi:10.1016/j.automatica.2022.110551 · Cited by 57
DiNNO: Distributed Neural Network Optimization for Multi-Robot Collaborative Learning
Yu, J., Vincent, J. A., & Schwager, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3142402 · Cited by 58
Li, W., Zeng, X., Liang, S., & Hong, Y. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3075666 · Cited by 56
Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems
Wang, Z., Zhang, J., Chang, T., Li, J., & Luo, Z.-Q. T. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3097211 · Cited by 55
Xu, Y., Ye, S., Qin, Z., Lin, X., Huangfu, J., & Zhou, W. (2023) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2022.102996 · Cited by 54
Derivation and Analysis of the Primal-Dual Method of Multipliers Based on Monotone Operator Theory
Sherson, T., Heusdens, R. R., & Kleijn, W. B. (2018) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2018.2876754 · Cited by 54
Shen, Z., Mokhtari, A., Zhou, T., Zhao, P., & Qian, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09969 · Cited by 54
Lin, W., Jin, X., Jia, H., Mu, Y., Xu, T., Xu, X., & Yu, X. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117448 · Cited by 53
Wang, Y., & Başar, T. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3212006 · Cited by 53
Yu, W., Liu, H., Zheng, W. X., & Zhu, Y. (2021) · Automatica · doi:10.1016/j.automatica.2021.109899 · Cited by 53
Weighted ADMM for Fast Decentralized Network Optimization
Ling, Q. H., Liu, Y., Shi, W., & Tian, Z. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2602803 · Cited by 52
Self-citationA Primal-Dual Quasi-Newton Method for Exact Consensus Optimization
Eisen, M., Mokhtari, A., & Ribeiro, A. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2951216 · Cited by 52
Decentralized Consensus Algorithm with Delayed and Stochastic Gradients
Sirb, B., & Ye, X. (2018) · SIAM Journal on Optimization · doi:10.1137/16m1081257 · Cited by 52
Multi-consensus Decentralized Accelerated Gradient DescentPreprint
Ye, H., Luo, L., Zhou, Z., & Zhang, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00797 · Cited by 52
Supervised Learning Under Distributed Features
Ying, B., Yuan, K., & Sayed, A. H. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2881661 · Cited by 50
“Other useful approaches to solving problems of the form (3) are the Alternating Direction Method of Multipliers (ADMM) [22], [34], [35] and primal dual-methods [18], [25], [36], [37].”
MethodSelf-citationDistributed Optimal Power Flow for VSC-MTDC Meshed AC/DC Grids Using ALADIN
Zhai, J., Dai, X., Jiang, Y., Xue, Y., Hagenmeyer, V., Jones, C. N., & Zhang, X. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3155866 · Cited by 50
Kamath, G., Agnihotri, P., Valero, M., Sarker, K., & Song, W.-Z. (2016) · 2016 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2016.7842181 · Cited by 42
Edge-Based Stochastic Gradient Algorithm for Distributed Optimization
Wang, Z., & Li, H. (2019) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2019.2933177 · Cited by 49
Wang, Y., Zhao, W., Hong, Y., & Zamani, M. (2019) · SIAM Journal on Control and Optimization · doi:10.1137/18m119046x · Cited by 49
A two-level distributed algorithm for nonconvex constrained optimization
Sun, K., & Sun, X. A. (2022) · Computational Optimization and Applications · doi:10.1007/s10589-022-00433-4 · Cited by 49
Analysis of Distributed ADMM Algorithm for Consensus Optimization in Presence of Node Error
Majzoobi, L., Lahouti, F., & Shah‐Mansouri, V. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2896266 · Cited by 48
Teixeira, A. M. H., Ghadimi, E., Shames, I., Sandberg, H., & Johansson, M. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2480041 · Cited by 47
Liu, Y., Guo, L., Lu, C., Chai, Y., Gao, S., & Xu, B. (2019) · IEEE Access · doi:10.1109/access.2019.2912004 · Cited by 47
Networked Signal and Information Processing: Learning by multiagent systems
Vlaski, S., Kar, S., Sayed, A. H., & Moura, J. M. F. (2023) · IEEE Signal Processing Magazine · doi:10.1109/msp.2023.3267896 · Cited by 47
Quantized Consensus by the ADMM: Probabilistic Versus Deterministic Quantizers
Zhu, S., & Chen, B. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2504341 · Cited by 47
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over NetworksPreprint
Xu, J., Tian, Y., Sun, Y., & Scutari, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10666 · Cited by 47
Private Optimization on Networks
Gade, S., & Vaidya, N. H. (2018) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2018.8430960 · Cited by 46
Privacy-Preserving Distributed Learning via Obfuscated Stochastic Gradients
Gade, S., & Vaidya, N. H. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619133 · Cited by 46
Casella, V., Valderrama, D. F., Ferro, G., Minciardi, R., Paolucci, M., Parodi, L., & Robba, M. (2022) · Energies · doi:10.3390/en15114020 · Cited by 46
A Fast Row-Stochastic Decentralized Method for Distributed Optimization Over Directed Graphs
Ghaderyan, D., Aybat, N. S., Aguiar, A. P., & Перейра, Ф. Л. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3275927 · Cited by 45
Liu, C., Li, H., & Shi, Y. (2020) · Automatica · doi:10.1016/j.automatica.2020.108834 · Cited by 45
A Proximal Atomic Coordination Algorithm for Distributed Optimization
Romvary, J. J., Ferro, G., Haider, R., & Annaswamy, A. M. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3053907 · Cited by 45
DC-DistADMM: ADMM Algorithm for Constrained Optimization Over Directed Graphs
Khatana, V., & Salapaka, M. V. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3221856 · Cited by 44
Confederated Learning: Federated Learning With Decentralized Edge Servers
Wang, B., Fang, J., Li, H., Yuan, X., & Ling, Q. H. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3241768 · Cited by 45
Self-citationDecentralized bilevel optimization
Chen, X., Huang, M., & Ma, S. (2024) · Optimization Letters · doi:10.1007/s11590-024-02101-4 · Cited by 43
AB /Push-Pull method for distributed optimization in time-varying directed networks
Nedić, A., Nguyen, D. T. A., & Nguyen, D. T. (2023) · Optimization methods & software · doi:10.1080/10556788.2023.2261602 · Cited by 42
Communication-Efficient Topologies for Decentralized Learning with O(1) Consensus Rate
Song, Z., Li, W., Jin, K., Shi, L., Yan, M., Yin, W., & Yuan, K. (2022) · neural information processing systems · doi:10.52202/068431-0079 · Cited by 42
Self-citationDistributed online semi-supervised support vector machine
Liu, Y., Xu, Z., & Li, C. (2018) · Information Sciences · doi:10.1016/j.ins.2018.07.045 · Cited by 42
Distributed Nash Equilibrium Seeking via the Alternating Direction Method of Multipliers
Salehisadaghiani, F., & Pavel, L. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.983 · Cited by 41
Privacy-Preserved Distributed Learning With Zeroth-Order Optimization
Gratton, C., Venkategowda, N. K. D., Arablouei, R., & Werner, S. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3139267 · Cited by 41
Decentralized nonconvex optimization with guaranteed privacy and accuracy
Wang, Y., & Başar, T. (2023) · Automatica · doi:10.1016/j.automatica.2023.110858 · Cited by 40
Decentralized linearized alternating direction method of multipliers
Ling, Q. H., & Ribeiro, A. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854644 · Cited by 40
Self-citationConsensus optimization with delayed and stochastic gradients on decentralized networks
Sirb, B., & Ye, X. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840591 · Cited by 40
Robust Decentralized Learning Using ADMM With Unreliable Agents
Li, Q., Kailkhura, B., Goldhahn, R., Ray, P., & Varshney, P. K. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3178655 · Cited by 40
Doan, T. T., Beck, C. L., & Srikant, R. (2017) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3154496 · Cited by 40
Dai, W., Jiang, X., Bonomi, L., Li, Y., Xiong, H., & Ohno-Machado, L. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2989301 · Cited by 39
Zhang, X., Liu, J., & Zhu, Z. (2022) · Journal of the American Statistical Association · doi:10.1080/01621459.2022.2126363 · Cited by 39
Decentralized Joint-Sparse Signal Recovery: A Sparse Bayesian Learning Approach
Khanna, S., & Murthy, C. R. (2016) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2016.2612120 · Cited by 39
Distributed model predictive control for continuous‐time nonlinear systems based on suboptimal ADMM
Bestler, A., & Graichen, K. (2018) · Optimal Control Applications and Methods · doi:10.1002/oca.2459 · Cited by 39
Distributed Channel Allocation and Rate Control for Hybrid FSO/RF Vehicular Ad Hoc Networks
Zhou, K., Gong, C., Wu, N., & Xu, Z. (2017) · Journal of Optical Communications and Networking · doi:10.1364/jocn.9.000669 · Cited by 39
Distributed Solution of Large-Scale Linear Systems Via Accelerated Projection-Based Consensus
Azizan, N., Lahouti, F., Avestimehr, S., & Hassibi, B. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2917855 · Cited by 39
Differentially Private ADMM for Regularized Consensus Optimization
Cao, X., Zhang, J., Poor, H. V., & Tian, Z. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3022856 · Cited by 38
Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints
Su, Y., Wang, Q., & Sun, C. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3123888 · Cited by 38
Differentially Private and Communication Efficient Collaborative Learning
Ding, J., Liang, G., Bi, J., & Pan, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16887 · Cited by 37
Revisiting Optimal Convergence Rate for Smooth and Non-Convex Stochastic Decentralized Optimization
Yuan, K., Huang, X., Chen, Y., Zhang, X., Zhang, X., & Pan, P. (2022) · neural information processing systems · doi:10.52202/068431-2636 · Cited by 37
Self-citationRemoving Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGDPreprint
Yuan, K., Alghunaim, S. A., & Huang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08023 · Cited by 37
Self-citationExpander graph and communication-efficient decentralized optimization
Chow, Y. T., Shi, W., Wu, T., & Yin, W. (2016) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2016.7869675 · Cited by 36
Self-citationCan Primal Methods Outperform Primal-Dual Methods in Decentralized Dynamic Optimization?
Yuan, K., Xu, W., & Ling, Q. H. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3011640 · Cited by 36
Self-citationECG Signal Denoising and Reconstruction Based on Basis Pursuit
Liu, R., Shu, M., & Chen, C. (2021) · Applied Sciences · doi:10.3390/app11041591 · Cited by 36
An Asynchronous, Decentralized Solution Framework for the Large Scale Unit Commitment Problem
Ramanan, P., Yildirim, M., Chow, E., & Gebraeel, N. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2909664 · Cited by 35
Distributed constraint-coupled optimization via primal decomposition over random time-varying graphs
Camisa, A., Farina, F., Notarnicola, I., & Notarstefano, G. (2021) · Automatica · doi:10.1016/j.automatica.2021.109739 · Cited by 35
Metadata
- Authors
- Shi, W., Ling, Q., Yuan, K., Wu, G., & Yin, W.
- Affiliations
- University of Science and Technology of China (CN)
- University of California, Los Angeles (US)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2014-04
- Volume
- 62
- Issue
- 7
- Pages
- 1750-1761
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2123705108
- Cited by
- 820
- References
- 34
- Citations by year
- 2026: 36 · 2025: 55 · 2024: 48 · 2023: 81 · 2022: 66 · 2021: 83 · 2020: 98 · 2019: 97 · 2018: 90 · 2017: 61 · 2016: 54 · 2015: 33 · 2014: 15
- FWCI
- 62.48
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- alternating direction method of multipliers, linear convergence, network topology, distributed optimization, convergence acceleration, multi-agent systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.