On the Linear Convergence of Distributed Optimization over Directed Graphs
Open accessAbstract
This paper develops a fast distributed algorithm, termed \emph{DEXTRA}, to solve the optimization problem when~$n$ agents reach agreement and collaboratively minimize the sum of their local objective functions over the network, where the communication between the agents is described by a~\emph{directed} graph. Existing algorithms solve the problem restricted to directed graphs with convergence rates of $O(\ln k/\sqrt{k})$ for general convex objective functions and $O(\ln k/k)$ when the objective functions are strongly-convex, where~$k$ is the number of iterations. We show that, with the appropriate step-size, DEXTRA converges at a linear rate $O(τ^{k})$ for $0
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This step-size selection requirement compares favorably to existing literature [70,76], which require detailed spectral information about the network for step-size selection.
“This compares favorably to some of the existing literature, e.g., [70,76], which require detailed spectral information about the network for step-size selection.”
From Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs (2017) · cites this paper as [70]
DEXTRA converges at an R-linear rate for a time-invariant strongly connected directed graph under strong convexity, but the step-size must be carefully chosen in some interval, and the feasible set of step-sizes can even be empty.
“It turns out that for a time-invariant strongly connected directed graph, DEXTRA converges at an R-linear rate under strong convexity assumption but the step-size has to be carefully chosen in some interval. However, the feasible set of step-sizes for DEXTRA can even be empty in some situations [70].”
From Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs (2017) · cites this paper as [70]
Cites
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,863 · see citing works
Consensus Problems in Networks of Agents With Switching Topology and Time-Delays
Olfati-Saber, R., & Murray, R. M. (2004) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2004.834113 · Cited by 12,788 · cited 1× · see citing works
“1See [24–27], for additional information on average-consensus problems.”
BackgroundCoordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339 · see citing works
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719 · see citing works
(1991) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(91)90038-5 · Cited by 2,474 · see citing works
Constrained Consensus and Optimization in Multi-Agent Networks
Nedić, A., Ozdaglar, A., & Parrilo, P. A. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2041686 · Cited by 2,052 · see citing works
Gossip-based computation of aggregate information
Kempe, D., Dobra, A., & Gehrke, J. (2004) · 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings. · doi:10.1109/sfcs.2003.1238221 · Cited by 1,480 · see citing works
EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization
Shi, W., Ling, Q., Wu, G., & Yin, W. (2015) · SIAM Journal on Optimization · doi:10.1137/14096668x · Cited by 1,261 · see citing works
Distributed Optimization Over Time-Varying Directed Graphs
Nedic, A., & Olshevsky, A. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2364096 · Cited by 1,187 · see citing works
Distributed average consensus with least-mean-square deviation
Xiao, L., Boyd, S., & Kim, S.-J. (2006) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2006.08.010 · Cited by 1,091 · see citing works
Distributed optimization in sensor networks
Rabbat, M., & Nowak, R. (2004) · Proceedings of the 3rd international symposium on Information processing in sensor networks · doi:10.1145/984622.984626 · Cited by 901 · see citing works
Consensus protocols for networks of dynamic agents
Saber, R. O., & Murray, R. M. (2004) · Proceedings of the 2003 American Control Conference, 2003. · doi:10.1109/acc.2003.1239709 · Cited by 901 · see citing works
Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
Duchi, J. C., Agarwal, A., & Wainwright, M. J. (2010) · Cited by 884 · see citing works
On the Linear Convergence of the ADMM in Decentralized Consensus Optimization
Shi, W., Ling, Q., Yuan, K., Wu, G., & Yin, W. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2304432 · Cited by 820 · see citing works
On the Convergence of Decentralized Gradient Descent
Yuan, K., Ling, Q. H., & Yin, W. (2016) · SIAM Journal on Optimization · doi:10.1137/130943170 · Cited by 630 · see citing works
Fast Distributed Gradient Methods
Jakovetic, D., Xavier, J., & Moura, J. M. F. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2298712 · Cited by 624 · see citing works
Distributed Sparse Linear Regression
Mateos, G., Bazerque, J. A., & Giannakis, G. B. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2055862 · Cited by 535 · see citing works
Laplacians and the Cheeger Inequality for Directed Graphs
Chung, F. (2005) · Annals of Combinatorics · doi:10.1007/s00026-005-0237-z · Cited by 535 · see citing works
Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity
Bazerque, J. A., & Giannakis, G. B. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2038417 · Cited by 512 · see citing works
Distributed Alternating Direction Method of Multipliers
Wei, E., & Ozdaglar, A. (2012) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6425904 · Cited by 391 · see citing works
D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization
Mota, J. F. C., Xavier, J., Aguiar, P. M. Q., & Püschel, M. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2254478 · Cited by 366 · see citing works
Subgradient methods and consensus algorithms for solving convex optimization problems
Johansson, B., Keviczky, T., Johansson, M., & Johansson, K. H. (2008) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2008.4739339 · Cited by 318 · see citing works
Cevher, V., Becker, S., & Schmidt, M. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2329397 · Cited by 304 · see citing works
Push-Sum Distributed Dual Averaging for convex optimization
Tsianos, K. I., Lawlor, S., & Rabbat, M. G. (2012) · 2012 IEEE 51st IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426375 · Cited by 304 · see citing works
Average consensus on general strongly connected digraphs
Cai, K., & Ishii, H. (2012) · Automatica · doi:10.1016/j.automatica.2012.08.003 · Cited by 258 · see citing works
Tsianos, K. I., Lawlor, S., & Rabbat, M. (2012) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2012.6483403 · Cited by 229 · see citing works
Weighted Gossip: Distributed Averaging using non-doubly stochastic matrices
Benezit, F., Blondel, V., Thiran, P., Tsitsiklis, J., & Vetterli, M. (2010) · 2010 IEEE International Symposium on Information Theory · doi:10.1109/isit.2010.5513273 · Cited by 224 · see citing works
Distributed Subgradient Projection Algorithm Over Directed Graphs
Xi, C., & Khan, U. A. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2615066 · Cited by 178 · see citing works
Self-citationDILAND: An Algorithm for Distributed Sensor Localization With Noisy Distance Measurements
Khan, U. A., Kar, S., & Moura, J. M. F. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2038423 · Cited by 175 · see citing works
Self-citationDistributed multi-agent optimization with state-dependent communication
Lobel, I., Ozdaglar, A., & Feijer, D. (2011) · Mathematical Programming · doi:10.1007/s10107-011-0467-x · Cited by 162 · see citing works
Application of a Smoothing Technique to Decomposition in Convex Optimization
Necoara, I., & Suykens, J. A. K. (2008) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2007159 · Cited by 161 · see citing works
On the distributed optimization over directed networks
Xi, C., Wu, Q., & Khan, U. A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.06.038 · Cited by 75 · see citing works
Self-citationExtraPush for Convex Smooth Decentralized Optimization over Directed Networks
Zeng, J., & Yin, W. (2017) · Journal of Computational Mathematics · doi:10.4208/jcm.1606-m2015-0452 · Cited by 68 · see citing works
ExtraPush for convex smooth decentralized optimization over directed networks
Zeng, J., & Yin, W. (2015) · arXiv · doi:10.48550/arxiv.1511.02942 · Cited by 65
Graph balancing for distributed subgradient methods over directed graphs
Makhdoumi, A., & Ozdaglar, A. (2015) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2015.7402401 · Cited by 57 · see citing works
Li, C., & Layuan, L. (2006) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2006.01.003 · Cited by 40 · see citing works
Decentralized linearized alternating direction method of multipliers
Ling, Q. H., & Ribeiro, A. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854644 · Cited by 37 · see citing works
Distributed gradient optimization for epidemic routing: A preliminary evaluation
Neglia, G., Reina, G., & Alouf, S. (2009) · IFIP Wireless Days · doi:10.1109/wd.2009.5449659 · Cited by 27 · see citing works
Directed-Distributed Gradient Descent
Xi, C., & Khan, U. A. (2015) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2015.7447120 · Cited by 20 · see citing works
Self-citationDistributed optimization of strongly convex functions on directed time-varying graphs
Nedić, A., & Olshevsky, A. (2013) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6736882 · Cited by 12 · see citing works
Distributed Gradient Descent over Directed GraphsPreprint
Xi, C., Wu, Q., & Khan, U. A. (2015) · arXiv (Cornell University) · Cited by 10 · see citing works
Self-citationNetwork NewtonPreprint
Mokhtari, A., Ling, Q. H., & Ribeiro, A. (2014) · arXiv (Cornell University) · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs
Nedić, A., Olshevsky, A., & Shi, W. (2017) · SIAM Journal on Optimization · doi:10.1137/16m1084316 · Cited by 1,073 · see citing works
Accelerated Distributed Nesterov Gradient Descent
Qu, G., & Li, N. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2937496 · Cited by 245 · see citing works
Li, Z., Shi, W., & Yan, M. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2926022 · Cited by 242 · see citing works
Convergence of Asynchronous Distributed Gradient Methods Over Stochastic Networks
Xu, J., Zhu, S., Soh, Y. C., & Xie, L. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2730481 · Cited by 212 · see citing works
Exact Diffusion for Distributed Optimization and Learning—Part I: Algorithm Development
Yuan, K., Ying, B., Zhao, X., & Sayed, A. H. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2875898 · Cited by 199 · see citing works
Distributed Subgradient Projection Algorithm Over Directed Graphs
Xi, C., & Khan, U. A. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2615066 · Cited by 178 · see citing works
Self-citationDEXTRA: A Fast Algorithm for Optimization Over Directed Graphs
Xi, C., & Khan, U. A. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2672698 · Cited by 203 · see citing works
Self-citationDistributed nonconvex constrained optimization over time-varying digraphs
Scutari, G., & Sun, Y. (2019) · Mathematical Programming · doi:10.1007/s10107-018-01357-w · Cited by 153 · see citing works
Geometrically convergent distributed optimization with uncoordinated step-sizes
Nedic, A., Olshevsky, A., Shi, W., & Uribe, C. A. (2017) · 2017 American Control Conference (ACC) · doi:10.23919/acc.2017.7963560 · Cited by 145 · see citing works
A Push-Pull Gradient Method for Distributed Optimization in Networks
Pu, S., Shi, W., Xu, J., & Nedić, A. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619047 · Cited by 95 · see citing works
ExtraPush for Convex Smooth Decentralized Optimization over Directed Networks
Zeng, J., & Yin, W. (2017) · Journal of Computational Mathematics · doi:10.4208/jcm.1606-m2015-0452 · Cited by 68 · see citing works
ExtraPush for convex smooth decentralized optimization over directed networks
Zeng, J., & Yin, W. (2015) · arXiv · doi:10.48550/arxiv.1511.02942 · Cited by 65
Group-Based Alternating Direction Method of Multipliers for Distributed Linear Classification
Wang, H., Gao, Y., Shi, Y., & Wang, R. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2570808 · Cited by 46 · see citing works
Private Optimization on Networks
Gade, S., & Vaidya, N. H. (2018) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2018.8430960 · Cited by 36 · see citing works
Privacy-Preserving Distributed Learning via Obfuscated Stochastic Gradients
Gade, S., & Vaidya, N. H. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619133 · Cited by 34 · see citing works
Gradient-Consensus Method for Distributed Optimization in Directed Multi-Agent Networks
Khatana, V., Saraswat, G., Patel, S., & Salapaka, M. V. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9147544 · Cited by 27 · see citing works
Accelerated Distributed Nesterov Gradient Descent for smooth and strongly convex functions
Qu, G., & Li, N. (2016) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2016.7852231 · Cited by 26 · see citing works
Distributed dynamic optimization over directed graphs
Xi, C., & Khan, U. A. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798277 · Cited by 21 · see citing works
Self-citationA geometrically convergent method for distributed optimization over time-varying graphs
Nedić, A., Olshevsky, A., & Shi, W. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798402 · Cited by 21 · see citing works
Distributed support vector machine in master–slave mode
Chen, Q., & Cao, F. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.02.006 · Cited by 20 · see citing works
Accelerated distributed Nesterov Gradient Descent for convex and smooth functions
Qu, G., & Li, N. (2017) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2017.8263979 · Cited by 16 · see citing works
A fast proximal gradient algorithm for decentralized composite optimization over directed networks
Zeng, J., He, T., & Wang, M. (2017) · Systems & Control Letters · doi:10.1016/j.sysconle.2017.07.005 · Cited by 16 · see citing works
Wang, D., Chen, Y., Gupta, V., & Lian, J. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.03.035 · Cited by 15 · see citing works
Private Learning on Networks: Part IIPreprint
Gade, S., & Vaidya, N. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09185 · Cited by 11 · see citing works
Fast distributed optimization over directed graphs
Xi, C., Wu, Q., & Khany, U. A. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7526694 · Cited by 9 · see citing works
Self-citationDistributed optimization for multi-agent system over unbalanced graphs with linear convergence rate
Cheng, S., & Liang, S. (2020) · Kybernetika · doi:10.14736/kyb-2020-3-0559 · Cited by 8 · see citing works
Asymmetrically Decentralized Federated Learning
Li, Q., Zhang, M., Yin, N., Yin, Q., Shen, L., & Cao, X. (2025) · IEEE Transactions on Computers · doi:10.1109/tc.2025.3569185 · Cited by 4 · see citing works
Linearly convergent decentralized consensus optimization over directed networks
Nedić, A., Olshevsky, A., & Shi, W. (2016) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2016.7905889 · Cited by 2 · see citing works
On linear convergence of two decentralized algorithmsPreprint
Li, Y., & Yan, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07225 · Cited by 1 · see citing works
Optimization over directed graphs: Linear convergence rate
Xi, C., & Khan, U. A. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952958
Self-citationDistributed convex optimization with a row-stochastic matrix over directed graphs
Zhang, Y., Lü, Q., Li, H., & Zhang, H. (2017) · International Workshop on Complex Systems and Networks (IWCSN) · doi:10.1109/iwcsn.2017.8276535
A Proximal Gradient Algorithm for Composite Consensus Optimization over Directed Graphs
Zeng, J., He, T., Ouyang, S., Wang, M., & Chang, X. (2017) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber.2017.8446454
- Authors
- Xi, C., & Khan, U. A.
- Affiliations
- Tufts University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1510.02149
- OpenAlex
- W2205030769
- Cited by
- 29
- References
- 41
- Citations by year
- 2025: 1 · 2020: 3 · 2019: 4 · 2018: 5 · 2017: 9 · 2016: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Control Multi-Agent Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Keywords
- distributed optimization, directed graphs, linear convergence, consensus, multi-agent systems, convex optimization, strongly convex functions, step size selection, convergence rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review