Distributed nonconvex multiagent optimization over time-varying networks
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework for the (constrained) minimization of the sum of a smooth (possibly nonconvex and nonseparable) function, i.e., the agents' sum-utility, plus a convex (possibly nonsmooth and nonseparable) regularizer. The latter is usually employed to enforce some structure in the solution, typically sparsity. The proposed method hinges on Successive Convex Approximation (SCA) techniques coupled with i) a tracking mechanism instrumental to locally estimate the gradients of agents' cost functions; and ii) a novel broadcast protocol to disseminate information and distribute the computation among the agents. Asymptotic convergence to stationary solutions is established. A key feature of the proposed algorithm is that it neither requires the double-stochasticity of the consensus matrices (but only column stochasticity) nor the knowledge of the graph sequence to implement. To the best of our knowledge, the proposed framework is the first broadcast-based distributed algorithm for convex and nonconvex constrained optimization over arbitrary, time-varying digraphs. Numerical results show that our algorithm outperforms current schemes on both convex and nonconvex problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719 · cited 1×
“Distributed solution methods for convex instances of Problem (1) have been widely studied in the literature, under various assumptions on network topology; some recent contributions include [1]–[8].”
BackgroundWeik, M. H. (2000) · Computer Science and Communications Dictionary · doi:10.1007/1-4020-0613-6_12436 · Cited by 2,570
Constrained Consensus and Optimization in Multi-Agent Networks
Nedic, A., Ozdaglar, A., & Parrilo, P. A. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2041686 · Cited by 2,086
Gossip-based computation of aggregate information
Kempe, D., Dobra, A., & Gehrke, J. (2004) · 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings. · doi:10.1109/sfcs.2003.1238221 · Cited by 1,480
EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization
Shi, W., Ling, Q., Wu, G., & Yin, W. (2015) · SIAM Journal on Optimization · doi:10.1137/14096668x · Cited by 1,261
Distributed Optimization Over Time-Varying Directed Graphs
Nedic, A., & Olshevsky, A. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2364096 · Cited by 1,187
A scheme for robust distributed sensor fusion based on average consensus
Xiao, L., Boyd, S., & Lall, S. (2005) · doi:10.5555/1147685.1147698 · Cited by 1,170
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs
Nedić, A., Olshevsky, A., & Shi, W. (2017) · SIAM Journal on Optimization · doi:10.1137/16m1084316 · Cited by 1,069 · cited 5×
“In the same technical report [26], the authors proposed pushDIGing, the extension of DIGing to B-strongly connected digraphs.”
BackgroundMethodInfluentialDual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
Duchi, J. C., Agarwal, A., & Wainwright, M. J. (2012) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2011.2161027 · Cited by 947
Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
Duchi, J. C., Agarwal, A., & Wainwright, M. J. (2010) · Cited by 884
Convergence in Multiagent Coordination, Consensus, and Flocking
Blondel, V. D., Hendrickx, J. M., Olshevsky, A., & Tsitsiklis, J. N. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1582620 · Cited by 859
Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs
Gharesifard, B., & Cortes, J. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2278132 · Cited by 833
NEXT: In-Network Nonconvex Optimization
Lorenzo, P. D., & Scutari, G. (2016) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2016.2524588 · Cited by 473
Self-citationDistributed Asynchronous Constrained Stochastic Optimization
Srivastava, K., & Nedic, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2118740 · Cited by 350
Decomposition by Partial Linearization: Parallel Optimization of Multi-Agent Systems
Scutari, G., Facchinei, F., Song, P., Palomar, D. P., & Pang, J.-S. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2293126 · Cited by 338
Self-citationXu, J., Zhu, S., Soh, Y. C., & Xie, L. (2015) · 2015 54th IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2015.7402509 · Cited by 332 · cited 9×
“While algorithm (28) is in principle more general than (29)–agents can use different step-sizes αis–the assumptions in [25] on α to guarantee convergence are difficult to be enforced in practice, and in particular in a distributed setting.”
BackgroundMethodInfluentialPush-Sum Distributed Dual Averaging for convex optimization
Tsianos, K. I., Lawlor, S., & Rabbat, M. G. (2012) · 2012 IEEE 51st IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426375 · Cited by 304 · cited 1×
“As a final remark, we point out that the proposed broadcast protocol is different from the renowned pushed-sum protocol [16], used in a number of papers [6], [7], [12], [17] to remove the doublestochastic requirement on the consensus matrix.”
MethodConvergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization
Bianchi, P., & Jakubowicz, J. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2012.2209984 · Cited by 245
ADD-OPT: Accelerated Distributed Directed Optimization
Xi, C., Xin, R., & Khan, U. A. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2737582 · Cited by 181
Non-Convex Distributed Optimization
Tatarenko, T., & Touri, B. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2648041 · Cited by 171
Parallel Selective Algorithms for Nonconvex Big Data Optimization
Facchinei, F., Scutari, G., & Sagratella, S. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2399858 · Cited by 162
Self-citationAn Approximate Dual Subgradient Algorithm for Multi-Agent Non-Convex Optimization
Zhu, M., & Martínez, S. (2012) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2012.2228038 · Cited by 128
Locally constructed algorithms for distributed computations in ad-hoc networks
Scherber, D. S., & Papadopoulos, H. (2004) · International Symposium on Information Processing in Sensor Networks (IPSN) · doi:10.1145/984622.984625 · Cited by 112
Distributed consensus and optimization under communication delays
Tsianos, K. I., & Rabbat, M. G. (2011) · 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton) · doi:10.1109/allerton.2011.6120272 · Cited by 92
When does a digraph admit a doubly stochastic adjacency matrix?
Gharesifard, B., & Cortes, J. (2010) · Proceedings of the 2010 American Control Conference · doi:10.1109/acc.2010.5530578 · Cited by 82
Harnessing smoothness to accelerate distributed optimization
Qu, G., & Li, N. (2016) · 2016 IEEE 55th Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798263 · Cited by 72
Distributed nonconvex optimization over networks
Lorenzo, P. D., & Scutari, G. (2015) · IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing · doi:10.1109/camsap.2015.7383778 · Cited by 40
Self-citationAchieving Geometric Convergence for Distributed Optimization over Time-Varying GraphsPreprint
Nedić, A., Olshevsky, A., & Shi, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.03218 · Cited by 31
Distributed nonconvex optimization over time-varying networks
Lorenzo, P. D., & Scutari, G. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472453 · Cited by 23
Self-citationDistributed nonconvex optimization for sparse representation
Sun, Y., & Scutari, G. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952916 · Cited by 18
Self-citation
Cited by
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs
Nedić, A., Olshevsky, A., & Shi, W. (2017) · SIAM Journal on Optimization · doi:10.1137/16m1084316 · Cited by 1,069
“Finally, the paper [64] proposed an algorithm with diminishing step-size for nonconvex optimization over directed graphs based on the push-sum method [27] and showed convergence to a stationary point.”
MethodNetwork Topology and Communication-Computation Tradeoffs in Decentralized Optimization
Nedic, A., Olshevsky, A., & Rabbat, M. G. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2817461 · Cited by 534
Distributed Optimization for Control
Nedić, A., & Liu, J. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105131 · Cited by 302
Li, Z., Shi, W., & Yan, M. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2926022 · Cited by 244
Distributed nonconvex constrained optimization over time-varying digraphs
Scutari, G., & Sun, Y. (2019) · Mathematical Programming · doi:10.1007/s10107-018-01357-w · Cited by 210
Self-citation
Metadata
- Authors
- Sun, Y., Scutari, G., & Palomar, D.
- Affiliations
- Purdue University West Lafayette (US)
- Hong Kong University of Science and Technology (HK)
- Venue
- 2016 50th Asilomar Conference on Signals, Systems and Computers
- Publisher
- IEEE
- Published
- 2016-11
- Pages
- 788-794
- ISSN
- 1058-6393 (ISSN-L)
- OpenAlex
- W2963090384
- Cited by
- 86
- References
- 30
- Citations by year
- 2026: 4 · 2024: 6 · 2023: 3 · 2022: 4 · 2021: 4 · 2020: 14 · 2019: 20 · 2018: 21 · 2017: 9 · 2016: 1
- FWCI
- 14.52
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Asilomar Conference on Signals, Systems and Computers (ACSSC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1555850, 1564044, CAREER)
- Office of Naval Research (N00014-16-1-2244, N00014)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
- Keywords
- distributed optimization, non-convex optimization, multi-agent systems, successive convex approximation, gradient tracking, constrained optimization, convergence to stationary solutions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.