On Distributed Averaging Algorithms and Quantization Effects
Open accessThe DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Abstract
We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of performance when only quantized information is available. We study a large and natural class of averaging algorithms, which includes the vast majority of algorithms proposed to date, and provide tight polynomial bounds on their convergence time. We also describe an algorithm within this class whose convergence time is the best among currently available averaging algorithms for time-varying topologies. We then propose and analyze distributed averaging algorithms under the additional constraint that agents can only store and communicate quantized information, so that they can only converge to the average of the initial values of the agents within some error. We establish bounds on the error and tight bounds on the convergence time, as a function of the number of quantization levels.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Consensus Problems in Networks of Agents With Switching Topology and Time-Delays
Olfati-Saber, R., & Murray, R. M. (2004) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2004.834113 · Cited by 12,788
Coordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339
Novel Type of Phase Transition in a System of Self-Driven Particles
Vicsek, T., Czirók, A., Ben-Jacob, E., Cohen, I., & Shochet, O. (1995) · Physical Review Letters · doi:10.1103/physrevlett.75.1226 · Cited by 7,380
Consensus seeking in multiagent systems under dynamically changing interaction topologies
Ren, W., & Beard, R. W. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.846556 · Cited by 6,569
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
Self-citationFast linear iterations for distributed averaging
Xiao, L., & Boyd, S. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.02.022 · Cited by 2,706
Stability of multiagent systems with time-dependent communication links
Moreau, L. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2004.841888 · Cited by 2,706
Distributed asynchronous deterministic and stochastic gradient optimization algorithms
Tsitsiklis, J., Bertsekas, D., & Athans, M. (1986) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1986.1104412 · Cited by 1,967
Self-citationPROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION
Τσιτσικλής, Ι. (2014) · doi:10.12681/eadd/3778 · Cited by 1,278
Parallel and distributed computation
Bertsekas, D. P., Tsitsiklis, J. N., & Sennikov, A. N. (1989) · Cited by 1,187
Self-citationDistributed average consensus with least-mean-square deviation
Xiao, L., Boyd, S., & Kim, S.-J. (2007) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2006.08.010 · Cited by 1,107
Dynamic load balancing for distributed memory multiprocessors
Cybenko, G. (1989) · Journal of Parallel and Distributed Computing · doi:10.1016/0743-7315(89)90021-x · Cited by 997
Convergence in Multiagent Coordination, Consensus, and Flocking
Blondel, V. D., Hendrickx, J. M., Olshevsky, A., & Tsitsiklis, J. N. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1582620 · Cited by 859
Self-citationToeplitz and Circulant Matrices: A Review
Gray, R. M. (2005) · now publishers, Inc. eBooks · doi:10.1561/9781933019680 · Cited by 759
Convergence Speed in Distributed Consensus and Averaging
Olshevsky, A., & Tsitsiklis, J. N. (2009) · SIAM Journal on Control and Optimization · doi:10.1137/060678324 · Cited by 692
Self-citationGossip algorithms: design, analysis and applications
Boyd, S., Ghosh, A., Prabbakar, B., & Shah, D. (2005) · Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies. · doi:10.1109/infcom.2005.1498447 · Cited by 558
Average consensus problems in networks of agents with delayed communications
Bliman, P.-A., & Ferrari-Trecate, G. (2008) · Automatica · doi:10.1016/j.automatica.2007.12.010 · Cited by 429
Global clock synchronization in sensor networks
Li, Q., & Rus, D. (2006) · IEEE Transactions on Computers · doi:10.1109/tc.2006.25 · Cited by 419
Devavrat Shah, B. (2009) · Cited by 248
Gray, R. M. (2006) · now publishers, Inc. eBooks · Cited by 168
Convergence Rates in Distributed Consensus and Averaging
Olshevsky, A., & Tsitsiklis, J. N. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2006.376899 · Cited by 153
Self-citationBounds for eigenvalues of certain stochastic matrices
Landau, H. J., & Odlyzko, A. M. (1981) · Linear Algebra and its Applications · doi:10.1016/0024-3795(81)90003-3 · Cited by 88
Average consensus on networks with transmission noise or quantization
Ruggero Carli, A., Fagnani, F., Frasca, P., Taylor, T., & Zampieri, S. (2007) · European Control Conference (ECC) · doi:10.23919/ecc.2007.7068829 · Cited by 86
Average consensus problems in networks of agents with delayed communications
Bliman, P., & Giancarlo Ferrari-trecate, A. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2005.1583300 · Cited by 65
Communication constraints in coordinated consensus problems
Ruggero Carli, A., Fagnani, F., Alberto Speranzon, B., & Zampieri, S. (2006) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2006.1657376 · Cited by 47
Kashyap, A., Başar, T., & Srikant, R. (2006) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2006.261862 · Cited by 43
Consensus with Quantized Information Updates
Kashyap, A., Başar, T., & Srikant, R. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2006.376993 · Cited by 40
Analysis and design of distributed algorithms for X-consensus
Cortés, J. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2006.377436 · Cited by 23
Research works printed but not linked: 1
- carli, 2005, Communication Constraints in the State Agreement Problem
Cited by
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719
Self-citationAn Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination
Cao, Y., Yu, W., Ren, W., & Chen, G. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2012.2219061 · Cited by 2,399
Constrained Consensus and Optimization in Multi-Agent Networks
Nedic, A., Ozdaglar, A., & Parrilo, P. A. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2041686 · Cited by 2,086
Self-citation(2005) · Elements of Information Theory · doi:10.1002/047174882x.ch15 · Cited by 1,504
Distributed Optimization Over Time-Varying Directed Graphs
Nedic, A., & Olshevsky, A. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2364096 · Cited by 1,187
Self-citation
Metadata
- Authors
- Nedic, A., Olshevsky, A., Ozdaglar, A., & Tsitsiklis, J. N.
- Affiliations
- Massachusetts Institute of Technology (US)
- Venue
- IEEE Transactions on Automatic Control
- Published
- 2009-11
- Volume
- 54
- Issue
- 11
- Pages
- 2506-2517
- ISSN
- 0018-9286 (ISSN-L)
- 1558-2523
- OpenAlex
- W2140655807
- Cited by
- 557
- References
- 29
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 11 · 2023: 16 · 2022: 23 · 2021: 23 · 2020: 31 · 2019: 25 · 2018: 42 · 2017: 38 · 2016: 44 · 2015: 35 · 2014: 32 · 2013: 55 · 2012: 53
- FWCI
- 65.84
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Automatic Control (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Funders
- National Science Foundation (0545910, 0742538, 0701623)
- Defense Advanced Research Projects Agency
- Division of Civil, Mechanical and Manufacturing Innovation
- Division of Electrical, Communications and Cyber Systems
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Stability and Control of Uncertain Systems
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Opinion Dynamics and Social Influence
- Keywords
- distributed averaging, time-varying topology, convergence time, quantization levels, polynomial bounds, distributed iterative algorithm, multi-agent systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.