The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks
Open accessAbstract
Adaptive networks consist of a collection of nodes with adaptation and learning abilities. The nodes interact with each other on a local level and diffuse information across the network to solve estimation and inference tasks in a distributed manner. In this work, we compare the mean-square performance of two main strategies for distributed estimation over networks: consensus strategies and diffusion strategies. The analysis in the paper confirms that under constant step-sizes, diffusion strategies allow information to diffuse more thoroughly through the network and this property has a favorable effect on the evolution of the network: diffusion networks are shown to converge faster and reach lower mean-square deviation than consensus networks, and their mean-square stability is insensitive to the choice of the combination weights. In contrast, and surprisingly, it is shown that consensus networks can become unstable even if all the individual nodes are stable and able to solve the estimation task on their own. When this occurs, cooperation over the network leads to a catastrophic failure of the estimation task. This phenomenon does not occur for diffusion networks: we show that stability of the individual nodes always ensures stability of the diffusion network irrespective of the combination topology. Simulation results support the theoretical findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Horn, R. A., & Johnson, C. R. (1985) · Cited by 22,203
Consensus Problems in Networks of Agents With Switching Topology and Time-Delays
Olfati-Saber, R., & Murray, R. M. (2004) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2004.834113 · Cited by 12,788
Haykin, S. (1986) · Cited by 12,603
Horn, R. A., & Johnson, C. R. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810817 · Cited by 10,280
Coordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339
Consensus seeking in multiagent systems under dynamically changing interaction topologies
Ren, W., & Beard, R. W. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.846556 · Cited by 6,569
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
Degroot, M. H. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10480137 · Cited by 4,004
Bellanger, M. (1987) · Signal Processing · doi:10.1016/0165-1684(87)90147-2 · Cited by 2,961
Fast linear iterations for distributed averaging
Xiao, L., & Boyd, S. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.02.022 · Cited by 2,706
Boyd, S., Ghosh, A., Prabhakar, B., & Shah, D. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.874516 · Cited by 2,439
Distributed asynchronous deterministic and stochastic gradient optimization algorithms
Tsitsiklis, J., Bertsekas, D., & Athans, M. (1986) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1986.1104412 · Cited by 1,967
Diffusion LMS Strategies for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2033729 · Cited by 1,174
Self-citationA scheme for robust distributed sensor fusion based on average consensus
Xiao, L., Boyd, S., & Lall, S. (2005) · doi:10.5555/1147685.1147698 · Cited by 1,170
Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis
Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917383 · Cited by 1,109
Self-citationMatrix Analysis for Scientists and Engineers
Laub, A. J. (2004) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717907 · Cited by 893
Sayed, A. H. (2008) · Wiley eBooks · doi:10.1002/9780470374122 · Cited by 848
Self-citationDistributed Stochastic Subgradient Projection Algorithms for Convex Optimization
Sundhar Ram, S., Nedić, A., & Veeravalli, V. V. (2010) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-010-9737-7 · Cited by 814
Gossip Algorithms for Distributed Signal Processing
Dimakis, A. G., Kar, S., Moura, J. M. F., Rabbat, M. G., & Scaglione, A. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2052531 · Cited by 741
A scheme for robust distributed sensor fusion based on average consensus
Xiao, L., Boyd, S., & Lall, S. (2005) · IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005. · doi:10.1109/ipsn.2005.1440896 · Cited by 713
Gossip Algorithms for Distributed Signal Processing
Dimakis, A. G., Kar, S., Moura, J. M. F., Rabbat, M., & Scaglione, A. (2018) · doi:10.1184/r1/6468842.v1 · Cited by 692
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
Self-citationIncremental Subgradient Methods for Nondifferentiable Optimization
Nedic, A., & Bertsekas, D. P. (2001) · SIAM Journal on Optimization · doi:10.1137/s1052623499362111 · Cited by 589
Broadcast Gossip Algorithms for Consensus
Aysal, T. C., Yildiz, M. E., Sarwate, A. D., & Scaglione, A. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016247 · Cited by 480
Diffusion Adaptation Over Networks
Sayed, A. H. (2014) · Academic Press Library in Signal Processing · doi:10.1016/b978-0-12-411597-2.00009-6 · Cited by 465
Self-citationDistributed LMS for Consensus-Based In-Network Adaptive Processing
Schizas, I. D., Mateos, G., & Giannakis, G. B. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016226 · Cited by 376
Distributed Asynchronous Constrained Stochastic Optimization
Srivastava, K., & Nedic, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2118740 · Cited by 350
Subgradient methods and consensus algorithms for solving convex optimization problems
Johansson, B., Keviczky, T., Johansson, M., & Johansson, K. H. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739339 · Cited by 316
A New Class of Incremental Gradient Methods for Least Squares Problems
Bertsekas, D. P. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495287022 · Cited by 312
Sensor Networks With Random Links: Topology Design for Distributed Consensus
Kar, S., & Moura, J. M. F. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.920143 · Cited by 261
Kar, S., & Moura, J. M. F. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2127446 · Cited by 231
A Necessary and Sufficient Condition for Reaching a Consensus Using DeGroot's Method
Berger, R. L. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477662 · Cited by 224
Adaptive Learning in a World of Projections
Theodoridis, S., Slavakis, K., & Yamada, I. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.938752 · Cited by 217
Cooperative distributed multi-agent optimization
Nedić, A., & Ozdaglar, A. (2009) · Convex Optimization in Signal Processing and Communications · doi:10.1017/cbo9780511804458.011 · Cited by 185
Diffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data
Zhao, X., Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2192928 · Cited by 183
Self-citationTu, S.-Y., & Sayed, A. H. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2125943 · Cited by 182
Self-citationAdaptive Robust Distributed Learning in Diffusion Sensor Networks
Chouvardas, S., Slavakis, K., & Theodoridis, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2161474 · Cited by 165
Modeling Bird Flight Formations Using Diffusion Adaptation
Cattivelli, F. S., & Sayed, A. H. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2107907 · Cited by 156
Self-citationA space-time diffusion scheme for peer-to-peer least-squares estimation
Xiao, L., Boyd, S., & Lall, S. (2006) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/1127777.1127806 · Cited by 155
Bio-Inspired Sensor Network Design
Barbarossa, S., & Scutari, G. (2007) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.361599 · Cited by 134
Adaptive Processing over Distributed Networks
Sayed, A. H., & Lopes, C. G. (2007) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1093/ietfec/e90-a.8.1504 · Cited by 131
Self-citationAsymptotic Optimality of Running Consensus in Testing Binary Hypotheses
Braca, P., Maranò, S., Matta, V., et al. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2030610 · Cited by 116
New Algorithms for Improved Adaptive Convex Combination of LMS Transversal Filters
Arenas‐García, J., Gómez-Verdejo, V., & Figueiras-Vidal, A. R. (2005) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2005.858823 · Cited by 109
Distributed processing over adaptive networks
Sayed, A. H., & Lopes, C. G. (2007) · International Symposium on Signal Processing and Its Applications (ISSPA) · doi:10.1109/isspa.2007.4555636 · Cited by 90
Self-citationDistributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms
Tsitsiklis, J. N., Bertsekas, D. P., & Athans, M. (1984) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.1984.4788427 · Cited by 89
Fast Distributed Average Consensus Algorithms Based on Advection-Diffusion Processes
Sardellitti, S., Giona, M., & Barbarossa, S. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2032030 · Cited by 74
Weight Optimization for Consensus Algorithms With Correlated Switching Topology
Jakovetić, D., Xavier, J., & Moura, J. M. F. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2046635 · Cited by 64
Diffusion LMS algorithms with information exchange
Cattivelli, F. S., & Sayed, A. H. (2008) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2008.5074402 · Cited by 38
Self-citationDiffusion networks outperform consensus networks
Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Statistical Signal Processing Workshop (SSP) · doi:10.1109/ssp.2012.6319691 · Cited by 12
Self-citation
Cited by
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
Zhang, K., Yang, Z., & Başar, T. (2021) · Studies in Systems, Decision and Control · doi:10.1007/978-3-030-60990-0_12 · Cited by 1,264
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 587
Self-citationSayed, A. H., Tu, S.-Y., Chen, J., Zhao, X., & Towfic, Z. J. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2231991 · Cited by 494
Self-citationDiffusion Adaptation Over Networks
Sayed, A. H. (2014) · Academic Press Library in Signal Processing · doi:10.1016/b978-0-12-411597-2.00009-6 · Cited by 465
Self-citationAdaptation, Learning, and Optimization over Networks
Sayed, A. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988515 · Cited by 415
Self-citation
Metadata
- Authors
- Tu, S.-Y., & Sayed, A. H.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2012-12
- Volume
- 60
- Issue
- 12
- Pages
- 6217-6234
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2024307985
- Cited by
- 467
- References
- 50
- FWCI
- 33.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.