The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Diffusion LMS Over Multitask Networks
Open accessAbstract
The diffusion LMS algorithm has been extensively studied in recent years. This efficient strategy allows to address distributed optimization problems over networks in the case where nodes have to collaboratively estimate a single parameter vector. Nevertheless, there are several problems in practice that are multitask-oriented in the sense that the optimum parameter vector may not be the same for every node. This brings up the issue of studying the performance of the diffusion LMS algorithm when it is run, either intentionally or unintentionally, in a multitask environment. In this paper, we conduct a theoretical analysis on the stochastic behavior of diffusion LMS in the case where the single-task hypothesis is violated. We analyze the competing factors that influence the performance of diffusion LMS in the multitask environment, and which allow the algorithm to continue to deliver performance superior to non-cooperative strategies in some useful circumstances. We also propose an unsupervised clustering strategy that allows each node to select, via adaptive adjustments of combination weights, the neighboring nodes with which it can collaborate to estimate a common parameter vector. Simulations are presented to illustrate the theoretical results, and to demonstrate the efficiency of the proposed clustering strategy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719
Fast linear iterations for distributed averaging
Xiao, L., & Boyd, S. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.02.022 · Cited by 2,706
Matrix Mathematics: Theory, Facts, and Formulas (Second Edition)
Bernstein, D. S. (2009) · Princeton University Press eBooks · doi:10.1515/9781400833344 · Cited by 1,324
Diffusion LMS Strategies for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2033729 · Cited by 1,174
Self-citationDiffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis
Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917383 · Cited by 1,109
Self-citationSayed, A. H. (2008) · Wiley eBooks · doi:10.1002/9780470374122 · Cited by 848
Self-citationGossip Algorithms for Distributed Signal Processing
Dimakis, A. G., Kar, S., Moura, J. M. F., Rabbat, M. G., & Scaglione, A. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2052531 · Cited by 741
Incremental Adaptive Strategies Over Distributed Networks
Lopes, C. G., & Sayed, A. H. (2007) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.896034 · Cited by 732
Self-citationGossip Algorithms for Distributed Signal Processing
Dimakis, A. G., Kar, S., Moura, J. M. F., Rabbat, M., & Scaglione, A. (2018) · doi:10.1184/r1/6468842.v1 · Cited by 692
Kar, S., & Moura, J. M. F. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2007111 · Cited by 691
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
Self-citationAdaptation, Learning, and Optimization over Networks
Sayed, A. H. (2014) · Foundations and Trends in Machine Learning · doi:10.1561/2200000051 · Cited by 667
Self-citationIncremental Subgradient Methods for Nondifferentiable Optimization
Nedic, A., & Bertsekas, D. P. (2001) · SIAM Journal on Optimization · doi:10.1137/s1052623499362111 · Cited by 589
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 587
Self-citationSayed, A. H., Tu, S.-Y., Chen, J., Zhao, X., & Towfic, Z. J. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2231991 · Cited by 494
Self-citationTu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2217338 · Cited by 467
Self-citationDiffusion Adaptation Over Networks
Sayed, A. H. (2014) · Academic Press Library in Signal Processing · doi:10.1016/b978-0-12-411597-2.00009-6 · Cited by 465
Self-citationAdaptation, Learning, and Optimization over Networks
Sayed, A. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988515 · Cited by 415
Self-citationQuantized incremental algorithms for distributed optimization
Rabbat, M. G., & Nowak, R. D. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2005.843546 · Cited by 408
Distributed learning in wireless sensor networks
Predd, J. B., Kulkarni, S. B., & Poor, H. V. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1657817 · Cited by 369
Distributed Asynchronous Constrained Stochastic Optimization
Srivastava, K., & Nedic, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2118740 · Cited by 350
A New Class of Incremental Gradient Methods for Least Squares Problems
Bertsekas, D. P. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495287022 · Cited by 312
A Convergent Incremental Gradient Method with a Constant Step Size
Blatt, D., Hero, A. O., & Gauchman, H. (2007) · SIAM Journal on Optimization · doi:10.1137/040615961 · Cited by 306
Multitask Diffusion Adaptation Over Networks
Chen, J., Richard, C., & Sayed, A. H. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2333560 · Cited by 291
Self-citationDistributed Learning in Wireless Sensor Networks
Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2007) · Wireless Sensor Networks · doi:10.1002/9780470061794.ch8 · Cited by 264
A multi-task learning formulation for predicting disease progression
Zhou, J., Yuan, L., Liu, J., & Ye, J. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020549 · Cited by 254
Convergence and asymptotic agreement in distributed decision problems
Tsitsiklis, J., & Athans, M. (1984) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1984.1103385 · Cited by 247
Sparse Distributed Learning Based on Diffusion Adaptation
Di Lorenzo, P., & Sayed, A. H. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2232663 · Cited by 224
Self-citationDiffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data
Zhao, X., Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2192928 · Cited by 183
Self-citationDistributed Pareto Optimization via Diffusion Strategies
Chen, J., & Sayed, A. H. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2013.2246763 · Cited by 177
Self-citationDiffusion Sparse Least-Mean Squares Over Networks
Liu, Y., Li, C., & Zhang, Z. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198468 · Cited by 170
Adaptive Robust Distributed Learning in Diffusion Sensor Networks
Chouvardas, S., Slavakis, K., & Theodoridis, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2161474 · Cited by 165
Enforcing Consensus While Monitoring the Environment in Wireless Sensor Networks
Braca, P., Maranò, S., & Matta, V. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917855 · Cited by 149
Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses
Braca, P., Maranò, S., Matta, V., et al. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2030610 · Cited by 116
Multi-task learning for boosting with application to web search ranking
Chapelle, O., Shivaswamy, P. K., Vadrevu, S., Weinberger, K. Q., Zhang, Y., & Tseng, B. L. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835953 · Cited by 113
Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy Links
Khalili, A., Tinati, M. A., Rastegarnia, A., & Chambers, J. A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2173338 · Cited by 108
A Sparsity Promoting Adaptive Algorithm for Distributed Learning
Chouvardas, S., Slavakis, K., Kopsinis, Y., & Theodoridis, S. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2204987 · Cited by 100
Matrix Mathematics: Theory, Facts, and Formulas: Second Edition
Bernstein, D. S. (2009) · CERN Document Server (European Organization for Nuclear Research) · Cited by 89
Clustering via diffusion adaptation over networks
Zhao, X., & Sayed, A. H. (2012) · International Workshop on Cognitive Information Processing (CIP) · doi:10.1109/cip.2012.6232902 · Cited by 75
Self-citationDistributed Consensus Algorithms in Sensor Networks: Link Failures and Channel NoisePreprint
Kar, S., & Moura, J. M. F. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0711.3915 · Cited by 63
Estimation of Space-Time Varying Parameters Using a Diffusion LMS Algorithm
Abdolee, R., Champagne, B., & Sayed, A. H. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2289888 · Cited by 49
Self-citationAcademic Press Library in Signal Processing
(2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-420149-1.00015-6 · Cited by 46
Diffusion LMS for multitask problems with overlapping hypothesis subspaces
Chen, J., Richard, C., Hero, A. O., & Sayed, A. H. (2014) · Machine learning for signal processing ... · doi:10.1109/mlsp.2014.6958929 · Cited by 44
Self-citationIncremental subgradient methods for nondifferentiable optimization
Geary, A., & Bertsekas, D. P. (2003) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1999.832908 · Cited by 40
Distributed diffusion-based LMS for node-specific parameter estimation over adaptive networks
Bogdanovie, N., Plata-Chaves, J., & Berberidis, K. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6855002 · Cited by 38
Distributed incremental-based LMS for node-specific parameter estimation over adaptive networks
Bogdanović, N., Plata-Chaves, J., & Berberidis, K. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638700 · Cited by 26
Distributed Regression in Sensor Networks with a Reduced-Order Kernel Model
Honeiné, P., Essoloh, M., Richard, C., & Snoussi, H. (2008) · Globecom · doi:10.1109/glocom.2008.ecp.29 · Cited by 24
Self-citation
Cited by
Communication-efficient distributed learning: An overview
Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139
Metadata
- Authors
- Chen, J., Richard, C., & Sayed, A. H.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2015-06
- Volume
- 63
- Issue
- 11
- Pages
- 2733-2748
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2093795816
- Cited by
- 253
- References
- 48
- FWCI
- 27.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.