The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Multitask Diffusion Adaptation Over Networks
Open accessAbstract
Adaptive networks are suitable for decentralized inference tasks. Recent works have intensively studied distributed optimization problems in the case where the nodes have to estimate a single optimum parameter vector collaboratively. However, there are many important applications that are multitask-oriented in the sense that there are multiple optimum parameter vectors to be inferred simultaneously, in a collaborative manner, over the area covered by the network. In this paper, we employ diffusion strategies to develop distributed algorithms that address multitask problems by minimizing an appropriate mean-square error criterion with l2-regularization. The stability and performance of the algorithm in the mean and mean-square error sense are analyzed. Simulations are conducted to verify the theoretical findings, and to illustrate how the distributed strategy can be used in several useful applications related to target localization and hyperspectral data unmixing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719
Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches
Bioucas-Dias, J. M., Plaza, A., Dobigeon, N., Parente, M., Du, Q., Gader, P., & Chanussot, J. (2012) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2194696 · Cited by 2,836
Fast linear iterations for distributed averaging
Xiao, L., & Boyd, S. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.02.022 · Cited by 2,706
Existence and Uniqueness of Equilibrium Points for Concave N-Person Games
Rosen, J. B. (1965) · Econometrica · doi:10.2307/1911749 · Cited by 2,686
Vertex component analysis: a fast algorithm to unmix hyperspectral data
Nascimento, J. M. P., & Dias, J. M. B. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2005.844293 · Cited by 2,669
Keshava, N., & Mustard, J. F. (2002) · IEEE Signal Processing Magazine · doi:10.1109/79.974727 · Cited by 2,549
The ASTER spectral library version 2.0
Baldridge, A. M., Hook, S. J., Grove, C. I., & Rivera, G. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2008.11.007 · Cited by 1,657
Regularized multi--task learning
Evgeniou, T., & Pontil, M. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014067 · Cited by 1,433
N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data:
Winter, M. E. (1999) · SPIE Proceedings · doi:10.1117/12.366289 · Cited by 1,414
Efficient projections onto the l1-ball for learning in high dimensions
Duchi, J., Shalev-Shwartz, S., Singer, Y., & Chandra, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390191 · Cited by 1,184
Diffusion LMS Strategies for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2033729 · Cited by 1,174
Self-citationDiffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis
Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917383 · Cited by 1,109
Self-citationDynamic noncooperative game theory
(1995) · European Journal of Operational Research · doi:10.1016/0377-2217(95)90173-6 · Cited by 1,096
Parameter Estimation and Inverse Problems
(2005) · International Geophysics · doi:10.1016/s0074-6142(05)x8014-7 · Cited by 902
Sayed, A. H. (2008) · Wiley eBooks · doi:10.1002/9780470374122 · Cited by 848
Self-citationTotal Variation Spatial Regularization for Sparse Hyperspectral Unmixing
Iordache, M.-D., Bioucas-Dias, J. M., & Plaza, A. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2191590 · Cited by 753
Incremental Adaptive Strategies Over Distributed Networks
Lopes, C. G., & Sayed, A. H. (2007) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.896034 · Cited by 732
Self-citationOptimization with Sparsity-Inducing Penalties
Bach, F., Jenatton, R., Mairal, J., & Obozinski, G. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000015 · Cited by 730
Kar, S., & Moura, J. M. F. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2007111 · Cited by 691
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
Self-citationDiffusion recursive least-squares for distributed estimation over adaptive networks
Cattivelli, F. S., Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.913164 · Cited by 623
Self-citationIncremental Subgradient Methods for Nondifferentiable Optimization
Nedic, A., & Bertsekas, D. P. (2001) · SIAM Journal on Optimization · doi:10.1137/s1052623499362111 · Cited by 589
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 587
Self-citationAn accelerated gradient method for trace norm minimization
Ji, S., & Ye, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553434 · Cited by 517
Sayed, A. H., Tu, S.-Y., Chen, J., Zhao, X., & Towfic, Z. J. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2231991 · Cited by 494
Self-citationOnline Prediction of Time Series Data With Kernels
Richard, C., Bermudez, J. C. M., & Honeiné, P. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2009895 · Cited by 470
Self-citationTu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2217338 · Cited by 467
Self-citationQuantized incremental algorithms for distributed optimization
Rabbat, M. G., & Nowak, R. D. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2005.843546 · Cited by 408
Distributed learning in wireless sensor networks
Predd, J. B., Kulkarni, S. B., & Poor, H. V. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1657817 · Cited by 369
Distributed Asynchronous Constrained Stochastic Optimization
Srivastava, K., & Nedic, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2118740 · Cited by 350
A New Class of Incremental Gradient Methods for Least Squares Problems
Bertsekas, D. P. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495287022 · Cited by 312
A Convergent Incremental Gradient Method with a Constant Step Size
Blatt, D., Hero, A. O., & Gauchman, H. (2007) · SIAM Journal on Optimization · doi:10.1137/040615961 · Cited by 306
Distributed Learning in Wireless Sensor Networks
Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2007) · Wireless Sensor Networks · doi:10.1002/9780470061794.ch8 · Cited by 264
Clustered Multi-Task Learning Via Alternating Structure Optimization.
Zhou, J., Chen, J., & Ye, J. (2011) · PubMed · Cited by 260
Self-citationA multi-task learning formulation for predicting disease progression
Zhou, J., Yuan, L., Liu, J., & Ye, J. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020549 · Cited by 254
Convergence and asymptotic agreement in distributed decision problems
Tsitsiklis, J., & Athans, M. (1984) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1984.1103385 · Cited by 247
Sparse Distributed Learning Based on Diffusion Adaptation
Di Lorenzo, P., & Sayed, A. H. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2232663 · Cited by 224
Self-citationAdaptive Learning in a World of Projections
Theodoridis, S., Slavakis, K., & Yamada, I. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.938752 · Cited by 217
A convex formulation for learning shared structures from multiple tasks
Chen, J., Tang, L., Liu, J., & Ye, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553392 · Cited by 197
Self-citationNonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model
Chen, J., Richard, C., & Honeine, P. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2222390 · Cited by 192
Self-citationDiffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data
Zhao, X., Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2192928 · Cited by 183
Self-citationTu, S.-Y., & Sayed, A. H. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2125943 · Cited by 182
Self-citationDistributed Pareto Optimization via Diffusion Strategies
Chen, J., & Sayed, A. H. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2013.2246763 · Cited by 177
Self-citationDiffusion Sparse Least-Mean Squares Over Networks
Liu, Y., Li, C., & Zhang, Z. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198468 · Cited by 170
Adaptive Robust Distributed Learning in Diffusion Sensor Networks
Chouvardas, S., Slavakis, K., & Theodoridis, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2161474 · Cited by 165
Multi-task learning for boosting with application to web search ranking
Chapelle, O., Shivaswamy, P. K., Vadrevu, S., Weinberger, K. Q., Zhang, Y., & Tseng, B. L. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835953 · Cited by 113
Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy Links
Khalili, A., Tinati, M. A., Rastegarnia, A., & Chambers, J. A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2173338 · Cited by 108
A Sparsity Promoting Adaptive Algorithm for Distributed Learning
Chouvardas, S., Slavakis, K., Kopsinis, Y., & Theodoridis, S. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2204987 · Cited by 100
Adaptive Penalty-Based Distributed Stochastic Convex Optimization
Towfic, Z. J., & Sayed, A. H. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2331615 · Cited by 98
Self-citationChen, J., Richard, C., & Honeiné, P. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2264392 · Cited by 86
Self-citationNonnegative Least-Mean-Square Algorithm
Chen, J., Richard, C., Bermudez, J. C. M., & Honeiné, P. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2162508 · Cited by 86
Self-citationClustering via diffusion adaptation over networks
Zhao, X., & Sayed, A. H. (2012) · International Workshop on Cognitive Information Processing (CIP) · doi:10.1109/cip.2012.6232902 · Cited by 84
Self-citationDistributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View
Jiang, C., Chen, Y., & Liu, K. J. R. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2280444 · Cited by 68
Geometric Unmixing of Large Hyperspectral Images: A Barycentric Coordinate Approach
Honeiné, P., & Richard, C. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2170999 · Cited by 59
Self-citationDistributed Decision-Making Over Adaptive Networks
Tu, S.-Y., & Sayed, A. H. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2296271 · Cited by 46
Self-citationAcademic Press Library in Signal Processing
(2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-420149-1.00014-4 · Cited by 40
Diffusion LMS for clustered multitask networks
Chen, J., Richard, C., & Sayed, A. H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854652 · Cited by 30
Self-citationDistributed incremental-based LMS for node-specific parameter estimation over adaptive networks
Bogdanović, N., Plata-Chaves, J., & Berberidis, K. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638700 · Cited by 26
Distributed Regression in Sensor Networks with a Reduced-Order Kernel Model
Honeiné, P., Essoloh, M., Richard, C., & Snoussi, H. (2008) · Globecom · doi:10.1109/glocom.2008.ecp.29 · Cited by 24
Self-citationFunctional estimation in Hilbert space for distributed learning in wireless sensor networks
Honeiné, P., Richard, C., Bermudez, J. C. M., Snoussi, H., Essoloh, M., & Vincent, F. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4960220 · Cited by 17
Self-citationChen, J., Richard, C., Ferrari, A., & Honeiné, P. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638039 · Cited by 13
Self-citationA Decentralized Approach for Nonlinear Prediction of Time Series Data in Sensor Networks
Honeiné, P., Richard, C., Bermudez, J. C. M., Chen, J., & Snoussi, H. (2010) · EURASIP Journal on Wireless Communications and Networking · doi:10.1155/2010/627372 · Cited by 9
Self-citation
Cited by
Diffusion LMS Over Multitask Networks
Chen, J., Richard, C., & Sayed, A. H. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2412918 · Cited by 253
Self-citationCommunication-efficient distributed learning: An overview
Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139
DJAM: Distributed Jacobi asynchronous method for learning personal models
Almeida, I., & Xavier, J. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2859596 · Cited by 10
Metadata
- Authors
- Chen, J., Richard, C., & Sayed, A. H.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2014-08
- Volume
- 62
- Issue
- 16
- Pages
- 4129-4144
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2962907301
- Cited by
- 291
- References
- 64
- FWCI
- 26.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.