The DOI matches its Crossref record; 221 of the 221 references it cites were found in a registry or an index.
Adaptation, Learning, and Optimization over Networks
Abstract
Adaptation, Learning, and Optimization over Networks deals with the topic of information processing over graphs. The presentation is largely self-contained and covers results that relate to the analysis and design of multi-agent networks for the distributed solution of optimization, adaptation, and learning problems from streaming data through localized interactions among agents. The results derived in this monograph are useful in comparing network topologies against each other, and in comparing networked solutions against centralized or batch implementations. There are many good reasons for the peaked interest in distributed implementations, especially in this day and age when the word "network" has become commonplace whether one is referring to social networks, power networks, transportation networks, biological networks, or other types of networks. Some of these reasons have to do with the benefits of cooperation in terms of improved performance and improved resilience to failure. Other reasons deal with privacy and secrecy considerations where agents may not be comfortable sharing their data with remote fusion centers. In other situations, the data may already be available in dispersed locations, as happens with cloud computing. One may also be interested in learning through data mining from big data sets. Motivated by these considerations, Adaptation, Learning, and Optimization over Networks examines the limits of performance of distributed solutions and discusses procedures that help bring forth their potential more fully. Adaptation, Learning, and Optimization over Networks adopts a useful statistical framework and derives performance results that elucidate the mean-square stability, convergence, and steady-state behavior of the learning networks. At the same time, the monograph illustrates how distributed processing over graphs gives rise to some revealing phenomena due to the coupling effect among the agents. These phenomena are discussed in the context of adaptive networks, along with examples from a variety of areas including distributed sensing, intrusion detection, distributed estimation, online adaptation, network system theory, and machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Horn, R. A., & Johnson, C. R. (1985) · Cited by 22,203
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Consensus Problems in Networks of Agents With Switching Topology and Time-Delays
Olfati-Saber, R., & Murray, R. M. (2004) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2004.834113 · Cited by 12,788
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Haykin, S. (1986) · Cited by 12,603
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Consensus and Cooperation in Networked Multi-Agent Systems
Olfati-Saber, R., Fax, J. A., & Murray, R. M. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.887293 · Cited by 10,522
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Gantmacher, F. R. (1984) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 8,520
Coordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339
Network biology: understanding the cell's functional organization
Barabási, A.-L., & Oltvai, Z. N. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1272 · Cited by 7,903
Flocks, herds and schools: A distributed behavioral model
Reynolds, C. W. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37406 · Cited by 7,714
Novel Type of Phase Transition in a System of Self-Driven Particles
Vicsek, T., Czirók, A., Ben-Jacob, E., Cohen, I., & Shochet, O. (1995) · Physical Review Letters · doi:10.1103/physrevlett.75.1226 · Cited by 7,380
Newman, M. (2010) · doi:10.1093/acprof:oso/9780199206650.001.0001 · Cited by 6,595
Kailath, T. (1980) · Cited by 6,215
The algebraic eigenvalue problem
Wilkinson, J. H. (1965) · Cited by 5,833
Nonnegative Matrices in the Mathematical Sciences
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-10361-3 · Cited by 5,451
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
The Algebraic Eigenvalue Problem
I., E., & Wilkinson, J. H. (1966) · Mathematics of Computation · doi:10.2307/2003558 · Cited by 5,140
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,095
Markov Chains and Stochastic Stability
Meyn, S. P., & Tweedie, R. L. (1993) · Springer eBooks · doi:10.1007/978-1-4471-3267-7 · Cited by 5,041
Flocking for Multi-Agent Dynamic Systems: Algorithms and Theory
Olfati-Saber, R. (2006) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.864190 · Cited by 5,037
Enhancing Sparsity by Reweighted ℓ 1 Minimization
Candès, E. J., Wakin, M. B., & Boyd, S. P. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9045-x · Cited by 4,863
Probability, Random Variables, and Stochastic Processes
Papoulis, A., & Hoffman, J. G. (1967) · Physics Today · doi:10.1063/1.3034123 · Cited by 4,107
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Degroot, M. H. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10480137 · Cited by 4,004
QUORUM SENSING: Cell-to-Cell Communication in Bacteria
Waters, C. M., & Bassler, B. L. (2005) · Annual Review of Cell and Developmental Biology · doi:10.1146/annurev.cellbio.21.012704.131001 · Cited by 3,979
Bollobás, B. (1998) · Graduate Texts in Mathematics · doi:10.1007/978-1-4612-0619-4 · Cited by 3,772
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719
Jackson, M. O. (2010) · Princeton University Press eBooks · doi:10.2307/j.ctvcm4gh1 · Cited by 3,606
Introductory Lectures on Convex Optimization: A Basic Course
Nesterov, Y. E. (2014) · Medical Entomology and Zoology · Cited by 3,557
Hamilton, W. D. (1971) · Journal of Theoretical Biology · doi:10.1016/0022-5193(71)90189-5 · Cited by 3,506
Matrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Probability: Theory and Examples.
Prewitt, K., & Durrett, R. (1992) · Journal of the American Statistical Association · doi:10.2307/2290301 · Cited by 3,085
Biomimicry of bacterial foraging for distributed optimization and control
(2002) · IEEE Control Systems · doi:10.1109/mcs.2002.1004010 · Cited by 3,069
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Self-Organization in Biological Systems
Sneyd, J., Theraula, G., Bonabeau, E., Deneubourg, J.-L., & Franks, N. R. (2001) · doi:10.1515/9780691212920 · Cited by 2,949
Non-negative Matrices and Markov Chains
Seneta, E. (1981) · Springer Series in Statistics · doi:10.1007/0-387-32792-4 · Cited by 2,807
Fast linear iterations for distributed averaging
Xiao, L., & Boyd, S. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.02.022 · Cited by 2,706
Dynamical Processes on Complex Networks
Barrat, A., Barthélemy, M., & Vespignani, A. (2008) · doi:10.1017/cbo9780511791383 · Cited by 2,704
A method for solving the convex programming problem with convergence rate O(1/k^2)
Nesterov, Y. E. (1983) · Доклады Академии наук · Cited by 2,662
Boyd, S., Ghosh, A., Prabhakar, B., & Shah, D. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.874516 · Cited by 2,439
Ahlfors, L. V. (1979) · Cited by 2,282
Convex Analysis and Optimization
Bertsekas, D. P., Nedić, A., & Ozdaglar, A. (2003) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,148
Collective Memory and Spatial Sorting in Animal Groups
COUZIN, I. D., KRAUSE, J., JAMES, R., RUXTON, G. D., & FRANKS, N. R. (2002) · Journal of Theoretical Biology · doi:10.1006/jtbi.2002.3065 · Cited by 2,138
Distributed asynchronous deterministic and stochastic gradient optimization algorithms
Tsitsiklis, J., Bertsekas, D., & Athans, M. (1986) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1986.1104412 · Cited by 1,967
Spectra of graphs : theory and application
Cvetković, D., Doob, M., & Sachs, H. (1995) · Cited by 1,825
Sur les fonctions convexes et les inégalités entre les valeurs moyennes
Jensen, J. L. W. V. (1906) · Acta Mathematica · doi:10.1007/bf02418571 · Cited by 1,811
(1989) · Choice Reviews Online · doi:10.5860/choice.26-5109 · Cited by 1,755
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-06164-6 · Cited by 1,728
Fundamentals of adaptive filtering
Sayed, A. H. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,673
Self-citationDistributed Kalman filtering for sensor networks
Olfati-Saber, R. (2007) · 2007 46th IEEE Conference on Decision and Control · doi:10.1109/cdc.2007.4434303 · Cited by 1,586
Sporns, O. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/8476.001.0001 · Cited by 1,580
Gossip-based computation of aggregate information
Kempe, D., Dobra, A., & Gehrke, J. (2004) · 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings. · doi:10.1109/sfcs.2003.1238221 · Cited by 1,480
Olmsted, J. M. H., Kolmogorov, A. N., Fomin, S. V., & Silverman, R. A. (1971) · The American Mathematical Monthly · doi:10.2307/2316932 · Cited by 1,397
Connected: The Surprising Power of Our Social Networks and How They Shape Our Lives
Fowler, I. N. A. C. I. J. H. (2009) · Medical Entomology and Zoology · Cited by 1,329
Optimality and non-scalar-valued performance criteria
Zadeh, L. (1963) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1963.1105511 · Cited by 1,210
Stationary and Nonstationary Learning Characteristics of the LMS Adaptive Filter
Widrow, B., McCool, J., Larimore, M. G., & Johnson, C. R. (1977) · Aspects of Signal Processing · doi:10.1007/978-94-010-1223-2_23 · Cited by 1,195
Diffusion LMS Strategies for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2033729 · Cited by 1,174
Self-citationA scheme for robust distributed sensor fusion based on average consensus
Xiao, L., Boyd, S., & Lall, S. (2005) · doi:10.5555/1147685.1147698 · Cited by 1,170
Animal behavior. An evolutionary approach
(1978) · Journal of Human Evolution · doi:10.1016/s0047-2484(78)80102-x · Cited by 1,150
(2006) · Indefinite Linear Algebra and Applications · doi:10.1007/3-7643-7350-4_14 · Cited by 1,115
Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis
Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917383 · Cited by 1,109
Self-citationNeuroscience: Exploring the Brain
Bear, M. F., Connors, B. W., & Paradiso, M. A. (1996) · Cited by 1,050
Distributed Kalman Filter with Embedded Consensus Filters
Olfati-Saber, R. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1583486 · Cited by 1,024
Consensus Filters for Sensor Networks and Distributed Sensor Fusion
Olfati-Saber, R., & Shamma, J. S. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1583238 · Cited by 982
Naïve Learning in Social Networks and the Wisdom of Crowds
Golub, B., & Jackson, M. O. (2010) · American Economic Journal: Microeconomics · doi:10.1257/mic.2.1.112 · Cited by 979
Collective cognition in animal groups
Couzin, I. D. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.10.002 · Cited by 911
Convergence in Multiagent Coordination, Consensus, and Flocking
Blondel, V. D., Hendrickx, J. M., Olshevsky, A., & Tsitsiklis, J. N. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1582620 · Cited by 859
Mathematical Optimization and Economic Theory
Intriligator, M. D. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898719215 · Cited by 849
Diffusion Strategies for Distributed Kalman Filtering and Smoothing
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2042987 · Cited by 842
Self-citationDistributed Stochastic Subgradient Projection Algorithms for Convex Optimization
Sundhar Ram, S., Nedić, A., & Veeravalli, V. V. (2010) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-010-9737-7 · Cited by 814
The theory of matrices : with applications
Lancaster, P., & Tismenetsky, M. (1985) · Cited by 791
Cooperative behavior cascades in human social networks
Fowler, J. H., & Christakis, N. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913149107 · Cited by 767
MILINSKI, M., & HELLER, R. (1978) · Nature · doi:10.1038/275642a0 · Cited by 745
Fastest Mixing Markov Chain on a Graph
Boyd, S., Diaconis, P., & Xiao, L. (2004) · SIAM Review · doi:10.1137/s0036144503423264 · Cited by 744
Linked: How Everything Is Connected to Everything Else and What It Means
Barabási, A.-Ĺ. (2003) · Plume eBooks · Cited by 734
Incremental Adaptive Strategies Over Distributed Networks
Lopes, C. G., & Sayed, A. H. (2007) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.896034 · Cited by 732
Self-citationOpinion Dynamics and Learning in Social Networks
Acemoglu, D., & Ozdaglar, A. (2011) · Dynamic Games and Applications · doi:10.1007/s13235-010-0004-1 · Cited by 705
Gossip Algorithms for Distributed Signal Processing
Dimakis, A. G., Kar, S., Moura, J. M. F., Rabbat, M., & Scaglione, A. (2018) · doi:10.1184/r1/6468842.v1 · Cited by 692
Kar, S., & Moura, J. M. F. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2007111 · Cited by 691
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
Self-citationKalman-Consensus Filter : Optimality, stability, and performance
Olfati-Saber, R. (2009) · Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference · doi:10.1109/cdc.2009.5399678 · Cited by 677
Sparse LMS for system identification
Chen, Y., Gu, Y., & Hero, A. O. (2009) · 2009 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2009.4960286 · Cited by 650
The Structure and Function of Fish Schools
Partridge, B. L. (1982) · Scientific American · doi:10.1038/scientificamerican0682-114 · Cited by 631
Diffusion recursive least-squares for distributed estimation over adaptive networks
Cattivelli, F. S., Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.913164 · Cited by 623
Self-citation(2005) · Interdisciplinary Mathematical Sciences · doi:10.1142/9789812701039_0003 · Cited by 611
Incremental Subgradient Methods for Nondifferentiable Optimization
Nedic, A., & Bertsekas, D. P. (2001) · SIAM Journal on Optimization · doi:10.1137/s1052623499362111 · Cited by 589
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 587
Self-citationPattern Recognition, Fourth Edition
Theodoridis, S., & Koutroumbas, K. (2008) · Academic Press eBooks · Cited by 548
Multidimensional Stochastic Approximation Methods
Blum, J. R. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728659 · Cited by 523
Distributed Kalman filtering based on consensus strategies
Carli, R., Chiuso, A., Schenato, L., & Zampieri, S. (2008) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2008.080505 · Cited by 511
Sayed, A. H., Tu, S.-Y., Chen, J., Zhao, X., & Towfic, Z. J. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2231991 · Cited by 494
Self-citationJadbabaie, A., Molavi, P., Sandroni, A., & Tahbaz-Salehi, A. (2012) · Games and Economic Behavior · doi:10.1016/j.geb.2012.06.001 · Cited by 485
Distributing the Kalman Filter for Large-Scale Systems
Khan, U. A., & Moura, J. M. F. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.927480 · Cited by 481
Broadcast Gossip Algorithms for Consensus
Aysal, T. C., Yildiz, M. E., Sarwate, A. D., & Scaglione, A. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016247 · Cited by 480
Kar, S., Moura, J. M. F., & Ramanan, K. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2012.2191450 · Cited by 476
Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2217338 · Cited by 467
Self-citationDiffusion Adaptation Over Networks
Sayed, A. H. (2014) · Academic Press Library in Signal Processing · doi:10.1016/b978-0-12-411597-2.00009-6 · Cited by 465
Self-citationGradient Convergence in Gradient methods with Errors
Bertsekas, D. P., & Tsitsiklis, J. N. (2000) · SIAM Journal on Optimization · doi:10.1137/s1052623497331063 · Cited by 437
Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures
Kar, S., & Moura, J. M. F. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2036046 · Cited by 435
Block diagonally dominant matrices and generalizations of the Gerschgorin circle theorem
Feingold, D. G., & Varga, R. S. (1962) · Pacific Journal of Mathematics · doi:10.2140/pjm.1962.12.1241 · Cited by 433
Zur formalen Theorie der Funktionen von mehr komplexen Ver�nderlichen
Wirtinger, W. (1927) · Mathematische Annalen · doi:10.1007/bf01447872 · Cited by 409
Quantized incremental algorithms for distributed optimization
Rabbat, M. G., & Nowak, R. D. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2005.843546 · Cited by 408
Berg, H. C. (2000) · Physics Today · doi:10.1063/1.882934 · Cited by 407
Complex-Valued Matrix Derivatives: With Applications in Signal Processing and Communications
Hjørungnes, A. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921490 · Cited by 401
Complex-Valued Signal Processing: The Proper Way to Deal With Impropriety
Adali, T., Schreier, P. J., & Scharf, L. L. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2162954 · Cited by 398
Distributed LMS for Consensus-Based In-Network Adaptive Processing
Schizas, I. D., Mateos, G., & Giannakis, G. B. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016226 · Cited by 376
Convergence analysis of LMS filters with uncorrelated Gaussian data
Feuer, A., & Weinstein, E. (1985) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1985.1164493 · Cited by 375
Distributed Asynchronous Constrained Stochastic Optimization
Srivastava, K., & Nedic, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2118740 · Cited by 350
Gardner, W. A. (1984) · Signal Processing · doi:10.1016/0165-1684(84)90013-6 · Cited by 343
The Perron-Frobenius theorem: some of its applications
Pillai, S. U., Suel, T., & Cha, S. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1406483 · Cited by 338
A Randomized Incremental Subgradient Method for Distributed Optimization in Networked Systems
Johansson, B., Rabi, M., & Johansson, M. (2010) · SIAM Journal on Optimization · doi:10.1137/08073038x · Cited by 336
Analysis of biological networks
(2017) · Molecular Data Analysis Using R · doi:10.1002/9781119165057.ch10 · Cited by 323
Subgradient methods and consensus algorithms for solving convex optimization problems
Johansson, B., Keviczky, T., Johansson, M., & Johansson, K. H. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739339 · Cited by 316
Distributed Average Consensus With Dithered Quantization
Aysal, T. C., Coates, M. J., & Rabbat, M. G. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.927071 · Cited by 315
A New Class of Incremental Gradient Methods for Least Squares Problems
Bertsekas, D. P. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495287022 · Cited by 312
Diffusion Least-Mean Squares With Adaptive Combiners: Formulation and Performance Analysis
Takahashi, N., Yamada, I., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2051429 · Cited by 310
Self-citationA Convergent Incremental Gradient Method with a Constant Step Size
Blatt, D., Hero, A. O., & Gauchman, H. (2007) · SIAM Journal on Optimization · doi:10.1137/040615961 · Cited by 306
Push-Sum Distributed Dual Averaging for convex optimization
Tsianos, K. I., Lawlor, S., & Rabbat, M. G. (2012) · 2012 IEEE 51st IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426375 · Cited by 304
Adaptation and Learning in Automatic Systems
Tsypkin, Y. Z., & Nikolić, S. (1971) · Academic Press, Inc. eBooks · Cited by 297
(1991) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(91)90064-a · Cited by 280
Interior Gradient and Proximal Methods for Convex and Conic Optimization
Auslender, A., & Teboulle, M. (2006) · SIAM Journal on Optimization · doi:10.1137/s1052623403427823 · Cited by 269
Distributed Learning in Wireless Sensor Networks
Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2007) · Wireless Sensor Networks · doi:10.1002/9780470061794.ch8 · Cited by 264
Distributed Autonomous Online Learning: Regrets and Intrinsic Privacy-Preserving Properties
Yan, F., Sundaram, S., Vishwanathan, S. V. N., & Qi, Y. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.191 · Cited by 263
Sensor Networks With Random Links: Topology Design for Distributed Consensus
Kar, S., & Moura, J. M. F. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.920143 · Cited by 261
van den Bos, A. (1994) · IEE Proceedings - Vision Image and Signal Processing · doi:10.1049/ip-vis:19941555 · Cited by 255
Diffusion Kalman Filtering Based on Covariance Intersection
Hu, J., Xie, L., & Zhang, C. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2175386 · Cited by 255
Devavrat Shah, B. (2009) · Cited by 248
Convergence and asymptotic agreement in distributed decision problems
Tsitsiklis, J., & Athans, M. (1984) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1984.1103385 · Cited by 247
Distributed delayed stochastic optimization
Agarwal, A., & Duchi, J. C. (2012) · 2012 IEEE 51st IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426626 · Cited by 243
Kar, S., & Moura, J. M. F. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2127446 · Cited by 231
A Necessary and Sufficient Condition for Reaching a Consensus Using DeGroot's Method
Berger, R. L. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477662 · Cited by 224
Sparse Distributed Learning Based on Diffusion Adaptation
Di Lorenzo, P., & Sayed, A. H. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2232663 · Cited by 224
Self-citationWeighted Gossip: Distributed Averaging using non-doubly stochastic matrices
Benezit, F., Blondel, V., Thiran, P., Tsitsiklis, J., & Vetterli, M. (2010) · 2010 IEEE International Symposium on Information Theory · doi:10.1109/isit.2010.5513273 · Cited by 224
Likelihood Consensus and Its Application to Distributed Particle Filtering
Hlinka, O., Sluciak, O., Hlawatsch, F., Djuric, P. M., & Rupp, M. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2196697 · Cited by 218
Adaptive Learning in a World of Projections
Theodoridis, S., Slavakis, K., & Yamada, I. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.938752 · Cited by 217
Advanced Calculus of Several Variables
(1973) · Elsevier eBooks · doi:10.1016/c2013-0-10610-1 · Cited by 216
Aerodynamic aspects of formation flight in birds
Hummel, D. (1983) · Journal of Theoretical Biology · doi:10.1016/0022-5193(83)90110-8 · Cited by 186
Cooperative distributed multi-agent optimization
Nedić, A., & Ozdaglar, A. (2009) · Convex Optimization in Signal Processing and Communications · doi:10.1017/cbo9780511804458.011 · Cited by 185
Distributed Random Projection Algorithm for Convex Optimization
Lee, S., & Nedic, A. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2013.2247023 · Cited by 184
Diffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data
Zhao, X., Tu, S.-Y., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2192928 · Cited by 183
Self-citationTu, S.-Y., & Sayed, A. H. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2125943 · Cited by 182
Self-citationDistributed Pareto Optimization via Diffusion Strategies
Chen, J., & Sayed, A. H. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2013.2246763 · Cited by 177
Self-citationDiffusion Sparse Least-Mean Squares Over Networks
Liu, Y., Li, C., & Zhang, Z. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198468 · Cited by 170
Performance advantage of complex LMS for controlling narrow-band adaptive arrays
Horowitz, L. L., & Senne, K. D. (1981) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1981.1163602 · Cited by 165
Adaptive Robust Distributed Learning in Diffusion Sensor Networks
Chouvardas, S., Slavakis, K., & Theodoridis, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2161474 · Cited by 165
Adaptive Processing: The Least Mean Squares Approach with Applications in Transmission
Macchi, O. (1995) · Medical Entomology and Zoology · Cited by 164
Kopsinis, Y., Slavakis, K., & Theodoridis, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2090874 · Cited by 164
Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links
Saligrama, V., Alanyali, M., & Savas, O. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.880227 · Cited by 158
A modelling framework for understanding social insect foraging
Sumpter, D. J. T., & Pratt, S. C. (2003) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-002-0549-0 · Cited by 156
Modeling Bird Flight Formations Using Diffusion Adaptation
Cattivelli, F. S., & Sayed, A. H. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2107907 · Cited by 156
Self-citationA space-time diffusion scheme for peer-to-peer least-squares estimation
Xiao, L., Boyd, S., & Lall, S. (2006) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/1127777.1127806 · Cited by 155
Decentralized Parameter Estimation by Consensus Based Stochastic Approximation
Stankovic, S. S., Stanković, M. S., & Stipanović, D. M. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2076530 · Cited by 153
Performance Limits for Distributed Estimation Over LMS Adaptive Networks
Zhao, X., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2204985 · Cited by 146
Self-citationA Collaborative Training Algorithm for Distributed Learning
Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2012992 · Cited by 145
On the Learning Behavior of Adaptive Networks—Part I: Transient Analysis
Chen, J., & Sayed, A. H. (2015) · IEEE Transactions on Information Theory · doi:10.1109/tit.2015.2427360 · Cited by 143
Self-citationDistributed Least Mean-Square Estimation With Partial Diffusion
Arablouei, R., Werner, S., Huang, Y.-F., et al. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2292035 · Cited by 142
Dugatkin, L. A. (2003) · Cited by 140
Distributed Kalman Filtering Using Weighted Averaging
Alriksson, P., & Rantzer, A. (2006) · Lund University Publications (Lund University) · Cited by 139
Bio-Inspired Sensor Network Design
Barbarossa, S., & Scutari, G. (2007) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.361599 · Cited by 134
Adaptive Processing over Distributed Networks
Sayed, A. H., & Lopes, C. G. (2007) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1093/ietfec/e90-a.8.1504 · Cited by 131
Self-citationJakovetić, D., Xavier, J., & Moura, J. M. F. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2146776 · Cited by 131
Analysis of Spatial and Incremental LMS Processing for Distributed Estimation
Cattivelli, F. S., & Sayed, A. H. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2100386 · Cited by 130
Self-citationDistributed and Collaborative Estimation over Wireless Sensor Networks
Speranzon, A., Fischione, C., & Johansson, K. H. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2006.377101 · Cited by 130
How does an informed minority of scouts guide a honeybee swarm as it flies to its new home?
Beekman, M., Fathke, R. L., & Seeley, T. D. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2005.04.009 · Cited by 113
Locally constructed algorithms for distributed computations in ad-hoc networks
Scherber, D. S., & Papadopoulos, H. (2004) · International Symposium on Information Processing in Sensor Networks (IPSN) · doi:10.1145/984622.984625 · Cited by 112
Generalized consensus computation in networked systems with erasure links
Rabbat, M., Nowak, R. D., & Bucklew, J. A. (2005) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2005.1506308 · Cited by 110
Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy Links
Khalili, A., Tinati, M. A., Rastegarnia, A., & Chambers, J. A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2173338 · Cited by 108
Diffusion Least-Mean Squares Over Adaptive Networks
Lopes, C. G., & Sayed, A. H. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.366830 · Cited by 108
Self-citationHeppner, F. H. (1974) · Bird-Banding · doi:10.2307/4512025 · Cited by 107
A Sparsity Promoting Adaptive Algorithm for Distributed Learning
Chouvardas, S., Slavakis, K., Kopsinis, Y., & Theodoridis, S. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2204987 · Cited by 100
Adaptive Penalty-Based Distributed Stochastic Convex Optimization
Towfic, Z. J., & Sayed, A. H. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2331615 · Cited by 98
Self-citationRegions in the Complex Plane Containing the Eigenvalues of a Matrix
Brualdi, R. A., & Mellendorf, S. (1994) · American Mathematical Monthly · doi:10.1080/00029890.1994.12004577 · Cited by 92
Meijer, I. C. (2010) · Rhodes Journalism Review · Cited by 92
Diffusion strategies for distributed Kalman filtering: formulation and performance analysis
Cattivelli, F. S., Lopes, C. G., & Sayed, A. H. (2008) · Cited by 92
Self-citationDistributed processing over adaptive networks
Sayed, A. H., & Lopes, C. G. (2007) · International Symposium on Signal Processing and Its Applications (ISSPA) · doi:10.1109/isspa.2007.4555636 · Cited by 90
Self-citationHoneybee swarms: how do scouts guide a swarm of uninformed bees?
Janson, S., Middendorf, M., & Beekman, M. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2004.10.018 · Cited by 88
The Natural History of the Flight ofHoney Bee Swarms
Seeley, T. D., Morse, R. A., & Visscher, P. K. (1979) · Psyche A Journal of Entomology · doi:10.1155/1979/80869 · Cited by 87
On the Learning Behavior of Adaptive Networks—Part II: Performance Analysis
Chen, J., & Sayed, A. H. (2015) · IEEE Transactions on Information Theory · doi:10.1109/tit.2015.2427352 · Cited by 85
Self-citationOrder-Optimal Consensus Through Randomized Path Averaging
Bénézit, F., Dimakis, A. G., Thiran, P., & Vetterli, M. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2060050 · Cited by 79
Performance Analysis of the Consensus-Based Distributed LMS Algorithm
Mateos, G., Schizas, I. D., & Giannakis, G. B. (2009) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2009/981030 · Cited by 76
Clustering via diffusion adaptation over networks
Zhao, X., & Sayed, A. H. (2012) · International Workshop on Cognitive Information Processing (CIP) · doi:10.1109/cip.2012.6232902 · Cited by 75
Self-citationFast Distributed Average Consensus Algorithms Based on Advection-Diffusion Processes
Sardellitti, S., Giona, M., & Barbarossa, S. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2032030 · Cited by 74
Learning over social networks via diffusion adaptation
Zhao, X., & Sayed, A. H. (2012) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2012.6489103 · Cited by 72
Self-citationAn Adaptive Projected Subgradient Approach to Learning in Diffusion Networks
Cavalcante, R. L. G., Yamada, I., & Mulgrew, B. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2018648 · Cited by 69
Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View
Jiang, C., Chen, Y., & Liu, K. J. R. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2280444 · Cited by 68
Djurić, P. M., & Wang, Y. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.943495 · Cited by 64
Distributed Consensus Algorithms in Sensor Networks: Link Failures and Channel NoisePreprint
Kar, S., & Moura, J. M. F. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0711.3915 · Cited by 63
A diffusion rls scheme for distributed estimation over adaptive networks
Cattivelli, F. S., Lopes, C. G., & Sayed, A. H. (2007) · IEEE Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2007.4401393 · Cited by 56
Self-citationOptimal Distributed Online Prediction
Dekel, O., Gilad-Bachrach, R., Shamir, O., & Xiao, L. (2011) · Cited by 53
Analysis of Sum-Weight-Like Algorithms for Averaging in Wireless Sensor Networks
Iutzeler, F., Ciblat, P., & Hachem, W. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2256904 · Cited by 51
Cited by
A survey of distributed optimization
Yang, T., Yi, X., Wu, J., Yuan, Y., Wu, D., Meng, Z., Hong, Y., Wang, H., Lin, Z., & Johansson, K. H. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.05.006 · Cited by 913
Robust Aggregation for Federated Learning
Pillutla, K., Kakade, S. M., & Harchaoui, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3153135 · Cited by 801
Sayed, A. H. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2306253 · Cited by 587
Self-citationNEXT: In-Network Nonconvex Optimization
Lorenzo, P. D., & Scutari, G. (2016) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2016.2524588 · Cited by 473
Yi, P., Hong, Y., & Liu, F. (2016) · Automatica · doi:10.1016/j.automatica.2016.08.007 · Cited by 478
Metadata
- Authors
- Sayed, A.
- Venue
- now publishers, Inc. eBooks
- Publisher
- now Publishers Inc
- Published
- 2014
- OpenAlex
- W2012445782
- Cited by
- 415
- References
- 221
- FWCI
- 30.02
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.