The DOI matches its OpenAlex record; 65 of the 65 references it cites were found in a registry or an index.
Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 2×
“A more related and popular work is Mnih et al. (2016), which has proposed the asynchronous actor-critic (A3C) algorithm.”
Background(1999) · Cited by 5,147
Distributed Subgradient Methods for Multi-Agent Optimization
Nedic, A., & Ozdaglar, A. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.2009515 · Cited by 3,719 · cited 8×
“…approached in a static setting, in the sense that the optimization objective is deterministic and there is no control input a ff ecting the transition of the system, see e ff orts in Nedic and Ozdaglar (2009); Ram et al. (2010); Agarwal and Duchi (2011); Jakovetic et al. (2011); Tu and Sayed (2012).”
BackgroundInfluentialMulti-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Coverage Control for Mobile Sensing Networks
Cortes, J., Martinez, S., Karatas, T., & Bullo, F. (2004) · IEEE Transactions on Robotics and Automation · doi:10.1109/tra.2004.824698 · Cited by 2,710
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,614
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
High-Dimensional Continuous Control Using Generalized Advantage Estimation
Schulman, J., Moritz, P., Levine, S., Jordan, M., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1506.02438 · Cited by 2,103
Distributed asynchronous deterministic and stochastic gradient optimization algorithms
Tsitsiklis, J., Bertsekas, D., & Athans, M. (1986) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1986.1104412 · Cited by 1,967
Counterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11794 · Cited by 1,873
Stochastic Approximation and Recursive Algorithms and Applications
(2003) · Stochastic Modelling and Applied Probability · doi:10.1007/b97441 · Cited by 1,838
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217 · cited 3×
“Moreover, none of them exploit the communication among agents, since they assume either a central controller exists to coordination the agents (Foerster et al., 2016; Lowe et al., 2017), or the reward of all agents are common (Gupta et al.”
BackgroundAn analysis of temporal-difference learning with function approximation
Tsitsiklis, J. N., & Van Roy, B. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.580874 · Cited by 1,194
A scheme for robust distributed sensor fusion based on average consensus
Xiao, L., Boyd, S., & Lall, S. (2005) · doi:10.5555/1147685.1147698 · Cited by 1,170
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs
Nedić, A., Olshevsky, A., & Shi, W. (2017) · SIAM Journal on Optimization · doi:10.1137/16m1084316 · Cited by 1,069
Achieving Controllability of Electric Loads
Callaway, D. S., & Hiskens, I. A. (2011) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2081652 · Cited by 1,069
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Distributed optimization in sensor networks
Rabbat, M., & Nowak, R. (2004) · Proceedings of the 3rd international symposium on Information processing in sensor networks · doi:10.1145/984622.984626 · Cited by 901 · cited 1×
“However, in many real-world scenarios, such as sensor networks (Rabbat and Nowak, 2004) and intelligent transportation systems (Adler and Blue, 2002), a central controller simply does not exist or may be costly to install.”
BackgroundCooperative Multi-agent Control Using Deep Reinforcement Learning
Gupta, J. K., Egorov, M., & Kochenderfer, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71682-4_5 · Cited by 874
Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization
Sundhar Ram, S., Nedić, A., & Veeravalli, V. V. (2010) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-010-9737-7 · Cited by 814 · cited 2×
“…approached in a static setting, in the sense that the optimization objective is deterministic and there is no control input a ff ecting the transition of the system, see e ff orts in Nedic and Ozdaglar (2009); Ram et al. (2010); Agarwal and Duchi (2011); Jakovetic et al. (2011); Tu and Sayed (2012).”
BackgroundKakade, S. M. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 775
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · cited 2×
“See Li (2017) for an overview of recent achievements of deep reinforcement learning.”
BackgroundPeters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Discrete Parameter Martingales
(2006) · Springer eBooks · doi:10.1007/978-0-387-35434-7_14 · Cited by 682
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
Chen, J., & Sayed, A. H. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198470 · Cited by 680
Diffusion recursive least-squares for distributed estimation over adaptive networks
Cattivelli, F. S., Lopes, C. G., & Sayed, A. H. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.913164 · Cited by 623
Planning, Learning and Coordination in Multiagent Decision Processes
Boutilier, C. E. (1996) · Theoretical Aspects of Rationality and Knowledge · Cited by 575
Natural actor–critic algorithms
Bhatnagar, S., Sutton, R. S., Ghavamzadeh, M., & Lee, M. (2009) · Automatica · doi:10.1016/j.automatica.2009.07.008 · Cited by 559
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
Shalev-Shwartz, S., Shammah, S., & Shashua, A. (2016) · arXiv · doi:10.48550/arxiv.1610.03295 · Cited by 509 · cited 2×
“, 2016, 2017), autonomous driving (Shalev-Shwartz et al., 2016), and robotics (Kober and Peters, 2012).”
BackgroundThe O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning
Borkar, V. S., & Meyn, S. P. (2000) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012997331639 · Cited by 499
Broadcast Gossip Algorithms for Consensus
Aysal, T. C., Yildiz, M. E., Sarwate, A. D., & Scaglione, A. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016247 · Cited by 480
Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures
Kar, S., & Moura, J. M. F. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2036046 · Cited by 435
An Actor-Critic Algorithm for Sequence Prediction
Bahdanau, D., Brakel, P., Xu, K., Goyal, A., Lowe, R., Pineau, J., Courville, A., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1607.07086 · Cited by 423
Dynamics of stochastic approximation algorithms
Benaïm, M. (1999) · Lecture Notes in Mathematics · doi:10.1007/bfb0096509 · Cited by 413
An Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems
Lauer, M., & Riedmiller, M. (2000) · Cited by 412
Value-function reinforcement learning in Markov games
Littman, M. L. (2001) · Cognitive Systems Research · doi:10.1016/s1389-0417(01)00015-8 · Cited by 397
Cooperative Optimal Control for Multi-Agent Systems on Directed Graph Topologies
Movric, K. H., & Lewis, F. L. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2275670 · Cited by 327
A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
Lanctot, M., Zambaldi, V., Gruslys, A., Lazaridou, A., Tuyls, K., Perolat, J., Silver, D., & Graepel, T. (2017) · arXiv · doi:10.48550/arxiv.1711.00832 · Cited by 295
Multi-Agent Reinforcement Learning:a critical survey
Shoham, Y., Powers, R., & Grenager, T. (2003) · Cited by 263
Multi-task reinforcement learning: a hierarchical Bayesian approach
Wilson, A., Fern, A., Ray, S., & Tadepalli, P. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273624 · Cited by 261
Policy evaluation with temporal differences
Dann, C., Neumann, G. M., & Peters, J. (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2638563 · Cited by 253
Reinforcement Learning to Play an Optimal Nash Equilibrium in Team Markov Games
Wang, X., & Sandholm, T. (2002) · Cited by 251
Learning Algorithms for Markov Decision Processes with Average Cost
Abounadi, J., Bertsekas, D., & Borkar, V. S. (2001) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012999361974 · Cited by 204
Reinforcement Learning in Robotics: A Survey
Kober, J., & Peters, J. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-03194-1_2 · Cited by 202
Reinforcement learning of coordination in cooperative multi-agent systems
Kapetanakis, S., & Kudenko⋆, D. (2002) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.5555/777092.777145 · Cited by 192
Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning
Parisotto, E., Ba, J. L., & Salakhutdinov, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06342 · Cited by 186
A cooperative multi-agent transportation management and route guidance system
Adler, J. L., & Blue, V. J. (2002) · Transportation Research Part C: Emerging Technologies · doi:10.1016/s0968-090x(02)00030-x · Cited by 182
Kar, S., Moura, J. M. F., & Poor, H. V. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2241057 · Cited by 175
Distral: Robust Multitask Reinforcement Learning
Teh, Y. W., Bapst, V., Czarnecki, W. M., Quan, J., Kirkpatrick, J., Hadsell, R. T., Heess, N., & Pascanu, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.04175 · Cited by 172
Decentralized Q-Learning for Stochastic Teams and Games
Arslan, G., & Yüksel, S. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2598476 · Cited by 168
Applications of a Kushner and Clark lemma to general classes of stochastic algorithms
Métivier, M., & Priouret, P. (1984) · IEEE Transactions on Information Theory · doi:10.1109/tit.1984.1056894 · Cited by 155
Jakovetić, D., Xavier, J., & Moura, J. M. F. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2146776 · Cited by 131
Direct gradient-based reinforcement learning
Baxter, J., & Bartlett, P. L. (2002) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2000.856049 · Cited by 110
Bhatnagar, S. (2010) · Systems & Control Letters · doi:10.1016/j.sysconle.2010.08.013 · Cited by 63
Diff-DAC: Distributed Actor-Critic for Average Multitask Deep Reinforcement LearningPreprint
Macua, S. V., Tukiainen, A., Hernández, D. G.-O., Baldazo, D., de Cote, E. M., & Zazo, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10363 · Cited by 43
Average cost temporal-difference learning
Tsitsiklis, J. N., & Roy, B. V. (2002) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1997.650675 · Cited by 29
A Convergent Online Single Time Scale Actor Critic AlgorithmPreprint
Castro, D. D., & Meir, R. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0909.2934 · Cited by 27
Cited by
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
Zhang, K., Yang, Z., & Başar, T. (2021) · Studies in Systems, Decision and Control · doi:10.1007/978-3-030-60990-0_12 · Cited by 1,264
Self-citationA review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 482
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
Yang, H., Zhao, J., Xiong, Z., Lam, K.-Y., Sun, S., & Xiao, L. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088655 · Cited by 306
Ganesh, A. H., & Xu, B. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 285
Metadata
- Authors
- Zhang, K., Yang, Z., Liu, H., Zhang, T., & Başar, T.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-02-23
- Volume
- 80
- Pages
- 5872-5881
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1802.08757
- OpenAlex
- W2788115019
- Cited by
- 293
- References
- 65
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.