The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Optimization for Reinforcement Learning: From a single agent to cooperative agents
Open accessAbstract
Fueled by recent advances in deep neural networks, reinforcement learning (RL) has been in the limelight because of many recent breakthroughs in artificial intelligence, including defeating humans in games (e.g., chess, Go, StarCraft), self-driving cars, smart-home automation, and service robots, among many others. Despite these remarkable achievements, many basic tasks can still elude a single RL agent. Examples abound, from multiplayer games, multirobots, cellular-antenna tilt control, traffic-control systems, and smart power grids to network management.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“By considering CSI variations [55], [275], [276] and stochastic task arrivals [84], [85], the dynamic communication and computation resource allocation problem can be formulated as a MDP, for which deep RL, a modelfree approach, can provide efficient and robust solutions [73].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Coordination of groups of mobile autonomous agents using nearest neighbor rules
Jadbabaie, A., Lin, J., & Morse, A. S. (2003) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2003.812781 · Cited by 8,339
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Constrained Consensus and Optimization in Multi-Agent Networks
Nedic, A., Ozdaglar, A., & Parrilo, P. A. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2041686 · Cited by 2,086
Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Research works printed but not linked: 19
- bertsekas, 1996, Neuro-Dynamic Programming
- dai, 0, Boosting the actor with dual critic, Proc Intl Conf on Learning Representations
- puterman, 2014, Markov Decision Processes Discrete Stochastic Dynamic Programming
- dai, 0, SBEED: Convergent reinforcement learning with nonlinear function approximation, Proc Int Conf Machine Learning, 1133
- dai, 0, Learning from conditional distributions via dual embeddings, Proc Int Conf Artificial Intelligence Statistics, 1458
- sutton, 0, A convergent O(n) temporal-difference algorithm for off-policy learning with linear function approximation, Proc Advances Neural Information Processing System Conf, 1609
- lee, 0, Target-based gradient TD-learning, Proc Int Conf Machine Learning, 3713
- leibo, 0, Multi-agent reinforcement learning in sequential social dilemmas, Proc 16th Conf Autonomous Agents and MultiAgent Systems, 464
- dalal, 0, Finite sample analyses for TD(0) with function approximation, Proc AAAI Conf Artificial Intelligence, 6144
- bhandari, 2018, A finite time analysis of temporal difference learning with linear function approximation
- hong, 0, Prox-PDA: The proximal primal-dual algorithm for fast distributed nonconvex optimization and learning over networks, Proc 34th Int Conf Mach Learn, 1529
- schulman, 0, Trust region policy optimization, Proc 31st Int Conf Mach Learn, 1889
- claus, 0, The dynamics of reinforcement learning in cooperative multiagent systems, Proc 15th Nat Conf Artificial Intelligence, 746
- zhang, 2018, Finite-sample analyses for fully decentralized multi-agent reinforcement learning
- wai, 0, Multi-agent reinforcement learning via double averaging primal-dual optimization, Proc Advances in Neural Information Processing Systems, 9672
- foerster, 0, Stabilising experience replay for deep multi-agent reinforcement learning, Proc 34th Int Conf Mach Learn, 70, 1146
- lauer, 0, An algorithm for distributed reinforcement learning in cooperative multi-agent systems, Proc 17th Int Conf Machine Learning, 535
- lauer, 0, Reinforcement learning for stochastic cooperative multi-agent systems, Proc 3rd Int Joint Conf Autonomous Agents and Multiagent Systems, 3, 1516
- peshkin, 0, Learning to cooperate via policy search, Proc 16th Conf Uncertainty in Artificial Intelligence, 489
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“By considering CSI variations [275], [55], [276] and stochastic task arrivals [85], [84], the dynamic communication and computation resource allocation problem can be formulated as a MDP, for which deep RL, a model-free approach, can provide efficient and robust solutions [73].”
BackgroundSingle and multi-agent deep reinforcement learning for AI-enabled wireless networks: A tutorial
Feriani, A., & Hossain, E. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3063822 · Cited by 410
Metadata
- Authors
- Lee, D., He, N., Kamalaruban, P., & Cevher, V.
- Affiliations
- Purdue University West Lafayette (US)
- University of Illinois Urbana-Champaign (US)
- École Polytechnique Fédérale de Lausanne (CH)
- Rice University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2020-05
- Volume
- 37
- Issue
- 3
- Pages
- 123-135
- ISSN
- 1053-5888 (ISSN-L)
- 1558-0792
- OpenAlex
- W3023368031
- Cited by
- 113
- References
- 42
- Citations by year
- 2026: 7 · 2025: 21 · 2024: 17 · 2023: 15 · 2022: 22 · 2021: 26 · 2020: 4
- FWCI
- 6.58
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- NSF (NSF-CRII-1755829)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Keywords
- reinforcement learning, multi-agent reinforcement learning, cooperative agents, optimization, deep reinforcement learning, multi-robot systems, traffic management, smart grid, network management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Optimization for Reinforcement Learning: From a single agent to cooperative agents. https://app.cochat.ai/papers/10.1109/msp.2020.2976000
- The paper
- Lee, D., He, N., Kamalaruban, P., & Cevher, V. (2020). Optimization for Reinforcement Learning: From a single agent to cooperative agents. IEEE Signal Processing Magazine. https://doi.org/10.1109/msp.2020.2976000
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.