The DOI matches its DataCite record; 31 of the 33 references it cites were found in a registry or an index.
Memory-based control with recurrent neural networks
Open accessAbstract
Partially observed control problems are a challenging aspect of reinforcement learning. We extend two related, model-free algorithms for continuous control -- deterministic policy gradient and stochastic value gradient -- to solve partially observed domains using recurrent neural networks trained with backpropagation through time. We demonstrate that this approach, coupled with long-short term memory is able to solve a variety of physical control problems exhibiting an assortment of memory requirements. These include the short-term integration of information from noisy sensors and the identification of system parameters, as well as long-term memory problems that require preserving information over many time steps. We also demonstrate success on a combined exploration and memory problem in the form of a simplified version of the well-known Morris water maze task. Finally, we show that our approach can deal with high-dimensional observations by learning directly from pixels. We find that recurrent deterministic and stochastic policies are able to learn similarly good solutions to these tasks, including the water maze where the agent must learn effective search strategies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This solution allows to avoid the RG in the rst place, by training a simulator with few real interactions and using it for the trial and error procedure.”
From Crossing the Reality Gap: A Survey on Sim-to-Real Transferability of Robot Controllers in Reinforcement Learning (2021) · cites this paper as [118]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Self-citationAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Self-citationThrun, S. (2002) · CACM · doi:10.1145/504729.504754 · Cited by 7,941
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Cited by
Sorted by citations
Items 101–200 of 251
Zhan, Y., Zhang, J., Li, P., & Xia, Y. (2019) · IEEE Network · doi:10.1109/mnet.001.1800498 · Cited by 21
Lu, C.-L., Huang, J.-T., Huang, C.-I., Liu, Z.-Y., Hsu, C.-C., Huang, Y.-Y., Huang, S.-C., Chang, P.-K., Ewe, Z. L., Huang, P.-J., et al. (2022) · Field Robotics · doi:10.55417/fr.2022020 · Cited by 21
Olfactory search with finite-state controllers
Verano, K. V. B., Panizon, E., & Celani, A. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2304230120 · Cited by 21
AdaptNet: Policy Adaptation for Physics-Based Character Control
Xu, P., Xie, K., Andrews, S., Kry, P. G., Neff, M., McGuire, M., Karamouzas, I., & Zordan, V. B. (2023) · ACM Transactions on Graphics · doi:10.1145/3618375 · Cited by 21
Jiang, K., Jiang, Z., Jiang, X., Xie, Y., & Gui, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3340741 · Cited by 22
Han, D., Doya, K., & Tani, J. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.06.002 · Cited by 21
SafeCritic: Collision-Aware Trajectory PredictionPreprint
van der Heiden, T., Nagaraja, N. S., Weiss, C., & Gavves, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06673 · Cited by 20
Hao, Y., Li, F., Zhao, C., & Yang, S. (2022) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2022.3194953 · Cited by 19
Sensorless Speed Control of Ultrasonic Motors Using Deep Reinforcement Learning
Mustafa, A., Sasamura, T., & Morita, T. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3340872 · Cited by 18
Local motion simulation using deep reinforcement learning
Xu, D., Huang, X., Li, Z., & Li, X. (2020) · Transactions in GIS · doi:10.1111/tgis.12620 · Cited by 18
Zhang, S., Wen, L., Peng, H., & Tseng, H. E. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564972 · Cited by 18
Iiyama, K., Tomita, K., Jagatia, B., Nakagawa, T., & Ho, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12432 · Cited by 18
Xue, Y., & Chen, W. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3330703 · Cited by 18
Self-optimizing adaptive optics control with reinforcement learning
Landman, R., Haffert, S. Y., Radhakrishnan, V. M., & Keller, C. U. (2020) · Adaptive Optics Systems VIII · doi:10.1117/12.2560053 · Cited by 18
Recurrent Off-policy Baselines for Memory-based Continuous Control
Yang, Z., & Nguyen, H. (2021) · arXiv · doi:10.48550/arxiv.2110.12628 · Cited by 17
Qin, J., Zhu, M., Pan, Z., Li, Y., & Li, Y. (2023) · IET Radar Sonar & Navigation · doi:10.1049/rsn2.12469 · Cited by 16
Multi-User Delay-Constrained Scheduling With Deep Recurrent Reinforcement Learning
Hu, P., Chen, Y., Pan, L., Fang, Z., Xiao, F., & Huang, L. (2024) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2024.3359911 · Cited by 16
Nguyen, Q. D., Vien, N. A., Dang, V.-H., & Chung, T. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01748-7 · Cited by 16
Fast Real-Time Reinforcement Learning for Partially-Observable Large-Scale Systems
Sadamoto, T., & Chakrabortty, A. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3058228 · Cited by 16
Hebecker, M., Lambrecht, J., & Schmitz, M. (2021) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim46487.2021.9517356 · Cited by 17
Deep Reinforcement Learning for Motion Planning of Mobile RobotsPreprint
Butyrev, L., Edelhäußer, T., & Mutschler, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09260 · Cited by 16
Model-Free Recurrent Reinforcement Learning for AUV Horizontal Control
Huo, Y., Li, Y., & Feng, X. (2018) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/428/1/012063 · Cited by 15
Hou, J., Chen, M., Geng, H., Li, R., & Lu, J. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.11.025 · Cited by 15
A Learning Approach to Robot-Agnostic Force-Guided High Precision Assembly
Luo, J., & Li, H. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636328 · Cited by 17
AlMahamid, F., & Grolinger, K. (2024) · Drones · doi:10.3390/drones8050173 · Cited by 14
Adaptive partial scanning transmission electron microscopy with reinforcement learning
Ede, J. M. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abf5b6 · Cited by 19
SnapNav: Learning Mapless Visual Navigation with Sparse Directional Guidance and Visual Reference
Xie, L., Markham, A., & Trigoni, N. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197523 · Cited by 14
Benchmark study of reinforcement learning in controlling and optimizing batch processes
Zhu, W., Castillo, I., Wang, Z., Rendall, R., Chiang, L. H., Hayot, P., & Romagnoli, J. A. (2022) · Journal of Advanced Manufacturing and Processing · doi:10.1002/amp2.10113 · Cited by 13
Nonparametric General Reinforcement LearningPreprint
Leike, J. (2016) · arXiv (Cornell University) · doi:10.25911/5d76346c2e2be · Cited by 13
Target-Based Temporal Difference LearningPreprint
Lee, D., & He, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10945 · Cited by 13
Ye, C., Ma, H., Zhang, X., Zhang, K., & You, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71589-6_36 · Cited by 12
Kumar, A., Buckley, T., Lanier, J. B., Wang, Q., Kavelaars, A. T., & Kuzovkin, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08639 · Cited by 16
Variational Quantum Circuit-Based Reinforcement Learning for POMDP and Experimental Implementation
Kimura, T., Shiba, K., Chen, C.-C., Sogabe, M., Sakamoto, K., & Sogabe, T. (2021) · Mathematical Problems in Engineering · doi:10.1155/2021/3511029 · Cited by 11
Non-linear Intelligent Control Design for Unconventional Unmanned Aerial Vehicle
Din, A. F. U., Mir, I., Gul, F., & Mir, S. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-1071 · Cited by 11
Kume, A., Matsumoto, E., Takahashi, K., Ko, W., & Tan, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06117 · Cited by 11
MELD: Meta-Reinforcement Learning from Images via Latent State ModelsPreprint
Zhao, T. Z., Nagabandi, A., Rakelly, K., Finn, C., & Levine, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13957 · Cited by 11
Formal Methods for Autonomous Systems
Wongpiromsarn, T., Ghasemi, M., Cubuktepe, M., Bakirtzis, G., Carr, S., Karabag, M. O., Neary, C., Gohari, P., & Topcu, U. (2023) · Foundations and Trends® in Systems and Control · doi:10.1561/2600000029 · Cited by 17
Two-step dynamic obstacle avoidance
Hart, F., Waltz, M., & Okhrin, O. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112402 · Cited by 10
Learning a Belief Representation for Delayed Reinforcement Learning
Liotet, P., Venneri, E., & Restelli, M. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534358 · Cited by 11
Interpretable, Verifiable, and Robust Reinforcement Learning via Program Synthesis
Bastani, O., Inala, J. P., & Solar-Lezama, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_11 · Cited by 11
Li, J., Cai, M., Kan, Z., & Xiao, S. (2024) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-024-09641-0 · Cited by 13
Wei, X., Huang, X., Yang, L., Cao, G., Tao, Z., Wang, B., & An, J. (2022) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-212795 · Cited by 10
RetractedDynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated MicrogridsPreprint
Lei, L., Tan, Y., Dahlenburg, G., Xiang, W., & Zheng, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02581 · Cited by 10
Reinforcement Learning in Quantitative Trading: A SurveyPreprint
Alameer, A., Saleh, H., & Alshehri, K. A. (2022) · doi:10.36227/techrxiv.19303853 · Cited by 10
Effective multi-user delay-constrained scheduling with deep recurrent reinforcement learning
Hu, P., Pan, L., Chen, Y., Fang, Z., & Huang, L. (2022) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3492866.3549712 · Cited by 9
Control of A Polyol Process Using Reinforcement Learning
Zhu, W., Rendall, R., Castillo, I., Wang, Z., Chiang, L. H., Hayot, P., & Romagnoli, J. A. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.08.291 · Cited by 9
Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process
Yoon, H., Lee, D., & Hovakimyan, N. (2019) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2019.8814849 · Cited by 9
Motion Planning and Control with Randomized Payloads Using Deep Reinforcement Learning
Demir, A., & Sezer, V. (2019) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00014 · Cited by 9
A Stackelberg Game-Based Trajectory Planning Strategy for Multi-AAVs-Assisted MEC System
Shi, B., & Chen, Z. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3539671 · Cited by 8
Data-Efficient MADDPG Based on Self-Attention for IoT Energy Management Systems
Al-Saffar, M., & Gül, M. (2023) · IEEE Access · doi:10.1109/access.2023.3322193 · Cited by 8
Final Iteration Convergence Bound of Q-Learning: Switching System Approach
Lee, D. (2024) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2024.3355326 · Cited by 8
Actor-critic versus direct policy search: a comparison based on sample complexityPreprint
de Broissia, A. D. F., & Sigaud, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.09152 · Cited by 8
Tan, X., Li, H., Xie, X., Guo, L., Ansari, N., Huang, X., Wang, L., Xu, Z., & Liu, Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3429571 · Cited by 7
Malekzadeh, P., & Plataniotis, K. N. (2024) · Neural Computation · doi:10.1162/neco_a_01698 · Cited by 9
Reentry trajectory optimization based on Deep Reinforcement Learning
Gao, J., Shi, X., Cheng, Z., Xiong, J., Liu, L., Wang, Y., & Yang, Y. (2019) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2019.8832559 · Cited by 7
Actor-Critic Reinforcement Learning for Linear Longitudinal Output Control of a Road Vehicle
Puccetti, L., Rathgeber, C., & Hohmann, S. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917113 · Cited by 7
Crowdfunding Dynamics Tracking: A Reinforcement Learning Approach
Wang, J., Zhang, H., Liu, Q., Pan, Z. K., & Tao, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6087 · Cited by 7
Luo, Z., & Miao, C. (2022) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3488560.3498438 · Cited by 7
Overview of Recent Advancements in Deep Learning and Artificial Intelligence
Narayanan, V., Cao, Y. K., Panda, P., Challapalle, N. R., Du, X., Kim, Y., Krishnan, G., V, Lee, C., Li, Y., Sun, J., et al. (2023) · Wiley eBooks · doi:10.1002/9781119853923.ch2 · Cited by 7
Deep Reinforcement Learning for Quantitative Trading
Xu, M., Lan, Z.-X., Tao, Z., Du, J.-W., & Ye, Z. (2023) · 2024 4th International Conference on Electronics, Circuits and Information Engineering (ECIE) · doi:10.1109/ecie61885.2024.10626209 · Cited by 27
Adaptive Quality Control for discrete large-scale Manufacturing Systems subjected to Disturbances
Lindemann, B., Jazdi, N., & Weyrich, M. (2020) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa46521.2020.9212176 · Cited by 7
Learning to Communicate: A Machine Learning Framework for Heterogeneous Multi-Agent Robotic Systems
Yoon, H., Chen, H., Long, K., Zhang, H., Gahlawat, A., Lee, D., & Hovakimyan, N. (2019) · AIAA SciTech Forum · doi:10.2514/6.2019-1456 · Cited by 6
Self-programming Robots Boosted by Neural Agents
Chang, O. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05587-5_42 · Cited by 6
Ikemoto, J., & Ushio, T. (2020) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.11.480 · Cited by 6
Neural Network Memory Architectures for Autonomous Robot NavigationPreprint
Chen, S. W., Atanasov, N., Khan, A., Karydis, K., Lee, D. D., & Kumar, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08049 · Cited by 9
Reinforcement Learning in Quantitative Trading: A SurveyPreprint
Alameer, A., Saleh, H., & Alshehri, K. A. (2022) · doi:10.36227/techrxiv.19303853.v1 · Cited by 6
Jing, S., Yao, F., Hui, F., Liu, J., Zhao, X., & Khattak, A. J. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3564607 · Cited by 5
MDRL-IR: Incentive Routing for Blockchain Scalability With Memory-Based Deep Reinforcement Learning
Tang, B., Liang, J., Cai, Z., Cai, T., Zhou, X., & Chen, Y. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3323647 · Cited by 6
Reservoir controllers design though robot-reservoir timescale alignment
Ye, F., Abdulali, A., Chu, K.-F., Zhang, X.-P. S., & Fumiya Iida, A. (2025) · Communications Engineering · doi:10.1038/s44172-025-00418-1 · Cited by 5
Communication Emitter Motion Behavior’s Cognition Based on Deep Reinforcement Learning
Ji, Y., Wang, J., Wu, W., Wang, L., Peng, C., & Shao, H. (2020) · IEEE Access · doi:10.1109/access.2020.3047845 · Cited by 5
RL-PGO: Reinforcement Learning-Based Planar Pose-Graph Optimization
Kourtzanidis, N., & Sajad Saeedi, G. (2023) · IEEE Control Systems Letters · doi:10.1109/lcsys.2023.3340619 · Cited by 5
Castaño-Candamil, S., Vaihinger, M., & Tangermann, M. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857533 · Cited by 5
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Luo, Z., Zhao, L., Cheng, W., Chen, S., Chen, Q., Xue, H., Wang, H., Liu, C., Yang, M., & Zhang, L. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449862 · Cited by 5
Addressing partial observability in reinforcement learning for energy management
Biemann, M., Liu, X., Zeng, Y., & Huang, L. (2021) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3486611.3488730 · Cited by 5
Imitating Driver Behavior with Generative Adversarial NetworksPreprint
Kuefler, A., Morton, J., Wheeler, T. A., & Kochenderfer, M. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.06699 · Cited by 5
Wu, D., Shi, Z., Zhang, Y., & Huang, M. (2024) · Journal of Aerospace Engineering · doi:10.1061/jaeeez.aseng-5265 · Cited by 4
Continuous Control With a Combination of Supervised and Reinforcement Learning
Kangin, D., & Pugeault, N. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489702 · Cited by 4
Decoupling Meta-Reinforcement Learning with Gaussian Task Contexts and Skills
He, H., Zhu, A., Liang, S., Chen, F., & Shao, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29127 · Cited by 4
Learning to Navigate in Human Environments via Deep Reinforcement Learning
Gao, X., Sun, S., Zhao, X., & Tan, M. H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-36708-4_34 · Cited by 4
Learning Adaptive Driving Behavior Using Recurrent Deterministic Policy Gradients
Mani, K., Kaushik, M., Singhania, N., & Krishna, K. M. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961480 · Cited by 4
CSLM: Convertible Short-Term and Long-Term Memory in Differential Neural Computers
Xiang, S., & Tang, B. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3016632 · Cited by 4
Adaptability Preserving Domain Decomposition for Stabilizing Sim2Real Reinforcement Learning
Gao, H., Yang, Z., Su, X. B., Tan, T., & Chen, F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341124 · Cited by 4
Viewpoint Optimization for Autonomous Strawberry Harvesting with Deep Reinforcement Learning
Sather, J. J. (2019) · doi:10.15368/theses.2019.63 · Cited by 4
Advances in Electron Microscopy with Deep Learning
Ede, J. M. (2020) · Warwick Research Archive Portal (University of Warwick) · doi:10.48550/arxiv.2101.01178 · Cited by 4
Wang, X., Chen, J., & Qiao, H. (2024) · Robotic Intelligence and Automation · doi:10.1108/ria-11-2023-0172 · Cited by 3
Recurrent neural networks with transient trajectory explain working memory encoding mechanisms
Liu, C., Jia, S., Liu, H., Zhao, X., Li, C., Xu, B., & Zhang, T. (2025) · Communications Biology · doi:10.1038/s42003-024-07282-3 · Cited by 4
AoI Optimal Dynamic Power Control for IoT networks: A DRDPG Approach
Chi, K., Wu, M., Chen, Y., & Xu, C. (2021) · IEEE International Conference on Electronic Information and Communication Technology (ICEICT) · doi:10.1109/iceict53123.2021.9531149 · Cited by 3
Trajectory tracking control of wheeled mobile robot based on improved LSTM-DDPG algorithm
Gou, W., & Liu, Y. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2303/1/012069 · Cited by 3
Automatic Collision Avoidance via Deep Reinforcement Learning for Mobile Robot
Yang, Y., Xie, C., Hou, Z., & Chen, H. (2022) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus55513.2022.9986833 · Cited by 3
Memory-Based Reinforcement Learning for Trans-Domain Tiltrotor Robot Control
Huo, Y., Li, Y., & Feng, X. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1510/1/012011 · Cited by 3
Latent Context Based Soft Actor-Critic
Pu, Y., Wang, S., Yao, X., & Li, B. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207008 · Cited by 3
Asymmetric Actor-Critic with Approximate Information State
Sinha, A. K., & Mahajan, A. (2023) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc49753.2023.10383636 · Cited by 3
Deep Reinforcement Learning Methods for Navigational Aids
Fakhri, B., Keech, A., Schlosser, J., Brooks, E., Venkateswara, H., Panchanathan, S., & Kira, Z. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04375-9_6 · Cited by 3
Synthesized Prioritized Data Pruning based Deep Deterministic Policy Gradient Algorithm Improvement
Xiang, H. Y., Cheng, J. S., Zhang, Q., & Liu, J. (2018) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2018.8812510 · Cited by 3
Synthesizing Control for a System with Black Box Environment, Based on Deep Learning
Iosti, S., Peled, D., Aharon, K., Bensalem, S., & Goldberg, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61470-6_27 · Cited by 3
Hierarchical Reinforcement Learning Under Mixed Observability
Nguyen, V., Yang, Z., Baisero, A., Ma, X., Platt, R., & Amato, C. (2022) · Springer proceedings in advanced robotics · doi:10.1007/978-3-031-21090-7_12 · Cited by 4
Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D SokobanPreprint
Karkus, P., Mirza, M., Guez, A., Jaegle, A., Lillicrap, T., Buesing, L., Heess, N., & Weber, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01298 · Cited by 6
Self-citationAnalysis of a Target-Based Actor-Critic Algorithm with Linear Function ApproximationPreprint
Barakat, A., Bianchi, P., & Lehmann, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07472 · Cited by 3
Observer-Feedback-Feedforward Controller Structures in Reinforcement Learning
Zhang, R., Mattson, P., & Wigren, T. (2023) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2023.10.765 · Cited by 2
Hierarchical RNNs with graph policy and attention for drone swarm
Wei, X., Cui, W., Huang, X., Yang, L., Geng, X., Tao, Z., & Zhai, Y. (2024) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwae031 · Cited by 2
Metadata
- Authors
- Heess, N., Hunt, J. J., Lillicrap, T. P., & Silver, D.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1512.04455
- OpenAlex
- W2291973609
- Cited by
- 211
- References
- 33
- Citations by year
- 2025: 8 · 2024: 18 · 2023: 28 · 2022: 16 · 2021: 48 · 2020: 39 · 2019: 23 · 2018: 15 · 2017: 12 · 2016: 3 · 2015: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- memory-based control, recurrent neural networks, deterministic policy gradient, long short-term memory, backpropagation through time, continuous control, physical control, system parameter identification, Morris water maze, high-dimensional observations, exploration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review