Memory-based control with recurrent neural networks

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155

Long Short-Term Memory

Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

Human-level control through deep reinforcement learning

Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357

Auto-Encoding Variational Bayes

Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067

Continuous control with deep reinforcement learning

Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782

Probabilistic robotics

Thrun, S. (2002) · CACM · doi:10.1145/504729.504754 · Cited by 7,941

MuJoCo: A physics engine for model-based control

Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767

Trust region policy optimization

Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578

CNN Features Off-the-Shelf: An Astounding Baseline for Recognition

Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451

Addressing the Task of Rocket Recycling with Deep Reinforcement Learning

Jin, G., Huang, J., Feng, Y., Cheng, G., Liu, Z., & Wang, Q. (2018) · International Conference on Information Technology: IoT and Smart City (ICIT) · doi:10.1145/3301551.3301552 · Cited by 2

Low-level controller in response to changes in quadrotor dynamics

Cho, J., Kim, C., Jaffar, M. K. M., Otte, M., & Kim, S.-W. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160987 · Cited by 2

Control of Deep Drawing Process Based on Integration of Deep Reinforcement Learning and Finite Element Method

Guo, P., Zhang, X., & Yu, J. (2020) · Journal of Mechanical Engineering · doi:10.3901/jme.2020.20.047 · Cited by 2

Qoe-guaranteed distributed offloading decision via partially observable deep reinforcement learning for edge-enabled Internet of Things

Hou, J., Wu, Y., Cai, J., & Zhou, Z. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08905-2 · Cited by 2

Analysis of Off-Policy Multi-Step TD-Learning with Linear Function Approximation

Lee, D. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10886545 · Cited by 2

Design of an iterative learning control with a selective learning strategy for swinging up a pendulum

Beuchert, J., Raischl, J., & Seel, T. (2018) · European Control Conference (ECC) · doi:10.23919/ecc.2018.8550250 · Cited by 2

Deep Reinforcement Learning with semi-expert distillation for autonomous UAV cinematography

Sochopoulos, A., Mademlis, I., Charalampakis, E., Papadopoulos, S., & Pitas, I. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00230 · Cited by 2

Learning Computational Efficient Bots with Costly Features

Kobanda, A., Valliappan, C. A., Romoff, J., & Denoyer, L. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333201 · Cited by 2

Rover Descent: Learning to Optimize by Learning to Navigate on Prototypical Loss Surfaces

Faury, L., & Vasile, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05348-2_24 · Cited by 2

A Q-learning-based network content caching method

Chen, H., & Tan, G. (2018) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-018-1268-1 · Cited by 2

Learning to Actively Reduce Memory Requirements for Robot Control TasksPreprint

Booker, M., & Majumdar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07451 · Cited by 2

Context-Based Soft Actor Critic for Environments with Non-stationary DynamicsPreprint

Pu, Y., Wang, S., Yao, X., & Li, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03310 · Cited by 2

Robotic Odor Source Localization via End-to-End Recurrent Deep Reinforcement Learning

Wang, L., & Pang, S. (2023) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc59093.2023.00014 · Cited by 1

Deep Reinforcement Learning-Based Lane-Changing Trajectory Planning for Connected and Automated Vehicles

Liu, J., Yao, F., Jing, S., & Hui, F. (2023) · International Conference on Mechanical and Electronics Engineering · doi:10.1109/icmee59781.2023.10525509 · Cited by 1

Improving recurrent deterministic policy gradient strategy in autonomous driving

Ooi, Y.-M., & Chang, C.-C. (2025) · Soft Computing · doi:10.1007/s00500-025-10442-0 · Cited by 1

Modular transfer learning with transition mismatch compensation for excessive disturbance rejection

Wang, T., Lu, W., Yu, H., & Liu, D. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01641-4 · Cited by 1

Domains as objectives: Domain-uncertainty-aware policy optimization through explicit multi-domain convex coverage set learning

Ilboudo, W. E. L., Kobayashi, T., & Matsubara, T. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649251358844 · Cited by 1

Contextual inference through flexible integration of environmental features and behavioural outcomes

Passlack, J., & MacAskill, A. F. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014093 · Cited by 1

Capturing Temporal Information with LSTM to Stabilize A Rotating Machine

Wei, Y., Weiming, Q., Zhang, T., Deng, Y., Hu, F., Xiangqi, Z., Liu, T., Bolchover, P., Yu, T., Zheng, G., et al. (2022) · 2022 3rd International Conference on Computer Vision, Image and Deep Learning & International Conference on Computer Engineering and Applications (CVIDL & ICCEA) · doi:10.1109/cvidliccea56201.2022.9825467 · Cited by 1

Adaptive action-prediction cortical learning algorithm under uncertain environments

Fujino, K., Aoki, T., Takadama, K., & Satō, H. (2023) · International Journal of Hybrid Intelligent Systems · doi:10.3233/his-230013 · Cited by 1

Multi-Agent Recurrent Deterministic Policy Gradient with Inter-Agent Communication

Cho, J., Liu, M., Zhou, Y., & Chen, R. (2023) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf59524.2023.10477063 · Cited by 1

Communication-Free Two-Stage Multi-Agent DDPG under Partial States and Observations

Cho, J., Liu, M., Zhou, Y., & Chen, R. (2021) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf53345.2021.9723197 · Cited by 1

Adaptive Synapse Adjustment and Decoding in Action-Prediction Cortical Learning Algorithm

Fujino, K., Aoki, T., Takadama, K., & Satō, H. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-27524-1_79 · Cited by 1

An Autonomous Vehicle-Following Technique for Self-Driving Cars Based on the Semantic Segmentation Technique

Tsai, J., Chang, Y.-T., Chuang, P.-H., & You, Z. (2023) · IEEE International Symposium on Robotic and Sensors Environments · doi:10.1109/rose60297.2023.10410810 · Cited by 2

Comparison of Modern Controls and Reinforcement Learning for Robust Control of Autonomously Backing Up Tractor-Trailers to Loading Docks

McDowell, J. (2019) · doi:10.15368/theses.2019.117 · Cited by 1

Implementing Inductive bias for different navigation tasks through diverse RNN attractorsPreprint

Xu, T. J., & Barak, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02496 · Cited by 1

Exploration of reinforcement learning algorithms for autonomous vehicle visual perception and control

Carton, F. (2021) · theses.fr (ABES) · doi:10.70675/9aa0cab2z7ec4z456az9f57z1c8be2733b1b · Cited by 1

Neuro-symbolic deep reinforcement learning for safe urban driving using low-cost sensors.

Albilani, M. (2024) · theses.fr (ABES) · doi:10.70675/ea6f5d11z7d78z4484zb809z38299a88535e · Cited by 1

An Intrinsically Motivated Robot Explores Non-reward Environments with Output Arbitration

Seno, T., Osawa, M., & Imai, M. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-99316-4_37

Implementing Inductive bias for different navigation tasks through diverse RNN attrractors

Xu, T. J., & Barak, O. (2020) · International Conference on Learning Representations

Tricks of Implementation

Ding, Z., & Dong, H. (2020) · Springer eBooks · doi:10.1007/978-981-15-4095-0_18

Learning Memory-Dependent Continuous Control from DemonstrationsPreprint

Hou, S., Han, D., & Tani, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.09208

Simulation Studies on Deep Reinforcement Learning for Building Control with Human InteractionPreprint

Lee, D.-H., He, N., Lee, S., Karava, P., & Hu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07919

Robust Reinforcement Learning under model misspecificationPreprint

Yu, L., Wang, J., & Zhang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.15370

Reinforcement Learning using Guided ObservabilityPreprint

Weigand, S., Klink, P., Peters, J., & Pajarinen, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10986

Artificial Conversational Agent using Robust Adversarial Reinforcement Learning

Wadekar, I. (2021) · International Conference on Computer Communication and Informatics (ICCCI) · doi:10.1109/iccci50826.2021.9402336

Reinforcement learning in partially observable environments using approximate information state

Sinha, A. K. (2021) · doi:10.82308/10764

Generating an optimal control policy via apprenticeship and reinforcement learning

Mowbray, M., Smith, R., Chanona, A. D. R., & Zhang, D. (2021) · Computer-aided chemical engineering/Computer aided chemical engineering · doi:10.1016/b978-0-323-88506-5.50187-x

Graph Convolutional Memory using Topological PriorsPreprint

Morad, S., Liwicki, S., Kortvelesy, R., Mecca, R., & Prorok, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14117 · Cited by 1

Inducing Functions through Reinforcement Learning without Task SpecificationPreprint

Cho, J., Lee, D., & Yoon, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11647

Instructions with Complex Control-Flow Entailing Machine Learning

Shinde, S., & Bali, H. S. (2022) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd54884.2022.10051797

Neurosymbolic Integration of Linear Temporal Logic in Non Symbolic Domains

Umili, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43264-4_41

Joint Recurrent Actor-Critic Model for Partially Observable Control

Xu, H., Yang, J. J., & Liang, B. (2023) · International Conference on Automation and Computing (ICAC) · doi:10.1109/icac57885.2023.10275190

A model-free method based on RDPG for fiber diameter steady control

Cao, Y., Zhang, J., Qian, Y., Wang, Y., Lang, Y., & Wang, H. (2024) · Optical Fiber Technology · doi:10.1016/j.yofte.2024.103680

Study on LSTM and ConvLSTM Memory-Based Deep Reinforcement Learning

Duarte, F. F., Lau, N., Pereira, A., & Reis, L. P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-55326-4_11

Cultivating Expertise in Deep and Reinforcement Learning Principles

Malathi, C., & Sheela, J. (2024) · Wiley eBooks · doi:10.1002/9781394272587.ch8

A Communication Aware AAV Trajectory Optimization Scheme in Source Access Unstable Environments

Zhang, H., Wu, G., Fang, M., Han, W., & Qu, Y. (2025) · doi:10.1145/3737904.3768529

Quantitative Finance with RDDPG: A Recurrent Reinforcement Learning Method for Stock Trading Automation

Annapoorna, A. K., Krishna, M. S., Sayanthika, K. R., Nambiar, A. R. K., Alex, A., & Udayan, J. D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-5754-4_35

Towards the Vision-Sound-Language-Action paradigm: The HEAR framework for sound-centric manipulation

Nie, C., Deng, T., Wang, G., Liu, Z., & Wang, H. (2026) · The International Journal of Robotics Research · doi:10.1177/02783649261477778 · Cited by 1

Beyond correlation: a survey on causal inference for dynamics-aware perception and introspective decision-making in robotics

Cai, Y.-L., Zhang, X., Liu, S.-R., Lou, J., & Yuan, C.-H. (2026) · Nonlinear dynamics · doi:10.1007/s11071-026-12695-2

To Share or Not to Share: Justifying Shared Extractors in Recurrent Actor-Critic for POMDPs

Calado, L., & Lago-Fernández, L. F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38404-1_2

Does Learning Recurrent Networks Matter in Partially Observable RL?Preprint

Wang, Z., He, Z., & Jin, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13197

Solving partially observable reinforcement learning problems with recurrent neural networks

Schäfer, A. M., Udluft, S., & Computation, D. N. (2005)

The Recurrent Control Neural Network

Schaefer, A. M., Udluft, S., & Zimmermann, H.-G. (2008)

Recurrent policy gradients

Wierstra, D., Förster, A., Peters, J., & Schmidhuber, J. (2009) · Logic Journal of IGPL · doi:10.1093/jigpal/jzp049 · Cited by 115

Solving Deep Memory POMDPs with Recurrent Policy Gradients

Wierstra, D., Foerster, A., Peters, J., & Schmidhuber, J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74690-4_71 · Cited by 141