The DOI matches its Crossref record; 40 of the 44 references it cites were found in a registry or an index.
Overcoming Exploration in Reinforcement Learning with Demonstrations
Open accessAbstract
Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal performance. However, finding a non-zero reward is exponentially more difficult with increasing task horizon or action dimensionality. This puts many real-world tasks out of practical reach of RL methods. In this work, we use demonstrations to overcome the exploration problem and successfully learn to perform long-horizon, multi-step robotics tasks with continuous control such as stacking blocks with a robot arm. Our method, which builds on top of Deep Deterministic Policy Gradients and Hindsight Experience Replay, provides an order of magnitude of speedup over RL on simulated robotics tasks. It is simple to implement and makes only the additional assumption that we can collect a small set of demonstrations. Furthermore, our method is able to solve tasks not solvable by either RL or behavior cloning alone, and often ends up outperforming the demonstrator policy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Demonstration learning (DemoL) algorithms often used in robotics applications are DQfD [218], DDPGfD [219] and Q-filtered BC [220].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [220]
The cited source says what the claim attributes to it.
In the citing paper
“Building upon DDPG [124] and HER [182], Nair et al. (2018) [220] propose a method called Q-filtered Behaviour Cloning (QfBC) that also applies the BC loss to learn demonstration data to solve long-horizon, sparse-reward and goal-conditioned tasks.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [220]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Probabilistic roadmaps for path planning in high-dimensional configuration spaces
Kavraki, L. E., Svestka, P., Latombe, J.-C., & Overmars, M. H. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.508439 · Cited by 6,343 · cited 1×
“More recent work on task and motion planning considers both logical and physical aspects of the task [27], [28], [29], but requires domainspecific engineering.”
BackgroundMuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Self-citationEnd to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Flagged first, then by citations
4 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- hester, 2017, Learning from demonstrations for real world reinforcement learning
- ng, 2000, Algorithms for Inverse Reinforcement Learning, International Conference on Machine Learning (ICML)
- ziebart, 2008, Maximum Entropy Inverse Reinforcement Learning, AAAI Conference on Artificial Intelligence, 1433
Cited by
Sorted by citations
Items 501–600 of 710
TendencyRL: Multi-stage Discriminative Hints for Efficient Goal-Oriented Reverse Curriculum Learning
Wang, C., Ding, J., Chen, X.-Y., Ye, Z.-L., Wang, J.-L., Cai, Z.-R., & Lu, C.-W. (2019) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.1109/iros40897.2019.8968248 · Cited by 3
Transferring Domain Knowledge with an Adviser in Continuous Tasks
Wijesinghe, R., Vithanage, K., Tissera, D., Xavier, A., Fernando, S., & Samarawickrama, J. G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75768-7_16 · Cited by 2
Industrial Human-Robot Collaboration
Philipsen, M. P., Rehm, M., & Moeslund, T. B. (2018) · doi:10.21437/ai-mhri.2018-9 · Cited by 2
Supervised Reinforcement Learning via Value Function
Pan, Y., Zhang, J., Yuan, C., & Yang, H. (2019) · Symmetry · doi:10.3390/sym11040590 · Cited by 3
Highway Pilot Training from Demonstration
Pankiewicz, N., Turlej, W., Orłowski, M., & Wrona, T. (2021) · International Conference on Methods and Models in Automation and Robotics · doi:10.1109/mmar49549.2021.9528436 · Cited by 2
Offline reinforcement learning with anderson acceleration for robotic tasks
Zuo, G., Huang, S., Li, J., & Gong, D. (2022) · Applied Intelligence · doi:10.1007/s10489-021-02953-8 · Cited by 2
Multi-goal Reinforcement Learning via Exploring Successor Matching
Feng, X. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893637 · Cited by 2
Wu, Y., Wu, X., Qiu, S., & Xiang, W. (2022) · Electronics · doi:10.3390/electronics11213553 · Cited by 2
Guided Deep Reinforcement Learning based on RBF-ARX Pseudo LQR in Single Stage Inverted Pendulum
Peng, T., Peng, H., & Liu, F. (2022) · doi:10.1109/icisci53188.2022.9941450 · Cited by 2
Tutorial on Course-of-Action (COA) Attack Search Methods in Computer Networks
Son, S. B., Park, S., Lee, H., Kim, J., Jung, S., & Kim, D. H. (2022) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc55196.2022.9952533 · Cited by 2
Empowerment-driven Policy Gradient Learning with Counterfactual Augmentation in Recommender Systems
Chen, X., Yao, L., Chang, X., & Wang, S. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00102 · Cited by 2
Trajectory Generation for Space Manipulators Capturing Moving Targets Using Transfer Learning
Sze, H. Y., & Chhabra, R. (2023) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero55745.2023.10115862 · Cited by 2
Robotic Stacking of Irregular Objects with Load Position Identification and Compensation
Zhou, X., Zhao, G., Xing, Y., Wu, J., & Xiong, Z. (2023) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case56687.2023.10260654 · Cited by 2
Aiding reinforcement learning for set point control
Zhang, R., Mattsson, P., & Wigren, T. (2023) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2023.10.1220 · Cited by 2
Embedding expert demonstrations into clustering buffer for effective deep reinforcement learning
Wang, S., Zhao, B., Zhang, Z., Zhang, J., & Pu, J. (2023) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2300084 · Cited by 2
Guiding Offline Reinforcement Learning Using a Safety Expert
Verma, R., Kalwar, D., Khadilkar, H., & Ravindran, B. (2024) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3632410.3632423 · Cited by 2
Learning Complicated Manipulation Skills Via Deterministic Policy with Limited Demonstrations
Liu, H., Tan, J., Chen, Y., & Ang, M. H. (2023) · International Conference on Advanced Robotics (ICAR) · doi:10.1109/icar58858.2023.10406318 · Cited by 3
Reinforcement Learning-Based Skill Acquisition Study for Linearly Heated Robots
Zhang, Z., Ikeura, R., Hayakawa, S., & Wang, Z. (2024) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma61710.2024.10633084 · Cited by 2
Adaptive algorithms for shaping behavior
Tong, W. L., Iyer, A., Murthy, V. N., & Reddy, G. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013454 · Cited by 2
A Comparative Study of Model-Free Reinforcement Learning Approaches
Moudgalya, A., Shafi, A., & Arun, B. A. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-3383-9_50 · Cited by 2
Reinforcement Learning with Converging Goal Space and Binary Reward Function
Ro, W., Jeon, W., Bamshad, H., & Yang, H. (2020) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case48305.2020.9249227 · Cited by 2
Augmenting Policy Learning with Routines Discovered from a Single Demonstration
Zhao, Z., Gan, C., Wu, J., Guo, X., & Tenenbaum, J. B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17316 · Cited by 2
Sharma, M. K., Hui, T. P., Kurniawan, E., & Sumei, S. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473857 · Cited by 2
Pretrain Soft Q-Learning with Imperfect DemonstrationsPreprint
Zhang, X., Li, Y., Ma, H., & Luo, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03501 · Cited by 3
Evolutionary Selective Imitation: Interpretable Agents by Imitation Learning Without a DemonstratorPreprint
Eliya, R., & Herrmann, J. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.08403 · Cited by 2
Wu, J., Huang, Z., Huang, W., & Lv, C. (2021) · arXiv (Cornell University) · Cited by 2
Improving Learning from Demonstrations by Learning from ExperiencePreprint
Liu, H., Chen, Y., Tan, J., & Ang, M. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08156 · Cited by 3
On Simple Reactive Neural Networks for Behaviour-Based Reinforcement Learning
Pore, A., & Aragón-Camarasa, G. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197262 · Cited by 15
Accelerating Reinforcement Learning with Suboptimal Guidance
Bøhn, E., Moe, S., & Johansen, T. A. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.2278 · Cited by 2
Alrakh, H., Fahmi, M., & Mohd, R. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0111117 · Cited by 1
Trajectory-based Split Hindsight Reverse Curriculum Learning
Wu, J., Zhang, D., Zhong, S., & Qiao, H. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636842 · Cited by 1
Visual Object Manipulation Based on Exploration Guided by Demonstration
Kim, D.-J., Jo, H., & Song, J.-B. (2022) · The Journal of Korea Robotics Society · doi:10.7746/jkros.2022.17.1.040 · Cited by 1
Learning Deposition Policies for Fused Multi-Material 3D Printing
Liao, K., Tricard, T., Piovarči, M., Seidel, H., & Babaei, V. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160465 · Cited by 2
Ganesh, P., Ramos, J. H., Goecks, V. G., Paquet, J., Longmire, M. A., Waytowich, N. R., & Brink, K. (2023) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2023.10.774 · Cited by 1
Exploring demonstration pre-training with improved Deep Q-learning
Pettersson, M., Westphal, F., & Riveiro, M. (2024) · Linköping electronic conference proceedings · doi:10.3384/ecp208008 · Cited by 1
Deep Reinforcement Learning for Autonomous Driving with Multiple Expert Demonstrations
Wang, C., Li, M., Zhang, M., & Zhang, M. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227385 · Cited by 1
Brain-in-the-Loop Learning for Intelligent Vehicle Decision-Making
Zhang, X., Zheng, H., Li, J., Huang, C. H., & Wang, H. (2026) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3641715 · Cited by 1
Wan, L., Fang, H., Yang, X., Sun, D., Niu, H., Lei, C., & Hao, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-12385-5_6 · Cited by 1
Collaborative Assembly Policy Learning of a Sightless Robot
Zhang, Z., Lu, W., Yang, L., Jing, W. P., Tang, B., & Pan, J. (2025) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio66223.2025.11377489 · Cited by 1
Self Punishment and Reward Backfill for Deep Q-Learning
Bonyadi, M. R., Wang, R., & Ziaei, M. (2020) · PubMed · doi:10.48550/arxiv.2004.05002 · Cited by 1
WMat algorithm based on Q-Learning algorithm in taxi-v2 game
Esmaeily, F., & Keyvanpour, M. R. (2020) · International Conference on Smart Cities, Internet of Things and Applications (SCIoT) · doi:10.1109/sciot50840.2020.9250211 · Cited by 1
Stable Object Reorientation using Contact Plane Registration
Li, R., Esteves, C., Makadia, A., & Agrawal, P. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811655 · Cited by 1
Mo, Y.-W., Ho, C.-K., & King, C. (2022) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma54519.2022.9856243 · Cited by 1
Kobayashi, S., & Shibuya, T. (2022) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53654.2022.9945538 · Cited by 1
Hu-bot: promoting the cooperation between humans and mobile robots
Miras, K., Mocanu, D. C., & Eiben, A. E. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-08061-z · Cited by 1
Li, C., Wu, F., & Zhao, J. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-0617-8_18 · Cited by 1
Andrés, A., Zha, D., & Ser, J. D. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10371796 · Cited by 1
Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules
Natale, L. D., Svetozarevic, B., Heer, P., & Jones, C. N. (2023) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc49753.2023.10383956 · Cited by 1
Embodied Human Activity Recognition
Hu, S., Gong, Y., & Mori, G. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00632 · Cited by 1
Multi-Task Reinforcement Learning with Cost-based HTN Planning
Hu, Y., & Zhuo, H. H. (2024) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea62105.2024.10603549 · Cited by 2
Sze, T., & Chhabra, R. (2024) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc60939.2024.10644232 · Cited by 1
Reinforcement Learning Approaches In Open-Ended Environments
Hossain, Z., Ahmed, N., Jahan, S. N., Yoshi, A. M., & Rohan, A. (2024) · International Conference on Electrical, Control and Instrumentation Engineering (ICECIE) · doi:10.1109/icecie63774.2024.10815636 · Cited by 1
Demonstration and offset augmented meta reinforcement learning with sparse rewards
Li, H., Liang, J., Wang, X., Jiang, C., Li, L., & Zeng, D. D. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-01785-0 · Cited by 1
Padalkar, A., Stulp, F., Neumann, G. M., & Silvério, J. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3566599 · Cited by 1
Energy-Based Exploration for Reinforcement Learning of Underactuated Mechanical Systems
Taets, J., Lefebvre, T., Ostyn, F., & Crevecoeur, G. (2025) · IEEE Access · doi:10.1109/access.2025.3576394 · Cited by 1
Wu, M., & Cao, Y. (2025) · IEEE Control Systems Letters · doi:10.1109/lcsys.2025.3591199 · Cited by 1
de Carvalho, G. J. A., de Carvalho, J. A., Roesler, H., & Borges, H. R. (2025) · Caderno Pedagógico · doi:10.54033/cadpedv22n12-136 · Cited by 1
Goal-Conditioned End-to-End Visuomotor Control for Versatile Skill Primitives
Groth, O., Hung, C.-M., Vedaldi, A., & Posner, I. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560752 · Cited by 1
Khadilkar, H., & Paranjape, A. A. (2020) · Advances in e-business research series · doi:10.4018/978-1-7998-0108-5.ch007 · Cited by 1
A Guided Evaluation Method for Robot Dynamic Manipulation
Feng, C., Lan, X., Wan, L., Liang, Z., & Wang, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66645-3_14 · Cited by 1
Li, S., Li, M., Su, J., Chen, S., Yuan, Z., & Ye, Q. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3452008 · Cited by 1
Leveraging optimal control demonstrations in reinforcement learning for powered descent
Wilson, C., & Riccardi, A. (2021) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 1
A noncontact robot demonstration method with human supervision
Zhang, Q., Xie, Z., & Liu, Y. (2021) · Science China Technological Sciences · doi:10.1007/s11431-021-1886-1 · Cited by 1
Leveraging Expert Demonstrations in Robot Cooperation with Multi-Agent Reinforcement Learning
Zhang, Z., Li, Y., Rojas, J., & Guan, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89098-8_20 · Cited by 1
LEARNING FROM DEMONSTRATIONS WITH SACR2: SOFT ACTOR-CRITIC WITH REWARD RELABELING
Martín, J. B., Chekroun, R., & Moutarde, F. (2021) · HAL · Cited by 1
Shelke, O., Meisheri, H., & Khadilkar, H. (2022) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3493700.3493709 · Cited by 1
Zhang, J., & Wu, J. (2021) · International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip49856.2021.9665135 · Cited by 1
Sample Efficiency in Deep Reinforcement Learning based Recommender Systems with Imitation Learning
Afsar, M. M., Crump, T., & Far, B. H. (2022) · doi:10.21428/594757db.6a36bb36 · Cited by 1
Extended-Self Recognition for Autonomous Agent Based on Controllability and Predictability
Esaki, K., Matsumura, T., Yoshimura, C., & Mizuno, H. (2022) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci51031.2022.10022161 · Cited by 1
Kyoung, D., & Sung, Y. (2023) · Sensors · doi:10.3390/s23177411 · Cited by 2
Multi-Preference Actor CriticPreprint
Durugkar, I., Hausknecht, M., Swaminathan, A., & MacAlpine, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.03295 · Cited by 1
Automated curriculum generation for Policy Gradients from DemonstrationsPreprint
Srinivasan, A., Bahdanau, D., Chevalier-Boisvert, M., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00444 · Cited by 1
Few-Shot Bayesian Imitation Learning with Logical Program PoliciesPreprint
Silver, T., Allen, K. R., Lew, A. K., Kaelbling, L. P., & Tenenbaum, J. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.06317 · Cited by 2
Hindsight Experience Replay with Kronecker Product Approximate CurvaturePreprint
Mariyappan, D. P. G., Singla, A., & Bhatnagar, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06142 · Cited by 1
"What, not how": Solving an under-actuated insertion task from scratchPreprint
Vezzani, G., Neunert, M., Wulfmeier, M., Jeong, R., Lampe, T., Siegel, N., Hafner, R., Abdolmaleki, A., Riedmiller, M., & Nori, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.15492 · Cited by 1
Automatic Curricula via Expert DemonstrationsPreprint
Dai, S., Hofmann, A., & Williams, B. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09159 · Cited by 4
End-to-End Visual Obstacle Avoidance for a Robotic Manipulator using Deep Reinforcement Learning
Sanches, F. P. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.55.2021.tde-30082021-100712 · Cited by 1
A Closer Look at Advantage-Filtered Behavioral Cloning in High-Noise DatasetsPreprint
Grigsby, J., & Qi, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04698 · Cited by 1
Kadi, H. A., & Terzić, K. (2022) · Preprints.org · doi:10.20944/preprints202212.0305.v1 · Cited by 1
Mobility aid for the disabled using unknown input observers and reinforcement learning
Feng, G. (2019) · theses.fr (ABES) · doi:10.70675/fee8e83dz1de1z4417za262z865555b81fc2 · Cited by 1
Race from Pixels: Evolving Neural Network Controller for Vision-Based Car Driving
Tymchenko, B. I., & Antoshchuk, S. G. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-97885-7_3
Autonomous Open-Ended Learning of Interdependent TasksPreprint
Santucci, V. G., Cartoni, E., da Silva, B. C., & Baldassarre, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02690
Task Dependent Trajectory Learning from Multiple Demonstrations Using Movement Primitives
Vidaković, J., Jerbić, B., Šekoranja, B., Švaco, M., & Šuligoj, F. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-19648-6_32
Evolutionary Stochastic Policy DistillationPreprint
Sun, H., Pan, X.-Y., Dai, B., Lin, D., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12909 · Cited by 1
Asking for Help with a Cost in Reinforcement Learning
Vandenhof, C. (2020) · UWSpace (University of Waterloo)
Optimizing Air-to-Air Missile Guidance using Reinforcement Learning
van Hoorn, M. (2019) · Research Repository (Delft University of Technology)
Active Hierarchical Imitation and Reinforcement LearningPreprint
Niu, Y., & Gu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07330
Learning Memory-Dependent Continuous Control from DemonstrationsPreprint
Hou, S., Han, D., & Tani, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.09208
Xin, M., Wang, G., Liu, Z., & Wang, H. (2020) · arXiv (Cornell University)
Guiding Deep Reinforcement Learning by Modelling Expert’s Planning Behavior
Ma, R., & Oyekan, J. O. (2021) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar52225.2021.9463325
Klein, D., & Cosgun, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06840
Impact of Domain Knowledge Quality on Inverse Reinforcement Learning
Sogabe, R., Malla, D. B., Sogabe, M., Sakamoto, K., & Sogabe, T. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-73113-7_9
Support Rather Than Assault – Cooperative Agents in Minecraft
Potts, D., MacFarlane, K., & Hall, L. E. (2021) · Electronic workshops in computing · doi:10.14236/ewic/hci2021.13
DCUR: Data Curriculum for Teaching via Samples with Reinforcement LearningPreprint
Seita, D., Gopal, A., Mandi, Z., & Canny, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.07380
Learning vector fields through persistent exploration for robot motion control
Júnior, W. S. F., Monteiro, N. S., & Gonçalves, V. M. (2021) · Anais do ... Simpósio Brasileiro de Automação Inteligente/Simpósio Brasileiro de Automação Inteligente · doi:10.20906/sbai.v1i1.2663
Peer Review #1 of "LORM: a novel reinforcement learning framework for biped gait control (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.927v0.1/reviews/1
Peer Review #2 of "LORM: a novel reinforcement learning framework for biped gait control (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.927v0.1/reviews/2
Peer Review #2 of "LORM: a novel reinforcement learning framework for biped gait control (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.927v0.2/reviews/2
Peer Review #1 of "LORM: a novel reinforcement learning framework for biped gait control (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.927v0.2/reviews/1
Metadata
- Authors
- Nair, A., McGrew, B., Andrychowicz, M., Zaremba, W., & Abbeel, P.
- Affiliations
- OpenAI (United States) (US)
- ORCID
- Abbeel, Pieter
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 6292-6299
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2756826236
- Cited by
- 712
- References
- 44
- Citations by year
- 2026: 24 · 2025: 72 · 2024: 86 · 2023: 111 · 2022: 93 · 2021: 117 · 2020: 105 · 2019: 67 · 2018: 35
- FWCI
- 33.08
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- exploration in reinforcement learning, sparse rewards, demonstrations, deep deterministic policy gradient, hindsight experience replay, long-horizon tasks, continuous control, robotic manipulation, block stacking, robot manipulators, behavior cloning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review