The DOI matches its Crossref record; 40 of the 44 references it cites were found in a registry or an index.
Overcoming Exploration in Reinforcement Learning with Demonstrations
Open accessAbstract
Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal performance. However, finding a non-zero reward is exponentially more difficult with increasing task horizon or action dimensionality. This puts many real-world tasks out of practical reach of RL methods. In this work, we use demonstrations to overcome the exploration problem and successfully learn to perform long-horizon, multi-step robotics tasks with continuous control such as stacking blocks with a robot arm. Our method, which builds on top of Deep Deterministic Policy Gradients and Hindsight Experience Replay, provides an order of magnitude of speedup over RL on simulated robotics tasks. It is simple to implement and makes only the additional assumption that we can collect a small set of demonstrations. Furthermore, our method is able to solve tasks not solvable by either RL or behavior cloning alone, and often ends up outperforming the demonstrator policy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Demonstration learning (DemoL) algorithms often used in robotics applications are DQfD [218], DDPGfD [219] and Q-filtered BC [220].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [220]
The cited source says what the claim attributes to it.
In the citing paper
“Building upon DDPG [124] and HER [182], Nair et al. (2018) [220] propose a method called Q-filtered Behaviour Cloning (QfBC) that also applies the BC loss to learn demonstration data to solve long-horizon, sparse-reward and goal-conditioned tasks.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [220]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Probabilistic roadmaps for path planning in high-dimensional configuration spaces
Kavraki, L. E., Svestka, P., Latombe, J.-C., & Overmars, M. H. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.508439 · Cited by 6,343 · cited 1×
“More recent work on task and motion planning considers both logical and physical aspects of the task [27], [28], [29], but requires domainspecific engineering.”
BackgroundMuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Self-citationEnd to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Flagged first, then by citations
4 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- hester, 2017, Learning from demonstrations for real world reinforcement learning
- ng, 2000, Algorithms for Inverse Reinforcement Learning, International Conference on Machine Learning (ICML)
- ziebart, 2008, Maximum Entropy Inverse Reinforcement Learning, AAAI Conference on Artificial Intelligence, 1433
Cited by
Sorted by citations
Items 201–300 of 710
Attention-based exploitation and exploration strategy for multi-hop knowledge graph reasoning
Shang, B., Zhao, Y., Liu, Y., & Wang, C. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119787 · Cited by 19
Tamizi, M. G., Honari, H., Nozdryn-Plotnicki, A., & Najjaran, H. (2024) · Robotica · doi:10.1017/s0263574724000109 · Cited by 19
Ensemble Bootstrapped Deep Deterministic Policy Gradient for Vision-Based Robotic Grasping
Liu, W., Peng, L., Cao, J., Fu, X., Liu, Y., Pan, Z., & Yang, J. (2021) · IEEE Access · doi:10.1109/access.2021.3049860 · Cited by 18
Wang, Y., Zheng, K., Tian, D., Duan, X., & Zhou, J. (2021) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1900637 · Cited by 20
Kerzel, M., Rosin, T. P., Strahl, E., Heinrich, S., & Wermter, S. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00028 · Cited by 18
Guillén, A., & Cano, M. (2022) · IEEE Access · doi:10.1109/access.2022.3175493 · Cited by 17
Dynamic Experience ReplayPreprint
Luo, J., & Li, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02372 · Cited by 18
Asymmetric self-play for automatic goal discovery in robotic manipulation
OpenAI, O., Plappert, M., Sampedro, R., Xu, T., Akkaya, I., Kosaraju, V., Welinder, P., D'Sa, R., Petron, A., Pinto, H. P. D. O., et al. (2021) · arXiv · doi:10.48550/arxiv.2101.04882 · Cited by 18
Self-citationDemonstration-Guided Reinforcement Learning with Learned SkillsPreprint
Pertsch, K., Lee, Y., Wu, Y., & Lim, J. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.10253 · Cited by 21
Impact Makes a Sound and Sound Makes an Impact: Sound Guides Representations and Explorations
Zhao, X., Weber, C., Hafez, M. B., & Wermter, S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981510 · Cited by 17
Shaping Rewards for Reinforcement Learning with Imperfect Demonstrations using Generative Models
Wu, Y., Mozifian, M., & Shkurti, F. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561333 · Cited by 17
Constrained-Space Optimization and Reinforcement Learning for Complex Tasks
Tsai, Y.-Y., Xiao, B. J., Johns, E., & Yang, G. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2965392 · Cited by 18
Episodic Self-Imitation Learning with Hindsight
Dai, T., Liu, H., & Bharath, A. A. (2020) · Electronics · doi:10.3390/electronics9101742 · Cited by 16
JueWu-MC: Playing Minecraft with Sample-efficient Hierarchical Reinforcement Learning
Lin, Z., Li, J., Shi, J., Ye, D., Fu, Q., & Yang, W. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/452 · Cited by 38
Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidance
Yu, H., Hirayama, C., Yu, C., Herbert, S., & Gao, S. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341605 · Cited by 23
TRASS: Time Reversal as Self-Supervision
Nair, S., Babaeizadeh, M., Finn, C., Levine, S., & Kumar, V. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196862 · Cited by 16
Imitation-Learning-Enabled Vehicular Edge Computing: Toward Online Task Scheduling
Nie, L., Wang, X., Sun, W., Li, Y., Li, S., & Zhang, P. (2021) · IEEE Network · doi:10.1109/mnet.011.2000572 · Cited by 16
de Heuvel, J., Corral, N., Bruckschen, L., & Bennewitz, M. (2022) · IEEE RO-MAN · doi:10.1109/ro-man53752.2022.9900554 · Cited by 16
Hu, C. (2020) · Symmetry · doi:10.3390/sym12040631 · Cited by 16
Hindsight Goal Ranking on Replay Buffer for Sparse Reward Environment
Luu, T. M., & Yoo, C. D. (2021) · IEEE Access · doi:10.1109/access.2021.3069975 · Cited by 15
TAG: Teacher-Advice Mechanism With Gaussian Process for Reinforcement Learning
Lin, K., Li, D., Li, Y., Chen, S., Liu, Q., Gao, J., Jin, Y., & Gong, L. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3262956 · Cited by 16
de Heuvel, J., Corral, N., Kreis, B., Conradi, J., Driemel, A., & Bennewitz, M. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341370 · Cited by 15
Zhang, B., Li, G., Zhang, J., & Bai, X. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109339 · Cited by 15
From Imitation to Refinement - Residual Rl for Precise Assembly
Ankile, L., Simeonov, A., Shenfeld, I., Torne, M., & Agrawal, P. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127442 · Cited by 75
Transferring Human Manipulation Knowledge to Industrial Robots Using Reinforcement Learning
Arana-Arexolaleiba, N., Anguiozar, N. U., Chrysostomou, D., & Bøgh, S. (2019) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.01.136 · Cited by 15
A conceptual framework for externally-influenced agents: an assisted reinforcement learning review
Bignold, A., Cruz, F., Taylor, M., Brys, T., Dazeley, R., Vamplew, P., & Foale, C. (2021) · Deakin Research Online (Deakin University) · Cited by 15
Policy Gradient From Demonstration and Curiosity
Chen, J., & Xu, W. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3150802 · Cited by 16
Learning latent state representation for speeding up explorationPreprint
Vezzani, G., Gupta, A., Natale, L., & Abbeel, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12621 · Cited by 15
Self-citationIntrinsically Motivated Goal-Conditioned Reinforcement Learning: a Short SurveyPreprint
Colas, C., Karch, T., Sigaud, O., & Oudeyer, P. (2021) · HAL · Cited by 16
Handling Sparse Rewards in Reinforcement Learning Using Model Predictive Control
Dawood, M., Dengler, N., de Heuvel, J., & Bennewitz, M. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161492 · Cited by 14
Hundreds Guide Millions: Adaptive Offline Reinforcement Learning With Expert Guidance
Yang, Q., Wang, S., Zhang, Q., Huang, G. M., & Song, S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3293508 · Cited by 14
Learning agility and adaptive legged locomotion via curricular hindsight reinforcement learning
Li, S., Wang, G., Pang, Y., Bai, P., Hu, S., Liu, Z., Wang, L., & Li, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-79292-4 · Cited by 18
Generating attentive goals for prioritized hindsight reinforcement learning
Liu, P., Bai, C., Zhao, Y., Bai, C., Zhao, W. Z., & Tang, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106140 · Cited by 14
Human-Inspired Multi-Agent Navigation using Knowledge Distillation
Xu, P., & Karamouzas, I. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636463 · Cited by 15
Active Inference Integrated With Imitation Learning for Autonomous Driving
Nozari, S., Krayani, A., Marin-Plaza, P., Marcenaro, L., Martín, D., & Regazzoni, C. S. (2022) · IEEE Access · doi:10.1109/access.2022.3172712 · Cited by 14
Zhang, Y., Bai, L., Liu, L., Ren, H., & Meng, M. Q. ‐. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10012018 · Cited by 15
Skill-based Programming of Force-controlled Assembly Tasks using Deep Reinforcement Learning
Lämmle, A., König, T., El-Shamouty, M., & Huber, M. F. (2020) · Procedia CIRP · doi:10.1016/j.procir.2020.04.153 · Cited by 14
Watch, Try, Learn: Meta-Learning from Demonstrations and RewardPreprint
Zhou, A., Jang, E., Kappler, D., Herzog, A., Khansari, M., Wohlhart, P., Bai, Y., Kalakrishnan, M., Levine, S., & Finn, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03352 · Cited by 31
Offline Learning from Demonstrations and Unlabeled ExperiencePreprint
Żołna, K., Novikov, A., Konyushkova, K., Gülçehre, Ç., Wang, Z., Aytar, Y., Denil, M., de Freitas, N., & Reed, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13885 · Cited by 14
Residual Reinforcement Learning from DemonstrationsPreprint
Alakuijala, M., Dulac-Arnold, G., Mairal, J., Ponce, J., & Schmid, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08050 · Cited by 14
AW-Opt: Learning Robotic Skills with Imitation and Reinforcement at ScalePreprint
Lu, Y., Hausman, K., Chebotar, Y., Yan, M., Jang, E., Herzog, A., Xiao, T. G., Irpan, A., Khansari, M., Kalashnikov, D., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05424 · Cited by 20
Wang, Y., Wang, W., & Chen, D. (2025) · Journal of Marine Science and Engineering · doi:10.3390/jmse13030423 · Cited by 13
Deep Reinforcement Learning for Peg-in-hole Assembly Task Via Information Utilization Method
Wang, F., Cui, B., Liu, Y., & Ren, B. (2022) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-022-01713-1 · Cited by 13
RLfOLD: Reinforcement Learning from Online Demonstrations in Urban Autonomous Driving
Coelho, D., Oliveira, M., & Santos, V. M. F. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29049 · Cited by 13
Multi-step Pick-and-Place Tasks Using Object-centric Dense Correspondences
Chai, C.-Y., Hsu, K.-F., & Tsao, S. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968294 · Cited by 13
Imtiaz, M. B., Qiao, Y., & Lee, B. (2021) · International Journal of Mechanical Engineering and Robotics Research · doi:10.18178/ijmerr.10.10.526-535 · Cited by 13
Hierarchical Learning from Demonstrations for Long-Horizon Tasks
Li, B., Li, J., Lu, T., Cai, Y., & Wang, S. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561408 · Cited by 13
Batch Prioritization in Multigoal Reinforcement Learning
Vecchietti, L. F., Kim, T., Choi, K., Hong, J., & Har, D. (2020) · IEEE Access · doi:10.1109/access.2020.3012204 · Cited by 14
Goal-Auxiliary Actor-Critic for 6D Robotic Grasping with Point CloudsPreprint
Wang, L., Yu, X., Yang, W., Mousavian, A., & Fox, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00824 · Cited by 13
Robotics: Science and Systems XV
(2019) · doi:10.15607/rss.2019.xv · Cited by 13
Deep Reinforcement Learning for Robotic Control with Multi-Fidelity Models
Leguizamo, D. F., Yang, H.-J., Lee, X. Y., & Sarkar, S. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.11.183 · Cited by 13
End-to-End Learning of Deep Visuomotor Policy for Needle Picking
Lin, H., Li, B., Chu, X., Dou, Q., Liu, Y., & Au, K. W. S. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342194 · Cited by 12
FoX: Formation-Aware Exploration in Multi-Agent Reinforcement Learning
Jo, Y., Lee, S., Yeom, J., & Han, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29196 · Cited by 16
Shan, Z., Zhao, J., Huang, W., Zhao, Y., Ge, L., Zhong, S., Hu, H., Lv, C., & Zhu, B. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105047 · Cited by 12
Hybrid Imitation Learning Framework for Robotic Manipulation Tasks
Jung, E., & Kim, I. (2021) · Sensors · doi:10.3390/s21103409 · Cited by 12
Curiosity-Driven Multi-Criteria Hindsight Experience ReplayPreprint
Lanier, J. B., McAleer, S., & Baldi, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03710 · Cited by 13
Co-training for Policy LearningPreprint
Song, J., Lanka, R., Yue, Y., & Ono, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04484 · Cited by 13
Watch, Try, Learn: Meta-Learning from Demonstrations and RewardsPreprint
Zhou, A., Jang, E., Kappler, D., Herzog, A., Khansari, M., Wohlhart, P., Bai, Y., Kalakrishnan, M., Levine, S., & Finn, C. (2020) · arXiv (Cornell University) · Cited by 12
A Survey of Reinforcement Learning Techniques: Strategies, Recent Development, and Future DirectionsPreprint
Mondal, A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.06921 · Cited by 13
Charlesworth, H. J., & Montana, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05104 · Cited by 12
Continuous Control with Action Quantization from DemonstrationsPreprint
Dadashi, R., Hussenot, L., Vincent, D., Girgin, S., Raichuk, A., Geist, M., & Pietquin, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10149 · Cited by 15
Reinforcement learning in robotic systems : A review on sim-to-real transfer
Tiwari, R., Khapre, S. P., & Singh, A. (2026) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.105327 · Cited by 12
Deep Reinforcement Learning Task Assignment Based on Domain Knowledge
Liu, J., Wang, G., Guo, X., Wang, S., & Fu, Q. (2022) · IEEE Access · doi:10.1109/access.2022.3217654 · Cited by 11
Hierarchical Reinforcement Learning from Demonstration via Reachability-Based Reward Shaping
Gao, X., Liu, J., Wan, B., & An, L. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11632-x · Cited by 11
Zhang, Y., Li, Y., Feng, Q., Sun, J., Peng, C., Gao, L., & Chen, L. (2025) · Plants · doi:10.3390/plants14050634 · Cited by 11
Data-driven and model-based hybrid reinforcement learning to reduce stress on power systems branches
Kamel, M., Dai, R., Wang, Y., Li, F. F., & Liu, G. (2021) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2020.04570 · Cited by 11
Liu, N., Lu, T., Cai, Y., Wang, R., & Wang, S. (2021) · Science China Information Sciences · doi:10.1007/s11432-019-2648-7 · Cited by 12
Evolutionary Action Selection for Gradient-Based Policy Learning
Ma, Y., Liu, T., Wei, B., Liu, Y., Xu, K., & Li, W. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30111-7_49 · Cited by 16
RESPRECT: Speeding-up Multi-Fingered Grasping With Residual Reinforcement Learning
Ceola, F., Rosasco, L., & Natale, L. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3363532 · Cited by 11
Lucid dreaming for experience replay: refreshing past states with the current policy
Du, Y., Warnell, G., Gebremedhin, A. H., Stone, P., & Taylor, M. E. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06104-5 · Cited by 11
[CASPI] Causal-aware Safe Policy Improvement for Task-oriented Dialogue
Ramachandran, G. S., Hashimoto, K., & Xiong, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.8 · Cited by 22
Automata Guided Reinforcement Learning With DemonstrationsPreprint
Li, X., Ma, Y., & Belta, C. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.06305 · Cited by 11
Kumar, A., Buckley, T., Lanier, J. B., Wang, Q., Kavelaars, A. T., & Kuzovkin, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08639 · Cited by 16
Jiang, H., Xiong, H., Zeng, W., & Ou, Y. (2023) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2023.3299913 · Cited by 10
Tang, Y. F., Guo, S., Liu, J., Wan, B., An, L., & Liu, J. K. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111736 · Cited by 10
Blockchain-based crowdsourced deep reinforcement learning as a service
Alagha, A., Otrok, H., Singh, S., Mizouni, R., & Bentahar, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121107 · Cited by 10
Mosbach, M., & Behnke, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610700 · Cited by 10
Al-Sharman, M. K., Edes, L., Sun, B., Jayakumar, V., Tahir, H., Daoud, M., Emran, B., Rayside, D., & Melek, W. W. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3646982 · Cited by 20
Hierarchical learning from human preferences and curiosity
Bougie, N., & Ichise, R. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02726-3 · Cited by 10
Robotic Embodiment of Human-Like Motor Skills via Reinforcement Learning
Guzman, L., Morellas, V., & Papanikolopoulos, N. P. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3147453 · Cited by 10
Li, M., Huang, T., & Zhu, W. (2021) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-021-01387-5 · Cited by 10
Tang, Z., Shi, Y., & Xu, X. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3253023 · Cited by 10
Liu, C., & Kampen, E.-J. V. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-0793 · Cited by 10
Time Reversal as Self-SupervisionPreprint
Nair, S., Babaeizadeh, M., Finn, C., Levine, S., & Kumar, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01128 · Cited by 10
Using Monte Carlo Tree Search as a Demonstrator within Asynchronous Deep RLPreprint
Kartal, B., Hernández-Leal, P., & Taylor, M. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00045 · Cited by 12
Bridging the Imitation Gap by Adaptive InsubordinationPreprint
Weihs, L., Jain, U., Liu, I.-J., Salvador, J., Lazebnik, S., Kembhavi, A., & Schwing, A. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.12173 · Cited by 16
Align-RUDDER: Learning From Few Demonstrations by Reward RedistributionPreprint
Patil, V. P., Hofmarcher, M., Dinu, M.-C., Dorfer, M., Blies, P., Brandstetter, J., Arjona-Medina, J. A., & Hochreiter, S. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.16583.32161 · Cited by 32
Filos, A., Lyle, C., Gal, Y., Levine, S., Jaques, N., & Farquhar, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12560 · Cited by 12
Reinforcement Learning in Quantitative Trading: A SurveyPreprint
Alameer, A., Saleh, H., & Alshehri, K. A. (2022) · doi:10.36227/techrxiv.19303853 · Cited by 10
Model-based trajectory stitching for improved behavioural cloning and its applications
Hepburn, C. A., & Montana, G. (2023) · Machine Learning · doi:10.1007/s10994-023-06392-z · Cited by 8
Soft imitation reinforcement learning with value decomposition for portfolio management
Dong, L., & Zheng, H.-C. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.111108 · Cited by 10
SC-AIRL: Share-Critic in Adversarial Inverse Reinforcement Learning for Long-Horizon Task
Xiang, G., Li, S., Shuang, F., Gao, F., & Yuan, X. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3366023 · Cited by 9
Safety Decision-Making for Autonomous Vehicles Integrating Passenger Physiological States by fNIRS
Zhang, X., Zheng, H., Li, J., Xie, Z., Sun, H., & Wang, H. (2024) · Cyborg and Bionic Systems · doi:10.34133/cbsystems.0205 · Cited by 13
Kim, G., Chang, K., Byun, Y., & Baek, J. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3600504 · Cited by 9
Self-Punishment and Reward Backfill for Deep Q-Learning
Bonyadi, M. R., Wang, R., & Ziaei, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3140042 · Cited by 9
Ceola, F., Maiettini, E., Rosasco, L., & Natale, L. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341776 · Cited by 9
Potential Driven Reinforcement Learning for Hard Exploration Tasks
Zhao, E., Deng, S., Zang, Y., Kang, Y., Li, K., & Xing, J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/290 · Cited by 9
A self-guided approach for navigation in a minimalistic foraging robotic swarm
Adams, S., Ornia, D. J., & Mazo, M. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10102-y · Cited by 9
A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill
Jiang, R., Wang, Z., He, B., Zhou, Y., Li, G., & Zhu, Z. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.023 · Cited by 9
Multi-Agent Advisor Q-Learning
Subramanian, S. G., Taylor, M. E., Larson, K. S., & Crowley, M. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13445 · Cited by 9
Metadata
- Authors
- Nair, A., McGrew, B., Andrychowicz, M., Zaremba, W., & Abbeel, P.
- Affiliations
- OpenAI (United States) (US)
- ORCID
- Abbeel, Pieter
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 6292-6299
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2756826236
- Cited by
- 712
- References
- 44
- Citations by year
- 2026: 24 · 2025: 72 · 2024: 86 · 2023: 111 · 2022: 93 · 2021: 117 · 2020: 105 · 2019: 67 · 2018: 35
- FWCI
- 33.08
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- exploration in reinforcement learning, sparse rewards, demonstrations, deep deterministic policy gradient, hindsight experience replay, long-horizon tasks, continuous control, robotic manipulation, block stacking, robot manipulators, behavior cloning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review