The DOI matches its OpenAlex record; 77 of the 77 references it cites were found in a registry or an index.
End-to-End Training of Deep Visuomotor Policies
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Self-citationDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · cited 1×
“CNNs have a long history in computer vision and deep learning (Fukushima, 1980; LeCun et al., 1989; Schmidhuber, 2015), and have recently gained prominence due to excellent results on a number of vision benchmarks (Ciresan et al.”
BackgroundMuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Self-citation(1989) · neural information processing systems · Cited by 3,736
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“, 2012) speech recognition (Dahl et al., 2012), and even playing video games (Mnih et al.”
BackgroundBest practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,945
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
Neural networks for control systems—A survey
Hunt, K. J., Sbarbaro, D., Żbikowski, R., & Gawthrop, P. J. (1992) · Automatica · doi:10.1016/0005-1098(92)90053-i · Cited by 1,864
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · cited 1×
“Since the training set is still quite limited, we initialize the filters in the first layer with weights from the model of Szegedy et al. [38], which is trained on ImageNet [4] classification.”
MethodA new approach to visual servoing in robotics
Espiau, B., Chaumette, F., & Rives, P. (1993) · Lecture Notes in Computer Science · doi:10.1007/3-540-57132-9_8 · Cited by 1,346
ALVINN: An autonomous land vehicle in a neural network
Pomerleau, D. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6603146.v1 · Cited by 1,340
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,338
Robotic Surgery: A Current Perspective
Lanfranco, A. R., Castellanos, A. E., Desai, J. P., & Meyers, W. C. (2004) · Annals of Surgery · doi:10.1097/01.sla.0000103020.19595.7d · Cited by 1,299
(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229
Rubinstein, R. Y., & Kroese, D. P. (2004) · Medical Entomology and Zoology · Cited by 1,074
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Levine, S., & Koltun, V. (2013) · International Conference on Machine Learning · Cited by 906
Self-citationReinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
A Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
Learning and generalization of motor skills by learning from demonstration
Pastor, P., Hoffmann, H., Asfour, T., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152385 · Cited by 702
Relative end-effector control using Cartesian position based visual servoing
Wilson, W. J., Williams Hulls, C. C., & Bell, G. S. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.538974 · Cited by 623
Policy gradient reinforcement learning for fast quadrupedal locomotion
Kohl, N., & Stone, P. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1307456 · Cited by 564
Autonomous Inverted Helicopter Flight via Reinforcement Learning
Ng, A. Y., Coates, A., Diel, M., Ganapathi, V., Schulte, J., Tse, B., Berger, E., & Liang, E. (2006) · Springer Tracts in Advanced Robotics · doi:10.1007/11552246_35 · Cited by 553
ITERATIVE LINEAR QUADRATIC REGULATOR DESIGN FOR NONLINEAR BIOLOGICAL MOVEMENT SYSTEMS
(2004) · Proceedings of the First International Conference on Informatics in Control, Automation and Robotics · doi:10.5220/0001143902220229 · Cited by 543
Learning Neural Network Policies with Guided Policy Search under Unknown Dynamics
Levine, S., & Abbeel, P. (2014) · neural information processing systems · Cited by 542
Self-citationRelative Entropy Policy Search
Peters, J., Mulling, K., & Altun, Y. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7727 · Cited by 455
Category Independent Object Proposals
Endres, I., & Hoiem, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_42 · Cited by 432
Deep spatial autoencoders for visuomotor learning
Finn, C., Tan, X. Y., Duan, Y., Darrell, T., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487173 · Cited by 430
Self-citation3D generic object categorization, localization and pose estimation
Savarese, S., & Fei-Fei, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408987 · Cited by 384
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Guo, X., Singh, S. P., Lee, H., Lewis, R. L., & Wang, X. (2014) · neural information processing systems · Cited by 368
DeepMPC: Learning Deep Latent Features for Model Predictive Control
Lenz, I., Knepper, R., & Saxena, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.012 · Cited by 332
A stochastic reinforcement learning algorithm for learning real-valued functions
Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 295
Stochastic policy gradient reinforcement learning on a simple 3D biped
Tedrake, R., Zhang, T. W., & Seung, H. S. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389841 · Cited by 264
Experimental evaluation of uncalibrated visual servoing for precision manipulation
Jagersand, M., Fuentes, O., & Nelson, R. (2002) · Proceedings of International Conference on Robotics and Automation · doi:10.1109/robot.1997.606723 · Cited by 224
Learning motor primitives for robotics
Kober, J., & Peters, J. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152577 · Cited by 220
Teaching 3D geometry to deformable part models
Pepik, B., Stark, M., Gehler, P., & Schiele, B. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248075 · Cited by 213
Learning to Control a Low-Cost Manipulator using Data-Efficient Reinforcement Learning
Deisenroth, M., Rasmussen, C., & Fox, D. (2011) · Robotics: Science and Systems VII · doi:10.15607/rss.2011.vii.008 · Cited by 205
Autonomous reinforcement learning on raw visual input data in a real world application
Lange, S., Riedmiller, M., & Voigtlander, A. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252823 · Cited by 202
Path Integral Policy Improvement with Covariance Matrix AdaptationPreprint
Stulp, F., & Sigaud, O. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.4621 · Cited by 192
Wyrobek, K. A., Berger, E. H., Van der Loos, H. F. M., & Salisbury, J. K. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543527 · Cited by 189
Bregman Alternating Direction Method of MultipliersPreprint
Wang, H., & Banerjee, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.3203 · Cited by 189
A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks
Mayer, H., Gomez, F., Wierstra, D., Nagy, I., Knoll, A., & Schmidhuber, J. (2008) · Advanced Robotics · doi:10.1163/156855308x360604 · Cited by 183
Autonomous door opening and plugging in with a personal robot
Meeussen, W., Wise, M., Glaser, S., Chitta, S., McGann, C., Mihelich, P., Marder-Eppstein, E., Muja, M., Eruhimov, V., Foote, T., et al. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509556 · Cited by 174
Learning force control policies for compliant manipulation
Kalakrishnan, M., Righetti, L., Pastor, P., & Schaal, S. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6095096 · Cited by 161
Movement templates for learning of hitting and batting
Kober, J., Mülling, K., Krömer, O., Lampert, C. H., Schölkopf, B., & Peters, J. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509672 · Cited by 152
Learning Complex Neural Network Policies with Trajectory Optimization
Levine, S., & Koltun, V. (2014) · International Conference on Machine Learning · Cited by 150
Self-citationActive, uncalibrated visual servoing
Yoshimi, B. H., & Allen, P. K. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1994.350995 · Cited by 149
Bagnell, J. A., & Schneider, J. (2018) · Figshare · doi:10.1184/r1/6552458 · Cited by 148
Evolving large-scale neural networks for vision-based reinforcement learning
Koutník, J., Cuccu, G., Schmidhuber, J., & Gomez, F. (2013) · Proceedings of the 15th annual conference on Genetic and evolutionary computation · doi:10.1145/2463372.2463509 · Cited by 130
(1993) · Springer eBooks · doi:10.1007/978-1-4615-3180-7 · Cited by 125
Variational Policy Search via Trajectory Optimization
Levine, S., & Koltun, V. (2013) · neural information processing systems · Cited by 114
Self-citationReinforcement learning to adjust robot movements to new situations
Kober, J., Öztop, E., & Peters, J. (2011) · Max Planck Digital Library · doi:10.5591/978-1-57735-516-8/ijcai11-441 · Cited by 86
Learning Contact-Rich Manipulation Skills with Guided Policy SearchPreprint
Levine, S., Wagener, N., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.05611 · Cited by 77
Self-citationA robot that reinforcement-leams to identify and memorize important previous observations
Bakker, B., Zhumatiy, V., Gruener, G., & Schmidhuber, J. (2004) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2003.1250667 · Cited by 73
Acquiring visual servoing reaching and grasping skills using neural reinforcement learning
Lampe, T., & Riedmiller, M. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6707053 · Cited by 66
Sung, J., Jin, S. H., & Saxena, A. (2018) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-60916-4_40 · Cited by 52
State Representation Learning in Robotics: Using Prior Knowledge about Physical Interaction
Jonschkowski, R., & Brock, O. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.019 · Cited by 47
Closed-Loop Learning of Visual Control Policies
Jodogne, S., & Piater, J. H. (2006) · Cited by 39
Applying the Episodic Natural Actor-Critic Architecture to Motor Primitive Learning
Peters, J., & Schaal, S. (2007) · Cited by 27
Learning of non-parametric control policies with high-dimensional state features
van Hoof, H., Peters, J., & Neumann, G. M. (2015) · Lincoln Repository (University of Lincoln) · Cited by 26
Construction of approximation spaces for reinforcement learning
Böhmer, W., Grünewälder, S., Shen, Y. C., Musial, M., & Obermayer, K. (2013) · Cited by 21
Cited by
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
“In guided policy search (Levine & Koltun, 2013; Levine et al., 2016), the maximum entropy distribution is used to guide policy learn-Soft ing towards high-reward regions.”
BackgroundSelf-citationDeep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
“Neural networks that encode policies have been successfully trained using both gradient-free [17], [33] and gradient-based [22], [41], [44], [70], [71], [96], [97] methods.”
InfluentialA Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Metadata
- Authors
- Levine, S., Finn, C., Darrell, T. J., & Abbeel, P.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2015-04-02
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.00702
- OpenAlex
- W2155007355
- Cited by
- 1,344
- References
- 77
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.