Language Conditioned Imitation Learning over Unstructured Data
Open accessAbstract
Natural language is perhaps the most flexible and intuitive way for humans to communicate tasks to a robot. Prior work in imitation learning typically requires each task be specified with a task id or goal image -- something that is often impractical in open-world environments. On the other hand, previous approaches in instruction following allow agent behavior to be guided by language, but typically assume structure in the observations, actuators, or language that limit their applicability to complex settings like robotics. In this work, we present a method for incorporating free-form natural language conditioning into imitation learning. Our approach learns perception from pixels, natural language understanding, and multitask continuous control end-to-end as a single neural network. Unlike prior work in imitation learning, our method is able to incorporate unlabeled and unstructured demonstration data (i.e. no task or language labels). We show this dramatically improves language conditioned performance, while reducing the cost of language annotation to less than 1% of total data. At test time, a single language conditioned visuomotor policy trained with our method can perform a wide variety of robotic manipulation skills in a 3D environment, specified only with natural language descriptions of each task (e.g. "open the drawer...now pick up the block...now press the green button..."). To scale up the number of instructions an agent can follow, we propose combining text conditioned policies with large pretrained neural language models. We find this allows a policy to be robust to many out-of-distribution synonym instructions, without requiring new demonstrations. See videos of a human typing live text commands to our agent at language-play.github.io
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The original Language Table trajectories have short horizons (e.g., only moving one block).
“The original trajectories have short horizons (e.g., only moving one block).”
From Learning Interactive Real-World Simulators (2023) · cites this paper as Lynch & Sermanet, 2020
The Experiments section (p. 5) describes trajectories in a simulated 3D Playroom, and Appendix O (p. 14) describes long-horizon task sequences. Our copy does not identify an original Language Table dataset or say its trajectories have short horizons involving only one block (searched: “Language Table,” “short horizon,” and “only moving one block”). (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · see citing works
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767 · see citing works
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · see citing works
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227 · see citing works
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165 · see citing works
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · see citing works
Understanding natural language
Winograd, T. A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90002-3 · Cited by 2,803 · see citing works
Generative adversarial imitation learning
Ho, J., & Ermon, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03476 · Cited by 1,942 · see citing works
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621 · see citing works
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,325 · see citing works
Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations
Rajeswaran, A., Kumar, V., Gupta, A., Vezzani, G., Schulman, J., Todorov, E., & Levine, S. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.049 · Cited by 847 · see citing works
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., Vanhoucke, V., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.10293 · Cited by 697 · see citing works
Efficient Training of Artificial Neural Networks for Autonomous Navigation
Pomerleau, D. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.88 · Cited by 693 · see citing works
Universal Value Function Approximators
Schaul, T., Horgan, D., Gregor, K., & Silver, D. (2015) · Cited by 677 · see citing works
Visual Reinforcement Learning with Imagined GoalsPreprint
Nair, A., Pong, V. H., Dalal, M., Bahl, S., Lin, S., & Levine, S. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1807.04742 · Cited by 623 · see citing works
Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
Zhang, T., McCarthy, Z., Jow, O., Lee, D., Chen, X., Goldberg, K., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461249 · Cited by 609 · see citing works
Guided Cost Learning: Deep Inverse Optimal Control via Policy OptimizationPreprint
Finn, C., Levine, S., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00448 · Cited by 589 · see citing works
Time-Contrastive Networks: Self-Supervised Learning from Video
Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Stefan Schaal, A., Levine, S., & Brain, G. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8462891 · Cited by 579 · see citing works
Self-citationWang, X., Huang, Q., Celikyilmaz, A., Gao, J., Shen, D., Wang, Y.-F., Wang, W. Y., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00679 · Cited by 522 · see citing works
Multilingual Universal Sentence Encoder for Semantic Retrieval
Yang, Y., Cer, D. M., Ahmad, A., Guo, M., Law, J., Constant, N., Ábrego, G. H., Yuan, S., Tar, C., Sung, Y.-H., et al. (2020) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2020.acl-demos.12 · Cited by 411 · see citing works
Maximum Entropy Deep Inverse Reinforcement LearningPreprint
Wulfmeier, M., Ondrúška, P., & Posner, I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.04888 · Cited by 294 · see citing works
Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic ControlPreprint
Ebert, F., Finn, C., Dasari, S., Xie, A., Lee, A. X., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00568 · Cited by 294 · see citing works
Toward understanding natural language directions
Kollar, T., Tellex, S., Roy, D. K., & Roy, N. (2010) · Cited by 287 · see citing works
Mapping Instructions and Visual Observations to Actions with Reinforcement Learning
Misra, D. K., Langford, J., & Artzi, Y. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1106 · Cited by 258 · see citing works
Rahmatizadeh, R., Abolghasemi, P., Bölöni, L. L., & Levine, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461076 · Cited by 214 · see citing works
A Survey of Reinforcement Learning Informed by Natural Language
Luketina, J., Nardelli, N., Farquhar, G., Foerster, J., Andreas, J., Grefenstette, E., Whiteson, S., & Rocktäschel, T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/880 · Cited by 208 · see citing works
Kaelbling, L. P. (1993) · Cited by 206 · see citing works
End-To-End Robotic Reinforcement Learning without Reward Engineering
Singh, A., Yang, L., Finn, C., & Levine, S. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.073 · Cited by 198 · see citing works
Keyframe-based Learning from Demonstration
Akgün, B., Çakmak, M., Jiang, K., & Thomaz, A. L. (2012) · International Journal of Social Robotics · doi:10.1007/s12369-012-0160-0 · Cited by 197 · see citing works
Action-conditional video prediction using deep networks in Atari games
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · Cited by 196 · see citing works
Learning Latent Plans from PlayPreprint
Lynch, C., Khansari, M., Xiao, T. G., Kumar, V., Tompson, J., Levine, S., & Sermanet, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.01973 · Cited by 195 · see citing works
Self-citationGrounded Language Learning in a Simulated 3D WorldPreprint
Hermann, K. M., Hill, F., Green, S., Wang, F., Faulkner, R., Soyer, H., Szepesvári, D., Czarnecki, W. M., Jaderberg, M., Teplyashin, D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06551 · Cited by 179 · see citing works
Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning
Gupta, A., Kumar, V., Lynch, C., Levine, S., & Hausman, K. (2019) · arXiv · doi:10.48550/arxiv.1910.11956 · Cited by 153 · see citing works
Self-citationDistral: Robust Multitask Reinforcement Learning
Teh, Y. W. (2025) · TIB Data Manager · doi:10.57702/nufubi9l · Cited by 126 · see citing works
Goal-Conditioned Imitation LearningPreprint
Ding, Y., Florensa, C., Phielipp, M., & Abbeel, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05838 · Cited by 119 · see citing works
Language as an Abstraction for Hierarchical Deep Reinforcement Learning
Jiang, Y., Gu, S., Murphy, K., & Finn, C. (2019) · arXiv · doi:10.48550/arxiv.1906.07343 · Cited by 109 · see citing works
BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning
Chevalier-Boisvert, M., Bahdanau, D., Lahlou, S., Willems, L., Saharia, C., Nguyen, T. H., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1810.08272 · Cited by 104 · see citing works
Language-Conditioned Imitation Learning for Robot Manipulation TasksPreprint
Stepputtis, S., Campbell, J., Phielipp, M., Lee, S., Baral, C. R., & Amor, H. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12083 · Cited by 85 · see citing works
Contextual Imagined Goals for Self-Supervised Robotic LearningPreprint
Nair, A., Bahl, S., Khazatsky, A., Pong, V. H., Berseth, G., & Levine, S. (2019) · Conference on Robot Learning · doi:10.48550/arxiv.1910.11670 · Cited by 77 · see citing works
Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial NetsPreprint
Hausman, K., Chebotar, Y., Stefan Schaal, A., Sukhatme, G. S., & Lim, J. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10479 · Cited by 68 · see citing works
Interactive Grounded Language Acquisition and Generalization in a 2D WorldPreprint
Yu, H., Zhang, H., & Xu, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01433 · Cited by 49 · see citing works
Scalable Multi-Task Imitation Learning with Autonomous Improvement
Singh, A., Jang, E., Irpan, A., Kappler, D., Dalal, M., Levine, S., Khansari, M., & Finn, C. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197020 · Cited by 32 · see citing works
Self-supervised Learning of Image Embedding for Continuous ControlPreprint
Florensa, C., Degrave, J., Heess, N., Springenberg, J. T., & Riedmiller, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00943 · Cited by 27 · see citing works
Online Object Representations with Contrastive LearningPreprint
Pirk, S., Khansari, M., Bai, Y., Lynch, C., & Sermanet, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04312 · Cited by 23 · see citing works
Self-citationEmergent Systematic Generalization In a Situated AgentPreprint
Hill, F., Lampinen, A. K., Schneider, R. G., Clark, S. C., Botvinick, M., McClelland, J. L., & Santoro, A. (2019) · arXiv (Cornell University) · Cited by 21 · see citing works
Flagged first, then by citations
3 of the 49 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- [2][2] Marcin Andrychowicz, Filip Wolski, Alex Ray, Jonas Schneider, Rachel Fong, Peter Welinder, Bob McGrew, Josh Tobin, OpenAI Pieter Abbeel, and Wojciech Zaremba. Hindsight experience replay. In Advances in neural information processing systems , pages 5048-5058, 2017. -
- [13][13] Shixiang Gu, Ethan Holly, Timothy Lillicrap, and Sergey Levine. Deep reinforcement learning for robotic manipulation with asynchronous offpolicy updates. In 2017 IEEE international conference on robotics and automation (ICRA) , pages 3389-3396. IEEE, 2017. -
- [28][28] Ashvin Nair, Shikhar Bahl, Alexander Khazatsky, Vitchyr Pong, Glen Berseth, and Sergey Levine. Contextual imagined goals for selfsupervised robotic learning. In Conference on Robot Learning , pages 530-539. PMLR, 2020. -
- [32][32] Junhyuk Oh, Satinder Singh, Honglak Lee, and Pushmeet Kohli. Zeroshot task generalization with multi-task deep reinforcement learning. In Proceedings of the 34th International Conference on Machine LearningVolume 70 , pages 2661-2670. JMLR. org, 2017. -
- [33][33] Sherjil Ozair, Corey Lynch, Yoshua Bengio, Aaron Van den Oord, Sergey Levine, and Pierre Sermanet. Wasserstein dependency measure for representation learning. In Advances in Neural Information Processing Systems , pages 15578-15588, 2019. -
- [36][36] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. OpenAI Blog , 1(8):9, 2019. -
- [41][41] Pierre Sermanet, Corey Lynch, Yevgen Chebotar, Jasmine Hsu, Eric Jang, Stefan Schaal, and Sergey Levine. Time-contrastive networks: Selfsupervised learning from video. Proceedings of International Conference in Robotics and Automation (ICRA) , 2018. URL http://arxiv.org/abs/ 1704.06888. -
- [43][43] Avi Singh, Eric Jang, Alexander Irpan, Daniel Kappler, Murtaza Dalal, Sergey Levine, Mohi Khansari, and Chelsea Finn. Scalable multitask imitation learning with autonomous improvement. arXiv preprint arXiv:2003.02636 , 2020. - · arXiv
- [54][54] Victor Zhong, Tim Rockt¨ aschel, and Edward Grefenstette. Rtfm: Generalising to novel environment dynamics via reading. arXiv preprint arXiv:1910.08210 , 2019. · arXiv
Cited by
Sorted by citations
Code as Policies: Language Model Programs for Embodied Control
Liang, J., Huang, W., Xia, F., Xu, P., Hausman, K., Ichter, B., Florence, P., & Zeng, A. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160591 · Cited by 767 · see citing works
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
Brohan, A., Brown, N., Carbajal, J., Chebotar, Y., Chen, X., Choromanski, K., Ding, T., Driess, D., Dubey, A., Finn, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.15818 · Cited by 276 · see citing works
Self-citationA Survey of Zero-shot Generalisation in Deep Reinforcement Learning
Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14174 · Cited by 193 · see citing works
Interactive Language: Talking to Robots in Real Time
Lynch, C., Wahid, A., Tompson, J., Ding, T., Betker, J., Baruch, R., Armstrong, T., & Florence, P. (2022) · arXiv · doi:10.48550/arxiv.2210.06407 · Cited by 113 · see citing works
Self-citationChatGPT Empowered Long-Step Robot Control in Various Environments: A Case Application
Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., & Ikeuchi, K. (2023) · IEEE Access · doi:10.1109/access.2023.3310935 · Cited by 96 · see citing works
Bharadhwaj, H., Vakil, J., Sharma, M. K., Gupta, A. K., Tulsiani, S., & Kumar, V. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611293 · Cited by 88 · see citing works
GPT-4V(ision) for Robotics: Multimodal Task Planning From Human Demonstration
Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., & Ikeuchi, K. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3477090 · Cited by 77 · see citing works
Generating Executable Action Plans with Environmentally-Aware Language Models
Gramopadhye, M., & Szafir, D. (2023) · 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341989 · Cited by 26 · see citing works
Learning Video-Conditioned Policies for Unseen Manipulation Tasks
Chane-Sane, E., Schmid, C., & Laptev, I. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161336 · Cited by 17 · see citing works
Learning Interactive Real-World Simulators
Yang, S., Du, Y., Ghasemipour, K., Tompson, J., Kaelbling, L., Schuurmans, D., & Abbeel, P. (2023) · arXiv · doi:10.48550/arxiv.2310.06114 · Cited by 12 · see citing works
User-Conditioned Neural Control Policies for Mobile Robotics
Bauersfeld, L., Kaufmann, E., & Scaramuzza, D. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160851 · Cited by 9 · see citing works
SURRL: Structural Unsupervised Representations for Robot Learning
Zhang, F., Chen, Y., Qiao, H., & Liu, Z. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3187186 · Cited by 8 · see citing works
Toward Teachable Autotelic Agents
Sigaud, O., Akakzia, A., Caselles-Dupré, H., Colas, C., Oudeyer, P., & Chétouani, M. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3231731 · Cited by 11 · see citing works
Policy Adaptation from Foundation Model Feedback
Ge, Y., Macaluso, A., Li, L. E., Luo, P., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01827 · Cited by 4 · see citing works
PolarNet: 3D Point Clouds for Language-Guided Robotic ManipulationPreprint
Chen, S., García, R., Schmid, C., & Laptev, I. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.15596 · Cited by 7 · see citing works
HMAE: a high-fidelity multi-agent simulator for economic phenomenon emergence
Wang, C., Ma, X., Jin, X., Zeng, H., & Wang, Z. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1451423 · Cited by 2 · see citing works
Uncertainty-Aware Deployment of Pre-trained Language-Conditioned Imitation Learning Policies
Wu, B., Lee, B. D., Daniilidis, K., Bucher, B., & Matni, N. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802849 · Cited by 1 · see citing works
LUOR: A Framework for Language Understanding in Object Retrieval and Grasping
Yoon, D., Cha, S., & Oh, Y. (2025) · International Journal of Control Automation and Systems · doi:10.1007/s12555-024-0527-7 · Cited by 2 · see citing works
Visual Robotic Manipulation with Depth-Aware Pretraining
Li, J., Wang, W., Peng, Y., Shen, C., Zhu, Y., & Xu, Z. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907650 · Cited by 2 · see citing works
Interactive Task Encoding System for Learning-from-Observation
Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., & Ikeuchi, K. (2023) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim46323.2023.10196126 · Cited by 2 · see citing works
Peng, S., Hu, X., Yi, Q., Zhang, R., Guo, J., Huang, D., Tian, Z., Chen, R., Du, Z., Guo, Q., et al. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29376 · Cited by 5 · see citing works
Kim, D., Lee, S., Park, S., & Kim, H. (2025) · Journal of Broadcast Engineering · doi:10.5909/jbe.2025.30.4.589
- Authors
- Lynch, C., & Sermanet, P.
- Affiliations
- Google (United States) (US)
- ORCID
- Lynch, Corey
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2005.07648
- OpenAlex
- W3178987284
- Cited by
- 18
- References
- 49
- Citations by year
- 2025: 2 · 2024: 6 · 2023: 8 · 2022: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- robotic manipulation, visuomotor control, end-to-end learning, unstructured data, pre-trained language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
