The DOI matches its Crossref record; 179 of the 179 references it cites were found in a registry or an index.
Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods
Open accessAbstract
With extensive pretrained knowledge and high-level general capabilities, large language models (LLMs) emerge as a promising avenue to augment reinforcement learning (RL) in aspects, such as multitask learning, sample efficiency, and high-level task planning. In this survey, we provide a comprehensive review of the existing literature in LLM-enhanced RL and summarize its characteristics compared with conventional RL methods, aiming to clarify the research scope and directions for future studies. Utilizing the classical agent-environment interaction paradigm, we propose a structured taxonomy to systematically categorize LLMs' functionalities in RL, including four roles: information processor, reward designer, decision-maker, and generator. For each role, we summarize the methodologies, analyze the specific RL challenges that are mitigated and provide insights into future directions. Finally, the comparative analysis of each role, potential applications, prospective opportunities, and challenges of the LLM-enhanced RL are discussed. By proposing this taxonomy, we aim to provide a framework for researchers to effectively leverage LLMs in the RL field, potentially accelerating RL applications in complex applications, such as robotics, autonomous driving, and energy systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Framework implementations support comprehensive ecosystems: AutoGen enables dynamic response generation, MetaGPT provides shared message pools, CAMEL offers integrated orchestration, CrewAI facilitates adaptation, with reinforcement learning integration enhancing reward redesign, action selection, and policy interpretation [188, 38, 119, 1004, 228, 871, 935, 958, 1273].”
From A Survey of Context Engineering for Large Language Models (2025) · cites this paper as [119]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453
Self-citationProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“…are largely driven by scaling laws , i.e., as these models grow in size—both in terms of their parameter count, and the data they are trained on—they tend to exhibit emergent abilities that are not present in small models [66], [67], [68], such as in-context learning, reasoning, and generalization.”
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 1×
“To effectively learn these representations, a contrastive loss function such as InfoNCE [89] is used where exp is the exponential symbol and the whole L c can be viewed as the log-loss of a softmax classifier, treating the matching of q to k as a multiclass classification problem among K classes.”
Self-citationSoft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Self-Refine: Iterative Refinement with Self-Feedback
Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.17651 · Cited by 2,314
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Gu, A., & Dao, T. (2023) · arXiv · doi:10.48550/arxiv.2312.00752 · Cited by 1,579
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Bias and Fairness in Large Language Models: A Survey
Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 1,245
Mastering Atari, Go, chess and shogi by planning with a learned model
Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., Graepel, T., et al. (2020) · Nature · doi:10.1038/s41586-020-03051-4 · Cited by 1,214
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · UCL Discovery (University College London) · Cited by 1,187
Anderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158
Self-citation(2015) · Journal of Machine Learning Research · Cited by 1,119
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Wang, L., Zhang, X., Su, H., & Zhu, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367329 · Cited by 1,113 · cited 1×
“Continual learning techniques are also a hot field that enables models to continuously acquire new knowledge while retaining previously learned capabilities [168].”
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087
Dota 2 with Large Scale Deep Reinforcement Learning
OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.06680 · Cited by 1,065
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Offline Reinforcement Learning as One Big Sequence Modeling ProblemPreprint
Janner, M., Li, Q.-Y., & Levine, S. (2021) · Neural Information Processing Systems · doi:10.48550/arxiv.2106.02039 · Cited by 968
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2176 · Cited by 932
Review - Mastering the game of Go with deep neural networks and tree search
Babbar, S. (2017) · Unpublished · doi:10.13140/rg.2.2.18893.74727 · Cited by 929
Model-based Reinforcement Learning: A Survey
Moerland, T. M., Broekens, J., Plaat, A., & Jonker, C. M. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000086 · Cited by 871
Decision Transformer: Reinforcement Learning via Sequence ModelingPreprint
Chen, L.-L., Lu, K., Rajeswaran, A., Lee, K., Grover, A., Laskin, M., Abbeel, P., Srinivas, A., & Mordatch, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01345 · Cited by 849
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2021) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 783
Code as Policies: Language Model Programs for Embodied Control
Liang, J., Huang, W., Xia, F., Xu, P., Hausman, K., Ichter, B., Florence, P., & Zeng, A. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160591 · Cited by 767
Learning Latent Dynamics for Planning from Pixels
Hafner, D., Lillicrap, T., Fischer, I., Villegas, R., Ha, D., Lee, H., & Davidson, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04551 · Cited by 708
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., Vanhoucke, V., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.10293 · Cited by 697
A Survey of Visual Transformers
Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J. S., Tian, J., Zhang, Y. S., Shi, Z., Jianping Fan, B., & He, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3227717 · Cited by 652
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01842 · Cited by 630
Self-citationDo As I Can, Not As I Say: Grounding Language in Robotic Affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.01691 · Cited by 624
Multitask Prompted Training Enables Zero-Shot Task Generalization
Sanh, V., Webson, A., Raffel, C., Bach, S. H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T. L., Raja, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.08207 · Cited by 612
Deep learning, reinforcement learning, and world models
Matsuo, Y., LeCun, Y., Sahani, M., Precup, D., Silver, D., Sugiyama, M., Uchibe, E., & Morimoto, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.037 · Cited by 611
Superhuman AI for multiplayer poker
Brown, N., & Sandholm, T. (2019) · Science · doi:10.1126/science.aay2400 · Cited by 592
A Survey on the Memory Mechanism of Large Language Model-based Agents
Zhang, Z., Dai, Q., Bo, X., Ma, C., Li, R., Chen, X., Zhu, J., Dong, Z., & Wen, J.-R. (2025) · ACM Transactions on Information Systems · doi:10.1145/3748302 · Cited by 592
Dream to Control: Learning Behaviors by Latent Imagination
Hafner, D., Lillicrap, T., Ba, J., & Norouzi, M. (2019) · arXiv · doi:10.48550/arxiv.1912.01603 · Cited by 558
Graph of Thoughts: Solving Elaborate Problems with Large Language Models
Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Podstawski, M., Gianinazzi, L., Gajda, J., Lehmann, T., Niewiadomski, H., Nyczyk, P., et al. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29720 · Cited by 556
Learning to summarize from human feedback
Stiennon, N., Ouyang, L., Wu, J., Ziegler, D. M., Lowe, R., Voss, C., Radford, A., Amodei, D., & Christiano, P. (2020) · arXiv · doi:10.48550/arxiv.2009.01325 · Cited by 550
Language to Rewards for Robotic Skill SynthesisPreprint
Yu, W., Gileadi, N., Fu, C., Kirmani, S., Lee, K.-H., Arenas, M. G., Chiang, H., Erez, T., Hasenclever, L., Humplik, J., et al. (2023) · Conference on Robot Learning · doi:10.48550/arxiv.2306.08647 · Cited by 485
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
Song, C. H., Sadler, B. M., Wu, J., Chao, W.-L., Washington, C., & Su, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00280 · Cited by 435 · cited 1×
“Previous works generally ground natural language into individual task components, such as task objectives description [93], rewards [94], and polices [95], [96].”
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.67 · Cited by 428
Emergent analogical reasoning in large language models
Webb, T., Holyoak, K. J., & Lu, H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01659-w · Cited by 404
Talking about Large Language Models
Shanahan, M. (2024) · Communications of the ACM · doi:10.1145/3624724 · Cited by 381 · cited 1×
“LLMs typically refer to the Transformer-based language models [12] containing billions of parameters and being trained on massive text data (i.e., several terabytes (TBs) scale) [64], such as GPT-3 [28] and LLaMA [65].”
Generating with Confidence: Uncertainty Quantification for Black-box Large Language ModelsPreprint
Lin, Z., Trivedi, S., & Sun, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.19187 · Cited by 334
Grounding Large Language Models in Interactive Environments with Online Reinforcement LearningPreprint
Carta, T., Romac, C., Wolf, T., Lamprier, S., Sigaud, O., & Oudeyer, P. (2023) · International Conference on Machine Learning · doi:10.48550/arxiv.2302.02662 · Cited by 307
SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models
Kannan, S. S., Venkatesh, V. L. N., & Min, B. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802322 · Cited by 306
Exploring Large Language Model‐Based Intelligent Agents: Definitions, Methods, and Prospects
Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., et al. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70111 · Cited by 286
Self-citationShould ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · doi:10.2139/ssrn.4614228 · Cited by 282
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · arXiv · doi:10.48550/arxiv.2304.03738 · Cited by 282
A Survey of Reinforcement Learning Informed by Natural Language
Luketina, J., Nardelli, N., Farquhar, G., Foerster, J., Andreas, J., Grefenstette, E., Whiteson, S., & Rocktäschel, T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/880 · Cited by 279
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
Brohan, A., Brown, N., Carbajal, J., Chebotar, Y., Chen, X., Choromanski, K., Ding, T., Driess, D., Dubey, A., Finn, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.15818 · Cited by 276 · cited 1×
“To integrate multimodal data, e.g., vision and language, into the offline RL, Zitkovich et al. [133] co-fine-tuned VLMs on both robotic trajectory data and Internet-scale vision-language tasks, e.g., visual Q&A.”
Modular Multitask Reinforcement Learning with Policy Sketches
Andreas, J., Klein, D., & Levine, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01796 · Cited by 274
WebGPT: Browser-assisted question-answering with human feedback
Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., Saunders, W., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.09332 · Cited by 272
Mastering Atari with Discrete World Models
Hafner, D., Lillicrap, T., Norouzi, M., & Ba, J. (2020) · arXiv · doi:10.48550/arxiv.2010.02193 · Cited by 247
Data-Efficient Reinforcement Learning with Self-Predictive RepresentationsPreprint
Schwarzer, M., Anand, A., Goel, R., Hjelm, R. D., Courville, A. C., & Bachman, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05929 · Cited by 246
Gorilla: Large Language Model Connected with Massive APIs
Patil, S., Zhang, T., Wang, X., & Gonzalez, J. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-4020 · Cited by 226
Gorilla: Large Language Model Connected with Massive APIs
Patil, S. G., Zhang, T., Wang, X., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2305.15334 · Cited by 226
End-To-End Robotic Reinforcement Learning without Reward Engineering
Singh, A., Yang, L., Finn, C., & Levine, S. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.073 · Cited by 208
EPlus-LLM: A large language model-based computing platform for automated building energy modeling
Jiang, G., Ma, Z., Zhang, L., & Chen, J. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123431 · Cited by 204
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web
Majumdar, A., Shrivastava, A., Lee, S., Anderson, P., Parikh, D., & Batra, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_16 · Cited by 201
A Survey of Multi-Task Deep Reinforcement Learning
Varghese, N. V., & Mahmoud, Q. H. (2020) · Electronics · doi:10.3390/electronics9091363 · Cited by 173
Goal Misgeneralization in Deep Reinforcement LearningPreprint
Langosco, L., Koch, J., Sharkey, L. D., Pfau, J., Orseau, L., & Krueger, D. (2021) · International Conference on Machine Learning · doi:10.48550/arxiv.2105.14111 · Cited by 171
A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy AdaptationPreprint
Yang, R., Sun, X., & Narasimhan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.08342 · Cited by 168
Reinforcement Learning with Action-Free Pre-Training from VideosPreprint
Seo, Y., Lee, K., James, S., & Abbeel, P. (2022) · International Conference on Machine Learning · doi:10.48550/arxiv.2203.13880 · Cited by 163
Interactive Fiction Games: A Colossal Adventure
Hausknecht, M., Ammanabrolu, P., Côté, M.-A., & Yuan, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6297 · Cited by 158
TransDreamer: Reinforcement Learning with Transformer World ModelsPreprint
Chen, C., Wu, Y., Yoon, J., & Ahn, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.09481 · Cited by 147
Guiding Pretraining in Reinforcement Learning with Large Language ModelsPreprint
Du, Y., Watkins, O., Wang, Z., Colas, C., Darrell, T., Abbeel, P., Gupta, A. K., & Andreas, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.06692 · Cited by 147
ProgPrompt: program generation for situated robot task planning using large language models
Singh, I., Blukis, V., Mousavian, A., Goyal, A., Xu, D.-F., Tremblay, J., Fox, D., Thomason, J., & Garg, A. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10135-3 · Cited by 141
Reward Function Design in Reinforcement Learning
Eschmann, J. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-41188-6_3 · Cited by 137
Reward (Mis)design for autonomous driving
Knox, W. B., Allievi, A., Banzhaf, H., Schmitt, F., & Stone, P. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2022.103829 · Cited by 125
Hadfield-Menell, D., Milli, S., Abbeel, P., Russell, S., & Dragan, A. (2017) · arXiv · doi:10.48550/arxiv.1711.02827 · Cited by 125
LLM-based Multi-Agent Reinforcement Learning: Current and Future DirectionsPreprint
Sun, C., Huang, S., & Pompili, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.11106 · Cited by 124
Decoupling Representation Learning from Reinforcement Learning
Stooke, A., Lee, K., Abbeel, P., & Laskin, M. (2020) · arXiv · doi:10.48550/arxiv.2009.08319 · Cited by 123
Pre-Trained Language Models for Interactive Decision-Making
Li, S., Puig, X., Paxton, C., Du, Y., Wang, C. J., Fan, L., Chen, T., Huang, D.-A., Akyürek, E., Anandkumar, A., et al. (2022) · CaltechAUTHORS (California Institute of Technology) · doi:10.48550/arxiv.2202.01771 · Cited by 120
Interactive Language: Talking to Robots in Real Time
Lynch, C., Wahid, A., Tompson, J., Ding, T., Betker, J., Baruch, R., Armstrong, T., & Florence, P. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3295255 · Cited by 113
Interactive Language: Talking to Robots in Real Time
Lynch, C., Wahid, A., Tompson, J., Ding, T., Betker, J., Baruch, R., Armstrong, T., & Florence, P. (2022) · arXiv · doi:10.48550/arxiv.2210.06407 · Cited by 113
(2017) · Utah State University Press eBooks · doi:10.2307/j.ctt4cgngj.10 · Cited by 110
Language as an Abstraction for Hierarchical Deep Reinforcement Learning
Jiang, Y., Gu, S., Murphy, K., & Finn, C. (2019) · arXiv · doi:10.48550/arxiv.1906.07343 · Cited by 109
Larger language models do in-context learning differently
Wei, J., Wei, J., Tay, Y., Tran, D., Webson, A., Lu, Y., Chen, X., Liu, H., Huang, D., Zhou, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.03846 · Cited by 109
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model FeedbackPreprint
Wang, Y., Sun, Z., Zhang, J. M., Xian, Z., Bıyık, E., Held, D., & Erickson, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.03681 · Cited by 108
Multimodal transformer with adaptive modality weighting for multimodal sentiment analysis
Wang, Y., He, J., Wang, D., Wang, Q., Wan, B., & Luo, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127181 · Cited by 104
A Unified Continual Learning Framework with General Parameter-Efficient Tuning
Gao, Q., Zhao, C., Sun, Y., Xi, T., Zhang, G., Ghanem, B., & Zhang, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01055 · Cited by 104
Learning to Model the World with LanguagePreprint
Lin, J., Du, Y.-Q., Watkins, O., Hafner, D., Abbeel, P., Klein, D., & Dragan, A. (2023) · International Conference on Machine Learning · doi:10.48550/arxiv.2308.01399 · Cited by 99
Can Wikipedia Help Offline Reinforcement Learning?Preprint
Reid, M., Yamada, Y., & Gu, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.12122 · Cited by 92
XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language ModelsPreprint
Cambria, E., Malandri, L., Mercorio, F., Nobani, N., & Seveso, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.15248 · Cited by 92
What learning algorithm is in-context learning? Investigations with linear models
Akyürek, E., Schuurmans, D., Andreas, J., Ma, T., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2211.15661 · Cited by 86
Efficient Adversarial Training in LLMs with Continuous Attacks
Xhonneux, S., Sordoni, A., Günnemann, S., Gidel, G., & Schwinn, L. (2024) · neural information processing systems · doi:10.52202/079017-0048 · Cited by 86
Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models
Xiao, T. G., Chan, H., Sermanet, P., Wahid, A., Brohan, A., Hausman, K., Levine, S., & Tompson, J. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.029 · Cited by 84
Keep CALM and Explore: Language Models for Action Generation in Text-based Games
Yao, S., Rao, R., Hausknecht, M., & Narasimhan, K. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.704 · Cited by 75
Deng, C., Duan, Y., Jin, X., Chang, H., Tian, Y., Liu, H., Wang, Y., Gao, K., Zou, H. P., Jin, Y., et al. (2025) · AI and Ethics · doi:10.1007/s43681-025-00797-3 · Cited by 73
Emergent autonomous scientific research capabilities of large language models
Boiko, D. A., MacKnight, R., & Gomes, G. (2023) · arXiv · doi:10.48550/arxiv.2304.05332 · Cited by 72
Eureka: Human-Level Reward Design via Coding Large Language ModelsPreprint
Ma, Y. J., Liang, W., Wang, G., Huang, D.-A., Bastani, O., Jayaraman, D., Zhu, Y., Fan, L., & Anandkumar, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.12931 · Cited by 71
Improving Generalization in Reinforcement Learning with Mixture RegularizationPreprint
Wang, K., Kang, B., Shao, J., & Feng, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10814 · Cited by 67
Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents
Talebirad, Y., & Nadiri, A. (2023) · arXiv · doi:10.48550/arxiv.2306.03314 · Cited by 65
Booth, S., Knox, W. B., Shah, J., Niekum, S., Stone, P., & Allievi, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i5.25733 · Cited by 62
Scaling Laws for Reward Model Overoptimization
Gao, L., Schulman, J., & Hilton, J. (2022) · arXiv · doi:10.48550/arxiv.2210.10760 · Cited by 62
Reinforcement Learning for Engineering Design Automation
Dworschak, F., Dietze, S., Wittmann, M., Schleich, B., & Wartzack, S. J. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101612 · Cited by 61
Constraints Penalized Q-learning for Safe Offline Reinforcement Learning
Xu, H., Zhan, X., & Zhu, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20855 · Cited by 58
Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics TasksPreprint
Dalal, M., Chiruvolu, T., Chaplot, D. S., & Salakhutdinov, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.01534 · Cited by 55
Visual Navigation With Multiple Goals Based on Deep Reinforcement Learning
Rao, Z., Wu, Y., Yang, Z., Zhang, W., Lu, S., Lu, W., & Zha, Z.-J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3057424 · Cited by 53
Deductive Reinforcement Learning for Visual Autonomous Urban Driving Navigation
Huang, C., Zhang, R., Ouyang, M., Wei, P., Lin, J., Su, J., & Lin, L. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3109284 · Cited by 50
Safety-Aware Human-in-the-Loop Reinforcement Learning With Shared Control for Autonomous Driving
Huang, W., Liu, H., Huang, Z., & Lv, C. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3420959 · Cited by 50
General generative AI-based image augmentation method for robust rooftop PV segmentation
Tan, H., Guo, Z., Lin, Z., Chen, Y., Huang, D., Yuan, W., Zhang, H., & Yan, J. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123554 · Cited by 48
Self-citationLarge Language Model as a Policy Teacher for Training Reinforcement Learning Agents
Zhou, Z., Hu, B., Zhao, C., Zhang, P., & Liu, B. (2024) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/627 · Cited by 46
Reward Design with Language Models
Kwon, M., Xie, S. M., Bullard, K., & Sadigh, D. (2023) · arXiv · doi:10.48550/arxiv.2303.00001 · Cited by 45
Fine-Tuning Large Language Models with User-Level Differential PrivacyPreprint
Charles, Z., Ganesh, A., McKenna, R., McMahan, H. B., Mitchell, N., Pillutla, K., & Rush, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.07737 · Cited by 45
Learning to Combat Compounding-Error in Model-Based Reinforcement LearningPreprint
Xiao, C., Wu, Y., Ma, C., Schuurmans, D., & Müller, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11206 · Cited by 44
Language Instructed Reinforcement Learning for Human-AI CoordinationPreprint
Hu, H., & Sadigh, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.07297 · Cited by 43
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
Li, H., Yang, X., Wang, Z., Zhu, X., Zhou, J., Qiao, Y., Wang, X., Li, H., Lu, L., & Dai, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01554 · Cited by 42
Multitask Learning and Reinforcement Learning for Personalized Dialog Generation: An Empirical Study
Yang, M., Huang, W., Tu, W., Qu, Q., Shen, Y., & Lei, K. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2975035 · Cited by 41
Tan, R. S. Y. C., Lin, Q., Low, G. H., Lin, R., Goh, T. C., Chang, C. C. E., Lee, F. F., Chan, W. Y., Tan, W. C., Tey, H. J., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad133 · Cited by 41
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language ModelsPreprint
Gao, Z., Liu, P., Zhao, W. X., Lu, Z.-Y., & Wen, J.-R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.01104 · Cited by 37
ElecBench: a Power Dispatch Evaluation Benchmark for Large Language ModelsPreprint
Zhou, X.-Y., Zhao, H., Cheng, Y.-H., Cao, Y., Liang, G., Liu, G.-L., Liu, W.-X., Xu, Y., & Zhao, J.-H. (2024) · arXiv.org · doi:10.48550/arxiv.2407.05365 · Cited by 36
Self-citationMasked World Models for Visual ControlPreprint
Seo, Y., Hafner, D., Liu, H., Liu, F., James, S., Lee, K., & Abbeel, P. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.14244 · Cited by 33
Agashe, S., Fan, Y., Reyna, A., & Wang, X. E. (2025) · Findings of the Association for Computational Linguistics: NAACL 2025 · doi:10.18653/v1/2025.findings-naacl.448 · Cited by 32
A Survey of Explainable Reinforcement Learning
Milani, S., Topin, N., Veloso, M., & Fang, F. (2022) · arXiv · doi:10.48550/arxiv.2202.08434 · Cited by 30
Unleashing the Power of Pre-trained Language Models for Offline Reinforcement LearningPreprint
Shi, R., Liu, Y., Ze, Y., Du, S. S., & Xu, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.20587 · Cited by 30
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Yu, J., Wang, X., Tu, S., Cao, S., Zhang-Li, D., Lv, X., Peng, H., Yao, Z., Zhang, X., Li, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.09296 · Cited by 29 · cited 1×
“In addition, leveraging the vast amounts of training data, pretrained LLMs are equipped with a broad spectrum of world knowledge [39].”
Learning Rewards From Linguistic Feedback
Sumers, T. R., Ho, M. K., Hawkins, R. D., Narasimhan, K., & Griffiths, T. L. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i7.16749 · Cited by 28
Transformers are Sample Efficient World Models
Micheli, V., Alonso, E., & Fleuret, F. (2022) · arXiv · doi:10.48550/arxiv.2209.00588 · Cited by 25
Asynchronous Large Language Model Enhanced Planner for Autonomous Driving
Chen, Y., Ding, Z., Wang, Z., Wang, Y., Zhang, L., & Liu, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_2 · Cited by 23
Self-citationGrounding Language to Non-Markovian Tasks with No Supervision of Task Specifications
Patel, R., Pavlick, E., & Tellex, S. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.016 · Cited by 22
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals
Wu, Y., Fan, Y., Liang, P. P., Azaria, A., Li, Y., & Mitchell, T. M. (2023) · neural information processing systems · doi:10.52202/075280-0048 · Cited by 22
Self-citationELLA: Exploration through Learned Language AbstractionPreprint
Mirchandani, S., Karamcheti, S., & Sadigh, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05825 · Cited by 21
Semantic HELM: A Human-Readable Memory for Reinforcement Learning
Paischer, F., Adler, T., Hofmarcher, M., & Hochreiter, S. (2023) · Neural Information Processing Systems · doi:10.52202/075280-0429 · Cited by 21
DeRL: Coupling Decomposition in Action Space for Reinforcement Learning Task
He, Z., Li, J., Wu, F., Shi, H., & Hwang, K. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3326551 · Cited by 20
Yang, Z., Ren, K., Luo, X., Liu, M., Liu, W., Bian, J., Zhang, W., & Li, D. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/508 · Cited by 20
Constrained Decision Transformer for Offline Safe Reinforcement LearningPreprint
Liu, Z., Guo, Z., Yao, Y., Cen, Z., Yu, W., Zhang, T., & Zhao, D. X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.07351 · Cited by 18
Inoue, Y., & Ohashi, H. (2022) · arXiv · doi:10.48550/arxiv.2211.03267 · Cited by 17
PaCo: Parameter-Compositional Multi-Task Reinforcement Learning
Sun, L., Zhang, H., Xu, W., & Tomizuka, M. (2022) · neural information processing systems · doi:10.52202/068431-1562 · Cited by 16
Efficient Adversarial Training in LLMs with Continuous Attacks
Xhonneux, S., Sordoni, A., Günnemann, S., Gidel, G., & Schwinn, L. (2024) · arXiv · doi:10.48550/arxiv.2405.15589 · Cited by 16
Vision-Language Models are Zero-Shot Reward Models for Reinforcement LearningPreprint
Rocamonde, J., Montesinos, V., Nava, E., Perez, E., & Lindner, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.12921 · Cited by 14
Mobile battery energy storage system control with knowledge‐assisted deep reinforcement learning
Zhao, H. Q., Liu, Z., Mai, X., Zhao, J., Qiu, J., Liu, G., Dong, Z. Y., & Ghias, A. M. Y. M. (2022) · Energy Conversion and Economics · doi:10.1049/enc2.12075 · Cited by 13
Self-citationReCoRe: Regularized Contrastive Representation Learning of World Model
Poudel, R. P. K., Pandya, H., Liwicki, S., & Cipolla, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02161 · Cited by 12
Nottingham, K., Ammanabrolu, P., Suhr, A., Choi, Y., Hajishirzi, H., Singh, S., & Fox, R. (2023) · arXiv · doi:10.48550/arxiv.2301.12050 · Cited by 12
Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignment
Gordon, B., Bitton, Y., Shafir, Y., Garg, R., Chen, X., Lischinski, D., Cohen‐Or, D., & Szpektor, I. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_18 · Cited by 12
Efficient Multitask Reinforcement Learning via Task-Specific Action Correction
Feng, J., Chen, M., Pu, Z., Qiu, T., Yi, J., & Zhang, J. (2025) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2025.3543694 · Cited by 11
Supervised Pretraining Can Learn In-Context Reinforcement Learning
Lee, J., Xie, A., Pacchiano, A., Chandak, Y., Finn, C., Nachum, O., & Brunskill, E. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1866 · Cited by 11
Lygerakis, F., Dave, V., & Rueckert, E. (2024) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur61395.2024.10597462 · Cited by 10
Song, J., Zhou, Z., Liu, J., Fang, C., Shu, Z., & Ma, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.06687 · Cited by 8
Lee, J., Păduraru, C., Mankowitz, D. J., Heess, N., Precup, D., Kim, K.-E., & Guez, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.08957 · Cited by 7
SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM InferencePreprint
Corro, L. D., Giorno, A. D., Agarwal, S., Yu, B., Awadallah, A. H., & Mukherjee, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.02628 · Cited by 7
Guide Your Agent with Adaptive Multimodal Rewards
Kim, C., Seo, Y., Liu, H., Lee, L., Shin, J., Lee, H., & Lee, K. (2023) · neural information processing systems · doi:10.52202/075280-2373 · Cited by 7
Goal-Conditioned Predictive Coding for Offline Reinforcement Learning
Zeng, Z., Zhang, C., Wang, S., & Sun, C. (2023) · neural information processing systems · doi:10.52202/075280-1111 · Cited by 7
A Closer Look at Reward Decomposition for High-Level Robotic Explanations
Lu, W., Zhao, X., Magg, S., Gromniak, M., Li, M., & Wermter, S. (2023) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl55364.2023.10364407 · Cited by 6
Efficient Prompting via Dynamic In-Context LearningPreprint
Zhou, W., Jiang, Y. E., Cotterell, R., & Sachan, M. (2023) · arXiv (Cornell University) · doi:10.3929/ethz-b-000653704 · Cited by 5
Language Reward Modulation for Pretraining Reinforcement LearningPreprint
Adeniji, A., Xie, A., Sferrazza, C., Seo, Y., James, S., & Abbeel, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.12270 · Cited by 5
Basavatia, S., Murugesan, K., & Ratnakar, S. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.935 · Cited by 5
Efficient Policy Adaptation with Contrastive Prompt Ensemble for Embodied Agents
Choi, W., Kim, W. K., Kim, S., & Woo, H. (2023) · neural information processing systems · doi:10.52202/075280-2420 · Cited by 5
Pang, J.-C., Yang, X., Yang, S., & Yu, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.09368 · Cited by 4
Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language ModelsPreprint
Chu, K., Zhao, X., Weber, C., Li, M., & Wermter, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.02379 · Cited by 4
Testing Language Model Agents Safely in the Wild
Naihin, S., Atkinson, D., Green, M., Hamadi, M., Swift, C., Schonholtz, D., Kalai, A. T., & Bau, D. (2023) · arXiv · doi:10.48550/arxiv.2311.10538 · Cited by 4
Chakraborty, S., Weerakoon, K., Poddar, P., Elnoor, M., Narayanan, P., Busart, C., Tokekar, P., Bedi, A. S., & Manocha, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.07622 · Cited by 3
Think Before You Act: Unified Policy for Interleaving Language Reasoning with ActionsPreprint
Mezghani, L., Bojanowski, P., Alahari, K., & Sukhbaatar, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.11063 · Cited by 3
GAIA -- A Large Language Model for Advanced Power DispatchPreprint
Cheng, Y., Zhao, H. Q., Zhou, X., Zhao, J., Cao, Y., & Yang, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.03847 · Cited by 3
Self-citationToward Robust Multimodal Learning using Multimodal Foundational ModelsPreprint
Zhao, X., Poria, S., Li, X., Chen, Y., & Tang, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.13697 · Cited by 2
Self-citationBuçinca, Z., Swaroop, S., Paluch, A. E., Murphy, S. A., & Gajos, K. Z. (2024) · arXiv · doi:10.48550/arxiv.2403.05911 · Cited by 2
LanGWM: Language Grounded World ModelPreprint
Poudel, R. P. K., Pandya, H., Zhang, C., & Cipolla, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.17593 · Cited by 1
Addressing Bias Through Ensemble Learning and Regularized Fine-TuningPreprint
Radwan, A., Zaafarani, L., Abudawood, J., AlZahrani, F., & Fourat, F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.00910 · Cited by 1
Research works printed but not linked: 18
- Sutton, 2018, Reinforcement Learning: An Introduction
- Schmid, 2021, Rebel: A general game playing AI, Science, 373, 664
- Mandlekar, 2021, What matters in learning from offline human demonstrations for robot manipulation, arXiv:2108.03298 · arXiv
- Radford, 2018, Improving Language Understanding By Generative Pre-Training
- Devidze, Exploration-guided reward shaping for reinforcement learning under sparse rewards, 35, 5829
- Cho, Hard tasks first: Multi-task reinforcement learning through task scheduling, 1
- Zhang, Efficient multi-task reinforcement learning via selective behavior sharing, 1
- Yuan, 2023, Plan4mc: Skill reinforcement learning and planning for open-world minecraft tasks, arXiv:2303.16563 · arXiv
- Paischer, 2023, History compression via language models in reinforcement learning, arXiv:2205.12258 · arXiv
- 10.1109/ICRA48891.2023.10160591 · DOI · Paper page
- Spiegel, Informing reinforcement learning agents by grounding language to Markov decision processes, 1
- Nair, 2022, R3M: A universal visual representation for robot manipulation, arXiv:2203.12601 · arXiv
- Xie, Text2reward: Reward shaping with language models for reinforcement learning, 1
- Chakraborty, 2023, REBEL: A regularization-based solution for reward overoptimization in robotic reinforcement learning from human feedback, arXiv:2312.14436 · arXiv
- Fu, 2020, D4RL: Datasets for deep data-driven reinforcement learning, arXiv:2004.07219 · arXiv
- Robine, 2023, Transformer-based world models are happy with 100k interactions, arXiv:2303.07109 · arXiv
- Das, State2explanation: Concept-based explanations to benefit agent learning and user understanding, 1
- Slumbers, Leveraging large language models for optimised coordination in textual multi-agent reinforcement learning, 1
Cited by
Sorted by citations
A review of large language models and autonomous agents in chemistry
Ramos, M. C., Collison, C. J., & White, A. D. (2025) · Chemical Science · doi:10.1039/d4sc03921a · Cited by 274
LLM-based framework for bearing fault diagnosis
Tao, L., Liu, H., Ning, G., Cao, W., Huang, B., & Lu, C. (2024) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2024.112127 · Cited by 211
Chen, C., Zhao, K., Leng, J., Liu, C., Fan, J., & Zheng, P. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.102982 · Cited by 118
Survey of Different Large Language Model Architectures: Trends, Benchmarks, and Challenges
Shao, M., Basit, A., Karri, R., & Shafique, M. (2024) · IEEE Access · doi:10.1109/access.2024.3482107 · Cited by 130
A Comprehensive Survey of Foundation Models in Medicine
Khan, W., Leem, S., See, K. B., Wong, J. K., Zhang, S., & Fang, R. (2025) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2025.3531360 · Cited by 137
Metadata
- Authors
- Cao, Y., Zhao, H., Cheng, Y., Shu, T., Chen, Y., Liu, G., Liang, G., Zhao, J., Yan, J., & Li, Y.
- Affiliations
- Chinese University of Hong Kong (HK)
- Hong Kong Polytechnic University (HK)
- Chinese University of Hong Kong, Shenzhen (CN)
- Shenzhen University (CN)
- Nanyang Technological University (SG)
- Harbin Institute of Technology (CN)
- University of Electronic Science and Technology of China (CN)
- ORCID
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2025-06
- Volume
- 36
- Issue
- 6
- Pages
- 9737-9757
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W4393763811
- Cited by
- 174
- References
- 176
- Citations by year
- 2026: 87 · 2025: 79
- FWCI
- 25.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (72331009, 72171206, 92270105)
- Guangdong Power Grid Company (GDKJXM20231024)
- Shenzhen Key Lab of Crowd Intelligence Empowered Low-Carbon Energy Network (ZDSYS20220606100601002)
- Shenzhen Natural Science Fund (GXWD20231128112434001)
- Shenzhen Institute of Artificial Intelligence and Robotics for Society
- PolyU Direct Grant (P0047700, P0043885, P0051105)
- CUHK Strategic Partnership Award for Research Collaboration (4750467)
- CUHK Direct Grant for Research (4055228)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, reinforcement learning, reward function design, multi-task learning, sample efficiency, task planning, agent-environment interaction, robotics, autonomous driving, energy systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
