Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates

Li, Yibo; Lin, Zijie; Deng, Ailin; Zhang, Xuan; He, Yufei; Ji, Shuo; Cao, Tri; Hooi, Bryan

doi:10.48550/arxiv.2601.18510

Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates

While Large Language Model (LLM) agents excel at general tasks, they inherently struggle with continual adaptation due to the frozen weights after deployment. Conventional reinforcement learning (RL) offers a solution but incurs prohibitive computational costs and the risk of catastrophic forgett…