CoChat
Sign Up
PreprintCited by 1Reinforcement Learning in RoboticsAutonomous Vehicle Technology and SafetyTraffic and Road Safety

VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving

Open access
Qu, Yansong, Huang, Zilin, Sheng, Zihao, Chen, Jiancong, Leng, Yue, Labi, Samuel, Chen, Sikai·2025·arXiv
DOI 10.48550/arxiv.2505.16377arXiv 2505.16377
Open this paper in CoChat — free accountOpen PDF

Abstract

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit constraints or costs, existing methods often fail to capture the semantic meaning of safety in real driving scenes, leading to conservative behaviors in simple cases and insufficient risk awareness in complex ones. To address this issue, we propose VLM-SAFE, an offline safe RL framework that follows a human cognitive loop of observe-imagine-evaluate-act. Starting from offline driving data, VLM-SAFE observes traffic scenarios and leverages a vision-language model (VLM) to provide semantic safety signals grounded in scene understanding. A learned world model then imagines future trajectories from the observed context, enabling the agent to reason about possible consequences without interacting with the real environment. Rather than using imagined rollouts solely for return estimation, VLM-SAFE further evaluates these predicted futures with VLM-based safety guidance, explicitly coupling future anticipation with semantic risk assessment. The resulting safety-aware imagined experience is finally used to optimize the policy via actor-critic learning, such that actions are chosen based on both predicted outcomes and their safety implications. By tightly integrating observation, imagination, evaluation, and action into a unified closed loop, VLM-SAFE enables safer and more efficient offline policy learning for autonomous driving. Extensive experiments in simulation show that VLM-SAFE achieves improved safety, stronger robustness under traffic-density shift, and a better safety-performance trade-off than representative baselines.

AI snapshot

Written from the paper’s full text.

TL;DR

VL-SAFE is an offline safe RL framework that uses pretrained CLIP as a semantic safety critic to label states, trains a safety-aware DreamerV3 world model to imagine rollouts with safety predictions, and optimizes actor-critic policies under VLM safety guidance plus Lagrangian cost constraints. The paper reports improved safety, sample efficiency, and overall performance over online, offline, and world-model baselines in CarDreamer/CARLA tasks.

Key findings

  • In ablation experiments, full VL-SAFE outperformed its variants across tasks: Four Lane Return 552.43 vs 326.95 (VL-SAFE-NCNL) and 429.18 (VL-SAFE-NC); Navigation Return 1074.96 vs 528.86 and 775.17; it also achieved the lowest Cost across all four tasks (69.17, 0.21, 9.15, 0.0).
  • CLIP analysis found the bigG model consistently outperformed Base, Large, and H across all four tasks, e.g., Four Lane Return 552.43/Cost 69.17 and Navigation Return 1074.96/Cost 9.15; however, in harder tasks (Four Lane, Navigation), larger H and Large models did not always outperform Base.
  • The paper reports VL-SAFE achieves better sample efficiency: DQN performs best in Four Lane Return (612.33) but is trained online for 1M timesteps, while VL-SAFE is trained with only 350k.
  • Safety metrics favor VL-SAFE in ablations: e.g., Four Lane CR 0.05, TCF 0.34, DCF 0.46 vs VL-SAFE-NCNL CR 0.2, TCF 0.89, DCF 1.46, though VL-SAFE’s average speed is slightly lower than variants.

Methods

  • Offline datasets are collected with well-trained DreamerV3 agents in CarDreamer; pretrained CLIP computes per-state safety scores via cosine similarity between BEV images and text prompts, which serve as ground truth for a safety-aware DreamerV3 world model predicting rewards, costs, continuation, and safety.
  • Actor-critic learning uses imagined rollouts and a VLM-weighted policy objective balancing reward advantages under safe states and cost advantages under risky states, with Lagrangian cost constraints; evaluation uses CarDreamer/CARLA Town 03 and Town 04 on Four Lane, Left Turn, Navigation, and Right Turn tasks.
  • Inputs are 64×64×3 BEV images; actions are 15 discrete acceleration-steering combinations; metrics include Return, Cost, AS, WC, TD, AR, CR, TCF, DCF, and CS; baselines include PPO, SAC, DQN, BC, CQL, IQL, DreamerV3, and FSOP.

Limitations

  • Stated: all experiments are in simulation, where rule-based background vehicles fail to reflect stochastic human driving, risking overfitting and poor generalization; pretrained VLMs are trained on general datasets and may lack domain-specific driving understanding, with fine-tuning or GPT-4o suggested as future work.
  • Evident from the text: reported numbers are inconsistent between Table I and Table II for Navigation (Return 935.63/Cost 0.55 vs Return 1074.96/Cost 9.15), and the claim of best Return/Cost in three tasks does not fully match Table I (e.g., Right Turn Return 315.17 < DreamerV3 318.44; Left Turn Cost 1.68 > FSOP 0.22).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.16377

Cites

0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 46 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    DQN performs best in the Four Lane scenario.

    “Although DQN performs best in the Four Lane scenario”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.
  • Findingnone given

    Simply applying Lagrangian methods, as in VL-SAFE-NC, may lead to performance degradation in some tasks (e.g., Left Turn and Right Turn).

    “However, simply applying Lagrangian methods, as in VL-SAFE-NC, may lead to performance degradation in some tasks (e.g., Left Turn and Right Turn).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The Return metric is a valid measure of driving performance.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.
  • Findingown data

    VL-SAFE consistently achieves the best performance on safety-related metrics including CR, TCF, and DCF.

    “Regarding safety-related metrics, including CR, TCF, and DCF, VL-SAFE consistently achieves the best performance”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.
  • Findingown data

    VL-SAFE's average speed (AS) is slightly lower than the other variants across all tasks.

    “Considering the AS metric, VL-SAFE's average speed is slightly lower than the other variants across all tasks”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.
  • Findingown data

    In simpler tasks like Left Turn and Right Turn, larger models such as Large, H, and bigG tended to outperform the smaller Base model.

    “In simpler tasks like Left Turn and Right Turn, the performance trend largely followed the expected pattern: larger models such as Large, H, and bigG tended to outperform the smaller Base model.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The Return metric is a valid measure of driving performance.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.
  • May combine two claims. 34
  • Classified as probably not a substantial claim. 17
  • The quote only partly states this claim. 2

  • May combine two claims.

    Findingnone given

    Keeping training makes the policy become more conservative gradually with a lower average speed.

    “but the policy will also become more conservative gradually with a lower average speed”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    In the Navigation task, VL-SAFE achieves a Return of 1074.96, which is significantly higher than VL-SAFE-NCNL (528.86) and VL-SAFE-NC (775.17).

    “For example, in terms of the Return metric, VL-SAFE achieves 552.43 in the Four Lane task and 1074.96 in the Navigation task, both significantly higher than VL-SAFE-NCNL (326.95 and 528.86, respectively) and VL-SAFE-NC (429.18 and 775.17, respectively).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The Return metric is a valid measure of driving performance.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

  • May combine two claims.

    Findingown data

    VL-SAFE consistently obtains the lowest Cost across all four tasks, with values of 69.17, 0.21, 9.15, and 0.0.

    “Specifically, it consistently obtains the lowest Cost across all four tasks, with values of 69.17, 0.21, 9.15, and 0.0, respectively”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

  • May combine two claims.

    Findingown data

    DQN is trained online for 1M timesteps, while VL-SAFE is trained with only 350k timesteps.

    “it is trained online for 1M timesteps, while VL-SAFE is trained with only 350k”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Keeping training can consistently reduce costs.

    “even though keeping training can consistently reduce costs”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    VL-SAFE achieves superior sample efficiency, generalization, safety, and overall performance compared to existing baselines.

    “Extensive evaluations demonstrate that VL-SAFE achieves superior sample efficiency, generalization, safety, and overall performance compared to existing baselines.”
    • Also stated in: § VII. CONCLUSIONS AND FUTURE WORK · boosted
      “Extensive experiments across multiple simulation platforms demonstrate that VL-SAFE achieves superior sample efficiency, generalization, safety, and overall performance compared to existing baselines.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.
    • Rests on an assumption: The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.
    • Rests on an assumption: The Return metric is a valid measure of driving performance.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

  • May combine two claims.

    Findingown data

    The world model can anticipate future scenes accurately across simulation platforms; it effectively forecasts vehicle motion, including straight paths and right turns, as well as the ego-relative rotation and translation of the BEV image.

    “The results confirm the world model's capability to anticipate future scenes accurately across simulation platforms, the world model effectively forecasts vehicle motion, including straight paths and right turns, as well as the ego-relative rotation and translation of the BEV image.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    In the Four Lane task, VL-SAFE achieves a Return of 552.43, which is significantly higher than VL-SAFE-NCNL (326.95) and VL-SAFE-NC (429.18).

    “For example, in terms of the Return metric, VL-SAFE achieves 552.43 in the Four Lane task and 1074.96 in the Navigation task, both significantly higher than VL-SAFE-NCNL (326.95 and 528.86, respectively) and VL-SAFE-NC (429.18 and 775.17, respectively).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The Return metric is a valid measure of driving performance.
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

  • Classified as probably not a substantial claim.

    Premisecitation

    Safe RL methods explicitly incorporate cost constraints or risk-sensitive objectives into the learning process to restrict unsafe behaviors and ensure long-term safety.

    “Safe RL methods explicitly incorporate cost constraints or risk-sensitive objectives into the learning process to restrict unsafe behaviors and ensure longterm safety”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    World models can reduce interactions by enabling policy learning through imagined rollouts, significantly reducing risky actions and improving sample efficiency.

    “World models [9], [10], [11] can reduce interactions by enabling policy learning through imagined rollouts, this could significantly largely reduce risky actions and improve sample efficiency”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [9]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [10]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [11]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Another limitation lies in the use of pretrained VLMs for safety guidance.

    “Another limitation lies in the use of pretrained VLMs for safety guidance.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Lipschitz continuity promotes stable training, improves generalization to unseen states, and enables reliable safety-aware planning and control.

    “This promotes stable training, improves generalization to unseen states, and enables reliable safety-aware planning and control.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    VLM-RL proposed a contrastive language goal by contrasting both desired and undesired goals combined with vehicle state information for richer reward signals.

    “VLM-RL [35] proposed a contrastive language goal by contrasting both desired and undesired goals combined with vehicle state information for richer reward signals.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [35]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    For safe policy learning, the key point is to keep a balance between maximizing rewards and minimizing costs.

    “For safe policy learning, the key point is to keep a balance between maximizing rewards and minimizing costs.”
    Quote in the paperNot a substantial claim

  • May combine two claims. The quote only partly states this claim.

    Interpretationown data

    VL-SAFE demonstrates efficiency by achieving comparable or better performance with fewer training timesteps than DQN.

    “demonstrating the efficiency of our method.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    Using p(s) to approximate p^VLM in the world model significantly reduces the inference time cost of CLIP and saves computation resources.

    “This can significantly reduce the inference time costed by CLIP and save computation resources.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.

  • May combine two claims.

    Premisecitation

    World models help decouple policy learning from direct environment interaction by simulating future trajectories, thus improving sample efficiency, particularly in safety-critical or data-scarce domains such as autonomous driving.

    “They help decouple policy learning from direct environment interaction by simulating future trajectories, thus improve sample efficiency, particularly in safety-critical or data-scarce domains such as autonomous driving [20], [21], [22].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [20]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [21]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [22]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    A major limitation of Offline RL is Q-value overestimation, primarily resulting from extrapolation errors when evaluating actions that are not well-supported by the dataset.

    “A major limitation of Offline RL is Q-value overestimation, primarily resulting from extrapolation errors when evaluating actions that are not wellsupported by the dataset.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    VL-SAFE is designed to be safety-conscious and conservative, leading to slightly lower mobility but aligning with its core objective of safer policy learning.

    “VL-SAFE, on the other hand, is designed to be safety-conscious and conservative, which leads to slightly lower mobility but aligns with its core objective of safer policy learning.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    SAC and IQL often remain nearly stationary (very slow average speed) due to poor mobility performance, indicating failure to learn effective driving policies.

    “However, considering their poor mobility performance (e.g., low AS and WC), these models often remain nearly stationary (very slow average speed), indicating failure to learn effective driving policies.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    World models learn to simulate environment dynamics from data, enabling agents to plan or imagine rollouts internally.

    “World models learn to simulate environment dynamics from data, enabling agents to plan or imagine rollouts internally [9], [10], [11].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [9]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [10]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [11]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Safe RL might learn a too conservative policy and be unable to generalize due to the lack of semantic understanding of the entire context.

    “safe RL might learn a too conservative policy and unable to generalize due to the lack of semantic understanding of the entire context”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The VLM-as-safety-guidance paradigm provides explicit semantic signals that directly inform the policy which states are safe and should be used to maximize rewards, and which states are unsafe and should be used to minimize costs.

    “In contrast, our VLM-assafety-guidance paradigm provides explicit semantic signals that directly inform the policy which states are safe and should be used to maximize rewards, and which states are unsafe and should be used to minimize costs.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    VLMs jointly process visual inputs and natural language, and have achieved success in general-purpose AI tasks such as image captioning, visual question answering, and embodied intelligence.

    “VLMs jointly process visual inputs and natural language, has been shown to achieve success in general-purpose AI tasks such as image captioning [27], [28], answering visual questions [29], [30], and embodied intelligence [31].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [27]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [28]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [29]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The VLM-generated safety estimation is Lipschitz continuous.

    “Proposition 1.The VLM-generated safety estimation is Lipschitz Continuous.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    Larger models, such as bigG, offer a more robust assessment of safety, making them particularly beneficial in environments where the ability to detect and mitigate risks is critical.

    “Larger models, such as bigG, seem to offer a more robust assessment of safety, making them particularly beneficial in environments where the ability to detect and mitigate risks is critical.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.

  • May combine two claims.

    Interpretationreasoning

    VL-SAFE achieves more precise speed control, enabling it to better follow target trajectories.

    “We infer that VL-SAFE achieves more precise speed control, enabling it to better follow target trajectories.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    VLMs have been widely applied and demonstrated success across diverse domains.

    “They have been widely applied and have demonstrated success across diverse domains [12].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [12]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    Semantic safety reasoning enables agents to make early, context-aware, and proportionate decisions, allowing them to act safely across a variety of road scenarios.

    “This example highlights the advantage of semantic safety reasoning: it enables agents to make early, context-aware, and proportionate decisions, ultimately allowing them to act safely across a variety of road scenarios.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisenone given

    Reliance on online interactions and trial-and-error learning in RL-based autonomous driving is unacceptable in safety-critical scenarios.

    “its reliance on online interactions and trial-and-error learning is especially unacceptable in safety-critical scenarios.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisenone given

    Safe RL methods lack semantic understanding of safety and often overlook driving context, leading to biased overly aggressive or overly conservative policies.

    “These methods are effective but lack semantic understanding of safety and often overlook driving context, leading to biased (overly aggressive or overly conservative) policies.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationown data

    Increased model size not only enhances performance in terms of task completion but also makes the model more effective at minimizing risk and ensuring safety.

    “This highlights that the increased model size not only enhances performance in terms of task completion but also makes the model more effective at minimizing risk and ensuring safety.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.
    • Rests on an assumption: The Return metric is a valid measure of driving performance.

  • May combine two claims.

    Premisereasoning

    Existing methods including safe RL often fail to capture the true semantic meaning of safety in complex driving contexts, leading to either overly conservative driving behavior or constraint violations.

    “These methods are effective but lack semantic understanding of safety and often overlook driving context, leading to biased (overly aggressive or overly conservative) policies.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The weight term combines both reward and cost advantages, and is modulated by a VLM-derived safety probability, which dynamically balances the influence of reward-seeking and cost-avoidance.

    “The weight term combines both reward and cost advantages, and is modulated by a VLM-derived safety probability, which dynamically balances the influence of reward-seeking and costavoidance.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: p(s) measures the safety of state s and 1-p(s) measures the risk.

  • May combine two claims.

    Interpretationreasoning

    VL-SAFE strikes a superior balance between safety and mobility, making it the most effective and risk-aware solution overall.

    “In contrast, VL-SAFE strikes a superior balance between safety and mobility, making it the most effective and risk-aware solution overall.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: VLM-derived safety evaluations can serve as ground truths for training the world model.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    CLIP projects multi-modal inputs into latent space to calculate cosine similarity between two modalities.

    “CLIP projects the multi-modal inputs into latent space to calculate cosine similarity between two modalities.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [37]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    Without VLM safety guidance, the RL agent must rely on extensive trial-and-error training to gradually infer which states are safe and which are unsafe, often resulting in slow convergence and unsafe actions during early learning.

    “Without such safety guidance, the RL agent must rely on extensive trialand-error training to gradually infer which states are safe and which are unsafe, often resulting in slow convergence and unsafe actions during early learning.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    VLM safety signals can guide the RL agent to determine when to maximize rewards and when to minimize costs, leading to learning of a more balanced driving policy in terms of safety and mobility.

    “These signals can guide the RL agent to determine when it is appropriate to maximize rewards (e.g., travel efficiency) and when to minimize costs (e.g., avoid collisions), leading to learning of more balanced driving policy in terms of safety and mobility.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Offline RL still fails occasionally in online testing due to the lack of safety constraints.

    “Offline RL still fails occasionally in online testing due to the lack of safety constraints”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    VLMs are appealing in autonomous driving domains, where they can provide semantic understanding of driving scenes, language-guided planning, curriculum learning, and decision-making.

    “Also, VLMs are appealing in autonomous driving domains, where they can provide semantic understanding of driving scenes [32], language-guided planning [33], curriculum learning [34], and decision-making [35].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [32]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [33]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [34]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The agent should prioritize reward maximization in safe conditions and focus on cost minimization in potentially risky situations, with the timing and degree of this tradeoff guided by the VLM's semantic understanding.

    “The intuition is that the agent should prioritize reward maximization in safe conditions, and focus on cost minimization when encountering potentially risky situations, where the timing and degree of this tradeoff is guided by the semantic understanding provided by the VLM.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: p(s) measures the safety of state s and 1-p(s) measures the risk.

  • Classified as probably not a substantial claim. The quote only partly states this claim.

    Study design and conductreasoning

    Default hyperparameter settings provided by Stable-Baselines3 and D3RLpy were adopted unless otherwise specified to ensure fair and reproducible comparisons.

    “Unless otherwise specified, we adopt the default hyperparameter settings provided by these frameworks to ensure fair and reproducible comparisons.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [50]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [51]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Offline RL removes the need for online exploration entirely by learning from pre-collected driving data, thus avoiding safety concerns of real-time trial-and-error.

    “Offline RL removes the need for online exploration entirely by learning from pre-collected driving data, thus avoiding the safety concerns of real-time trial-and-error”
    • Also stated in: § B. Offline RL · plain
      “By decoupling learning from real-time interactions, offline RL enables the use of previously collected expert demonstrations to develop safety-oriented policies [15].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [15]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Reinforcement learning-based autonomous driving policy learning faces critical limitations such as low sample efficiency and poor generalization.

    “Reinforcement learning (RL)-based autonomous driving policy learning faces critical limitations such as low sample efficiency and poor generalization”
    • Also stated in: § A. Classical Online RL-based autonomous driving · plain
      “Generalization remains a key challenge, agents trained in simulation often fail in other unseen environments [14].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [14]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    LORD uses undesired language goals to shape rewards and offers limited guidance by focusing only on states to avoid.

    “LORD [36] uses undesired language goals to shape rewards and offers limited guidance by focusing only on states to avoid.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [36]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    For algorithms that rely heavily on online interactions, such as SAC and DQN, each model was trained for 1 million steps to ensure convergence and stable performance.

    “For algorithms that rely heavily on online interactions, such as SAC and DQN, we train each model for 1 million steps to ensure convergence and stable performance.”
    Quote in the paperNot a substantial claim
46 of 46

  • The paper relies on this without support.

    VL-SAFE is the first work to introduce a VLM-guided world model-based approach for safe autonomous driving.

    “To the best of our knowledge, this is the first work that introduces a VLM-guided world model-based approach for safe autonomous driving.”

  • The paper relies on this without support.

    VLM-derived safety evaluations can serve as ground truths for training the world model.

    “The VLM's safety evaluations are served as ground truths for the world model to learn and generate safety-aware rollouts”
    “our model generates 𝑝 1:𝑇 𝑉𝐿𝑀 as ground truth by CLIP”

  • The authors state this as an assumption.

    p(s) measures the safety of state s and 1-p(s) measures the risk.

    “We assume 𝑝(s) measures the safety of the state s and 1 -𝑝(s) measures the risk.”

  • The paper relies on this without support.

    CLIP-based safety scores provide a meaningful estimate of driving safety.

    “We use CLIP [37] as our foundational safety estimator for each state in collected datasets.”

  • The paper relies on this without support.

    The safety metrics (Cost, CR, TCF, DCF, CS) used in the experiments are valid measures of driving safety.

    “Regarding safety-related metrics, including CR, TCF, and DCF, VL-SAFE consistently achieves the best performance”

  • The paper relies on this without support.

    The Return metric is a valid measure of driving performance.

    “in terms of the Return metric”

  • The paper relies on this without support.

    The CarDreamer simulation platform is a valid testbed for autonomous driving safety and performance.

    “We evaluate these variants on the CarDreamer simulation platform across four tasks”

  • The paper relies on this without support.

    Simulation cannot fully capture the complexities of the real world.

    “While simulation offers a controlled and reproducible setting, it cannot fully capture the complexities of the real world.”

  • The paper relies on this without support.

    A major contributor to the simulation-reality gap is the unrealistic behavior of background vehicles, which are typically controlled by rule-based models.

    “A major contributor to this gap is the unrealistic behavior of background vehicles, which are typically controlled by rule-based models.”

  • The paper relies on this without support.

    Rule-based background vehicle models fail to reflect the diverse and stochastic nature of human driving, leading to potential overfitting and poor generalization.

    “These models fail to reflect the diverse and stochastic nature of human driving, leading to potential overfitting and poor generalization.”

  • The paper relies on this without support.

    Pretrained VLMs are trained on general datasets and may lack domain-specific understanding of driving scenarios.

    “These models are trained on general datasets and may lack domain-specific understanding of driving scenarios.”

  • The authors state this as an assumption.

    The image encoder is L_f-Lipschitz.

    “If the encoder itself is 𝐿 𝑓 -Lipschitz, then:”
12 of 12

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Navigation VL-SAFE results differ between tables

    Major

    Table I reports a Navigation return of 935.63 and cost of 0.55 for VL-SAFE, whereas Table II reports 1074.96 and 9.15. The accompanying ablation discussion also identifies 1074.96 as the Navigation return.

  • Safety-score proof introduces a sigmoid absent from its definition

    Major

    The proof defines the original safety score by cosine similarity, then treats that same score as a sigmoid applied to cosine similarity. These are different functions.

  • Left Turn VL-SAFE results differ between tables

    Major

    Table I reports a Left Turn return of 358.7 and cost of 1.68 for VL-SAFE; Table II reports 422.96 and 0.21 for the same method and task.

  • Lagrangian expression maximizes where the text says it minimizes

    Minor

    Equation (5) specifies an outer maximization over the multipliers, but the immediately following description calls it an outer minimization.

  • bigG has worse Navigation cost than Base

    Minor

    Table III reports Navigation cost of 9.15 for bigG versus 0.55 for Base, contradicting the claim that bigG outperforms all other models on Cost across all tasks.

  • VL-SAFE does not have the best Right Turn return

    Minor

    Table I gives DreamerV3 a Right Turn return of 318.44, exceeding VL-SAFE's 315.17, contrary to the claim that VL-SAFE has the best Return result for this task.

  • Navigation is another exception to the NCNL cost claim

    Minor

    The text excepts only Four Lane, but in Navigation VL-SAFE-NCNL's cost of 48.41 is lower than VL-SAFE-NC's 54.4, not higher than both other variants.

  • Full method does not outperform the ablations on every task

    Minor

    In Table II's Right Turn task, VL-SAFE's return of 315.17 is below VL-SAFE-NCNL's 318.44; its arrival rate of 0.89 is also below VL-SAFE-NC's 0.93.

  • bigG does not lead every listed Four Lane metric

    Minor

    Table III gives H a higher Four Lane average speed than bigG (4.35 versus 4.25) and a lower TCF (0.3 versus 0.34). Thus bigG does not outperform every other model on the listed metrics.

  • VL-SAFE does not have the best Left Turn cost in Table I

    Minor

    The claimed best Return and Cost results for Left Turn conflict with Table I: VL-SAFE's cost is 1.68, while FSOP's is 0.22 and IQL's is 0.

  • Full method does not always have the best collision frequency

    Minor

    In the Four Lane ablation results, VL-SAFE's TCF is 0.34, higher-and therefore worse-than VL-SAFE-NC's 0.25.

11 of 11

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 23

  1. D. Hafner, T. Lillicrap, M. Norouzi, and J. Ba, "Mastering atari with discrete world models," ArXiv Prepr. ArXiv201002193, 2020.
  2. D. Hafner, T. Lillicrap, J. Ba, and M. Norouzi, "Dream to control: Learning behaviors by latent imagination," ArXiv Prepr. ArXiv191201603, 2019.
  3. K. Qian et al., "FASIONAD++: Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedback," ArXiv Prepr. ArXiv250308162, 2025.
  4. S. Levine, A. Kumar, G. Tucker, and J. Fu, "Offline reinforcement learning: Tutorial, review, and perspectives on open problems," ArXiv Prepr. ArXiv200501643, 2020.
  5. I. Kostrikov, A. Nair, and S. Levine, "Offline reinforcement learning with implicit q-learning," ArXiv Prepr. ArXiv211006169, 2021.
  6. A. Kumar, A. Zhou, G. Tucker, and S. Levine, "Conservative q- learning for offline reinforcement learning," Adv. Neural Inf. Process. Syst., vol. 33, pp. 1179-1191, 2020.
  7. X. Hu, P. Chen, Y. Wen, B. Tang, and L. Chen, "Long and Short- Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving," ArXiv Prepr. ArXiv240318209, 2024.
  8. J. Li, D. Li, S. Savarese, and S. Hoi, "Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models," presented at the International conference on machine learning, PMLR, 2023, pp. 19730-19742.
  9. J. Li, D. Li, C. Xiong, and S. Hoi, "Blip: Bootstrapping language- image pre-training for unified vision-language understanding and generation," presented at the International conference on machine learning, PMLR, 2022, pp. 12888-12900.
  10. H. Lu et al., "Deepseek-vl: towards real-world vision-language understanding," ArXiv Prepr. ArXiv240305525, 2024.
  11. P. Wang et al., "Qwen2-vl: Enhancing vision-language model's perception of the world at any resolution," ArXiv Prepr. ArXiv240912191, 2024.
  12. M. J. Kim et al., "Openvla: An open-source vision-language-action model," ArXiv Prepr. ArXiv240609246, 2024.
  13. X. Tian et al., "Drivevlm: The convergence of autonomous driving and large vision-language models," ArXiv Prepr. ArXiv240212289, 2024.
  14. Y. Xu et al., "Vlm-ad: End-to-end autonomous driving through vision-language model supervision," ArXiv Prepr. ArXiv241214446, 2024.
  15. A. Radford et al., "Learning transferable visual models from natural language supervision," presented at the International conference on machine learning, PmLR, 2021, pp. 8748-8763.
  16. C. Cao et al., "FOSP: Fine-tuning Offline Safe Policy through World Models," ArXiv Prepr. ArXiv240704942, 2024.
  17. X. B. Peng, A. Kumar, G. Zhang, and S. Levine, "Advantage- weighted regression: Simple and scalable off-policy reinforcement learning," ArXiv Prepr. ArXiv191000177, 2019.
  18. A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, "CARLA: An open urban driving simulator," presented at the Conference on robot learning, PMLR, 2017, pp. 1-16.
  19. J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, "Proximal policy optimization algorithms," ArXiv Prepr. ArXiv170706347, 2017.
  20. T. Haarnoja, A. Zhou, P. Abbeel, and S. Levine, "Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor," presented at the International conference on machine learning, Pmlr, 2018, pp. 1861-1870.
  21. X. Qi, J. Wang, Y. Chen, Y. Shi, and L. Zhang, "Lipsformer: Introducing lipschitz continuity to vision transformers," ArXiv Prepr. ArXiv230409856, 2023.
  22. A. Raffin, A. Hill, A. Gleave, A. Kanervisto, M. Ernestus, and N. Dormann, "Stable-baselines3: Reliable reinforcement learning implementations," J. Mach. Learn. Res., vol. 22, no. 268, pp. 1-8, 2021.
  23. T. Seno and M. Imai, "d3rlpy: An offline deep reinforcement learning library," J. Mach. Learn. Res., vol. 23, no. 315, pp. 1-20, 2022.

Cited by

Sorted by citations

Related

Authors
Qu, Y., Huang, Z., Sheng, Z., Chen, J., Leng, Y., Labi, S., & Chen, S.
Affiliations
Purdue University West Lafayette (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2505.16377
arXiv
2505.16377
OpenAlex
W4416451873
Semantic Scholar
f25f4195f21499a2214283a7df2ff517231e69e3
Cited by
1
References
0
Citations by year
2026: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • U.S. Department of Transportation (69A3552348305)
  • Purdue University
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Traffic and Road Safety
Keywords
safe reinforcement learning, autonomous driving, vision-language models, world models, offline policy learning, safety-performance trade-off, actor-critic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-01.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-01.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review