The DOI matches its Crossref record; 27 of the 31 references it cites were found in a registry or an index, and 4 are not checked yet; 2 of the 6 sources its claims cite were checked for support.
Safe Reinforcement Learning via Shielding
Open accessAbstract
Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties expressed in temporal logic. To this end, given the temporal logic specification that is to be obeyed by the learning system, we propose to synthesize a reactive system called a shield. The shield monitors the actions from the learner and corrects them only if the chosen action causes a violation of the specification. We discuss which requirements a shield must meet to preserve the convergence guarantees of the learner. Finally, we demonstrate the versatility of our approach on several challenging reinforcement learning scenarios.
Verified 2026-10-24 · 4 references not checked yet
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes shielded reinforcement learning, where a reactive shield synthesized from a temporal-logic safety specification and an environment abstraction monitors learner actions and replaces them only when needed to avoid unsafe behavior. It proves correctness and minimal interference, gives conditions for preserving convergence, and demonstrates safety and often faster learning in four simulated domains.
Key findings
- Shields can enforce safety during both learning and execution without changing the reward signal, and they are minimally interfering: they block an action only when it could lead to a specification violation under the abstraction.
- In the water-tank example, the product game had 602 states, and the shield prevented opening the inflow valve above level 93 and forced opening when the level became too low.
- Shield synthesis was fast in the reported experiments: under 2 seconds for the grid-world cases, about 2 seconds for the self-driving car, under 1 second for the water tank, and under 7 seconds for Pacman.
- In the 15x9 grid world, only the shielded setting with a ranking of 3 actions and no penalty found the optimal path; in the water-tank experiments, shielded Q-learning and SARSA reached optimal policies in significantly fewer episodes than unshielded versions; in the self-driving car case, the shielded learner never crashed and learned faster; in Pacman, the shielded agent cleared the game from the first episode.
Methods
- The approach specifies safety in linear temporal logic, converts it to a deterministic safety automaton, builds a conservative finite-state abstraction of the MDP environment, and solves a safety game to synthesize a shield.
- The shield receives the learner’s action or ranked list of actions and executes the highest-ranked safe action; it deviates only if every ranked action is unsafe, in which case it chooses some safe action.
- The paper proves correctness and minimal interference, constructs a product MDP to argue convergence for standard MDP learners, and evaluates the method in simulations: 9x9 and 15x9 grid worlds, a 480x480-pixel self-driving car task, the water-tank controller, and an 18x5 Pacman-like maze, using tabular Q-learning, deep Q-networks, and approximate Q-learning.
Limitations
- The paper states that the main downside is the need for an approximate model or abstraction indicating when actions are unsafe, and argues this is unavoidable when allowed actions depend on the environment state.
- The convergence argument requires that when the learner’s ranking contains no safe action, the shield’s choice among safe actions follows a fixed probability distribution over time, and it assumes the learner can observe the shield state.
- Evident from the text: the evaluation is entirely simulation-based, with no real-world deployment; the approach relies on the abstraction being conservative, and the shield must remain active after learning because unsafe actions may still be part of the learned policy.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
45 Own interpretation · 10 Own result · 4 No basis given · 1 Partly supported · 1 Not supported · 1 No full text of the sources · 1 Not checked yet · accuracy not yet measured
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results show that only the unshielded versions experience negative rewards.”
§ Safe Reinforcement Learning via Shielding > Experiments
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fig. 11 shows that both shielded (dashed lines) and unshielded Q-learning and SARSA experiments (solid lines) do reach an optimal policy.”
§ Safe Reinforcement Learning via Shielding > Experiments
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all of them, the learning performance of the shielded agents improved compared to the unshielded case.”
§ Safe Reinforcement Learning via Shielding > Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As expected, in the shielded case, pacman is always able to clear the game starting from the first episode.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the shielded implementations reach the optimal policy in a significantly shorter time than the unshielded implementations.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the computational cost of the construction of the shield depends on the complexity of the specification and a very abstract version of the system”
§ Safe Reinforcement Learning via Shielding > Safety in Formal Methods.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“since the shield corrects unsafe actions in the learning and deployment phases.”
§ Safe Reinforcement Learning via Shielding > Related Work Safety in RL.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Even though the inner working of learning algorithms is often complex, shielding with respect to critical safety specifications may be manageable (as we demonstrate in upcoming sections).”
§ Safe Reinforcement Learning via Shielding > Environment
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, to reason about when exactly a specification violation cannot be avoided, we have to give a (coarse finite-state) abstraction of the environment dynamics.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We introduce a new approach to learn optimal policies while enforcing properties expressed in temporal logic.”
§ Safe Reinforcement Learning via Shielding > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 17
- It may state two separate claims as one. 17
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“An exploration process is called safe if no undesirable states are ever visited, which can only be achieved through the incorporation of external knowledge (García and Fernández 2015;Moldovan and Abbeel 2012).”
§ Safe Reinforcement Learning via Shielding > Related Work Safety in RL.
What the sources say
- Not checked — no full text of the sourcecites García and Fernández 2015
- Disputedcites Moldovan and Abbeel 2012 sourceExperimental — accuracy not yet measured
The Safety Constraint section (p. 3) defines safety as preserving ergodicity with a user-specified probability, not as never visiting an undesirable state. The Safety Counter-Examples section (p. 3) explicitly argues against defining safety by safe and unsafe states. The paper uses a prior belief and information learned during exploration, but does not say that incorporating external knowledge is the only way to achieve safety. (LLM, conf=0.82)
Checked by a reasoning model — may be wrong.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unlike the approach in the paper, their technique does not work with function approximation, which prevents it from being used in complex scenarios.”
§ Safe Reinforcement Learning via Shielding > Safety in Formal Methods.
What the sources say
- Partly supportedcites Wen, Ehlers, and Topcu 2015 sourceExperimental — accuracy not yet measured
Section V (Examples; page unavailable) shows that learning time and iterations grow as the grid grows, and describes a trade-off between performance and computation cost. This supports a scalability concern, but the paper does not say that its technique cannot work with function approximation or that it cannot be used in complex scenarios. (LLM, conf=0.76)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The plot in Fig. 10 shows that the accumulated rewards for unshielded RL (red, dashed) increases over time, but the car still crashes at the end of the simulation.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In scenarios with |rank t | = 1 (red) or with penalties (solid), the agent computes a suboptimal path.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only the shielded version with |rank t | = 3 without penalty (blue, dashed) finds the optimal path, resulting in a higher average reward.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the shielded version is not only safe, but also tends to learn more rapidly.”
§ Safe Reinforcement Learning via Shielding > Experiments
hedgedconditionalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The shielded version without punishment (blue, solid) learns more rapidly than the unshielded learner and never crashes.”
§ Safe Reinforcement Learning via Shielding > Experiments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For specifications in LTL, it is known how to check if it is a safety language and how to compute a safety automaton that represents it (Kupferman and Vardi 2001).”
§ Safe Reinforcement Learning via Shielding > The set of all distributions on X is denoted by Distr(X).
What the sources say
- Not checked — no full text of the sourcecites Kupferman and Vardi 2001 source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“An abstraction of an MDP describes how its executions can possibly evolve, and provides the needed information about the environment to allow planning ahead w.r.t. the safety properties of interest.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and is independent of the state space components of the system to be controlled that are irrelevant for enforcing the safety specification.”
§ Safe Reinforcement Learning via Shielding > Safety in Formal Methods.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It ensures safety and minimum interference.”
§ Safe Reinforcement Learning via Shielding > Environment
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The shield is computed upfront from the safety part of the given system specification and an abstraction of the agent's environment dynamics.”
§ Safe Reinforcement Learning via Shielding > Environment
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This boundary helps to separate the concerns, e.g., safety and correctness on one side and convergence and optimality on the other”
§ Safe Reinforcement Learning via Shielding > The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The latter is necessary as the valve has to stay open for at least three time steps.So as the inflow may be up to 2 liters/second during this time and the outflow may be 0, there is otherwise an overflow risk.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approximation may have finitely many states even if the MDP has infinitely many states and/or is only approximately known.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Last but not least, the shielding framework is compatible with mechanisms such as function approximation, employed by learning algorithms in order to improve their scalability.”
§ Safe Reinforcement Learning via Shielding > The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The algorithms we present for the computation of shields make relatively mild assumptions on the input-output structure of the learning algorithm (rather than its inner working).”
§ Safe Reinforcement Learning via Shielding > Environment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Reactive synthesis enforces ϕ s by solving a safety game built from ϕ s and an abstraction of the environment in which the policy is to be executed.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Planning ahead does not require the environment dynamics to be completely known in advance.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“All of the above approaches have in common that a faithful, yet precise enough, abstraction of the physical environment is required, which is not only difficult to obtain in practice, but also introduces the mentioned computa-tional burden.”
§ Safe Reinforcement Learning via Shielding > Safety in Formal Methods.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and provides a basis for the convergence analysis of a shielded RL algorithm.”
§ Safe Reinforcement Learning via Shielding > The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This ensures that paths that model traces that cannot occur in M are rejected by ϕ M as early as possible.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the shield is generated using the specification, it plans ahead for this not to happen, so it must prevent the opening of the inflow valve if the level is above 93.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our setup introduces a clear boundary between the learning agent and the shield.”
§ Safe Reinforcement Learning via Shielding > The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Given that the environment is often represented as an MDP, such an abstraction has to be conservative w.r.t. the behavior of the real MDP.”
§ Safe Reinforcement Learning via Shielding > Safety, Abstractions, and Games
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
- Rests on an assumption: The environment is often represented as an MDP.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Control methods based on RL partly address this problem, but do not typically incorporate any correctness guarantees.”
§ Safe Reinforcement Learning via Shielding > Safety in Formal Methods.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Shielding exploits this possibility.”
§ Safe Reinforcement Learning via Shielding > Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since an unsafe action is always mapped to a safe one, this does not pose a problem and the agent never has to learn to avoid unsafe actions.Consequently, the shield is (again) needed during the learning and execution phases.”
§ Safe Reinforcement Learning via Shielding > Shielded Reinforcement Learning
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our experiments show, however, that in applications in which safe learning is needed, the effort to construct an abstraction is well-spent, as our approach not only makes learning safe, but also shows great promise of improving learning performance.”
§ Safe Reinforcement Learning via Shielding > Conclusion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The agent assigns a punishment r t+1 < 0 to a 1 t and learns that selecting a 1 t at state s t is unsafe, without ever violating ϕ s .”
§ Safe Reinforcement Learning via Shielding > Shielded Reinforcement Learning
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: The environment can be modeled as an MDP M = (S, s_I, A, P, R).
- The authors state this as an assumption: We have constructed an abstraction ϕ_M.
- The authors state this as an assumption: The learner accepts elements from S × Q as state input (for the state space of the shield Q).
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, there is no guarantee that unsafe actions are not part of the final policy.Therefore, the shield has to remain active even after the learning phase.”
§ Safe Reinforcement Learning via Shielding > Shielded Reinforcement Learning
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The authors state this as an assumption.
The specification ϕ is a set of properties {ϕ1,...,ϕl} such that L(ϕ) is the intersection of the languages of its properties.
“We assume ϕ is a set of properties {ϕ 1 , . . ., ϕ l } such that L(ϕ) = i L(ϕ i ).”
The paper relies on this without support.
The environment is often represented as an MDP.
“Given that the environment is often represented as an MDP, such an abstraction has to be conservative w.r.t. the behavior of the real MDP.”
The paper relies on this without support.
Safety or more generally correctness during learning and execution of controllers has attracted significantly less attention than convergence, optimality and data-efficiency of learning algorithms.
“While convergence, optimality and data-efficiency of learning algorithms are relatively well understood, safety or more generally correctness during learning and execution of controllers has attracted significantly less attention.”
The authors state this as an assumption.
The environment can be modeled as an MDP M = (S, s_I, A, P, R).
“Assumption 1 (i) The environment can be modeled as an MDP M = (S, s I , A, P, R).”
The authors state this as an assumption.
We have constructed an abstraction ϕ_M.
“(ii) We have constructed an abstraction ϕ M .”
The authors state this as an assumption.
The learner accepts elements from S × Q as state input (for the state space of the shield Q).
“(iii) The learner accepts elements from S × Q as state input (for the state space of the shield Q).”
The authors state this as an assumption.
Some abstraction ϕ_M = (Q_M, q_0,M, A × L, δ_M, F_M) of M for some MDP observer function f : S → L is given.
“We assume some abstraction ϕ M = (Q M , q 0,M , A × L, δ M , F M ) of M for some MDP observer function f : S → L to be given.”
The authors state this as an assumption.
ϕ_s has Σ = L × A, i.e., it reads the part of the system behavior that the abstraction is concerned with.
“Since ϕ s models a restriction of the traces of the MDP and the learner together that we want to enforce, we assume it to have Σ = L × A, i.e., it reads the part of the system behavior that the abstraction is concerned with.”
The authors state this as an assumption.
A shield S = (Q_S, q_0,S, Σ_I,S, Σ_O,S, δ_S, λ_S) is given for M and for some MDP labeling function f : S → L.
“Assume also that a shield S = (Q S , q 0,S , Σ I,S , Σ O,S , δ S , λ S ) is given for M and for some MDP labeling function f : S → L.”
The authors state this as an assumption.
Whenever an action ranking is chosen by the learner that does not contain a safe action, there is a fixed probability distribution over the safe actions executed instead, constant over time.
“Note that this argument requires that whenever an action ranking is chosen by the learner that does not contain a safe action, there is a fixed probability distribution over the safe actions executed instead.”
The authors state this as an assumption.
The learner has access to the state of the shield and can base its actions on it.
“Note that we made use of the fact that the learner has access to the state of the shield and can base its actions on it in this argument.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To provide system-level, physically absolute safety guarantees, SafeCodeRL incorporates a hard shielding mechanism [37].”
From SafeCodeRL: Security-Constrained Multi-Agent Reinforcement Learning for Trustworthy LLM-Generated IoT/CPS Software (2026) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Safe Reinforcement Learning via Shielding > Synthesis of Shields
“ϕ M = (Q M , q 0,M , A × L, δ M , F M )”
§ Safe Reinforcement Learning via Shielding > Synthesis of Shields
“(δ(q, (l, a)), δ M (q, (l, a))), for all (q, q M ) ∈ G, l ∈ L, a ∈ A”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Safe Reinforcement Learning via Shielding > Synthesis of Shields
“if we merge all states in F × Q M into a single error state”
§ Safe Reinforcement Learning via Shielding > Synthesis of Shields
“F g = (F × Q M ) ∪ (Q × (Q M \ F M )).”
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(2008) · Cited by 4,811
Handbook of theoretical computer science
Leeuwen, J. V. (1990) · Medical Entomology and Zoology · Cited by 4,259
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
Emerson, E. (1991) · Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics · doi:10.1016/b978-0-444-88074-1.50021-4 · Cited by 3,268
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
The temporal logic of programs
Pnueli, A. (1977) · 18th Annual Symposium on Foundations of Computer Science (sfcs 1977) · doi:10.1109/sfcs.1977.32 · Cited by 1,523
(2015) · Journal of Machine Learning Research · Cited by 1,119
Cited by
Sorted by citations
Cheng, R., Orosz, G., Murray, R. M., & Burdick, J. W. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013387 · Cited by 611
“The concept is akin to shielded RL (Alshiekh et al. 2017; Fisac et al. 2018), since the CBF controller compensates for the RL controller to ensure safety, but does not guide exploration of the RL algorithm.”
BackgroundNavigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., & Fujimura, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461233 · Cited by 379
Ganesh, A. H., & Xu, B. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 295
Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic
Chen, D., Hajidavalloo, M. R., Li, Z., Chen, K., Wang, Y., Jiang, L., & Wang, Y. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3285442 · Cited by 290
Tran, H.-D., Yang, X.-D., Lopez, D. M., Musau, P., Nguyen, L. V., Xiang, W.-M., Bak, S., & Johnson, T. T. (2020) · International Conference on Computer Aided Verification · doi:10.1007/978-3-030-53288-8_1 · Cited by 306
Recovery RL: Safe Reinforcement Learning With Learned Recovery Zones
Thananjeyan, B., Balakrishna, A., Nair, S., Luo, M., Srinivasan, K., Hwang, M., Gonzalez, J. E., Ibarz, J., Finn, C., & Goldberg, K. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3070252 · Cited by 218
Deep Reinforcement Learning for Traffic Signal Control: A Review
Rasheed, F., Yau, K. A., Noor, R. M., Wu, C., & Low, Y.-C. (2020) · IEEE Access · doi:10.1109/access.2020.3034141 · Cited by 189
Huang, X., Ruan, W., Huang, W., Jin, G., Dong, Y., Wu, C., Bensalem, S., Mu, R., Yi, Q., Zhao, X., et al. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10824-0 · Cited by 228
Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning
Ye, F., Cheng, X., Wang, P., Chan, C., & Zhang, J. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304668 · Cited by 149
Autonomous Highway Driving using Deep Reinforcement Learning
Nageshrao, S. P., Tseng, E., & Filev, D. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914621 · Cited by 161
Venkatasatish, R., & Dhanamjayulu, C. (2022) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2022.06.088 · Cited by 123
Wang, Y., Qiu, D., Sun, M., Štrbac, G., & Gao, Z. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.120759 · Cited by 126
Safe reinforcement learning for power system control: A review
Yu, P., Zhang, H., Song, Y., Wang, Z., Dong, H., & Ji, L. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.116022 · Cited by 117
Safe deep reinforcement learning-based adaptive control for USV interception mission
Du, B., Lin, B., Zhang, C., Dong, B., & Zhang, W. (2022) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.110477 · Cited by 110
A survey on interpretable reinforcement learning
Glanois, C., Weng, P., Zimmer, M., Li, D., Yang, T., Hao, J., & Liu, W. (2024) · Machine Learning · doi:10.1007/s10994-024-06543-w · Cited by 176
Learning to Walk in the Real World with Minimal Human EffortPreprint
Ha, S., Xu, P., Tan, Z., Levine, S., & Tan, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08550 · Cited by 165
A formal methods approach to interpretable reinforcement learning for robotic planning
Li, X., Serlin, Z., Yang, G., & Belta, C. A. (2019) · Science Robotics · doi:10.1126/scirobotics.aay6276 · Cited by 104
Zhang, H., Zhou, A., Lu, J., Ma, R., Hu, Y., Li, C., Zhang, X., Ma, H., & Chen, X. (2020) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3372224.3419186 · Cited by 106
(2021) · Journal of Machine Learning Research · Cited by 224
Self-citationHobbs, K. L., Mote, M., Abate, M., Coogan, S., & Féron, É. (2023) · IEEE Control Systems · doi:10.1109/mcs.2023.3234380 · Cited by 117
Continuous improvement of self-driving cars using dynamic confidence-aware reinforcement learning
Cao, Z. L., Jiang, K., Zhou, W., Xu, S., Peng, H., & Yang, D. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00610-y · Cited by 91
Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environments
Bouton, M., Nakhaei, A., Fujimura, K., et al. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8813803 · Cited by 87
Phan, D. T., Grosu, R., Jansen, N., Paoletti, N., Smolka, S. A., & Stoller, S. D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55754-6_6 · Cited by 94
A Review of Safe Reinforcement Learning Methods for Modern Power Systems
Su, T., Wu, T., Zhao, J., Scaglione, A., & Xie, L. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3584656 · Cited by 91
Zhang, H., Zhou, A., Hu, Y., et al. (2021) · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · doi:10.1145/3447993.3483259 · Cited by 77
On reliability of reinforcement learning based production scheduling systems: a comparative survey
de Puiseau, C. W., Meyes, R., & Meisen, T. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01915-2 · Cited by 68
Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization
Wen, L., Duan, J., Li, S. E., Xu, S., & Peng, H. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294262 · Cited by 78
Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamics
Li, S., & Bastani, O. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196867 · Cited by 80
Constrained Cross-Entropy Method for Safe Reinforcement Learning
Wen, M., & Topcu, U. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3015931 · Cited by 75
Self-citationFoundations for Restraining Bolts: Reinforcement Learning with LTLf/LDLf Restraining Specifications
Giacomo, G. D., Iocchi, L., Favorito, M., & Patrizi, F. (2019) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v29i1.3549 · Cited by 69
SoK: Explainable Machine Learning for Computer Security Applications
Nadeem, A., Vos, D., Cao, C., Pajola, L., Dieck, S., Baumgartner, R., & Verwer, S. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00022 · Cited by 79
Safe Reinforcement Learning on Autonomous Vehicles
Isele, D., Nakhaei, A., & Fujimura, K. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593420 · Cited by 70
Deep Reinforcement Learning: A Chronological Overview and Methods
Terven, J. R. (2025) · AI · doi:10.3390/ai6030046 · Cited by 98
A Survey and Perspective on Industrial Cyber-Physical Systems (ICPS): From ICPS to AI-Augmented ICPS
Chae, J., Lee, S., Jang, J., Hong, S., & Park, K. (2023) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2023.3323600 · Cited by 72
Joint Inference of Reward Machines and Policies for Reinforcement Learning
Xu, Z., Gavran, I., Ahmad, Y., Majumdar, R., Neider, D., Topcu, U., & Wu, B. (2020) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v30i1.6756 · Cited by 67
Self-citationProvable repair of deep neural networks
Sotoudeh, M., & Thakur, A. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454064 · Cited by 75
Control Barriers in Bayesian Learning of System Dynamics
Dhiman, V., Khojasteh, M. J., Franceschetti, M., et al. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3137059 · Cited by 65
Hu, B., & Li, J. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3116581 · Cited by 62
Tan, M., Dai, Z., Su, Y., Chen, C., Wang, L., & Chen, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105557 · Cited by 58
SafeLight: A Reinforcement Learning Method toward Collision-Free Traffic Signal Control
Du, W., Ye, J., Gu, J., Li, J., Wei, H., & Wang, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26729 · Cited by 60
Verifiably Safe Off-Model Reinforcement Learning
Fulton, N., & Platzer, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-17462-0_28 · Cited by 53
Reinforcement Learning with Probabilistic Guarantees for Autonomous DrivingPreprint
Bouton, M., Karlsson, J., Nakhaei, A., Fujimura, K., Kochenderfer, M. J., & Tůmová, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07189 · Cited by 53
Shield Synthesis for Reinforcement Learning
Könighofer, B., Lorber, F., Jansen, N., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61362-4_16 · Cited by 52
Self-citationSafe Reinforcement Learning via Shielding under Partial Observability
Carr, S., Jansen, N., Junges, S., & Topcu, U. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26723 · Cited by 80
Self-citationTowards Safe Control of Continuum Manipulator Using Shielded Multiagent Reinforcement Learning
Ji, G., Yan, J., Du, J., et al. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3097660 · Cited by 50
Learning safe control for multi-robot systems: Methods, verification, and open challenges
Garg, K., Zhang, S., So, O., Dawson, C., & Fan, C. (2024) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2024.100948 · Cited by 56
International Conference on the Foundations of Digital Games
(2020) · doi:10.1145/3402942 · Cited by 49
A collective AI via lifelong learning and sharing at the edge
Soltoggio, A., Ben-Iwhiwhu, E., Braverman, V., Eaton, E., Epstein, B., Ge, Y., Halperin, L., How, J., Itti, L., Jacobs, M. A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00800-2 · Cited by 51
Schenke, M., Haucke-Korber, B., & Wallscheid, O. (2023) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2023.3303651 · Cited by 48
Real-world Video Adaptation with Reinforcement LearningPreprint
Mao, H., Chen, S., Dimmery, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12858 · Cited by 48
Verifiably safe exploration for end-to-end reinforcement learning
Hunt, N., Fulton, N., Magliacane, S., Hoang, T. N., Das, S., & Solar-Lezama, A. (2021) · International Conference on Hybrid Systems: computation and control · doi:10.1145/3447928.3456653 · Cited by 48
Ensuring Safety of Learning-Based Motion Planners Using Control Barrier Functions
Wang, X. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3152313 · Cited by 47
Kochdumper, N., Krasowski, H., Wang, X., Bak, S., & Althoff, M. (2023) · IEEE Open Journal of Control Systems · doi:10.1109/ojcsys.2023.3256305 · Cited by 47
Provably Safe Deep Reinforcement Learning for Robotic Manipulation in Human Environments
Thumm, J., & Althoff, M. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811698 · Cited by 43
Transfer of Temporal Logic Formulas in Reinforcement Learning
Xu, Z., & Topcu, U. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/557 · Cited by 43
Self-citationSim-to-Lab-to-Real: Safe reinforcement learning with shielding and generalization guarantees
Hsu, K., Ren, A. Z., Nguyen, D. P., et al. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2022.103811 · Cited by 43
Safe Reinforcement Learning for Single Train Trajectory Optimization via Shield SARSA
Zhao, Z., Xun, J., Wen, X., et al. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3218705 · Cited by 42
Waghmare, A. V., Singh, V. P., Varshney, T., & Sanjeevikumar, P. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-07529-6 · Cited by 50
EXPLORA: AI/ML EXPLainability for the Open RAN
Fiandrino, C., Bonati, L., D’Oro, S., Polese, M., Melodia, T., & Widmer, J. (2023) · Proceedings of the ACM on Networking · doi:10.1145/3629141 · Cited by 43
Formal synthesis of controllers for safety-critical autonomous systems: Developments and challenges
Yin, X., Gao, B., & Yu, X. P. (2024) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2024.100940 · Cited by 48
Safe Reinforcement Learning with Nonlinear Dynamics via Model Predictive Shielding
Bastani, O. (2021) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc50511.2021.9483182 · Cited by 40
Stabilizing Neural Control Using Self-Learned Almost Lyapunov Critics
Chang, Y.-C., & Gao, S. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560886 · Cited by 42
Reinforcement Learning with Iterative Reasoning for Merging in Dense Traffic
Bouton, M., Nakhaei, A., Isele, D., Fujimura, K., & Kochenderfer, M. J. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294338 · Cited by 38
Temporal-Logic-Based Reward Shaping for Continuing Reinforcement Learning Tasks
Jiang, Y., Bharadwaj, S., Wu, B., Shah, R., Topcu, U., & Stone, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16975 · Cited by 39
Self-citationRun-Time Optimization for Learned Controllers Through Quantitative Games
Avni, G., Bloem, R., Chatterjee, K., Henzinger, T. A., Könighofer, B., & Pranger, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-25540-4_36 · Cited by 38
Self-citationCan You Trust Your Autonomous Car? Interpretable and Verifiably Safe Reinforcement Learning
Schmidt, L. M., Kontes, G. D., Plinge, A., & Mutschler, C. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575328 · Cited by 39
Logically-Constrained Reinforcement LearningPreprint
Hasanbeig, M., Abate, A., & Kroening, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08099 · Cited by 116
Zhao, T., Wang, J., & Yue, M. (2023) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3233770 · Cited by 36
Online shielding for reinforcement learning
Könighofer, B., Rudolf, J., Palmisano, A., Tappler, M., & Bloem, R. (2022) · Innovations in Systems and Software Engineering · doi:10.1007/s11334-022-00480-4 · Cited by 39
Self-citationLane-Change in Dense Traffic With Model Predictive Control and Neural Networks
Bae, S., Isele, D., Nakhaei, A., Xu, P., Añon, A. M., Choi, C., Fujimura, K., & Moura, S. J. (2022) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2022.3193923 · Cited by 35
Robust Regression for Safe Exploration in ControlPreprint
Liu, A., Shi, G., Chung, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05819 · Cited by 35
Neurosymbolic Reinforcement Learning with Formally Verified ExplorationPreprint
Anderson, G., Verma, A., Dillig, I., & Chaudhuri, S. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2009.12612 · Cited by 95
Safe Reinforcement Learning via Probabilistic Logic Shields
Yang, W.-C., Marra, G., Rens, G., & De Raedt, L. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/637 · Cited by 34
Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks
Zhang, Z., Liu, Y., Peng, Z., Chen, M., Xu, D., & Cui, S. R. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431575 · Cited by 35
Formal Safety Net Control Using Backward Reachability Analysis
Schürmann, B., Klischat, M., Kochdumper, N., et al. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3124188 · Cited by 34
He, H., Niu, Z., Wang, Y., et al. (2023) · Journal of Energy Storage · doi:10.1016/j.est.2023.108517 · Cited by 34
Keroglou, C., Kansizoglou, I., Michailidis, P., Oikonomou, K. M., Papapetros, I. T., Dragkola, P., Michailidis, I., Gasteratos, A. C., Kosmatopoulos, E. B., & Sirakoulis, G. C. (2023) · IEEE Transactions on Medical Robotics and Bionics · doi:10.1109/tmrb.2023.3261342 · Cited by 33
Reinforcement Learning for Blood Glucose Control: Challenges and Opportunities
Fox, I., & Wiens, J. (2019) · Cited by 33
Safe Reinforcement Learning Benchmark Environments for Aerospace Control Systems
Ravaioli, U., Cunningham, J., McCarroll, J., Gangal, V., Dunlap, K. M., & Hobbs, K. L. (2022) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero53065.2022.9843750 · Cited by 37
Navigating Intersections with Autonomous Vehicles using Deep Reinforcement LearningPreprint
Isele, D., Cosgun, A., Subramanian, K. A., & Fujimura, K. (2017) · arXiv (Cornell University) · Cited by 36
SRL-ORCA: A Socially Aware Multi-Agent Mapless Navigation Algorithm in Complex Dynamic Scenes
Qin, J., Qin, J., Qiu, J., Liu, Q., Li, M., & Ma, Q. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3331621 · Cited by 33
Cao, H., Xiong, H., Zeng, W., Jiang, H., Cai, Z., Hu, L., Zhang, L., & Lu, W. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3330183 · Cited by 33
Kamran, D., Engelgeh, T., Busch, M., Fischer, J., & Stiller, C. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636847 · Cited by 31
Temporal Logic Guided Safe Reinforcement Learning Using Control Barrier FunctionsPreprint
Li, X., & Belta, C. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09885 · Cited by 34
Yin, J., Dawson, C., Fan, C., et al. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3315211 · Cited by 30
Engineering Human–Machine Teams for Trusted Collaboration
Alhaji, B., Beecken, J., Ehlers, R., Gertheiss, J., Merz, F., Müller, J. P., Prilla, M., Rausch, A., Reinhardt, A., Reinhardt, D., et al. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4040035 · Cited by 31
Self-citationControl for smart systems: Challenges and trends in smart cities
Jia, Q., Panetto, H., Macchi, M., Siri, S., Weichhart, G., & Xu, Z. (2022) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2022.04.010 · Cited by 30
Search-Based Testing of Reinforcement Learning
Tappler, M., Cano, F., Aichernig, B. K., & Könighofer, B. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/72 · Cited by 36
Self-citationSafe Reinforcement Learning via Statistical Model Predictive Shielding
Bastani, O., & Li, S. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.026 · Cited by 35
Compositional Learning and Verification of Neural Network Controllers
Ivanov, R., Jothimurugan, K., Hsu, S., Vaidya, S., Rajeev Alur, A., & Bastani, O. (2021) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3477023 · Cited by 29
Runtime Monitors for Markov Decision Processes
Junges, S., Torfah, H., & Seshia, S. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-81688-9_26 · Cited by 28
Shield Synthesis for Real: Enforcing Safety in Cyber-Physical Systems
Wu, M., Wang, J.-B., Deshmukh, J. V., & Wang, C. (2019) · Formal Methods in Computer-Aided Design · doi:10.23919/fmcad.2019.8894264 · Cited by 31
Learning Control Policies for Stochastic Systems with Reach-Avoid Guarantees
Žikelić, Đ., Lechner, M., Henzinger, T. A., & Chatterjee, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26407 · Cited by 27
Safety-Aware Apprenticeship Learning
Zhou, W., & Li, W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-96145-3_38 · Cited by 26
Hu, B., & Li, J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3063489 · Cited by 26
Advice-Guided Reinforcement Learning in a non-Markovian Environment
Neider, D., Gaglione, J.-R., Gavran, I., Topcu, U., Wu, B., & Xu, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17096 · Cited by 26
Self-citationRenkhoff, J., Feng, K., Meier-Doernberg, M., Velasquez, A., & Song, H. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3351798 · Cited by 30
Imitation-Projected Programmatic Reinforcement LearningPreprint
Verma, A., Le, H. M., Yue, Y., & Chaudhuri, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05431 · Cited by 28
Active Task-Inference-Guided Deep Inverse Reinforcement Learning
Memarian, F., Xu, Z., Wu, B., Wen, M., & Topcu, U. (2020) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc42340.2020.9304190 · Cited by 25
Self-citationEnforcing Almost-Sure Reachability in POMDPs
Junges, S., Jansen, N., & Seshia, S. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-81688-9_28 · Cited by 8
Metadata
- Authors
- Alshiekh, M., Bloem, R., Ehlers, R., Könighofer, B., Niekum, S., & Topcu, U.
- Affiliations
- The University of Texas at Austin (US)
- Graz University of Technology (AT)
- University of Bremen (DE)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-29
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2751422670
- Cited by
- 37
- References
- 19
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 7 · 2022: 3 · 2021: 7 · 2020: 7 · 2019: 4 · 2018: 4
- FWCI
- 2.24
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1652113, 1617639, 1646522)
- Austrian Science Fund (S11406-N23, W1255)
- Universität Bremen
- Defense Advanced Research Projects Agency (W911NF-16-1-0001, FA8650-15C)
- Army Research Office (W911NF-15-1-0592, W911NF-15-1-, W911NF-16-1-, W911NF, W911NF-15)
- Air Force Research Laboratory (FA8650-15-C-2546, FA8650-15-, 8650-16-C-2610)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Formal Methods in Verification
- Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
- Keywords
- safe reinforcement learning, temporal logic specifications, reactive systems, convergence guarantees, policy learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-24, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-24 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
