atlas

Research map / Bandits and online learning / RL theory and MDPs

A Near-Optimal Algorithm for Safe Reinforcement Learning Under Instantaneous Hard Constraints

ICML 2023 · Bandits and online learning › RL theory and MDPs · approach: Linear function approximation in RL · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Construct safe subgraphs backward so chosen actions lead only to safe future statesLSVI-NEW · Episodic linear mixture MDP with unsafe states and actionsinstantaneous hard-constraint satisfactionHelped
Add bonuses for uncertain transitions and future and past subsubgraphsLSVI-NEW · Episodic linear mixture MDP with unsafe states and actionsregret: \tilde{O}\left( \frac{dH^3 \sqrt{dK}}{\bar{c}-\bar{c}_1^0-\Delta_{\boldsymbol{\phi}}(c)} \right)Helped
Handle unsafe states and actions under instantaneous hard constraintsLSVI-NEW · Episodic linear mixture MDPregret: \tilde{O}\left( \frac{dH^3 \sqrt{dK}}{\bar{c}-\bar{c}_1^0-\Delta_{\boldsymbol{\phi}}(c)} \right); \tilde{O}(dH^2\sqrt{K}Mixed
Impose the instantaneous safety requirementAny safe algorithm · Episodic linear mixture MDP with unsafe states and actionsregret: \max\left\{ \frac{dH\sqrt{K}}{16\sqrt{2}}, \frac{H/24}{(\bar{c}-\bar{c}_1^0-\Delta_{\boldsymbol{\phi}}(c))^2} \right\}Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy