Research map / Reinforcement learning / Policy gradient and actor-critic
How Does the Lagrangian Guide Safe Reinforcement Learning through Diffusion Models?
Xiaoyuan Cheng, Wenxuan Yuan, Boyang Li, Yuanchao Xu, Yiming Yang, Hao Liang, Bei Peng, Robert Loftin, Zhuo Sun, Yukun Hu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| increase Monte Carlo sample size N from 2 to 16 (ablation) | ALGD · PointPush1 | GPU time (ms): 5.3 -> 5.9 | No clear effect |
| increase Monte Carlo sample size N from 2 to 16 (ablation) | ALGD · PointButton2 | GPU time (ms): 4.6 -> 5.0 | No clear effect |
| increase Monte Carlo sample size N (ablation) | ALGD · Safe RL tasks | training stability and return | Improved |
| use augmented Lagrangian instead of standard Lagrangian for diffusion guidance (ablation) | Lagrangian-guided diffusion policy · Safe RL tasks | training stability and constraint violation | Improved |
| add augmented Lagrangian to SAC with Gaussian policy | SAC · Safe RL tasks | reward and cost | No clear effect |
| use ALGD instead of on-policy PPO+Lag | PPO+Lag · Safe RL tasks | sample efficiency | Improved |
Closest papers by meaning
- Prior-Guided Diffusion Planning for Offline Reinforcement Learning (NeurIPS 2025 · similarity 0.91)
- Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimization (NeurIPS 2024 · similarity 0.90)
- Score Regularized Policy Optimization through Diffusion Behavior (ICLR 2024 · similarity 0.90)
- Diffusion Policies Creating a Trust Region for Offline Reinforcement Learning (NeurIPS 2024 · similarity 0.90)
- Scalable Maximum Entropy Reinforcement Learning for Diffusion Policies via Adjoint Matching (NeurIPS 2026 · similarity 0.89)
- Behavior-Regularized Diffusion Policy Optimization for Offline Reinforcement Learning (ICML 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
