Research map / Learning theory and algorithms / Prediction and decision losses
A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a physics-informed neural approach that solves the epigraph HJB-PDE for state-constrained optimal control, with conformal-prediction safety and performance certificates, co-optimizing safety and performance in 2D to 20D autonomous systems.
Problem
Co-optimizing performance and hard safety for high-dimensional autonomous systems: constrained RL offers only soft safety, safety filters ignore performance, and grid-based HJB solvers suffer the curse of dimensionality.
Approach
Formulate safety-performance co-optimization as a state-constrained optimal control problem, reformulate it in epigraph form with an augmented cost-state z, learn the resulting HJB value function with a physics-informed neural network (PDE residual loss plus boundary loss and curriculum in time), and certify safety and performance using split conformal prediction.
Key results
- On 2D boat navigation, the proposed method achieves a 100% safety rate, while SAC-Lag has 76% safety and 7.5% higher mean cost and MPPI-NCBF has 100% safety but 50.72% higher cost.
- On the 8D pursuer-evader task, MPPI-NCBF reaches 100% safety at 42% higher mean cost, and SAC-Lag has a 66% safety rate with 101% higher cost.
- On the 20D multi-agent task, MPPI, MPPI-NCBF and SAC-Lag show cost increases of 148%, 192% and 164%, with safety rates of 90%, 100% and lower for SAC-Lag; the method reports an optimal policy computed in 2 ms.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use the proposed PIML controller instead of SAC-Lag | Boat Navigation · Boat Navigation | mean cost: 7.5% higher mean cost for SAC-Lag | Helped |
| Use the proposed PIML controller instead of SAC-Lag | Boat Navigation · Boat Navigation | safety rate: 76% vs 100% | Helped |
| Use the proposed PIML controller instead of MPPI | Boat Navigation · Boat Navigation | mean cost: 32.67% higher mean cost for MPPI | Helped |
| Use the proposed PIML controller instead of MPPI-NCBF | Boat Navigation · Boat Navigation | mean cost: 50.72% higher mean cost for MPPI-NCBF | Helped |
| Use the proposed PIML controller instead of MPPI | Pursuer-Evader Tracking · Pursuer-Evader Tracking | mean cost: 18% higher mean cost for MPPI | Helped |
| Use the proposed PIML controller instead of MPPI-NCBF | Pursuer-Evader Tracking · Pursuer-Evader Tracking | mean cost: 42% higher mean cost for MPPI-NCBF | Helped |
| Use the proposed PIML controller instead of SAC-Lag | Pursuer-Evader Tracking · Pursuer-Evader Tracking | mean cost: 101% higher mean cost for SAC-Lag | Helped |
| Use the proposed PIML controller instead of SAC-Lag | Pursuer-Evader Tracking · Pursuer-Evader Tracking | safety rate: 66% vs 100% | Helped |
| Use the proposed PIML controller instead of MPPI | Multi-Agent Navigation · Multi-Agent Navigation | mean cost: 148% mean percentage cost increase for MPPI | Helped |
| Use the proposed PIML controller instead of MPPI-NCBF | Multi-Agent Navigation · Multi-Agent Navigation | mean cost: 192% mean percentage cost increase for MPPI-NCBF | Helped |
| Use the proposed PIML controller instead of SAC-Lag | Multi-Agent Navigation · Multi-Agent Navigation | mean cost: 164% mean percentage cost increase for SAC-Lag | Helped |
| Use the proposed PIML value-function learner instead of Level Set Toolbox | Boat Navigation · Boat Navigation | computation time: 390 minutes -> 122 minutes | Helped |
Limitations
- Assumes the dynamics model is known, though it could be learned from data.
- Safety and performance guarantees are probabilistic (conformal) rather than deterministic, and depend on dense sampling of states.
- Evaluated only on simulated systems with limited dimensionality (2D, 8D, 20D).
Experimental setup
Datasets: simulated states sampled from state space (boat, pursuer-evader, multi-agent)
Benchmarks: 2D boat navigation 8D pursuer-evader tracking 20D multi-agent navigation
Metrics: mean cumulative cost increase relative to proposed method safety rate offline and online computation time conformal safety level delta conformal performance level psi
Baselines: SAC-Lag PPO-Lag CPO MPPI MPPI-NCBF MPPI-C3BF Level Set Toolbox ground truth
Builds on: DeepReach epigraph formulation of state-constrained optimal control split conformal prediction adaptive loss re-balancing for PINNs
Closest papers by meaning
- Learning Safe Control via On-the-Fly Bandit Exploration (ICML 2025 · similarity 0.89)
- Safely Learning Controlled Stochastic Dynamics (NeurIPS 2025 · similarity 0.89)
- Verified Safe Reinforcement Learning for Neural Network Dynamic Models (NeurIPS 2024 · similarity 0.89)
- Absolute State-wise Constrained Policy Optimization: High-Probability State-wise Constraints Satisfaction (NeurIPS 2026 · similarity 0.88)
- Latent Safety-Constrained Policy Approach for Safe Offline Reinforcement Learning (ICLR 2025 · similarity 0.88)
- Safety-Polarized and Prioritized Reinforcement Learning (ICML 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
