Research map / Reinforcement learning / Policy gradient and actor-critic
Confounding-Robust Policy Evaluation in Infinite-Horizon Reinforcement Learning
Nathan Kallus, Angela Zhou
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use sensitivity bounds with Γ=3 | Confounding-robust policy evaluation · Confounded random walk | coverage of true policy value | Improved |
| Increase trajectory length | Confounding-robust bounds estimator · 3x3 confounded windy gridworld | convergence of estimated bounds | Improved |
| Optimize over larger Γ values | Confounding-robust bounds estimator · 3x3 confounded windy gridworld | finite-sample bias | Hurt |
Closest papers by meaning
- Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding (ICLR 2024 · similarity 0.89)
- Provably Good Batch Off-Policy Reinforcement Learning Without Great Exploration (NeurIPS 2020 · similarity 0.89)
- Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding (NeurIPS 2020 · similarity 0.89)
- Doubly Robust Off-policy Value Evaluation for Reinforcement Learning (ICML 2016 · similarity 0.89)
- Pessimism in the Face of Confounders: Provably Efficient Offline Reinforcement Learning in Partially Observable Markov Decision Processes (ICLR 2023 · similarity 0.89)
- Confounding Robust Deep Reinforcement Learning: A Causal Approach (NeurIPS 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
