Research map / Reinforcement learning / Policy gradient and actor-critic
Adaptive Temporal-Difference Learning for Policy Evaluation with Per-State Uncertainty Estimates
Carlos Riquelme, Hugo Penedones, Damien Vincent, Hartmut Maennel, Sylvain Gelly, Timothy A Mann, Andre Barreto, Gergely Neu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| adaptively switch between TD and MC per state vs TD(lambda=0.75) | Adaptive TD · Atari Pong low-data | MSVE: 30\% | Improved |
| adaptive switching vs TD(lambda=0.75) | Adaptive TD · Atari Space Invaders | MSVE: 20\% | Improved |
| Adaptive TD vs raw TD in Labyrinth-2D high-data regime | Adaptive TD · Labyrinth-2D | MSVE | Improved |
| Adaptive TD vs MC in Labyrinth-2D low-data regime | Adaptive TD · Labyrinth-2D | MSVE | Improved |
| MC ensemble of 3 networks vs single MC network | MC · Atari | MSVE | Improved |
| Adaptive TD vs auxiliary MC ensemble | Adaptive TD · Atari | MSVE | Improved |
| Adaptive TD vs raw TD in Atari | Adaptive TD · Atari | MSVE | No clear effect |
| TD(lambda=0.75) as fixed choice | TD(lambda) · Labyrinth-2D | MSVE | Improved |
| TD(lambda=0.75) as fixed choice | TD(lambda) · Atari | MSVE | Hurt |
| Adaptive TD vs TD in Mountain Car | Adaptive TD · Mountain Car | MSVE | Improved |
Closest papers by meaning
- Adaptive Temporal Difference Learning With Linear Function Approximation (TPAMI 2021 · similarity 0.90)
- The surprising efficiency of temporal difference learning for rare event prediction (NeurIPS 2024 · similarity 0.90)
- Discerning Temporal Difference Learning (AAAI 2024 · similarity 0.89)
- Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes (NeurIPS 2024 · similarity 0.87)
- Conformal Prediction Beyond the Horizon: Distribution-Free Inference for Policy Evaluation (NeurIPS 2025 · similarity 0.87)
- Beyond Expected Return: Accounting for Policy Reproducibility When Evaluating Reinforcement Learning Algorithms (AAAI 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
