Research map / Reinforcement learning / Policy gradient and actor-critic
Truncating Trajectories in Monte Carlo Policy Evaluation: an Adaptive Approach
Riccardo Poiani, Nicole Nobili, Alberto Maria Metelli, Marcello Restelli
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use adaptive, iterative trajectory allocation instead of a fixed uniform schedule | Monte Carlo policy evaluation · LQG | empirical MSE | Improved |
| Use adaptive, iterative trajectory allocation instead of the robust non-adaptive schedule | Monte Carlo policy evaluation · Continuous Navigation | empirical MSE | No clear effect |
| Use adaptive, iterative trajectory allocation instead of the uniform schedule | Monte Carlo policy evaluation · Inverted Pendulum | empirical MSE | Improved |
| Use adaptive or robust trajectory allocation instead of the uniform schedule | Monte Carlo policy evaluation · Ant, γ=0.999 | empirical MSE | No clear effect |
| Use adaptive or robust trajectory allocation instead of the uniform schedule | Monte Carlo policy evaluation · Ant, γ=0.99 | empirical MSE | Improved |
| Use the robust schedule that truncates trajectories based only on the discount factor | Monte Carlo policy evaluation · Continuous Navigation | empirical MSE | Hurt |
| Allocate more samples to early interaction steps when early rewards have greater uncertainty | Monte Carlo policy evaluation · LQG | empirical MSE | Improved |
Closest papers by meaning
- Truncating Trajectories in Monte Carlo Reinforcement Learning (ICML 2023 · similarity 0.94)
- Efficient Policy Evaluation with Offline Data Informed Behavior Policy Design (ICML 2024 · similarity 0.88)
- Exploring Starts Are Not Enough: Counterexamples and a Fix for Monte Carlo Exploring Starts (NeurIPS 2026 · similarity 0.88)
- Doubly Optimal Policy Evaluation for Reinforcement Learning (ICLR 2025 · similarity 0.86)
- Provable and Practical: Efficient Exploration in Reinforcement Learning via Langevin Monte Carlo (ICLR 2024 · similarity 0.86)
- Composite Flow Matching for Reinforcement Learning with Shifted-Dynamics Data (NeurIPS 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
