Research map / Reinforcement learning / MDPs and planning
Memory Bounded Open-Loop Planning in Large POMDPs Using Thompson Sampling
Thomy Phan, Lenz Belzner, Marie Kiermeier, Markus Friedrich, Kyrill Schmid, Claudia Linnhoff-Popien
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use a fixed stack of Thompson Sampling bandits instead of a search tree | POSTS · RockSample | undiscounted return | Improved |
| use a fixed stack of Thompson Sampling bandits instead of a search tree | POSTS · Battleship | undiscounted return | Mixed |
| use open-loop planning rather than closed-loop POMCP | POSTS · PocMan | undiscounted return | Hurt |
| increase prior parameter β₀ (ablation) | POSTS · large benchmark problems | undiscounted return | Improved |
| increase prior parameter β₀ (ablation) | POOLTS · RockSample and Battleship | undiscounted return | No clear effect |
| increase planning horizon beyond T = 100 (ablation) | most approaches · all benchmarks | undiscounted return | Mixed |
| increase planning horizon to T = 400 (ablation) | POMCP · benchmarks except RockSample(11,11) | undiscounted return | Improved |
| restrict memory capacity (ablation) | POSTS · RockSample and Battleship | undiscounted return | Improved |
| restrict memory capacity (ablation) | POSTS · PocMan | undiscounted return | Mixed |
Closest papers by meaning
- Adaptive Online Packing-guided Search for POMDPs (NeurIPS 2021 · similarity 0.88)
- Online POMDP Planning with Anytime Deterministic Guarantees (NeurIPS 2023 · similarity 0.87)
- Simplifying Complex Observation Models in Continuous POMDP Planning with Probabilistic Guarantees and Practice (AAAI 2024 · similarity 0.86)
- Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning (NeurIPS 2026 · similarity 0.86)
- Factored Online Planning in Many-Agent POMDPs (AAAI 2024 · similarity 0.85)
- A Surprisingly Simple Continuous-Action POMDP Solver: Lazy Cross-Entropy Search Over Policy Trees (AAAI 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
