Research map / Reinforcement learning / MDPs and planning
Dynamically Constructed (PO)MDPs for Adaptive Robot Planning
Shiqi Zhang, Piyush Khandelwal, Peter Stone
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| dynamically construct POMDP with reward reasoning (iCORPP) instead of hand-coded static model (CORPP) | shopping request identification · Task 1 delivery mistakes | mistakes per item/room | Improved |
| remove unavailable items from the POMDP dynamically | iCORPP · Task 1 shopping with item unavailability | accuracy and overall reward: states/actions 37,50 -> 18,29 with 3 items unavailable | Improved |
| set cautious reward values [30,-30] instead of [20,-20] (ablation) | iCORPP · Task 1 delivery mistakes | cautiousness of behavior: [20,-20] -> [30,-30] | Mixed |
| adaptive MDP reconstruction vs fixed cached policies when walker blocks route | robot navigation · Task 2, loc0-loc2 | travel time (s): about 250 -> about 110 | Improved |
| iCORPP vs CORPP on other start-goal pairs | robot navigation · Task 2, other position pairs | travel time | No clear effect |
| iCORPP vs CORPP early in trials | robot navigation · Task 2 overall time | total time per trial | No clear effect |
Closest papers by meaning
- Tru-POMDP: Task Planning Under Uncertainty via Tree of Hypotheses and Open-Ended POMDPs (NeurIPS 2025 · similarity 0.87)
- PO-PDDL: Learning Symbolic POMDPs from Visual Demonstrations for Robot Planning Under Uncertainty (NeurIPS 2026 · similarity 0.85)
- Learning Logic Specifications for Policy Guidance in POMDPs: an Inductive Logic Programming Approach (AAAI 2025 · similarity 0.84)
- Revelations: A Decidable Class of POMDPs with Omega-Regular Objectives (AAAI 2025 · similarity 0.83)
- Hierarchical Planning and Learning for Robots in Stochastic Settings Using Zero-Shot Option Invention (AAAI 2024 · similarity 0.83)
- Simplifying Complex Observation Models in Continuous POMDP Planning with Probabilistic Guarantees and Practice (AAAI 2024 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
