AI Paper Atlas

Research map / Reinforcement learning / MDPs and planning

Planning with Abstract Learned Models While Learning Transferable Subtasks

John Winder, Stephanie Milani, Matthew Landen, Erebus Oh, Shane Parr, Shawn Squire, Marie desJardins, Cynthia Matuszek

AAAI 2020 · Reinforcement learning › MDPs and planning · approach: Average-reward and regularized MDPs · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use PALM with an expert Taxi hierarchy instead of R-MAXQ using the same hierarchyPALM-ET vs. R-MAXQ · Deterministic small TaxiperformanceHurt
Use PALM rather than R-MAXQPALM vs. R-MAXQ · Stochastic Taxilearning efficiencyImproved
Use PALM rather than R-MAXQ with the expert Cleanup hierarchyPALM-EC vs. R-MAXQ · Small Cleanupruntime per episode: 100 -> 10 ms; R-MAXQ: 10^4 msImproved
Learn the Taxi hierarchy from demonstrations rather than use the expert hierarchyPALM-HT vs. PALM-ET · Taxisamples to reach asymptotic performanceImproved
Learn the Taxi hierarchy from demonstrations rather than use the expert hierarchyPALM-HT vs. PALM-ET · Taxi with multiple passengerscumulative rewardHurt
Use the learned Cleanup hierarchy instead of the expert Cleanup hierarchyPALM-HC vs. PALM-EC · Cleanupsamples to convergenceImproved
Amend the Cleanup hierarchy using expert knowledge after observing the learned hierarchyPALM-AC vs. PALM-HC · Cleanupsamples to convergenceImproved
Use the original expert Cleanup hierarchy rather than model-free Q-learningPALM-EC vs. QL · Cleanupsteps to learnHurt
Transfer a converged Navigation subtask model to a new task setPALM-ET given Nav vs. PALM-ET · New related taskscumulative rewardImproved
Train HierGen on sufficiently complex Cleanup demonstrations with no shared featuresPALM-HC · Cleanuphierarchy structureHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy