atlas

Research map / Large language models / Agents, code and math

Tree-Planner: Efficient Close-loop Task Planning with Large Language Models

ICLR 2024 · Large language models › Agents, code and math · approach: Long-horizon LLM agents · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Tree-Planner, which samples multiple plans from an LLM once, merges them into an action tree, and has the LLM make grounded top-down decisions with backtracking, cutting token cost and error corrections in VirtualHome.

Problem

Iterative LLM task planning is token-inefficient (the same long prompt is re-charged every step) and correction-inefficient (local or global replanning), limiting large-scale use in closed-loop task planning.

Approach

Decompose LLM use into one plan-sampling call that produces N candidate plans, aggregate them into a prefix-sharing action tree, then make repeated grounded decisions over child nodes with environment observations, backtracking to the previous fork node on failure.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Tree-Planner instead of Iterative-Planner without correctionGPT-3.5 task planning · VirtualHome w/o correctionSR: 27.04\pm4.65 -> 28.33\pm1.18Helped
Use Tree-Planner instead of Global ReplanGPT-3.5 task planning with correction · VirtualHome with correction$Cost: 42.55$\pm$0.09 -> 3.30$\pm$0.01Helped
Use Tree-Planner instead of Local ReplanGPT-3.5 task planning with correction · VirtualHome with correctionNo.EC: 3.29$\pm$0.46 -> 1.85$\pm$0.05Helped
Increase sampled plans from N=25 to N=50 (ablation)Tree-Planner · VirtualHome w/o correctionSR: 28.33$\pm$1.18 -> 28.14$\pm$2.45No clear effect
Increase sampled plans from N=25 to N=50 (ablation)Tree-Planner · VirtualHome with correctionSR: 35.30$\pm$1.78 -> 41.58$\pm$3.20Helped
Add the gold plan to the action-tree construction (ablation)Tree-Planner N=25 · VirtualHome with correctionNo.EC: 1.85 to 1.21Helped
Add the gold plan to the action-tree construction (ablation)Tree-Planner N=50 · VirtualHome with correctionNo.EC: 2.04 to 1.39Helped
Replace grounded deciding with language-guided best-first search (ablation)Tree-Planner N=50 · VirtualHome w/o correctionSR: 28.14$\pm$2.45 -> 15.06$\pm$1.02Hurt
Replace grounded deciding with environment-guided best-first search (ablation)Tree-Planner N=50 · VirtualHome w/o correctionSR: 28.14$\pm$2.45 -> 6.24$\pm$0.65Hurt
Replace grounded deciding with hybrid best-first search (ablation)Tree-Planner N=50 · VirtualHome w/o correctionSR: 28.14$\pm$2.45 -> 17.74$\pm$0.69Hurt

Surprising findings

Limitations

Experimental setup

Datasets: VirtualHome ActivityPrograms-derived tasks (35 tasks across 4 scenes)

Benchmarks: VirtualHome (35 tasks, 4 scenes)

Metrics: executability success rate goal conditions recall cost number of error corrections

Baselines: Zero-shot Planner ProgPrompt Iterative-Planner Local Replan Global Replan

Builds on: ReAct-style iterative planning tree-of-thought VirtualHome

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy