Research map / Reinforcement learning / Visual and representation RL
Procedure Planning in Instructional Videos via Contextual Modeling and Model-Based Policy Learning
Jing Bi, Jiebo Luo, Chenliang Xu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add accumulated-reward maximization over the whole trajectory (ablation) | Int-MGAIL · CrossTask procedure planning (T=3) | success rate: 7.18 -> 17.03 | Improved |
| add accumulated-reward maximization over the whole trajectory (ablation) | Ext-MGAIL · CrossTask procedure planning (T=3) | success rate: 15.18 -> 21.27 | Improved |
| add the discriminator (adversarial imitation) loss to supervised sequence learning (ablation) | Int-MGAIL · CrossTask procedure planning (T=3) | success rate: 5.89 -> 17.03 | Improved |
| add the discriminator (adversarial imitation) loss to supervised sequence learning (ablation) | Ext-MGAIL · CrossTask procedure planning (T=3) | success rate: 11.42 -> 21.27 | Improved |
| add hindsight relabeling of demonstrations (ablation) | Int-MGAIL · CrossTask procedure planning (T=3) | success rate: 14.39 -> 17.03 | Improved |
| add hindsight relabeling of demonstrations (ablation) | Ext-MGAIL · CrossTask procedure planning (T=3) | success rate: 18.01 -> 21.27 | Improved |
| make the transition model/policy stochastic (Ext vs Int) | MGAIL · CrossTask procedure planning (T=3) | success rate: 17.03 -> 21.27 | Improved |
| make the transition model/policy stochastic (Ext vs Int) | MGAIL · CrossTask procedure planning (T=4) | success rate: 9.47 -> 16.41 | Improved |
| remove HER from the stochastic model (Ext w/o HER versus Int-MGAIL) | Ext-MGAIL · CrossTask procedure planning (T=3) | success rate: 17.03 -> 18.01 | Hurt |
| replace DDN with model-based imitation learning (Int-MGAIL) | Int-MGAIL · CrossTask procedure planning (T=3) | success rate: 12.18 -> 17.03 | Improved |
| use Ext-MGAIL instead of Int-MGAIL on a second dataset | MGAIL · second dataset (T=3) | success rate: 20.19/22.11 | No clear effect |
| use Ext-MGAIL versus DDN for walk-through ordering | Ext-MGAIL · CrossTask walk-through planning (T=3) | pair accuracy: 86.81 -> 93.66 | Improved |
Closest papers by meaning
- Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos (AAAI 2025 · similarity 0.90)
- Masked Temporal Interpolation Diffusion for Procedure Planning in Instructional Videos (ICLR 2025 · similarity 0.88)
- SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos (ICLR 2024 · similarity 0.88)
- Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos (CVPR 2024 · similarity 0.87)
- PlanLLM: Video Procedure Planning with Refinable Large Language Models (AAAI 2025 · similarity 0.87)
- Data Augmentation for Instruction Following Policies via Trajectory Segmentation (AAAI 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
