AI Paper Atlas

Research map / Video / Video generation

PreLAR: World Model Pre-training with Learnable Action Representation

Lixuan Zhang, Meina Kan, Shiguang Shan, Xilin Chen

ECCV 2024 · Video › Video generation · approach: World-model video generation · 4 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
pre-train the world model action-conditionally with learnable action representation instead of action-free video predictionPreLAR vs APV and ContextWM · Meta-world manipulation (RLBench pre-training, aggregate)success rate vs environment stepsImproved
pre-train on real-world SSv2 videos with PreLARPreLAR · Meta-world manipulation (SSv2 pre-training, aggregate)success rate vs environment stepsImproved
PreLAR pre-trained on SSv2 and fine-tuned on Door LockPreLAR · Meta-world Door Lock (SSv2 pre-training)success rateHurt
add action-state consistency loss (ablation)PreLAR · Meta-world aggregate (RLBench pre-training)success rateImproved
add action KL loss and stochastic latent action representation (ablation)PreLAR · Meta-world aggregate (RLBench pre-training)success rateImproved
naive fine-tune of an action-free pre-trained model instead of action-conditional pre-training (ablation)world model · Meta-world aggregate (RLBench pre-training)success rateNo clear effect
action-free video pre-training (APV, ContextWM, PreLAR) versus no pre-trainingDreamerV2 · Meta-world manipulation, most taskssuccess rate and sample efficiencyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy