AI Paper Atlas

Research map / Video / Video segmentation and tracking

Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning

Jialong Wu, Haoyu Ma, Chaoyi Deng, Mingsheng Long

NeurIPS 2023 · Video › Video segmentation and tracking · approach: Stochastic video prediction · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pre-train ContextWM on Something-Something-v2 videosContextWM · Meta-worldsuccess rateImproved
Use ContextWM instead of a plain world modelIPV fine-tuning on Meta-world · Meta-worldsample efficiencyImproved
Pre-train ContextWM on Something-Something-v2 videosContextWM · DMControl RemasteredperformanceImproved
Pre-train a plain world model on Something-Something-v2 videosPlain WM · DMControl RemasteredperformanceMixed
Pre-train ContextWM on Something-Something-v2 videosContextWM · CARLAepisode returnImproved
Pre-train with Human3.6M instead of training from scratchContextWM · DMControl RemasteredperformanceHurt
Use the assembled three-dataset pre-training set instead of SSv2ContextWM · DMControl RemasteredperformanceNo clear effect
Pre-train on the more domain-similar RLBench videos instead of SSv2ContextWM · Meta-worldperformanceImproved
Pre-train with assembled data from three in-the-wild datasets instead of SSv2ContextWM · Meta-worldperformanceImproved
Pre-train on YouTube Driving or assembled videos instead of training from scratchContextWM · CARLAperformanceImproved
Pre-train on YouTube Driving or assembled videos instead of SSv2ContextWM · CARLAperformanceNo clear effect
Add video pre-training (ablation)ContextWM · Meta-worldaggregate performanceImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy