Research map / Vision-language and multimodal / Robot action and navigation
RobotArena $\infty$: Unlimited Robot Benchmarking via Real-to-Sim Translation
Yash Jangir, Yidi Zhang, Kashu Yamazaki, Chenyu Zhang, Kuan-Hsun Tu, Tsung-Wei Ke, Lei Ke, Yonatan Bisk, Katerina Fragkiadaki
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| evaluate X-VLA on RH20T-derived environments instead of Bridge-derived ones | X-VLA · RH20TSim | VLM task progress score: fails (0.00%) | Hurt |
| evaluate policies on environments from datasets not in their training data (DROID, RH20T) | VLA policies · RobotArena infinity | VLM task progress score | Hurt |
| perturb backgrounds or randomize object poses in BridgeSim | VLA policies · BridgeSim perturbations | VLM task progress score | Hurt |
| use stronger VLM backbone under color shift perturbation | VLA policies · BridgeSim color shift | VLM task progress score | Improved |
| evaluate on the 4-environment SIMPLER reproduction instead of 70-environment BridgeSim | VLA policies · SIMPLER vs BridgeSim | policy score | Improved |
Closest papers by meaning
- VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models (NeurIPS 2026 · similarity 0.91)
- Beyond Data Scaling: Representation-Centric Pre-training for Vision-Language-Action Models (NeurIPS 2026 · similarity 0.89)
- ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models (NeurIPS 2026 · similarity 0.88)
- Human-assisted Robotic Policy Refinement via Action Preference Optimization (NeurIPS 2025 · similarity 0.88)
- VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model (ICML 2026 · similarity 0.88)
- CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation (ICML 2026 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
