AI Paper Atlas

Research map / Video / Video-language understanding

PAI-Bench: A Comprehensive Benchmark For Physical AI

Fengzhe Zhou, Jiannan Huang, Jialuo Li, Deva Ramanan, Humphrey Shi

CVPR 2026 · Video › Video-language understanding · approach: Event and anomaly reasoning in video · 27 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use multi-signal (All) conditioning instead of the best single control signal (ablation)Cosmos-Transfer1-7B · PAI-Bench-CQuality Score: 6.89 -> 9.24Improved
use multi-signal (All) conditioning instead of the best single control signal (ablation)Cosmos-Transfer2.5-2B · PAI-Bench-CQuality Score: 8.77 -> 9.24Improved
use segmentation maps instead of all signals as control (ablation)Cosmos-Transfer1-7B · PAI-Bench-CMask mIoU: 0.74 -> 0.70Hurt
use blur control instead of all signals (ablation)Cosmos-Transfer2.5-2B · PAI-Bench-CDiversity: 0.13 -> 0.18Improved
scale Qwen2.5-VL from 7B to 72BQwen2.5-VL · PAI-Bench-Uaccuracy: 51.0 -> 60.8Improved
scale Qwen3-VL from 8B to 235B-A22BQwen3-VL · PAI-Bench-Uaccuracy: 56.8 -> 64.7Improved
scale Cosmos-Predict2 from 2B to 14BCosmos-Predict2 · PAI-Bench-GOverall: 79.7 -> 80.0No clear effect
scale MAGI-1 from 4.5B to 24BMAGI-1 · PAI-Bench-GOverall: 77.5 -> 79.4Improved
enable textual thinking mode (ablation)Qwen3-VL series · PAI-Bench-UaccuracyHurt
use medium instead of minimal reasoning effort (thinking with visual reasoning) (ablation)GPT-5 · PAI-Bench-UaccuracyImproved
increase input frames from 0 (text-only) to visual frames (ablation)MLLMs · PAI-Bench-UaccuracyImproved
increase input frames beyond 8 (ablation)MLLMs · PAI-Bench-UaccuracyNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy