AI Paper Atlas

Research map / Video / Video-language understanding

4D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillation

Chiao-An Yang, Ryo Hachiuma, Sifei Liu, Subhashree Radhakrishnan, Raymond A. Yeh, Yu-Chiang Frank Wang, Min-Hung Chen

CVPR 2026 · Video › Video-language understanding · approach: Video question answering · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
apply P4D perceptual distillation with TPENVILA-Lite-8B · VSTI-Benchaccuracy: 45.2 -> 59.1Improved
apply P4D perceptual distillation with TPENVILA-Lite-8B · R4D-Bench (avg)accuracy: 37.9 -> 42.2Improved
use P4D instead of direct SFT (4D-SFT) (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 40.1 -> 42.2Improved
use P4D instead of concatenating F4D features (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 39.5 -> 42.2Improved
inject F4D as positional encodings (4D-PE) (ablation)NVILA-Lite-8B · STI-Benchaccuracy: 33.8 -> 31.3Hurt
combine latent and explicit distillation vs latent only (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 40.2 -> 42.2Improved
add depth and flow explicit distillation to latent distillation (ablation)NVILA-Lite-8B · STI-Benchaccuracy: 34.2 -> 36.2Improved
add motion and camray explicit signals (ablation)NVILA-Lite-8B · R4D-Bench (dynamic)accuracy: 45.3 -> 45.4 (dynamic)No clear effect
add timestamp positional encoding (TPE) to P4D (ablation)NVILA-Lite-8B · STI-Benchaccuracy: 34.8 -> 37.6Improved
use time marks or prompts instead of TPE (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 41.0 -> 41.1 (marks)No clear effect
tune vision encoder only (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 37.9 -> 35.8Hurt
tune projector and LLM fully instead of LLM LoRA only (ablation)NVILA-Lite-8B · R4D-Bench (avg)accuracy: 41.1 -> 42.2Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy