AI Paper Atlas

Research map / Video / Video-language understanding

Elysium: Exploring Object-level Perception in Videos through Semantic Integration Using MLLMs

Han Wang, Yanjie Wang, Ye Yongjie, Yuxiang Nie, Can Huang

ECCV 2024 · Video › Video-language understanding · approach: Video LLMs with fine-grained understanding

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use T-Selector token selection instead of concatenation at equal 144 tokens (ablation)Elysium · RefCOCO series averageaccuracy: 54.65 -> 78.45Improved
use T-Selector instead of one-layer cross-attention at equal 144 tokens (ablation)Elysium · RefCOCO series averageaccuracy: 49.23 -> 78.45Improved
use 336px ViT with T-Selector instead of 224px ViT with MLP at equal token count (ablation)Elysium · RefCOCO series averageaccuracy: 76.81 -> 80.09Improved
reduce visual tokens per image with T-Selector (108 to 72) (ablation)Elysium · RefCOCO series averageaccuracy: 78.54 -> 76.29Hurt
increase visual tokens from 108 to 256 with T-Selector (ablation)Elysium · RefCOCO series averageaccuracy: 78.54 -> 80.09Improved
compress to 108 tokens with T-Selector versus 576 uncompressed tokens at 336px (ablation)Elysium · RefCOCO series averageaccuracy: 81.45 -> 78.54Hurt
train end-to-end video MLLM on ElysiumTrack-1M instead of per-frame MiniGPT-v2Elysium · ElysiumTrack-1M eval RSOTAUC: 65.4 -> 87.5Improved
zero-shot tracking on datasets with small objectsElysium · UAV123AUC: 56.6 vs 64.6 (SiamGAT)Hurt

Later papers that compared with this method

1 later accepted paper reports Elysium as a baseline in their results tables; 0 of them report a better number on most of the results they share with it.

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 1 of 1 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy