AI Paper Atlas

Research map / Video / Video-language understanding

E3M: Zero-Shot Spatio-Temporal Video Grounding with Expectation-Maximization Multimodal Modulation

Peijun Bao, Zihao Shao, Wenhan Yang, Boon Poh Ng, Alex Kot

ECCV 2024 · Video › Video-language understanding · approach: Temporal video grounding · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add EM alternating optimization of temporal and spatial grounding (ablation)E3M · HC-STVGm_vIoU: 17.21 -> 19.11Improved
add context-based visual modulation (ablation)E3M · HC-STVGm_vIoU: 17.05 -> 19.11Improved
add prototype-based textual modulation (ablation)E3M · HC-STVGm_vIoU: 18.76 -> 19.11Improved
use long context (T=10) instead of short context (1) (ablation)visual modulation · HC-STVGm_vIoU: 17.62 -> 19.11Improved
use both past and future context instead of one side (ablation)visual modulation · HC-STVGm_vIoU: 18.27 (past only), 18.09 (future only) -> 19.11Improved
use K=3 prototypes instead of a single one (ablation)textual modulation · HC-STVGm_vIoU: 18.80 -> 19.11Improved
increase prototype count K beyond 3 (ablation)textual modulation · HC-STVGavg vIoU@{0.3,0.5}: 20.00 (K=3) -> 20.09 (K=5)No clear effect
increase context size T beyond 10 (ablation)visual modulation · HC-STVGavg vIoU@{0.3,0.5}: 20.14 -> 20.22No clear effect
use CLIP RN-50 instead of ViT-B/32 (ablation)E3M · HC-STVGm_vIoU: 19.11 -> 18.29Hurt
zero-shot E3M versus weakly supervised WinnerHC-STVG · HC-STVGvIoU@0.5: 6.12 -> 10.60Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy