AI Paper Atlas

Research map / Video / Video-language understanding

Movie Description

Anna Rohrbach, Atousa Torabi, Marcus Rohrbach, Niket Tandon, Christopher Pal, Hugo Larochelle, Aaron C. Courville, Bernt Schiele

IJCV 2017 · Video › Video-language understanding · approach: Video LLMs with fine-grained understanding · 344 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
stack IDT, LSDA and PLACES features instead of one (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.10 -> 7.24Improved
assign features by label group (verbs IDT, others LSDA) (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.24 -> 7.27Improved
add a places group with PLACES features (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.27 -> 7.39Improved
use objects group only instead of all other labels (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.39 -> 7.48Improved
restrict to labels with ROC >= 0.7 (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.48 -> 7.54Improved
apply the same restriction with uniform features (ablation)IDT+LSDA+PLACES baseline · MPII-MD valMETEOR: 7.24 -> 7.20No clear effect
use two factored LSTM layers instead of one layer (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.54 -> 7.41Hurt
add dropout after the LSTM (lstm-drop) (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.19 -> 7.54Improved
dropout on language only (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.19 -> 7.13Hurt
dropout ratio 0.5 instead of 0.1 (ablation)Visual-Labels LSTM · MPII-MD valMETEOR: 7.22 -> 7.54Improved
use text-labels instead of sense-labels (ablation)SMT with IDT 30 · MPII-MD valMETEOR: 4.93 -> 5.59Improved
use Visual-Labels LSTM instead of SMT (ablation)SMT-Best · MPII-MD testMETEOR: 5.59 -> 7.03Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy