AI Paper Atlas

Research map / Video / Video-language understanding

Just Ask: Learning To Answer Questions From Millions of Narrated Videos

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

ICCV 2021 · Video › Video-language understanding · approach: Video question answering · 235 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
pretrain on HowToVQA69M before finetuningVQA-T · iVQA (finetuned)top-1 accuracy: 23.0 -> 35.4Improved
pretrain on HowToVQA69M instead of HowTo100MVQA-T · iVQA (finetuned)top-1 accuracy: 28.1 -> 35.4Improved
pretrain on HowToVQA69M before finetuningVQA-T · MSRVTT-QA (finetuned)top-1 accuracy: 39.6 -> 41.5Improved
pretrain on HowToVQA69M before finetuningVQA-T · How2QA (finetuned)top-1 accuracy: 80.8 -> 84.4Improved
add video input (VQA-T instead of language-only QA-T)VQA-T trained on HowToVQA69M · iVQA (zero-shot)top-1 accuracy: 4.4 -> 12.2Improved
train on HowToVQA69M instead of HowTo100MVQA-T · iVQA (zero-shot)top-1 accuracy: 1.9 -> 12.2Improved
remove duplicate negative answers in contrastive loss (ablation)VQA-T · iVQA (zero-shot)top-1 accuracy: 10.9 -> 12.2Improved
add MLM loss in pretraining (ablation)VQA-T · iVQA (finetuned)top-1 accuracy: 34.3 -> 35.4Improved
add MLM loss in pretraining (ablation)VQA-T · iVQA (zero-shot)top-1 accuracy: 12.1 -> 12.2Improved
increase pretraining data from 1% to 100% of HowToVQA69M (ablation)VQA-T · iVQA (finetuned)top-1 accuracy: 24.2 -> 35.4Improved
use transformer QA generation instead of rule-based Heilman et al. (ablation)VQA-T · iVQA (finetuned)top-1 accuracy: 31.4 -> 35.4Improved
use transformer QA generation instead of rule-based Heilman et al. (ablation)VQA-T · iVQA (zero-shot)top-1 accuracy: 7.4 -> 12.2Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy