AI Paper Atlas

Research map / Video / Video-language understanding

Hierarchical Conditional Relation Networks for Multimodal Video Question Answering

Thao Minh Le, Vuong Le, Svetha Venkatesh, Truyen Tran

IJCV 2021 · Video › Video-language understanding · approach: Video question answering · 27 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add motion conditioning (ablation)HCRN · TGIF-QA Actionaccuracy: 69.8 -> 75.2Improved
add linguistic (question) conditioning (ablation)HCRN · TGIF-QA Actionaccuracy: 68.7 -> 75.2Improved
add relations (k_max=n-1, t=3) over no relations (k_max=1,t=1) (ablation)HCRN · TGIF-QA Actionaccuracy: 72.8 -> 75.2Improved
add relations (k_max=n-1) over no relations (ablation)HCRN · TGIF-QA CountMSE: 3.87 -> 4.00Hurt
add hierarchy (two levels) over video-level CRN only (ablation)HCRN · TGIF-QA Actionaccuracy: 72.7 -> 75.2Improved
add hierarchy (two levels) over video-level CRN only (ablation)HCRN · TGIF-QA FrameQAaccuracy: 57.2 -> 55.9Hurt
add multiplicative relation in all CRNs (ablation)HCRN · TGIF-QA FrameQAaccuracy: 74.0 -> 75.2 Action; 81.7 -> 81.3 TransitionMixed
sample subsets directly instead of from pre-computed superset (ablation)HCRN · TGIF-QA Actionaccuracy: 75.2 -> 75.3No clear effect
add subtitle pre-selection to S.+Q. baseline (ablation)(B) S.+Q. · TVQA val (w/o timestamp)accuracy: 42.3 -> 57.9Improved
add subtitle pre-selection to S.+Q. baseline (ablation)(B) S.+Q. · TVQA val (w/ timestamp)accuracy: 41.8 -> 62.1Improved
replace baseline with HCRN CRN units in textual stream(B) S.+Q. w/ pre-selection · TVQA val (w/o timestamp)accuracy: 57.9 -> 59.0Improved
replace averaged visual features with HCRN visual stream(B) V.+Q. · TVQA valaccuracy: 42.2 -> 43.1Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy