AI Paper Atlas

Research map / Video / Video-language understanding

HiT: Hierarchical Transformer With Momentum Contrast for Video-Text Retrieval

Song Liu, Haoqi Fan, Shengsheng Qian, Yiru Chen, Wenkui Ding, Zhongyuan Wang

ICCV 2021 · Video › Video-language understanding · approach: Text-video retrieval · 175 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add momentum cross-modal contrast (4,096 queue) (ablation)HiT · MSR-VTTrsum: 306.5 -> 320.3Improved
increase memory bank from 4,096 to 8,192 (ablation)HiT · MSR-VTTrsum: 320.3 -> 316.2Hurt
add momentum key encoders instead of query encoders for bank (ablation)HiT · MSR-VTTtext-to-video R@5: 48.4 -> 59.2Improved
add feature-level matching to semantic-level matching (ablation)HiT · MSR-VTTtext-to-video R@1: 23.5 -> 27.0Improved
add semantic-level matching to feature-level matching (ablation)HiT · MSR-VTTtext-to-video R@1: 25.1 -> 27.0Improved
add a third matching level (3-level-a) (ablation)HiT · MSR-VTTtext-to-video R@1: 27.0 -> 28.5No clear effect
add four matching levels (ablation)HiT · MSR-VTTtext-to-video R@1: 27.0 -> 27.1No clear effect
use InfoNCE instead of triplet ranking loss (ablation)HiT · MSR-VTTtext-to-video R@1: 25.6 -> 27.7Improved
set temperature to 0.07 instead of 0.7 (ablation)HiT · MSR-VTTrsum: 155.4 -> 320.3Improved
set temperature to 0.07 instead of 0.0007 (ablation)HiT · MSR-VTTrsum: 285.1 -> 320.3Improved
add appearance expert to motion and audio (ablation)HiT · MSR-VTTtext-to-video R@1: 28.1 -> 27.7No clear effect
add audio expert to motion (ablation)HiT · MSR-VTTtext-to-video R@1: 25.1 -> 28.1Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy