AI Paper Atlas

Research map / Video / Video-language understanding

TeachText: CrossModal Generalized Distillation for Text-Video Retrieval

Ioana Croitoru, Simion-Vlad Bogolin, Marius Leordeanu, Hailin Jin, Andrew Zisserman, Samuel Albanie, Yang Liu

ICCV 2021 · Video › Video-language understanding · approach: Text-video retrieval · 152 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add TeachText distillation from multiple text-embedding teachersCE+ · DiDeMogeometric mean R1-R5-R10: 35.8 -> 40.4Improved
add TeachText distillationCE+ · ActivityNetgeometric mean R1-R5-R10: 39.7 -> 46.3Improved
add TeachText distillationCE+ · MSVDgeometric mean R1-R5-R10: 46.5 -> 46.6No clear effect
add TeachText distillationMoEE · DiDeMogeometric mean R1-R5-R10: 33.2 -> 40.2Improved
add TeachText distillationCE · MSVDgeometric mean R1-R5-R10: 42.3 -> 42.6No clear effect
add TeachText distillationCE+ · MSR-VTT fullgeometric mean R1-R5-R10: 29.2 -> 30.4Improved
use TeachText rather than concatenating or averaging multiple text embeddings at test time (ablation)CE+ · MSR-VTTR1-R5-R10 geometric meanImproved
add more teachers beyond three (ablation)TeachText with CE+ student · MSR-VTTR1-R5-R10 geometric meanNo clear effect
restrict distillation to top-K teacher ranks (Rank 1 or Rank 10) instead of the whole batch (ablation)TeachText · MSR-VTTR1-R5-R10 geometric meanHurt
distill cross-modal similarity matrix instead of Relational or Pdist distillation (ablation)TeachText · MSR-VTTR1-R5-R10 geometric meanImproved
use mean aggregation of teacher similarity matrices instead of min or max (ablation)TeachText · MSR-VTTR1-R5-R10 geometric meanImproved
use Huber loss instead of L1 or L2 for distillation (ablation)TeachText · MSR-VTTR1-R5-R10 geometric meanImproved

Later papers that compared with this method

1 later accepted paper reports TeachText as a baseline in their results tables; 1 of them report a better number on most of the results they share with it.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy