AI Paper Atlas

Research map / Video / Video-language understanding

Towards Bridging Event Captioner and Sentence Localizer for Weakly Supervised Dense Event Captioning

Shaoxiang Chen, Yu-Gang Jiang

CVPR 2021 · Video › Video-language understanding · approach: Dense video captioning · 77 citations (OpenAlex)

Check your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
bridge the captioner and localizer with concept features, word-importance guidance, and proposal reconstructionWS-DEC · ActivityNet Captions validationCIDEr: 18.77 -> 21.21Improved
bridge the captioner and localizer with concept features, word-importance guidance, and proposal reconstructionWS-DEC · ActivityNet Captions, top-1 recall at IoU=0.5Top-1 recall: 23.34 -> 24.16Improved
add MIL concept learning (ablation)EC-SL base · ActivityNet Captions validationCIDEr: 19.09 -> 20.46Improved
add ISAB to MIL concept learning (ablation)EC-SL · ActivityNet Captions validationCIDEr: 20.46 -> 20.98Improved
add gating to the concept-enhanced features (ablation)EC-SL with MIL and ISAB · ActivityNet Captions validationCIDEr: 20.98 -> 21.44Improved
add localizer-derived word-importance weights to the caption loss (ablation)EC-SL with MIL, ISAB, and gating · ActivityNet Captions validationCIDEr: 21.44 -> 21.21Hurt
vary induced set size from 8 to 16, 32, and 64 (ablation)EC-SL · ActivityNet Captions validationCIDEr: 21.05; 21.21; 21.44; 21.45Mixed
select inducing points from maximum-contribution concept features instead of randomly (ablation)EC-SL · ActivityNet Captions validationCIDEr: 20.67 -> 21.21Improved
use word-prediction logits rather than LSTM hidden states as sentence features (ablation)EC-SL sentence localizer · ActivityNet Captions validationCIDEr: 21.21 -> 18.41Hurt
use word embeddings rather than LSTM hidden states as sentence features (ablation)EC-SL sentence localizer · ActivityNet Captions validationCIDEr: 21.21 -> 21.36No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy