Research map / Video / Video-language understanding
Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning
Check your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Replace mean pooling with hierarchical Fourier encoding (ablation) | Two-layer GRU video captioner using C3D and IRV2 · MSVD | METEOR: 31.3 -> 34.7 | Helped |
| Replace mean pooling with hierarchical Fourier encoding (ablation) | Two-layer GRU video captioner using C3D and IRV2 · MSVD | CIDEr_D: 61.9 -> 75.8 | Helped |
| Replace mean pooling with hierarchical Fourier encoding (ablation) | Two-layer GRU video captioner using C3D and IRV2 · MSVD | BLEU-4: 41.0 -> 47.8 | Helped |
| Add object and action semantic attributes (ablation) | GRU-EVE hft using C3D and IRV2 · MSVD | METEOR: 34.7 -> 35.0 | Helped |
| Add object and action semantic attributes (ablation) | GRU-EVE hft using C3D and IRV2 · MSVD | CIDEr_D: 75.8 -> 78.1 | Helped |
| Add object and action semantic attributes (ablation) | GRU-EVE hft using C3D and IRV2 · MSR-VTT | METEOR: 27.7 -> 28.4 | Helped |
| Add object and action semantic attributes (ablation) | GRU-EVE hft using C3D and IRV2 · MSR-VTT | CIDEr_D: 45.2 -> 48.1 | Helped |
| Use both C3D and IRV2 features rather than IRV2 features alone (ablation) | GRU-EVE hft · MSR-VTT | METEOR: 26.4 -> 27.7 | Helped |
| Increase the number of GRU layers beyond two (ablation) | GRU video captioner · MSVD and MSR-VTT | BLEU-4 | Hurt |
| Increase the number of GRU layers beyond two (ablation) | GRU video captioner · MSVD and MSR-VTT | Other reported metrics | Helped |
| Increase GRU state size up to 2048 (ablation) | GRU video captioner · MSVD and MSR-VTT | Captioning performance | Helped |
| Increase GRU state size beyond 2048 (ablation) | GRU video captioner · MSVD and MSR-VTT | Captioning performance | No clear effect |
Closest papers by meaning
- Temporal Deformable Convolutional Encoder-Decoder Networks for Video Captioning (AAAI 2019 · similarity 0.90)
- Distilling Vision-Language Models on Millions of Videos (CVPR 2024 · similarity 0.88)
- Dense Video Object Captioning from Disjoint Supervision (ICLR 2025 · similarity 0.88)
- Fine-Grained Captioning of Long Videos through Scene Graph Consolidation (ICML 2025 · similarity 0.88)
- Video ReCap: Recursive Captioning of Hour-Long Videos (CVPR 2024 · similarity 0.87)
- Progress-Aware Video Frame Captioning (CVPR 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.