Research map / Vision-language and multimodal / Visual question answering
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add co-attention and correlation pretraining rather than using masking loss only with zeroed co-attention (ablation) | ViLBERT · VQA | score: 64.85 -> 66.59 | Helped |
| Add co-attention and correlation pretraining rather than using masking loss only with zeroed co-attention (ablation) | ViLBERT · RefCOCO+ | score: 68.04 -> 70.38 | Helped |
| Add alignment loss (ablation) | ViLBERT · VQA | score: 64.61 -> 66.59 | Helped |
| Add alignment loss (ablation) | ViLBERT · RefCOCO+ | score: 68.49 -> 70.38 | Helped |
| Add masking loss (ablation) | ViLBERT · VQA | score: 42.43 -> 66.59 | Helped |
| Add masking loss (ablation) | ViLBERT · RefCOCO+ | score: 10.00 -> 70.38 | Helped |
Closest papers by meaning
- Revisiting the Role of Language Priors in Vision-Language Models (ICML 2024 · similarity 0.89)
- VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks (ICLR 2025 · similarity 0.88)
- ClawMachine: Learning to Fetch Visual Tokens for Referential Comprehension (ICLR 2025 · similarity 0.88)
- The Neglected Tails in Vision-Language Models (CVPR 2024 · similarity 0.88)
- Bridging Vision and Language Spaces with Assignment Prediction (ICLR 2024 · similarity 0.88)
- Hugging Visual Prompt and Segmentation Tokens: Consistency Learning for Fine-Grained Visual Understanding in MLLMs (CVPR 2026 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.