atlas

Research map / Vision-language and multimodal / CLIP and zero-shot

CLIP-Event: Connecting Text and Images With Event Structures

CVPR 2022 · Vision-language and multimodal › CLIP and zero-shot · approach: Open-vocabulary alignment from VLMs · 106 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pretrain CLIP with event-structure contrastive learning and graph alignmentCLIP ViT-B/32 · M2E2 zero-shotEvent F1: 42.6 -> 48.1Helped
Pretrain CLIP with event-structure contrastive learning and graph alignmentCLIP ViT-B/32 · M2E2 zero-shotArgument F1: 11.1 -> 14.8Helped
Pretrain CLIP with event-structure contrastive learning and graph alignmentCLIP ViT-B/32 · VOANews text-to-image retrievalRecall@1: 23.5 -> 27.5Helped
Pretrain CLIP with event-structure contrastive learning and graph alignmentCLIP ViT-B/32 · VCRRationale F1: 47.2 -> 49.2Helped
Add event graph alignment via optimal transport (ablation)CLIP-Event · M2E2 zero-shotArgument F1: 11.9 -> 14.8Helped
Add event graph alignment via optimal transport (ablation)CLIP-Event · VOANews text-to-image retrievalRecall@1: 25.5 -> 27.5Helped
Add event graph alignment via optimal transport (ablation)CLIP-Event · VCRAnswer F1: 52.0 -> 52.4Helped
Add event graph alignment via optimal transport (ablation)CLIP-Event · VisualCOMETAccuracy@50: 21.1 -> 22.4Helped
Use GPT-3-generated prompts instead of the full prompt-function setup (ablation)CLIP-Event · M2E2 zero-shotEvent F1: 48.1 -> 47.3Hurt
Use only single-template prompts instead of the full prompt-function setup (ablation)CLIP-Event · M2E2 zero-shotEvent F1: 48.1 -> 44.4Hurt
Use only composed-template prompts instead of the full prompt-function setup (ablation)CLIP-Event · M2E2 zero-shotEvent F1: 48.1 -> 46.3Hurt
Use only continuous prompts instead of the full prompt-function setup (ablation)CLIP-Event · M2E2 zero-shotEvent F1: 48.1 -> 46.5Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy