AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Simple Open-Vocabulary Object Detection with Vision Transformers

Matthias Minderer, Alexey Gritsenko, Austin Stone, Maxim Neumann, Dirk Weissenborn, Alexey Dosovitskiy, Aravindh Mahendran, Anurag Arnab, Mostafa Dehghani, Zhuoran Shen, Xiao Wang, Xiaohua Zhai and 2 more

ECCV 2022 · Detection and segmentation › Open-set and few-shot detection · approach: Open-vocabulary object detection · 253 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add Visual Genome to Open Images training data (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -5.7Improved
add Open Images to Visual Genome training data (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -14.0Improved
use lower text encoder learning rate than image encoder (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -8.5Improved
ensemble predictions over prompt templates at inference (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -5.5Improved
add random prompts in training and inference (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -1.3Improved
add random pseudo-negative labels (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -2.8Improved
add mosaic image augmentation (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -1.5Improved
train 3x longer without mosaics (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -1.5 -> -3.6Hurt
add location bias to box predictor (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -1.1Improved
merge overlapping instances (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: -1.3Improved
remove OI crowd instances (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: 0.7No clear effect
remove LVIS rare labels from training data (ablation)OWL-ViT R26+B/32 (LVIS) · LVIS rareAPr: 0.2No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy