AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

A Simple Framework for Open-Vocabulary Segmentation and Detection

Hao Zhang, Feng Li, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianwei Yang, Lei Zhang

ICCV 2023 · Detection and segmentation › Open-set and few-shot detection · approach: Open-vocabulary semantic segmentation · 186 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add detection data (Objects365) to joint training (ablation)OpenSeeD Swin-T · COCO panopticPQ: 54.0 -> 55.2Improved
add decoupled foreground and background decoding (ablation)OpenSeeD-SwinT · ADE20K zero-shotbox AP: 14.9 -> 17.2Improved
add online mask assistance for matching (ablation)OpenSeeD-SwinT · ADE20K zero-shotmask AP: 13.6 -> 14.2Improved
add offline pseudo masks on Objects365 generated by the large model (ablation)MaskDINO-R50 pretraining · COCO fine-tunebox AP: 52.0 -> 54.3Improved
add offline pseudo mask annotations to OpenSeeD-FocalT (ablation)OpenSeeD-FocalT · ADE20K zero-shotmask AP: 12.6 -> 14.1Improved
add offline pseudo annotations to OpenSeeD-FocalT on ADE20K PQ (ablation)OpenSeeD-FocalT · ADE20K zero-shotPQ: 18.4 -> 18.2No clear effect
condition mask decoding on GT concept and box (ablation)OpenSeeD (T) trained on COCO · ADE20Kmask AP: 8.6 -> 46.4Improved
use early-stage conditioned masks as direct supervision (ablation)OpenSeeD online mask assistance · COCOmask AP: 45.1 -> 42.2Hurt
OpenSeeD (L) versus X-Decoder (L) on ADE20K panoptic qualityzero-shot segmentation · ADE20K zero-shotPQ: 21.8 -> 19.7Hurt
joint segmentation and detection pretraining instead of segmentation-only pretrainingOpenSeeD (T) versus X-Decoder (T) · SegInWaverage mask AP: 22.7 -> 33.9Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy