AI Paper Atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidance

Lukas Hoyer, David Joseph Tan, Muhammad Ferjad Naeem, Luc Van Gool, Federico Tombari

ECCV 2024 · Label-efficient and robust learning › Semi-supervised learning · approach: Consistency training for semi-supervised segmentation · 55 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace ImageNet initialization with CLIP vision-language pre-training (ablation)UniMatch with ViT-B/16 · Pascal VOC (92 labels)mIoU: 77.9 -> 80.6Improved
add spatial fine-tuning (attention layers only) (ablation)SemiVL · Pascal VOC (92 labels)mIoU: 80.6 -> 81.7Improved
add language-guided decoder (ablation)SemiVL · Pascal VOC (92 labels)mIoU: 81.7 -> 82.7Improved
add dense CLIP guidance from a frozen CLIP (ablation)SemiVL · Pascal VOC (92 labels)mIoU: 82.7 -> 83.2Improved
add dense CLIP guidance and class definitions (ablation)SemiVL · Pascal VOC (1464 labels)mIoU: 87.3 -> 87.4 -> 87.3No clear effect
add class definition guidance from annotation guidelines (ablation)SemiVL · Pascal VOC (92 labels)mIoU: 83.2 -> 84.0Improved
spatial fine-tuning instead of full fine-tuning, LoRA, prompt tuning or frozen (ablation)SemiVL encoder · Pascal VOC (92 labels)mIoU: 80.6 -> 81.7 (vs full fine-tuning)Improved
decouple spatial and semantic reasoning instead of joint reasoning over all classes (ablation)language-guided decoder · Pascal VOC (92 labels)mIoU: 64.9 -> 82.7Improved
add semantic reasoning module on top of upsampling and spatial reasoning (ablation)language-guided decoder · Pascal VOC (92 labels)mIoU: 80.3 -> 82.7Improved
use guideline concepts with max aggregation instead of dictionary text, GPT concepts, or averaged embeddings (ablation)class definition guidance · Pascal VOC (92 labels)mIoU: 83.4 -> 84.0 (Guidelines Avg vs Max)Improved
raise initial CLIP guidance weight from 0.1 to 1 (ablation)dense CLIP guidance · Pascal VOC (92 labels)mIoU: 84.0 -> 75.7Hurt
lower CLIP guidance confidence threshold from 0.9 to 0.7 (ablation)dense CLIP guidance · Pascal VOC (92 labels)mIoU: 84.0 -> 81.5Hurt

Later papers that compared with this method

2 later accepted papers report SemiVL as a baseline in their results tables; 2 of them report a better number on most of the results they share with it.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy