AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Object-Centric Learning with Slot Attention

NeurIPS 2020 · Detection and segmentation › Open-set and few-shot detection · approach: Slot attention methods · 211 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use iterative slot attention instead of the soft k-means variant (ablation)Slot Attention · CLEVR6ARI: 75.5\pm3.8\% -> 98.8\pm0.3\%Helped
Use weighted mean rather than weighted sum aggregation (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and APHelped
Add position embeddings to CNN feature maps (ablation)Slot Attention · CLEVR6 object discovery and CLEVR10 position predictionARI and position predictionHelped
Use shared rather than per-slot Gaussian initialization parameters (ablation)Slot Attention · CLEVR6 object discovery and supervised property predictionARI and property predictionMixed
Normalize attention over slots rather than inputs (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHelped
Use the learned GRU update rather than directly using aggregated updates as slots (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHelped
Use more than one attention iteration during training (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHelped
Train with more than 3 attention iterations for the same number of steps (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHurt
Apply LayerNorm to inputs and slot representations (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHelped
Remove the residual MLP after the GRU (ablation)Slot Attention · CLEVR6 object discovery and CLEVR10 property predictionARI and property predictionMixed
Scale the softmax temperature by sqrt(D) (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionHelped
Use the attention-map offset rather than putting the offset in the weighted-mean denominator (ablation)Slot Attention · CLEVR6 and CLEVR10ARI and property predictionNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy