atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

SuperVLAD: Compact and Robust Image Descriptors for Visual Place Recognition

NeurIPS 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Correspondence and causal representation learning · 6 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes SuperVLAD, a NetVLAD variant without cluster centers and with few clusters (4), plus a 1-Cluster VLAD using a ghost cluster, for compact and domain-robust VPR global descriptors on DINOv2 features.

Problem

Global descriptors for visual place recognition from VLAD-style aggregation are high-dimensional, and learned cluster centers become improper under train-test domain shift, degrading generalization.

Approach

Remove the learned cluster centers from NetVLAD so that soft-assigned features are aggregated by weighted sum of raw local features, use only a few clusters for compactness, and add a ghost cluster that is discarded from the output to yield a 1-cluster descriptor of GeM-level dimension.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace NetVLAD with SuperVLAD by removing cluster centers (ablation)DINOv2-B VPR · MSLS-val, trained on Pitts30kR@1: 72.7 -> 75.1Helped
replace NetVLAD with SuperVLAD by removing cluster centers (ablation)CCT VPR · MSLS-val, trained on Pitts30kR@1: 55.4 -> 62.2Helped
add a ghost cluster (ablation)CCT-SV trained on Pitts30k · MSLS-valR@1: 60.3 -> 62.2Helped
add a ghost cluster (ablation)DINOv2-SV trained on GSV-Cities · MSLS-valR@1: 92.4 -> 92.2Hurt
use 1-Cluster VLAD instead of GeM pooling (ablation)DINOv2-B global descriptor · Pitts30k-testR@1: 89.5 -> 91.6Helped
use 1-Cluster VLAD instead of the class token (ablation)DINOv2-B global descriptor · MSLS-valR@1: 88.4 -> 90.4Helped
add the cluster-wise cross-image encoder (ablation)SuperVLAD with 4 clusters · Pitts30k-testR@1: 92.6 -> 95.0Helped
add the cluster-wise cross-image encoder (ablation)SuperVLAD with 4 clusters · MSLS-valR@1: 92.2 -> 92.2No clear effect
use 16 or 64 clusters instead of 4 (ablation)SuperVLAD without cross-image encoder · MSLS-valR@1: 92.2 -> 90.5; 92.2 -> 91.4Hurt
increase cluster count from 4 to 16 or 64 (ablation)SuperVLAD without cross-image encoder · Pitts30k-testR@1: 92.6; 92.4; 92.5No clear effect
remove cluster centers and use SuperVLAD rather than NetVLAD (ablation)CCT VPR · Pitts30k-test, trained on Pitts30kR@1: 84.7 -> 84.7No clear effect
remove cluster centers and use SuperVLAD rather than NetVLAD (ablation)ViT VPR · Pitts30k-test, trained on MSLSR@1: 79.0 -> 79.4Helped

Surprising findings

Limitations

Experimental setup

Datasets: GSV-Cities MSLS Pitts30k

Benchmarks: Pitts30k-test MSLS-val Nordland SPED-test Pitts250k Tokyo247 Baidu Mall

Metrics: Recall@1 Recall@5 Recall@10 inference time

Baselines: NetVLAD SFRS TransVPR CosPlace MixVPR EigenPlaces SelaVPR CricaVPR SALAD GeM pooling class token

Builds on: NetVLAD GhostVLAD CricaVPR GeM pooling DINOv2

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy