AI Paper Atlas

Research map / Vision-language and multimodal / CLIP and zero-shot

Retrieval Augmented Classification for Long-Tail Visual Recognition

Alexander Long, Wei Yin, Thalaiyasingam Ajanthan, Vu Nguyen, Pulak Purkait, Ravi Garg, Alan Blair, Chunhua Shen, Anton van den Hengel

CVPR 2022 · Vision-language and multimodal › CLIP and zero-shot · approach: Open-vocabulary alignment from VLMs · 77 citations (OpenAlex)

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the retrieval branch to the LACE-trained base encoder (ablation)ViT-B-16 on Places365-LT · Places365-LTtop-1 accuracy, All: 44.05 -> 47.17Improved
add the retrieval branch to the LACE-trained base encoder (ablation)ViT-B-16 on iNaturalist 2018 · iNaturalist 2018 validationtop-1 accuracy, All: 78.32 -> 80.24Improved
add the retrieval branch to the LACE-trained base encoder (ablation)ViT-B-16 on Places365-LT · Places365-LTtop-1 accuracy, Few: 40.77 -> 41.76Improved
add the retrieval branch to the LACE-trained base encoder (ablation)ViT-B-16 on iNaturalist 2018 · iNaturalist 2018 validationtop-1 accuracy, Few: 78.55 -> 81.07Improved
use a ViT-B-16 rather than a ViT-B-32 retrieval encoder (ablation)retrieval branch · iNaturalist 2018 retrievaltop-1 accuracy, All: 44.31 -> 53.89Improved
increase retrieval input resolution from 224×224 to 384×384 (ablation)ViT-B-16 retrieval branch · iNaturalist 2018 retrievaltop-1 accuracy, All: 53.89 -> 61.77Improved
replace exact k-NN with HNSW approximate k-NN (ablation)Places365-LT retrieval index, 62.5k items, L2 distance · Places365-LT retrievalquery time: 1.12 -> 1.06Improved
replace exact k-NN with HNSW approximate k-NN (ablation)Places365-LT retrieval index, 62.5k items, L2 distance · Places365-LT retrievaltop-1 accuracy: 29.91 -> 29.66Hurt
replace L2 distance with cosine distance (ablation)exact k-NN retrieval · Places365-LT retrieval, 62.5k indextop-1 accuracy: 29.91 -> 29.64Hurt
increase retrieval input resolution from 224×224 to 384×384 (ablation)ViT-B-16 retrieval branch · Places365-LT retrievaltop-1 accuracy, All: 29.91 -> 30.55Improved
add inverse-square-root class-frequency reweighting to logit adjustment (ablation)RAC · Places365-LTtop-1 accuracy, All: 47.75 -> 48.32Improved
add inverse-log class-frequency reweighting to logit adjustment (ablation)RAC · Places365-LTtop-1 accuracy, All: 47.75 -> 48.29Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy