atlas

Research map / Label-efficient and robust learning / Self-supervised and contrastive

An Asymmetric Augmented Self-Supervised Learning Method for Unsupervised Fine-Grained Image Hashing

CVPR 2024 · Label-efficient and robust learning › Self-supervised and contrastive · approach: Masked autoencoder pretraining · 15 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes A2-SSL, an unsupervised fine-grained image hashing method combining asymmetric augmentation contrastive learning, part-oriented dense contrastive learning with Fisher Vectors, and a self-consistency reconstruction loss for hash codes.

Problem

Unsupervised hashing methods perform far worse on fine-grained image datasets than on generic ones (a "granularity gap"), because conventional contrastive SSL with strong augmentations can destroy fine-grained category cues.

Approach

Use asymmetric augmentation (mild views for anchor/positive, destructive ColorJitter+ElasticTransform for negatives), add part-level dense contrastive learning over GMM/Fisher Vector descriptors, and a self-consistent encoder-decoder reconstruction loss on the hash embedding.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use A2-SSL instead of MeCoQUnsupervised fine-grained image hashing · CUB200-2011, 48-bitmAP (%): 18.80 -> 29.19Helped
Use A2-SSL instead of MeCoQUnsupervised fine-grained image hashing · Oxford Flowers, 48-bitmAP (%): 35.44 -> 46.37Helped
Use A2-SSL instead of SPQUnsupervised fine-grained image hashing · Stanford Dogs, 48-bitmAP (%): 56.55 -> 64.56Helped
Use A2-SSL instead of SPQUnsupervised fine-grained image hashing · Stanford Cars, 48-bitmAP (%): 4.36 -> 5.28Helped
Use A2-SSL instead of SPQUnsupervised fine-grained image hashing · Food101, 48-bitmAP (%): 13.33 -> 15.38Helped
Add asymmetric augmented SSL instead of conventional contrastive learning (ablation)Unsupervised hashing · CUB200-2011, 48-bitmAP (%): 15.36 -> 26.57Helped
Add part-oriented DenseCL without cluster weights (ablation)Asymmetric augmented SSL hashing · CUB200-2011, 48-bitmAP (%): 26.57 -> 27.13Helped
Add cluster weights to part-oriented DenseCL (ablation)Asymmetric augmented SSL hashing · CUB200-2011, 48-bitmAP (%): 26.57 -> 28.32Helped
Add self-consistent hash code learning to asymmetric augmented SSL and unweighted part-oriented DenseCL (ablation)Unsupervised hashing · CUB200-2011, 48-bitmAP (%): 27.13 -> 28.85Helped
Add self-consistent hash code learning to asymmetric augmented SSL and weighted part-oriented DenseCL (ablation)Unsupervised hashing · CUB200-2011, 48-bitmAP (%): 28.32 -> 29.19Helped
Use only RandomCrop rather than traditional contrastive-learning augmentations (ablation)Unsupervised hashing · CUB200-2011, 48-bitmAP (%): 15.36 -> 23.57Helped
Remove GaussianBlur from traditional contrastive-learning augmentations (ablation)Unsupervised hashing · CUB200-2011, 48-bitmAP (%): 15.36 -> 16.69Helped

Surprising findings

Limitations

Experimental setup

Datasets: CUB200-2011 Oxford Flowers Stanford Dogs Stanford Cars Food101

Benchmarks: CUB200-2011 Oxford Flowers Stanford Dogs Stanford Cars Food101

Metrics: mAP

Baselines: UnsupervisedGreedyHash MLS3RUDH BiHalf CIBHash SPQ MeCoQ SDC

Builds on: SimCLR DenseCL self-consistency principle Fisher Vector

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy