atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

Cross-domain Open-world Discovery

ICML 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Cross-domain text and graph transfer · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CROW, a cluster-then-match prototype method on frozen-then-partially-finetuned CLIP ViT-L features for cross-domain open-world discovery, evaluated across 75 UniDA-derived settings.

Problem

Open-world discovery under domain shift: assign target samples to seen classes and discover novel classes when labeled source and unlabeled target differ in feature distribution.

Approach

Cluster target features from a foundation model first, then robustly match clusters to seen classes (allowing many-to-many matches via column-wise softmax and threshold), treating unmatched clusters as novel; then fine-tune with source cross-entropy plus a target entropy-regularization term.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CROW's cluster-then-match method instead of GLCCross-domain open-world discovery · Office, OfficeHome, VisDA, and DomainNet (50% seen/unseen split)H-score: 74.6 -> 84.9; 68.2 -> 69.6; 65.2 -> 69.2; 56.1 -> 59.0Helped
Fine-tune both the feature extractor and classifier rather than omit fine-tuning (ablation)CROW · VisDA (6/6)H-score: 66.9 -> 69.2Helped
Fine-tune both the feature extractor and classifier rather than only W (ablation)CROW · VisDA (6/6)H-score: 67.8 -> 69.2Helped
Add supervised loss L_s (ablation)CROW · VisDA (6/6)seen accuracy: 65.6 -> 77.0Helped
Add entropy regularization L_reg (ablation)CROW · VisDA (6/6)unseen accuracy: 56.9 -> 62.8Helped
Use CLIP ViT-L instead of CLIP ViT-B (ablation)CROW · VisDA (6/6)H-score: 65.8 -> 69.2Helped
Scale up DINO_v2 from ViT-B to ViT-G (ablation)CROW · VisDA (6/6)H-score: 63.5 -> 68.2Helped
Scale up SWAG from ViT-B to ViT-H (ablation)CROW · VisDA (6/6)H-score: 66.7 -> 70.3Helped
Exclude unseen-class examples from ImageNet pretraining (ablation)ResNet-50 · Officeunseen accuracy: 56.4 -> 55.8No clear effect
Use CROW instead of K-means clustering aloneCLIP features · Office, OfficeHome, and VisDAH-score: 77.2 -> 84.9; 65.9 -> 69.9; 62.4 -> 69.2Helped
Use the estimated rather than known number of target classes (ablation)CROW · Office, OfficeHome, VisDA, and DomainNet (50% split)H-score: 84.9 -> 81.5; 69.6 -> 67.2; 69.2 -> 68.0; 59.0 -> 57.8Hurt
Vary λ across the reported values (ablation)CROW · VisDA (6/6)H-score: 69.3; 69.0; 68.8; 69.4; 69.2; 69.2No clear effect

Surprising findings

Limitations

Experimental setup

Datasets: Office OfficeHome VisDA DomainNet

Benchmarks: Office OfficeHome VisDA DomainNet

Metrics: H-score seen accuracy unseen accuracy

Baselines: SIMPLE GCD ORCA DCC DANCE OVANet UniOT NCDDA SAN GLC K-means CLIP zero-shot

Builds on: DCC universal domain adaptation GCD ORCA SimCLR

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy