atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

Category-Aware Active Domain Adaptation

ICML 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Source-free domain adaptation

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes category-aware active domain adaptation that uses influence functions to select target samples that most improve the recognition of a specified category, without hurting other categories.

Problem

Existing active domain adaptation methods improve overall accuracy but concentrate queries on easy-to-improve categories, leaving challenging categories unimproved or degraded.

Approach

Binarize labels into a target category versus the rest, train a convex logistic-regression surrogate, compute influence of labeled source samples on a validation loss over queried target samples, train a regressor to predict influence for unlabeled target samples, and query high-influence ones per category.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use category-aware influence-based active learning instead of Always OneDANN-based category-aware active domain adaptation · Office-Homeaverage per-category accuracy: 79.32% across 12 tasks; Always One obtains an average of 75.81% in 12 tasksHelped
use category-aware influence-based active learning instead of Always OneDANN-based category-aware active domain adaptation · DomainNet-126average per-category accuracy: 57.78 vs 53.33Helped
use category-aware influence-based active learning instead of Always OneDANN-based category-aware active domain adaptation · VisDA-2017, S→Rper-category accuracy: 66.68 vs 63.25Helped
add influence-based selection to DANN (ablation)category-aware active domain adaptation · Office-Home, Rw→Araccuracy: 52.28 ± 3.63 -> 72.74 ± 5.41; 20.46%Helped
add data re-weighting to influence-based selection (ablation)category-aware active domain adaptation · Office-Home, Rw→Araccuracy: 72.74 ± 5.41 -> 76.52 ± 6.37; 2.74%Helped
add diversity sampling to influence-based selection (ablation)category-aware active domain adaptation · Office-Home, Rw→Araccuracy: 72.74 ± 5.41 -> 74.36 ± 3.18; 1.64%Helped
combine data re-weighting and diversity sampling with influence-based selection (ablation)category-aware active domain adaptation · Office-Home, Rw→Araccuracy: 72.74 ± 5.41 -> 79.15 ± 2.92; 6.41%Helped
exclude queried samples with negative estimated influence on Non-One data (ablation)category-aware active domain adaptation · Office-Home, Cl→PrNon-One category accuracyHelped
train using queried One samples (ablation)category-aware active domain adaptation · Office-Home, Pr→Artarget-category accuracyHelped
train using queried Non-One samples (ablation)category-aware active domain adaptation · Office-Home, Pr→Artarget-category accuracyHelped

Surprising findings

Limitations

Experimental setup

Datasets: Office-Home DomainNet-126 VisDA-2017

Benchmarks: Office-Home DomainNet-126 VisDA-2017

Metrics: per-category accuracy accuracy change on non-target categories

Baselines: Random CLUE DUC ISAL Always One DANN

Builds on: influence function (Koh & Liang 2017) DANN CLUE ISAL

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy