atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection

CVPR 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Mixture and distillation for domain shift · 7 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes MAP, a binary mask-pruning framework that freezes a well-trained source model and learns a target-specific mask to suppress unauthorized-domain generalization while preserving source accuracy, extended to source-free (SF-MAP) and data-free (DF-MAP) settings with a new ST-D metric.

Problem

Protecting model intellectual property by restricting a well-trained model's applicability to authorized domains, without access to source training data or target unauthorized data (source-free and data-free settings).

Approach

Inverse Transfer Parameter Hypothesis: well-trained models contain domain-specific parameters whose pruning removes generalization to unauthorized domains while preserving source performance; MAP learns a binary mask over a frozen source model, with pseudo-source samples from replay-based generators (and a diversity generator for data-free) replacing the real data.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use source-available binary-mask pruningMAP · Digit benchmarks (mean)ST-D: 0.004 -> -0.004Helped
use source-free replay-based pseudo-source generation and target dataMAP · Digit benchmarks (mean)ST-D: 1.01 (NTL), 1.08 (CUTI) -> 0.24Helped
use data-free diversity generation of auxiliary domainsMAP · Digit benchmarks (mean)ST-D: 0.27Helped
use SF-MAP instead of supervised learning across tested backbones (ablation)MAP · STL10 → CIFAR10target accuracy: 50.3 -> 15.7; 61 -> 21.4; 58.9 -> 36.9; 36.2 -> 20.7; 38 -> 24.6; 72.5 -> 47; 39.2 -> 28.1Mixed
use L1 consistency loss alone instead of the full SF-MAP loss (ablation)SF-MAP · MT → US, CIFAR10 → STL10, VisDA-2017 (T → V)target accuracyHurt
use L2 pseudo-label loss alone instead of the full SF-MAP loss (ablation)SF-MAP · MT → US, CIFAR10 → STL10, VisDA-2017 (T → V)source accuracyHurt
combine L1 consistency loss and L2 pseudo-label loss (ablation)SF-MAP · MT → US, CIFAR10 → STL10, VisDA-2017 (T → V)target accuracyHelped

Surprising findings

Limitations

Experimental setup

Datasets: MNIST USPS SVHN MNIST-M CIFAR10 STL10 VisDA-2017

Benchmarks: MNIST USPS SVHN MNIST-M CIFAR10 STL10 VisDA-2017

Metrics: source drop target drop ST-D accuracy

Baselines: NTL CUTI

Builds on: lottery ticket hypothesis NTL CUTI-Domain data-free knowledge distillation

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy