atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Generative Modeling Helps Weak Supervision (and Vice Versa)

ICLR 2023 · Label-efficient and robust learning › Recognition and long-tail · approach: Loss design and classifier theory · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Align GAN discrete codes with sample-dependent LF accuracy-weighted pseudolabelsWSGAN · AwA2-A, AwA2-B, DomainNet, MNIST, FashionMNIST, GTSRB, CIFAR10-A, CIFAR10-Bpseudolabel accuracy: AwA2-A: 0.641 -> 0.681; AwA2-B: 0.623 -> 0.699; DomainNet: 0.658 -> 0.661; MNIST: 0.782 -> 0.813; FashionMNIST: 0.737 ->Helped
Align weak supervision with learned discrete latent structureWSGAN · AwA2-A, AwA2-B, DomainNet, CIFAR10-A, CIFAR10-BFID: AwA2-A: 41.62 -> 34.71; AwA2-B: 41.62 -> 34.52; DomainNet: 53.98 -> 44.35; CIFAR10-A: 28.93 -> 22.71; CIFAR10-B: 33.50 -Helped
Align weak supervision with learned discrete latent structureWSGAN · GTSRBFID: 69.67 -> 73.96Hurt
Use a sample-dependent accuracy encoder instead of a global LF-weight vector (ablation)WSGAN-Encoder versus WSGAN-Vector · Label model accuracy across eight main datasetspseudolabel accuracy: AwA2-A: 0.647 -> 0.681; AwA2-B: 0.645 -> 0.699; DomainNet: 0.661 -> 0.643; MNIST: 0.782 -> 0.813; FashionMNIST: 0.737 ->Helped
Use a sample-dependent accuracy encoder instead of a global LF-weight vector (ablation)WSGAN-Encoder versus WSGAN-Vector · AwA2-A, AwA2-B, DomainNet, GTSRB, CIFAR10-A, CIFAR10-BFID: AwA2-A: 36.74 -> 34.71; AwA2-B: 36.79 -> 34.52; DomainNet: 50.16 -> 44.35; GTSRB: 75.27 -> 73.96; CIFAR10-A: 25.70 -> 22Mixed
Add 1,000 generated images labeled by the learned latent-code pseudolabelerResNet-18 downstream classifier · AwA2-A, AwA2-B, DomainNet, MNIST, FashionMNIST, GTSRB, CIFAR10-A, CIFAR10-Btest accuracy increase: AwA2-A: 0.88%; AwA2-B: 2.40%; DomainNet: 2.31%; MNIST: 1.60%; FashionMNIST: 0.29%; GTSRB: 0.40%; CIFAR10-A: 0.04%; CIFARHelped
Add 1,000 generated images labeled by LFs and WSGAN label modelResNet-18 downstream classifier · AwA2-A, AwA2-B, DomainNet, MNIST, FashionMNIST, GTSRBtest accuracy increase: AwA2-A: 0.79%; AwA2-B: 3.90%; DomainNet: 1.50%; MNIST: 1.71%; FashionMNIST: 0.34%; GTSRB: 0.02%Helped
Increase the number of generated augmentation samples beyond 1,000 (ablation)WSGAN-augmented downstream classifier · Image classification datasetstest accuracyNo clear effect
Replace the DCGAN base with StyleGAN2-ADA (ablation)StyleWSGAN · LSUN scene categoriesFID: 8.41 -> 7.54Helped
Replace the DCGAN base with StyleGAN2-ADA (ablation)StyleWSGAN · CIFAR10-BFID: 3.85 -> 3.79Helped
Add a decaying penalty encouraging equal LF weights early in training (ablation)WSGAN · Latent label estimateslatent label estimate qualityHelped
Use batch size 8 or 32 instead of batch size 16 (ablation)WSGAN · GAN image generation and label modelingFID and label model accuracyNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy