AI Paper Atlas

Research map / Image generation / Autoregressive and latent generation

Unifying Dataset Pruning and Distillation for Efficient Large-scale Compression

Lingao Xiao, Songhua Liu, Yang He, Xinchao Wang

ICML 2026 · Image generation › Autoregressive and latent generation · approach: Synthetic training data from generators · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train on pruned (EL2N) subset instead of random subset, hard labels (ablation)ImageNet-1K IPC10 · ImageNet-1K ResNet-18top-1 accuracy: 4.6 -> 12.2Improved
add cropping-free combination of pruned images (ablation)PCA · ImageNet-1K IPC10 hard labeltop-1 accuracy: 12.2 -> 14.4Improved
add constrained augmentation (ablation)PCA · ImageNet-1K IPC10 hard labeltop-1 accuracy: 14.4 -> 22.8Improved
use soft labels with distilled images vs random subsetSRe2L/CDA · ImageNet-1K IPC10 soft labeltop-1 accuracy: 35.8 -> 33.5Hurt
use pruning subsets instead of random with soft labelsEL2N/AUM · ImageNet-1K IPC10 soft labeltop-1 accuracy: 35.8 -> 41.5Improved
replace noise init with real image init in SRe2L (ablation)SRe2L · ImageNet-1K IPC10 hard labeltop-1 accuracy: 1.5 -> 2.5Improved
select hard instead of easy samples for pruning (ablation)EL2N · ImageNet-1K IPC10 hard labeltop-1 accuracy: 12.2 -> 0.2Hurt
enforce class balance in pruning (ablation)EL2N easy · ImageNet-1K IPC50 hard labeltop-1 accuracy: 0.3 -> 31.1Improved
crop patches before training (dataset cropping) (ablation)PCA · ImageNet-1K IPC10 hard labeltop-1 accuracy: 22.8 -> 17.1Hurt
restrict training crop ratio to r=1.0 (no crop) (ablation)PCA · ImageNet-1K IPC10top-1 accuracy: 22.8 -> 18.7Hurt
add CutMix with label mixing at probability 1.0 (ablation)PCA SGD · ImageNet-1K IPC10top-1 accuracy: 25.6 -> 17.4Hurt
add Cutout (ablation)PCA SGD · ImageNet-1K IPC10top-1 accuracy: 25.6 -> 26.2Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy