AI Paper Atlas

Research map / Image generation / Fast diffusion sampling

Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation

Dongjun Kim, Seungjae Shin, Kyungwoo Song, Wanmo Kang, Il-Chul Moon

ICML 2022 · Image generation › Fast diffusion sampling · approach: Diffusion theory and design space · 11 citations (OpenAlex)

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Randomize the truncation threshold across minibatches instead of using a fixed threshold (ablation)Likelihood-weighted DDPM++ (VP) · CIFAR-10FID (ODE): 6.70 -> 3.96Improved
Use randomized truncation with P₀.₉ rather than fixed likelihood-weighted truncation (ablation)DDPM++ (VP) · CIFAR-10FID (ODE): 6.70 -> 3.45Improved
Use randomized truncation P₁ rather than fixed likelihood-weighted truncation (ablation)DDPM++ (VP) · CIFAR-10NLL: 3.03 -> 3.01Improved
Decrease σmin from 10⁻² to 10⁻⁵ (ablation)NCSN++ · CIFAR-10NLL: 4.95 -> 2.97Improved
Decrease σmin from 10⁻² to 10⁻⁵ (ablation)NCSN++ · CIFAR-10FID-10k: 6.95 -> 8.29Hurt
Use randomized truncation P₀ instead of a distribution that samples small truncation levels (ablation)DDPM++ (VP) · CIFAR-10NLL: 3.01 -> 3.24Hurt
Use truncation distribution P₃ rather than P₀.₉ (ablation)DDPM++ (VP) · CIFAR-10FID (ODE): 3.45 -> 6.54Hurt
Replace fixed likelihood weighting with Soft Truncation P₀.₉ (ablation)DDPM++ (VP) · ImageNet32FID (ODE): 12.68 -> 8.42Improved
Apply Soft Truncation with variance weighting (ablation)NCSN++ (VE) · CelebAFID (PC): 3.95 -> 2.68Improved
Apply Soft Truncation with likelihood weighting (ablation)DDPM++ (VP) · CelebAFID (ODE): 3.95 -> 2.90Improved
Use Soft Truncation with P₁ instead of hard truncation at ε = 10⁻⁵ (ablation)DDPM++ (VP) · CIFAR-10NLL: 3.03 -> 3.01Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy