atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Learning Energy-based Model via Dual-MCMC Teaching

NeurIPS 2023 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Stochastic gradient MCMC

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use dual-MCMC teaching with a generator and inference model to initialize MCMCEnergy-based image modeling · CIFAR-10FID: 30.10 -> 9.26Helped
Use dual-MCMC teaching rather than Divergence TriangleEnergy-based image modeling · CelebA-64FID: 18.21 -> 5.15Helped
Initialize latent posterior MCMC with the inference model rather than noise (ablation)Generator posterior inference · CIFAR-10MSE: 0.0214 -> 0.0072Helped
Initialize latent posterior MCMC with the inference model rather than noise (ablation)Generator posterior inference · CelebA-64MSE: 0.0227 -> 0.0164Helped
Increase latent-space Langevin steps from 10 to 30 without inference initialization (ablation)Dual-MCMC teaching · CIFAR-10FID: 17.32 -> 14.51Helped
Increase inference-initialized latent-space Langevin steps from 10 to 30 (ablation)Dual-MCMC teaching · CIFAR-10FID: 9.26 -> 9.18No clear effect
Increase inference-initialized latent-space Langevin steps from 10 to 30 (ablation)Dual-MCMC teaching · CIFAR-10Time (s): 1.594 -> 2.112Hurt
Increase EBM-guided data-space Langevin steps from 10 to 30 (ablation)EBM sampling · CIFAR-10FID: 14.78 -> 9.26Helped
Increase EBM-guided data-space Langevin steps from 30 to 50 (ablation)EBM sampling · CIFAR-10FID: 9.26 -> 9.07No clear effect
Increase hidden features from nef=256 to nef=512 (ablation)Dual-MCMC teaching model · CIFAR-10FID: 11.19 -> 9.26Helped
Increase hidden features from nef=512 to nef=1024 (ablation)Dual-MCMC teaching model · CIFAR-10FID: 9.26 -> 8.45Helped
Use latent posterior MCMC revision before generation (ablation)Image inpainting · CelebA-64, M20PSNR: 21.035 -> 24.976Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy