Research map / Optimization / Nonconvex and smooth optimization
Exploring Non-Convex Discrete Energy Landscapes: An Efficient Langevin-Like Sampler with Replica Exchange
Haoyang Zheng, Hengrong Du, Ruqi Zhang, Guang Lin
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace DMALA with DREAM (replica exchange + MH) on wave | DMALA · Synthetic 2D (wave) | KL divergence (1e-2): 10.891 -> 4.975 | Improved |
| replace ACS with DREAM on flower | ACS · Synthetic 2D (flower) | KL divergence (1e-2): 3.371 -> 6.558 | Hurt |
| add replica exchange (DREAM) to DMALA, non-local jumps | DMALA · Synthetic 16gaussian | non-local jump rate (%): 0.07 -> 7.52 | Improved |
| raise high-temperature chain temperature from 2.0 to 10.0 (ablation) | DREAM · Synthetic 16gaussian | swap rate (%): 10.0 -> 1.2 | Hurt |
| increase energy barrier strength C from 0.5 to 5.0 (DREAM vs DMALA) (ablation) | DREAM · Synthetic 16gaussian | KL divergence | Improved |
| add replica exchange to DULA (DREXEL), no MH | DULA · Ising model (w=0.15) | log RMSE: over 50% reduction | Improved |
| add replica exchange to DMALA (DREAM), with MH | DMALA · Ising model (w=0.15) | log RMSE: nearly 25% reduction | Improved |
| add replica exchange near critical coupling w 0.4-0.7 (ablation) | DMALA · Ising model | log RMSE: around 30% reduction | Improved |
| increase high temperature tau from 5.0 to 10.0 (ablation) | DREAM · Ising model (w=0.7) | log RMSE: -7.86 -> -7.48 | Hurt |
| add replica exchange (DREAM) to DMALA on RBM MNIST | DMALA · RBM MNIST | MMD: 9.7% | Improved |
| add MH correction to DREXEL (DREAM) (ablation) | DREXEL · Deep EBM (Omniglot) | test log-likelihood: -101.973 -> -98.525 | Improved |
| add bias-corrected swap function (bDREAM) to DREAM (ablation) | DREAM · Deep EBM (Omniglot) | test log-likelihood: -98.525 -> -100.117 | Hurt |
Closest papers by meaning
- On scalable and efficient training of diffusion samplers (NeurIPS 2025 · similarity 0.89)
- Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics (ICML 2024 · similarity 0.89)
- Iterated Denoising Energy Matching for Sampling from Boltzmann Densities (ICML 2024 · similarity 0.89)
- NETS: A Non-equilibrium Transport Sampler (ICML 2025 · similarity 0.87)
- Masked Diffusion Models as Energy Minimization (NeurIPS 2025 · similarity 0.87)
- Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics (ICLR 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
