AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Natural gradient enables fast sampling in spiking neural networks

Paul Masset, Jacob A Zavatone-Veth, J. Patrick Connor, Venkatesh N Murthy, Cengiz Pehlevan

NeurIPS 2022 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Exact inference for probabilistic programs · 4 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use natural-gradient geometry (D = Sigma) instead of naive geometry (D = I) in a Langevin-sampling efficient balanced network (ablation)EBN Langevin sampler · Equicorrelated Gaussian, increasing correlation rhoestimated variance and 2-Wasserstein distance (50 ms window)Improved
Use natural geometry instead of naive geometry in the Langevin EBN as correlation rho grows (ablation)EBN Langevin sampler · Equicorrelated Gaussian, varying rhomean estimate after mean shiftImproved
Use natural geometry instead of naive geometry in the Langevin EBN as parameter dimension np grows from 2 to 64 (ablation)EBN Langevin sampler · Equicorrelated Gaussian, varying npmean 2-Wasserstein distanceImproved
Use natural geometry in the Langevin EBN to reduce discretization-induced variance overestimation (ablation)EBN Langevin sampler · Equicorrelated Gaussianvariance overestimationImproved
Use geometry-aware readout weights (Gamma Gamma^T ~ Sigma) instead of generic Gamma in the Metropolis-Hastings spiking network (ablation)probabilistic spike-rule network · Equicorrelated Gaussian, strong rho (np=10, nn=100)average firing rateImproved
Use geometry-aware Gamma instead of naive Gamma in the probabilistic spiking network at strong correlation (ablation)probabilistic spike-rule network · Equicorrelated Gaussian, strong rhomean and variance estimatesImproved
Use geometry-aware Gamma instead of naive Gamma in the probabilistic spiking network as dimension np increases (nn = 10 np, rho = 0.75) (ablation)probabilistic spike-rule network · Equicorrelated Gaussian, varying npfiring rate and 2-Wasserstein distanceImproved
Natural-space sampling versus naive Langevin dynamics in linear rate networks (analytical) (ablation)linear rate network Langevin sampler · zero-mean Gaussian, analytical 2-Wasserstein2-Wasserstein distance to target over timeImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy