AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Dense Distributions from Sparse Samples: Improved Gibbs Sampling Parameter Estimators for LDA

Yannis Papanikolaou, James R. Foulds, Timothy N. Rubin, Grigorios Tsoumakas

JMLR 2017 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Variational methods for sequence models · 25 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use dense soft-count theta^p estimator instead of hard-count theta with a single burned-in sampleCGS LDA · Unsupervised LDA held-out perplexity (BioASQ, NYT, Reuters, TASA, K=100)perplexityImproved
use phi^p estimator instead of standard phiCGS LDA · Unsupervised LDA held-out perplexity (K=100)perplexityImproved
average over more samples/chainstheta vs theta^p · Unsupervised LDA held-out perplexity (K=100)perplexityNo clear effect
use phi^p instead of phi for word association rankingLDA trained on TASA · Word association norms (TASA)median rank differenceImproved
use CGS_p estimators instead of CVB0 as number of topics growsCGS_p · Unsupervised LDA perplexity vs topicsperplexityMixed
use VB instead of CVB0/CGSLDA inference · Unsupervised LDA perplexity vs topicsperplexityHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy