AI Paper Atlas

Research map / Probabilistic and scientific modeling / Uncertainty and Gaussian processes

Easy Variational Inference for Categorical Models via an Independent Binary Approximation

Michael T Wojnowicz, Shuchin Aeron, Eric L Miller, Michael Hughes

ICML 2022 · Probabilistic and scientific modeling › Uncertainty and Gaussian processes · approach: Nonparametric and PAC-Bayes Bayesian learning · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Bayesian model averaging over CBM and CBC predictions instead of choosing one likelihoodIB-CAVI with CB-Probit or CB-Logit · Simulated categorical predictionKL divergence to true probabilitiesImproved
Use CBM rather than CBC as the prediction likelihood (ablation)IB-CAVI predictions · Simulated data with weakly predictable outcomesKL divergence to true probabilitiesImproved
Use CBC rather than CBM as the prediction likelihood (ablation)IB-CAVI predictions · Simulated data with strongly predictable outcomesKL divergence to true probabilitiesImproved
Use IB-Probit-CAVI with CB-Probit and BMA rather than softmax MLECategorical regression · Simulated softmax data with few observations relative to parametersholdout log likelihoodImproved
Use IB-Probit-CAVI with CB-Probit and BMA rather than softmax MLECategorical regression · Simulated softmax data with abundant observationsholdout log likelihoodNo clear effect
Use IB-CAVI rather than ADVI for softmax modelsCategorical regression · Intrusion detection, 32 users and 1,553 processesintrusion detection score: 20 minutes per user vs. 200 minutes per userImproved
Use IB-CAVI rather than ADVI, NUTS, or Gibbs samplingCategorical regression · Detergent, computer process starts, and simulated datasetstraining time to prediction qualityImproved
Use Bayesian inference with IB-CAVI rather than point-estimated softmax MLECB-Probit categorical regression · Simulated data generated by softmax regressionKL divergence between predicted and true probabilities: less than 0.10Improved
Fit separate independent binary regressions across categoriesIB-CAVI · Categorical regression with many categoriesscalability: K=1,553Improved
Use a single IB-CAVI posterior to average over multiple CB prediction likelihoodsCBM and CBC · Categorical predictiontraining cost: no additional training costImproved
Use the IB approximation as a target for CBM rather than CBC (ablation)IB-Probit approximation · Simulated data, smaller dataset (K=3, M=1, N=1800)approximation errorImproved
Use the IB approximation as a target for CBC rather than CBM (ablation)IB-Probit approximation · Simulated data, larger dataset (K=20, M=40, N=12000)approximation errorImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy