AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Conditional Dependence via Shannon Capacity: Axioms, Estimators and Applications

Weihao Gao, Sreeram Kannan, Sewoong Oh, Pramod Viswanath

ICML 2016 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Likelihood-free and graphical model estimation · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CMI (Shannon capacity with optimized input weights) instead of UMI (uniform input) as the causal strength measureconditional dependence estimation on flow-cytometry data · T-cell flow-cytometry trend recovery under subsamplingfraction of subsamples recovering true biological trend: uniformly dominates UMI at all subsample sizes (qualitative)Improved
Replace DREMI-style partition/KDE estimation with UMI kNN importance-sampling estimatorUMI estimation on flow-cytometry data · T-cell flow-cytometry trend recovery under subsamplingfraction of subsamples recovering true biological trend: uniformly dominates DREMI when fewer samples availableImproved
Use UMI/CMI estimators on full flow-cytometry datasetUMI and CMI vs DREMI · Full flow-cytometry datasetrecovery of biological trendNo clear effect
Use UMI as direction-of-causality scorecausal direction benchmark · Causal direction benchmark datasetsaccuracy of predicting correct direction: 45% vs CMI 53%, marginal entropy 45%No clear effect
Use CMI as direction-of-causality scorecausal direction benchmark · Causal direction benchmark datasetsaccuracy of predicting correct direction: 53% (near chance)No clear effect
Replace partition-based estimator with proposed UMI kNN estimatorUMI estimation on synthetic Beta/Gaussian data · Synthetic data, sigma^2 in {0.09,0.36,1.0}sample complexity to match ground truthImproved
Replace Blahut-Arimoto on quantized data with proposed CMI kNN optimization estimatorCMI estimation on synthetic data · Synthetic data, sigma^2 in {0.36,1.0,2.25}sample complexityImproved
Add nearest-neighbor regularization of rho_{k,i} (rho^{d}>Ck/N) in UMI estimatorUMI estimator theory · Theoretical analysisvalidity of reverse Fatou interchangeNo clear effect
Use Renyi capacity (lambda != 1) instead of Shannon capacity CMIaxiomatic causal strength measure · Theoretical axiomsaxiom satisfactionNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy