Research map / Probabilistic and scientific modeling / Variational and generative sampling
Mutual Information Gradient Estimation for Representation Learning
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace the DIM mutual-information estimator with MIGE | Deep InfoMax · CIFAR-10 and CIFAR-100 | top-1 accuracy | Helped |
| replace the Information Bottleneck MI estimator with MIGE | Information Bottleneck · Permutation-invariant MNIST | misclassification rate: 1.11% -> 1.05% | Helped |
| apply MIGE instead of the listed DIM(L) estimators | DIM(L) · CIFAR-10 and CIFAR-100 | top-1 accuracy | Hurt |
| increase random projection dimension from 16 to 128 (ablation) | MIGE in Deep InfoMax · STL-10 Y(64) | top-1 accuracy | Helped |
| increase random projection dimension beyond 128 (ablation) | MIGE in Deep InfoMax · STL-10 Y(64) | top-1 accuracy | No clear effect |
Closest papers by meaning
- On Mutual Information Maximization for Representation Learning (ICLR 2020 · similarity 0.91)
- Connecting Jensen–Shannon and Kullback–Leibler Divergences: A New Bound for Representation Learning (NeurIPS 2025 · similarity 0.88)
- Mutual Information Estimation via $f$-Divergence and Data Derangements (NeurIPS 2024 · similarity 0.87)
- InfoNet: Neural Estimation of Mutual Information without Test-Time Optimization (ICML 2024 · similarity 0.86)
- A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets (NeurIPS 2024 · similarity 0.85)
- FMMI: Flow Matching Mutual Information Estimation (NeurIPS 2026 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.