Research map / Probabilistic and scientific modeling / Variational and generative sampling
Neural Methods for Point-wise Dependency Estimation
Yao-Hung Hubert Tsai, Han Zhao, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use Probabilistic Classifier instead of Density-Ratio Fitting for point-wise dependency estimation | Audio-to-text retrieval · Audio-to-text 1:5 matching, test split | top-1 retrieval accuracy: 96.24% vs 92.26% | Improved |
| Use Density-Ratio Fitting Coding instead of CPC or Probabilistic Classifier Coding | Self-supervised representation learning · Shallow and deep visual representation learning | downstream linear-evaluation performance | Improved |
| Use Probabilistic Classifier Coding instead of CPC | Self-supervised representation learning · Shallow CIFAR10 | downstream linear-evaluation performance | Improved |
| Use Probabilistic Classifier Coding instead of CPC | Self-supervised representation learning · Other reported self-supervised experiments | downstream linear-evaluation performance | Hurt |
| Estimate MI by plugging in Probabilistic Classifier or Density-Ratio Fitting estimates rather than using most neural lower-bound estimators | MI estimation · Correlated Gaussian and Cubic tasks | bias and variance | Improved |
Closest papers by meaning
- A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets (NeurIPS 2024 · similarity 0.88)
- MINDE: Mutual Information Neural Diffusion Estimation (ICLR 2024 · similarity 0.86)
- Connecting Jensen–Shannon and Kullback–Leibler Divergences: A New Bound for Representation Learning (NeurIPS 2025 · similarity 0.85)
- Mutual Information Estimation via $f$-Divergence and Data Derangements (NeurIPS 2024 · similarity 0.85)
- Neural Mutual Information Estimation with Vector Copulas (NeurIPS 2025 · similarity 0.85)
- InfoNet: Neural Estimation of Mutual Information without Test-Time Optimization (ICML 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
