NeurIPS 2022 accepted papers on Learning theory and algorithms
406 of the 2,901 papers accepted at NeurIPS 2022 (14.0%) are on Learning theory and algorithms, compared with 14.6% at NeurIPS 2021. They fall into 9 topics.
See NeurIPS 2022 in the interactive map
Submitting to NeurIPS? Checklist →
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Prediction and decision losses · 99 papers
- Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanations (27 citations)
- Decentralized Training of Foundation Models in Heterogeneous Environments (24 citations)
- What are the best Systems? New Perspectives on NLP Benchmarking (20 citations)
- On Computing Probabilistic Explanations for Decision Trees (12 citations)
- Better Uncertainty Calibration via Proper Scores for Classification and Beyond (11 citations)
- FasterRisk: Fast and Accurate Interpretable Risk Scores (11 citations)
- If Influence Functions are the Answer, Then What is the Question? (11 citations)
- Why neural networks find simple solutions: The many regularizers of geometric complexity (10 citations)
- A Consistent and Differentiable Lp Canonical Calibration Error Estimator (9 citations)
- Benchopt: Reproducible, efficient and collaborative optimization benchmarks (9 citations)
- Positive-Unlabeled Learning using Random Forests via Recursive Greedy Risk Minimization (9 citations)
- Scalable Interpretability via Polynomials (9 citations)
and 87 more in the interactive map.
Sample complexity · 86 papers
- The Query Complexity of Cake Cutting (16 citations)
- Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit (11 citations)
- Learning single-index models with shallow neural networks (11 citations)
- The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statistics (11 citations)
- Convergence for score-based generative modeling with polynomial complexity (8 citations)
- Hardness of Noise-Free Learning for Two-Hidden-Layer Neural Networks (6 citations)
- Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers (6 citations)
- $k$-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension (5 citations)
- An Information-Theoretic Framework for Deep Learning (5 citations)
- Cryptographic Hardness of Learning Halfspaces with Massart Noise (5 citations)
- On the inability of Gaussian process regression to optimally learn compositional functions (5 citations)
- On the Sample Complexity of Stabilizing LTI Systems on a Single Trajectory (4 citations)
and 74 more in the interactive map.
Kernels and regression theory · 54 papers
- Efficient Dataset Distillation using Random Feature Approximation (17 citations)
- Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spaces (16 citations)
- Deep Active Learning by Leveraging Training Dynamics (8 citations)
- Learning sparse features can lead to overfitting in neural networks (8 citations)
- Optimal Rates for Regularized Conditional Mean Embedding Learning (8 citations)
- PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization (7 citations)
- Efficient Aggregated Kernel Tests using Incomplete $U$-statistics (6 citations)
- Exact learning dynamics of deep linear networks with prior knowledge (6 citations)
- Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study (6 citations)
- Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization) (6 citations)
- Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power (6 citations)
- A New Family of Generalization Bounds Using Samplewise Evaluated CMI (5 citations)
and 42 more in the interactive map.
Matrix and tensor methods · 43 papers
- DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization (26 citations)
- The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation? (7 citations)
- Global Linear and Local Superlinear Convergence of IRLS for Non-Smooth Robust Regression (5 citations)
- Tensor Wheel Decomposition and Its Tensor Completion Application (5 citations)
- Truncated Matrix Power Iteration for Differentiable DAG Learning (4 citations)
- Biologically-Plausible Determinant Maximization Neural Networks for Blind Separation of Correlated Sources (3 citations)
- Subquadratic Kronecker Regression with Applications to Tensor Decomposition (3 citations)
- Unsupervised Learning From Incomplete Measurements for Inverse Problems (3 citations)
- Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion (2 citations)
- Coordinate Linear Variance Reduction for Generalized Linear Programming (2 citations)
- Cost-efficient Gaussian tensor network embeddings for tensor-structured inputs (2 citations)
- Error Analysis of Tensor-Train Cross Approximation (2 citations)
and 31 more in the interactive map.
Combinatorial and search optimization · 37 papers
- Sample Efficiency Matters: A Benchmark for Practical Molecular Optimization (57 citations)
- Efficient and Modular Implicit Differentiation (37 citations)
- General Cutting Planes for Bound-Propagation-Based Neural Network Verification (33 citations)
- Pareto Set Learning for Expensive Multi-Objective Optimization (23 citations)
- Simulation-guided Beam Search for Neural Combinatorial Optimization (21 citations)
- End-to-end Symbolic Regression with Transformers (18 citations)
- Do Current Multi-Task Optimization Methods in Deep Learning Even Help? (17 citations)
- A Unified Framework for Deep Symbolic Regression (12 citations)
- Neur2SP: Neural Two-Stage Stochastic Programming (11 citations)
- A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEs (10 citations)
- Learning to Configure Computer Networks with Neural Algorithmic Reasoning (9 citations)
- Polynomial time guarantees for the Burer-Monteiro method (9 citations)
and 25 more in the interactive map.
Fairness · 28 papers
- On Learning Fairness and Accuracy on Multiple Subgroups (16 citations)
- Fairness Reprogramming (6 citations)
- Fair Infinitesimal Jackknife: Mitigating the Influence of Biased Training Data Points Without Refitting (5 citations)
- Subgroup Robustness Grows On Trees: An Empirical Baseline Investigation (5 citations)
- Are Two Heads the Same as One? Identifying Disparate Treatment in Fair Neural Networks (4 citations)
- Certifying Some Distributional Fairness with Subpopulation Decomposition (4 citations)
- Fairness Transferability Subject to Bounded Distribution Shift (4 citations)
- Bounding and Approximating Intersectional Fairness through Marginal Fairness (3 citations)
- RISE: Robust Individualized Decision Learning with Sensitive Variables (3 citations)
- Beyond Adult and COMPAS: Fair Multi-Class Prediction via Information Projection (2 citations)
- Conformalized Fairness via Quantile Regression (2 citations)
- Fair Ranking with Noisy Protected Attributes (2 citations)
and 16 more in the interactive map.
Submodular and game algorithms · 26 papers
- Fair and Efficient Allocations Without Obvious Manipulations (7 citations)
- Exploitability Minimization in Games and Beyond (3 citations)
- Nonstationary Dual Averaging and Online Fair Allocation (3 citations)
- Using Partial Monotonicity in Submodular Maximization (3 citations)
- Zero-Sum Stochastic Stackelberg Games (3 citations)
- Benefits of Permutation-Equivariance in Auction Mechanisms (2 citations)
- Don't Roll the Dice, Ask Twice: The Two-Query Distortion of Matching Problems and Beyond (2 citations)
- Finding Correlated Equilibrium of Constrained Markov Game: A Primal-Dual Approach (2 citations)
- Neural Estimation of Submodular Functions with Applications to Differentiable Subset Selection (2 citations)
- Random Rank: The One and Only Strategyproof and Proportionally Fair Randomized Facility Location Mechanism (2 citations)
- Simple Mechanisms for Welfare Maximization in Rich Advertising Auctions (2 citations)
- Submodular Maximization in Clean Linear Time (2 citations)
and 14 more in the interactive map.
Clustering · 18 papers
- A Simple Approach to Automated Spectral Clustering (9 citations)
- Improved Coresets for Euclidean $k$-Means (7 citations)
- Hierarchical Agglomerative Graph Clustering in Poly-Logarithmic Depth (5 citations)
- Wasserstein $K$-means for clustering probability distributions (5 citations)
- Consistency of Constrained Spectral Clustering under Graph Induced Fair Planted Partitions (4 citations)
- Coresets for Relational Data and The Applications (4 citations)
- Near-Optimal Correlation Clustering with Privacy (3 citations)
- Sublinear Algorithms for Hierarchical Clustering (2 citations)
- Chromatic Correlation Clustering, Revisited (1 citation)
- Near-Optimal Private and Scalable $k$-Clustering (1 citation)
- Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gap (1 citation)
- Amortized Mixing Coupling Processes for Clustering
and 6 more in the interactive map.
Optimal transport · 15 papers
- Supervised Training of Conditional Monge Maps (13 citations)
- Low-rank Optimal Transport: Approximation, Statistics and Debiasing (6 citations)
- Distributional Convergence of the Sliced Wasserstein Process (5 citations)
- Amortized Projection Optimization for Sliced Wasserstein Generative Models (4 citations)
- Kantorovich Strikes Back! Wasserstein GANs are not Optimal Transport? (4 citations)
- Revisiting Sliced Wasserstein on Images: From Vectorization to Convolution (4 citations)
- Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance (4 citations)
- Wasserstein Iterative Networks for Barycenter Estimation (4 citations)
- Efficient and Effective Optimal Transport-Based Biclustering (3 citations)
- Tikhonov Regularization is Optimal Transport Robust under Martingale Constraints (2 citations)
- Asymptotics of smoothed Wasserstein distances in the small noise regime (1 citation)
- Optimal Efficiency-Envy Trade-Off via Optimal Transport (1 citation)
and 3 more in the interactive map.
