Research map / Optimization / Nonconvex and smooth optimization
The Common-directions Method for Regularized Empirical Risk Minimization
Po-Wei Wang, Ching-pei Lee, Chih-Jen Lin
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use multiple inner iterations instead of a single inner iteration (ablation) | CommDir · logistic regression, several data sets | training time | No clear effect |
| use common-directions method instead of NEWTON, L-BFGS, BFGS and AG | CommDir · logistic regression, several data sets | number of data passes | Improved |
| use common-directions method instead of baselines on a9a, rcv1t and KDD2010-b | CommDir · logistic regression, a9a, rcv1t, KDD2010-b | training time | Hurt |
| use common-directions method on squared-hinge loss instead of logistic loss | CommDir · squared-hinge loss problems | training time relative to baselines | Hurt |
| use L-BFGS history m = 30 instead of m = 5 | L-BFGS · logistic regression | training time | Improved |
| use BFGS (unbounded memory) instead of L-BFGS | BFGS · logistic regression | training time | Mixed |
Closest papers by meaning
- Stochastic Primal-Dual Method for Empirical Risk Minimization with O(1) Per-Iteration Complexity (NeurIPS 2018 · similarity 0.91)
- Doubly Accelerated Stochastic Variance Reduced Dual Averaging Method for Regularized Empirical Risk Minimization (NeurIPS 2017 · similarity 0.89)
- Stochastic Primal-Dual Coordinate Method for Regularized Empirical Risk Minimization (JMLR 2017 · similarity 0.89)
- Doubly Greedy Primal-Dual Coordinate Descent for Sparse Empirical Risk Minimization (ICML 2017 · similarity 0.88)
- Scaling-up Empirical Risk Minimization: Optimization of Incomplete $U$-statistics (JMLR 2016 · similarity 0.88)
- On the Asymptotic Distribution of the Minimum Empirical Risk (ICML 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
