AI Paper Atlas

Research map / Learning theory and algorithms / Matrix and tensor methods

A Two-Level Decomposition Framework Exploiting First and Second Order Information for SVM Training Problems

Giulio Galvan, Matteo Lapucci, Chih-Jen Lin, Marco Sciandrone

JMLR 2021 · Learning theory and algorithms › Matrix and tensor methods · approach: Tensor network decompositions · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use two-level decomposition (inner SMO on working set q=4) instead of plain SMOSMO-WSS1/WSS2 · 17 data sets, 25 problems eachtotal runtime: a9a 7708.22 -> 3003.09; covtype 2213224.58 -> 518847.84; cod-rna 26490.30 -> 1999.17Improved
use TLD-ISMO on HIGGS subsetSMO · HIGGS-subsetcompletion within time limit: 1011667 (3) vs 1166775 (5)Improved
add second-order WSS2 instead of WSS1 (ablation)SMO · iterationsnumber of iterationsImproved
add second-order WSS2 instead of WSS1 (ablation)SMO · computing timeruntime: in about a half of the situations WSS1 led to a faster trainingNo clear effect
increase working set size q (ablation)Algorithm 1 with extended-WSS1 · 150 SVM problemsnumber of iterationsImproved
increase working set size q (ablation)Algorithm 1 with extended-WSS1 · 150 SVM problemskernel evaluationsHurt
increase working set size to non-extreme values (ablation)Algorithm 1 · 150 SVM problemsruntimeImproved
double working set size (ablation)TLD-ISMO · small data setsnumber of iterations: slightly less than a halfImproved
use WSS-MIX (mixed first and second order selection) (ablation)TLD-ISMO q=4 · 175 Gaussian kernel SVM problemsruntimeImproved
use second-order information on large data sets (ablation)TLD-ISMO · rcv1, real-simruntimeImproved
replace SMO-MVP with Dai-Fletcher subproblem solver at q=50 (ablation)Two-level decomposition · SVM problemsruntimeImproved
replace GVPM/Dai-Fletcher by SMO-MVP as inner solver for small q (ablation)Two-level decomposition · SVM problemsruntime: limited qImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy