AI Paper Atlas

Research map / Learning theory and algorithms / Kernels and regression theory

Empirical Evaluation of Resampling Procedures for Optimising SVM Hyperparameters

Jacques Wainer, Gavin Cawley

JMLR 2017 · Learning theory and algorithms › Kernels and regression theory · approach: High-dimensional linear regression theory · 40 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use 2-fold instead of 5-fold CV for hyperparameter selectionRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: -0.0012 (95% CI -0.0056, 0.0024)No clear effect
use 3-fold instead of 5-fold CV for hyperparameter selectionRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: -0.0031 (95% CI -0.0094, 0.0002)No clear effect
use 2-fold instead of 5-fold CV to save computeRBF SVM · 112 UCI data sets (<10000 points)time ratio to kf5: 0.35Improved
use 3-fold instead of 5-fold CV to save computeRBF SVM · 112 UCI data sets (<10000 points)time ratio to kf5: 0.54Improved
use 10-fold CV or 2x repeated 5-fold or 20x bootstrap instead of 5-fold CVRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: kf10 -0.0020, 2xkf5 -0.0014, 20xboot -0.0018No clear effect
use resubstitution instead of 5-fold CVRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: 0.1354Hurt
use 20/20 hold-out instead of 5-fold CVRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: 0.0191Hurt
use 10/10 hold-out instead of 5-fold CVRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: 0.0255Hurt
use 80/20 hold-out instead of 5-fold CVRBF SVM · 112 UCI data sets (<10000 points)excess loss vs kf5: 0.0053 (95% CI -0.0003, 0.0115)No clear effect
use kf2 instead of kf5 on the 9 largest data setsRBF SVM · 9 largest UCI data sets (>10000 points)excess loss vs kf5: 0.0073 on chess-krvk; -0.0004 on pendigitsMixed
use kf2 or kf3 instead of kf5 with polynomial and linear kernelsSVM · 112 UCI data sets (<10000 points) (polynomial and linear kernels)excess loss vs kf5: kf2 0.006 polynomial, 0.002 linearNo clear effect
repeat the bootstrap 5 times instead of 20 timesRBF SVM · 112 UCI data sets (<10000 points)time ratio to kf5: 4.43 -> 1.24Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy