AI Paper Atlas

Research map / Probabilistic and scientific modeling / Bayesian optimization

Hyperparameter Optimization via Sequential Uniform Designs

Zebin Yang, Aijun Zhang

JMLR 2021 · Probabilistic and scientific modeling › Bayesian optimization · approach: Multi-fidelity hyperparameter optimization · 15 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
make search sequential (SeqRand instead of Rand)random search · 120 HPO tasks (5-fold CV)tasks won: 106 out of the 120 tasksImproved
make uniform design sequential (SeqUD instead of UD)uniform design · 120 HPO tasks (5-fold CV)tasks won: 109 out of the 120 tasksImproved
use uniform design points instead of random in the sequential scheme (SeqUD vs SeqRand)sequential search · 120 HPO tasks (5-fold CV)tasks won: 91 (36)Improved
use SeqUD instead of HyperbandXGBoost HPO · R11 parkinsons tele test RMSERMSE: 2.477 -> 2.015Improved
use SeqUD instead of HyperbandXGBoost HPO · C20 electricity test accuracyaccuracy: 92.08 -> 92.99Improved
use SeqUD instead of GP-EIcliff function · cliff (100 runs)best value: 0.994 -> 1.000No clear effect
use SeqUD instead of SeqRandoctopus function · octopus (100 runs)best value: 2.904 -> 2.996Improved
use larger per-stage runs n=q=150/250 (1000-run budget) (ablation)SeqUD · 32 synthetic functions (1000 runs)function value: 29 out of 32 synthetic functionsImproved
use larger per-stage runs n=q=150/250 (ablation)SeqUD · early runs 100-300 of 1000function valueHurt
use UD or Sobol instead of random search or LHSnon-sequential design · 100 runs SVM s=2centered discrepancy CD2: 0.003440 -> 0.000035Improved
use SeqUD instead of AutoSklearn on pipeline optimizationpipeline HPO · 40 data setstasks won: 17 out of the 40Mixed

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 1 of 1 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy