AI Paper Atlas

Research map / Architectures and efficiency / RNNs and normalization

AMLB: an AutoML Benchmark

Pieter Gijsbers, Marcos L. P. Bueno, Stefan Coors, Erin LeDell, Sébastien Poirier, Janek Thomas, Bernd Bischl, Joaquin Vanschoren

JMLR 2024 · Architectures and efficiency › RNNs and normalization · approach: Learned embeddings for retrieval · 93 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use AutoGluon(B) instead of other AutoML frameworksAutoML frameworks · Binary classification (albert, 1h)AUC: 0.782 vs 0.737 (autosklearn2)Improved
use AutoGluon stacking ensembles instead of TPOTTPOT · Binary classification (albert, 1h)AUC: 0.782 vs 0.718Improved
tune random forest hyperparameters instead of using an AutoML search (TPOT)TPOT · All suites, average rankaverage rankImproved
use AutoGluon(B) instead of the second best frameworkAutoGluon(B) · All suites, CD diagramaverage rankNo clear effect
increase time budget from 1 hour to 4 hoursAutoML frameworks · All tasksscaled performanceImproved
use AutoGluon(B) stacking ensemble instead of lighter presetsAutoGluon · Inference speedrows per secondHurt
use cost-frugal optimization that accounts for inference time (FLAML)FLAML · Inference speedrows per secondImproved
use AutoGluon(B) on datasets with more than 8237 instancesAutoGluon(B) · Bradley-Terry tree, 1h classificationworth parameterImproved
use AutoGluon(B) on small balanced binary tasksAutoGluon(B) · Small balanced binary classificationworth parameterHurt
add iterative-learner-only search space with ensembling (MLJAR(B)) bug fixesMLJAR(B) · Classification and regression suiteserrors: 284Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy