AI Paper Atlas

Research map / Learning theory and algorithms / Optimal transport

Optimal Transport Kernels for Sequential and Parallel Neural Architecture Search

Vu Nguyen, Tam Le, Makoto Yamada, Michael A. Osborne

ICML 2021 · Learning theory and algorithms › Optimal transport · approach: Transport map estimation · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace standard OT (indefinite) distance with tree-Wasserstein (negative definite) distance for GP kernel in sequential NAS (ablation)BO for NAS (GP surrogate) · NB101/NB201 sequential NASbest accuracy vs iterationsImproved
Use 2-gram operation representation instead of 1-gram in tree-Wasserstein (ablation)TW distance for NAS · NB101/NB201 sequential NASbest accuracy vs iterationsImproved
Use evolutionary candidate pool generation instead of random generation (ablation)Candidate pool P_t for BO · NAS benchmarksbest accuracyImproved
Use k-DPP with quality (GP-based) for parallel batch selection instead of GP-BUCB/KB, Thompson sampling, and vanilla k-DPPParallel NAS batch selection · NB101 parallel NAS (budget 500, batch 5)best accuracy vs iterationsImproved
Use TW-2G distance instead of path distance within k-DPP quality (ablation)Parallel NAS k-DPP quality · NB201 (ImageNet, CIFAR-100)best accuracyImproved
Replace OT distance with Gromov-Wasserstein or path encoding within BO (ablation)BO distances for NAS · NAS benchmarksbest accuracyHurt
Use GP-UCB acquisition instead of expected improvement (ablation)Sequential BO · NAS benchmarksbest accuracyImproved
Add quality term to k-DPP (vs diversity only) (ablation)Parallel NAS k-DPP · NB101 parallel NASbest accuracyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy