AI Paper Atlas

Research map / Learning theory and algorithms / Combinatorial and search optimization

RoMA: Robust Model Adaptation for Offline Model-based Optimization

Sihyun Yu, Sungsoo Ahn, Le Song, Jinwoo Shin

NeurIPS 2021 · Learning theory and algorithms › Combinatorial and search optimization · approach: Constrained neural network optimization · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add gradient-norm regularization only (drop consistency term) vs both terms (ablation)RoMA · HopperController100th percentile score: 2183.4 -> 2466.5Improved
Add output-consistency term to gradient-norm term (ablation)RoMA · HopperController100th percentile score: 2183.4 -> 2466.5Improved
Add gradient-norm term to consistency term (ablation)RoMA · HopperController100th percentile score: 2081.9 -> 2466.5Improved
Replace naive pre-training with robust pre-training strategy (ablation)RoMA · HopperController100th percentile scoreImproved
Add model adaptation on top of robust pre-training (ablation)RoMA · HopperController100th percentile scoreImproved
Use larger iteration count T=500 vs 300 (ablation)RoMA · all 6 tasks100th percentile scoreNo clear effect
Reduce alpha from alpha0 to 0.5*alpha0 (ablation)RoMA · HopperController100th percentile score: 2466.5 -> 2420.5No clear effect
Reduce alpha to 0.1*alpha0 (ablation)RoMA · HopperController100th percentile score: 2466.5 -> 2412.3No clear effect
Use smaller perturbation 0.2*eps0 (ablation)RoMA · HopperController100th percentile score: 2466.5 -> 2303.6Hurt
Reduce both alpha (0.1x) and eps (0.2x) (ablation)RoMA · HopperController100th percentile score: 2466.5 -> 2088.1Hurt
Use alpha=0.1*alpha0 instead of alpha0 (ablation)RoMA · Molecule100th percentile score: 6.890 -> 6.941Improved
Use eps=0.2*eps0 instead of eps0 (ablation)RoMA · Superconductor100th percentile score: 103.9 -> 106.3Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy