atlas

Research map / Bandits and online learning / Online convex optimization and games

Memory Efficient Online Meta Learning

ICML 2021 · Bandits and online learning › Online convex optimization and games · approach: Parameter-free non-stationary online learning · 6 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace stored task history (FTML) with fixed-size state vector (MOML)online meta learning on S-MNIST · S-MNISTCTM test accuracy: 85.82 vs 80.62Helped
replace stored task history (FTML) with fixed-size state vector (MOML)online meta learning on 5 way-CIFAR-100 · 5 way-CIFAR-100LTM test accuracy: 60.78 vs 54.50Helped
replace stored task history with fixed-size state vector on miniImageNetonline meta learning on 5 way-miniImageNet · 5 way-miniImageNetCTM test accuracy: 56.23 vs 56.77No clear effect
add a 10-task FIFO buffer to MOML (ablation)MOML on 5 way-CIFAR-100 · 5 way-CIFAR-100LTM test accuracy: 60.78 -> 65.24Helped
add a 10-task buffer to MOML (ablation)MOML on 5 way-CIFAR-100 · 5 way-CIFAR-100CTM test accuracy: 55.83 -> 56.70 (about 1 point)Helped
add a 10-task buffer to MOML (ablation)MOML on S-MNIST · S-MNISTLTM test accuracy: 87.49 -> 87.77Helped
add a 10-task buffer to MOML (ablation)MOML on S-MNIST · S-MNISTCTM test accuracy: 85.82 -> 84.33 (lower)No clear effect
use latest-B buffer instead of random-B buffer (ablation)B-MOML · 5 way-CIFAR-100 and S-MNISTLTM test accuracy: 65.24 vs 64.37 on CIFAR-100 (B=10); 87.77 vs 86.97 on S-MNIST (B=10)Mixed
sub-linear regret / memory-free MOML vs FTML memory growthMOML · theoryregret / memoryHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy