AI Paper Atlas

Research map / Continual learning / Online and replay-based

Rewiring Neurons in Non-Stationary Environments

Zhicheng Sun, Yadong MU

NeurIPS 2023 · Continual learning › Online and replay-based · approach: Plasticity-preserving continual reinforcement learning · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add rewiring by neuron permutation (with caching) to FT-L2 baseline (ablation)FT-L2 · HalfCheetah/forgettingaverage performance: 0.67 -> 0.95Improved
add caching of each learned wiring (versus rewiring without caching) (ablation)Rewire · HalfCheetah/forgettingaverage performance: 0.76 -> 0.95Improved
add multi-mode rewiring strategy (ablation)Rewire · HalfCheetah/forgettingaverage performance: 0.95 -> 1.14Improved
add alignment mechanism for cached wirings (ablation)Rewire + multi-mode · HalfCheetah/forgettingaverage performance: 1.14 -> 1.31Improved
add alignment mechanism without multi-mode (ablation)Rewire · HalfCheetah/forgettingaverage performance: 0.95 -> 1.15Improved
add multi-mode on top of rewiring plus alignment (ablation)Rewire + alignment · HalfCheetah/forgettingaverage performance: 1.15 -> 1.31Improved
rewiring (without multi-mode) versus vanilla finetuning, speed to reward 2000 (ablation)Rewire vs FT · HalfCheetah/forgetting first stagesteps to average reward 2000Improved
rewiring versus vanilla finetuning, final reward (ablation)Rewire vs FT · HalfCheetah/forgetting first stagefinal reward: over 3000Improved
add multi-mode rewiring, final reward (ablation)Rewire · HalfCheetah/forgetting first stagefinal reward: nearly 4000Improved
add multi-mode rewiring, early learning speed (ablation)Rewire · HalfCheetah/forgetting first stagereward at step 200kHurt
add KL distillation loss across wirings (ablation)multi-mode rewiring · HalfCheetah/forgetting first stagemean and median rewardImproved
increase number of modes K beyond 3 (ablation)multi-mode rewiring · HalfCheetah/forgettingperformanceHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy