atlas

Research map / Continual learning / Online and replay-based

Thalamus: a brain-inspired algorithm for biologically-plausible continual learning and disentangled representations

ICLR 2023 · Continual learning › Online and replay-based · approach: Gradient projection and plasticity preservation · 9 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use latent updates to adapt task context while keeping model weights frozenThalamus · Split MNIST, all 5 tasksend average accuracy: 97.71 (± 0.13); RtF: 97.31 (± 0.11)Helped
Use latent updates after learning the first four tasks, with weights frozenThalamus · Split MNIST, unseen task 5accuracy: 91.14±3.73Helped
Use latent updates to handle flipped-label contextual tasksThalamus · Contextual split MNISTaccuracy: 96.09 ±0.83; other methods: around 59%Helped
Use SGD with 10^-4 learning rate instead of the usual Thalamus update balance (ablation)Thalamus · Split MNIST, all tasks and unseen task 5accuracy: 83%; unseen fifth task: 67%Hurt
Remove the accuracy criterion and alternate weight and latent updates every trial (ablation)Thalamus · NeuroGym, unlabeled task streamaccuracy change after latent updatesHurt
Replace Bernoulli latent-to-network gates with rectified Gaussian gates (ablation)Thalamus · NeuroGym, 5 tasksperformanceNo clear effect
Add Bernoulli sparsification to rectified Gaussian latent-to-network gates (ablation)Thalamus · NeuroGym, 5 tasksperformanceHelped
Allow latent-to-network gate weights Wz to be trainable rather than fixed (ablation)Thalamus · NeuroGym, 5 tasksperformanceNo clear effect
Use task identifiers, training to criterion, and rehearsal together during pretraining (ablation)Pretrained RNN · 15 NeuroGym tasksaverage accuracyHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy