atlas

Research map / Architectures and efficiency / RNNs and normalization

Differentiable plasticity: training plastic neural networks with backpropagation

ICML 2018 · Architectures and efficiency › RNNs and normalization · approach: Hebbian and predictive coding · 17 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add trainable plastic connections to the recurrent networkRecurrent network · Binary pattern memorization (1{,}000-bit patterns)bit error: <1\%Helped
Add trainable plastic connections instead of using an LSTM50-bit binary pattern memorization · Binary pattern memorization (50-bit patterns)episodes to reach mean error below .01: ~2{,}000 vs. 500{,}000 episodesHelped
Use independent plasticity coefficients for each connection rather than one shared coefficient (ablation)Differentiable plasticity network · Natural image memorizationreconstruction performanceHelped
Use trainable plastic connections for the output layerConvolutional Omniglot classifier · Omniglot 5-way 1-shotaccuracy: 98.3\% $\pm$ 0.80Helped
Use individually learned plasticity coefficients instead of no plasticityRecurrent maze agent · Maze exploration taskrewardHelped
Use one shared learnable plasticity coefficient instead of individually learned coefficients (ablation)Recurrent maze agent · Maze exploration taskrewardHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy