Research map / Architectures and efficiency / RNNs and normalization
A Biologically Plausible Dense Associative Memory with Exponential Capacity
Mohadeseh Shafiei Kafraj, Dmitry Krotov, Peter E. Latham
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace winner-take-all nonlinearity with Heaviside threshold | Krotov-Hopfield two-layer DAM · MNIST, N_h=50 | stored memories recalled: 50 -> 60,000 memories (12%-90% -> 98% recall) | Improved |
| store CIFAR-10 images with threshold DAM (N_h=500) | threshold DAM · CIFAR-10 | unique stable minima: 49982 of 50,000 | Improved |
| classify from recalled hidden vs visible vs original on CIFAR-10 | threshold DAM · CIFAR-10 | accuracy: 88% -> 56% (visible), 40% (hidden) | Hurt |
| classify from recalled hidden patterns vs original on MNIST | threshold DAM · MNIST | accuracy: 99% -> 95% (hidden), 98% (visible) | No clear effect |
| set threshold to theoretical optimum 0.5 (ablation) | threshold DAM · capacity vs N_h (random weights) | capacity | Improved |
| use smooth sigmoid instead of Heaviside (ablation) | threshold DAM · capacity | recall | No clear effect |
| use asymmetric weights and heterogeneous thresholds (ablation) | threshold DAM · MNIST and CIFAR-10 recall | recall | No clear effect |
| ratio tau_v/tau_h of only 4 (ablation) | threshold DAM · capacity, N_h=10 | capacity | Improved |
Closest papers by meaning
- Dense Associative Memory Through the Lens of Random Features (NeurIPS 2024 · similarity 0.88)
- Exponential Dynamic Energy Network for High Capacity Sequence Memory (NeurIPS 2025 · similarity 0.87)
- Learning Associative Memories with Gradient Descent (ICML 2024 · similarity 0.87)
- Factual recall in linear associative memories: sharp asymptotics and mechanistic insights (NeurIPS 2026 · similarity 0.87)
- Semantically-correlated memories in a dense associative model (ICML 2024 · similarity 0.86)
- Dense Associative Memory with Epanechnikov Energy (NeurIPS 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
