Research map / Architectures and efficiency / Attention and transformers
Multiplicative Interactions and Where to Find Them
Siddhant M. Jayakumar, Wojciech M. Czarnecki, Jacob Menick, Jonathan Schwarz, Jack Rae, Simon Osindero, Yee Whye Teh, Tim Harley, Razvan Pascanu
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Monitoring Primitive Interactions During the Training of DNNs (AAAI 2025 · similarity 0.87)
- Towards the Dynamics of a DNN Learning Symbolic Interactions (NeurIPS 2024 · similarity 0.86)
- A distributional simplicity bias in the learning dynamics of transformers (NeurIPS 2024 · similarity 0.86)
- Layerwise Change of Knowledge in Neural Networks (ICML 2024 · similarity 0.85)
- A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization (ICML 2025 · similarity 0.85)
- Defining and extracting generalizable interaction primitives from DNNs (ICLR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
