Research map / Architectures and efficiency / CNN design
Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Products
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Shows tensor products of irreps equal multiplication of spherical functions via Gaunt coefficients, then computes them in a 2D Fourier basis with FFT, reducing full tensor product cost from O(L^6) to O(L^3).
Problem
Full tensor products of irreducible representations used in E(3)-equivariant networks scale as O(L^6) in the max degree L, limiting practical degree to 2-3 and slowing inference on large systems.
Approach
Connects Clebsch-Gordan coefficients to Gaunt coefficients (integrals of triple products of spherical harmonics) so that irreps tensor products become multiplication of spherical functions; changes basis from spherical harmonics to a 2D Fourier basis so the products become 2D convolutions computed via the convolution theorem and FFT.
Key results
- On OC20 S2EF validation, EquiformerV2 + Gaunt-Selfmix (L=6) reaches 276 meV energy MAE, 20.1 meV/Å force MAE and 1.95% EFwT, versus 285 / 20.5 / 1.67 for EquiformerV2 at L=6.
- On 3BPA, MACE-Gaunt achieves 43.7x speed-up over the e3nn implementation with 5.8% memory cost, while keeping accuracy comparable to MACE.
- Efficiency experiments show multiple orders of magnitude speed-up over e3nn for full tensor products when L>7.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add Gaunt Selfmix to EquiformerV2 | EquiformerV2 · OC20 2M Validation S2EF, L=6 | Energy MAE [meV]: 285 -> 276 | Helped |
| Add Gaunt Selfmix to EquiformerV2 | EquiformerV2 · OC20 2M Validation S2EF, L=6 | Force MAE [meV/Å]: 20.5 -> 20.1 | Helped |
| Add Gaunt Selfmix to EquiformerV2 | EquiformerV2 · OC20 2M Validation S2EF, L=6 | Force Cos: 0.663 -> 0.669 | Helped |
| Add Gaunt Selfmix to EquiformerV2 | EquiformerV2 · OC20 2M Validation S2EF, L=6 | EFwT [%]: 1.67 -> 1.95 | Helped |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 300 K | Energy error (meV): 3.0 (0.2) -> 2.9 (0.1) | Helped |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 600 K | Energy error (meV): 9.7 (0.5) -> 10.6 (0.5) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 1200 K | Energy error (meV): 29.8 (1.0) -> 30.4 (1.2) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA Dihedral Slices | Energy error (meV): 7.8 (0.6) -> 9.9 (0.3) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 300 K | Force error (meV/Å): 8.8 (0.3) -> 9.2 (0.1) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 600 K | Force error (meV/Å): 21.8 (0.6) -> 22.2 (0.2) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA 1200 K | Force error (meV/Å): 62.0 (0.7) -> 63.1 (1.2) | Hurt |
| Use Gaunt Tensor Product in MACE | MACE · 3BPA Dihedral Slices | Force error (meV/Å): 16.5 (1.7) -> 17.7 (1.1) | Hurt |
Surprising findings
- Gaunt-based parameterization, which excludes pseudovector outputs, performs competitively with Clebsch-Gordan tensor products on the SEGNN N-body task.
Limitations
- Gaunt coefficients impose more symmetry constraints and exclude pseudovector outputs, so the method is not equivalent to Clebsch-Gordan products in general.
- Efficiency results are reported on sampled random features and specific architectures rather than broad end-to-end deployments.
Experimental setup
Datasets: OC20 2M 3BPA N-body simulation
Benchmarks: OC20 S2EF validation 3BPA
Metrics: energy MAE force MAE force cosine EFwT energy MAE (meV) force MAE (meV/Å) speed-up memory cost
Baselines: e3nn eSCN MACE EquiformerV2 SCN GemNet-OC NequIP Allegro BOTNet sGDML
Builds on: e3nn eSCN MACE SEGNN EquiformerV2
Closest papers by meaning
- The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products (ICML 2025 · similarity 0.90)
- Spin-Weighted Spherical Harmonics Enable Complete and Scalable E(3)-Equivariant Networks (NeurIPS 2026 · similarity 0.88)
- O$n$ Learning Deep O($n$)-Equivariant Hyperspheres (ICML 2024 · similarity 0.86)
- On the Fourier analysis in the SO(3) space : the EquiLoPO Network (ICLR 2025 · similarity 0.85)
- E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products (NeurIPS 2025 · similarity 0.85)
- Neural Fourier Transform: A General Approach to Equivariant Representation Learning (ICLR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
