Research map / Probabilistic and scientific modeling / Differential equations and PDEs
Lie Generator Networks for Nonlinear Partial Differential Equations
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes LGN-KM, a neural operator that learns a continuous-time Koopman generator decomposed as skew-symmetric minus positive diagonal (S−D) per Fourier mode, yielding stable, interpretable spectra for 2D Navier–Stokes and enabling long-horizon stability and cross-viscosity transfer.
Problem
Nonlinear PDEs lack analytical tools such as eigenspectra and dispersion relations; existing neural operators predict solutions without exposing an interpretable, stable generator of the dynamics.
Approach
Learn the continuous-time Koopman generator per Fourier mode as L_k = S − D_k, with S skew-symmetric and shared across modes (conservative coupling) and D_k positive diagonal with wavenumber-dependent dissipation, so eigenvalues have non-positive real parts by construction and propagation is a single matrix exponential.
Key results
- Learned generator's dominant eigenvalue scales linearly with |k|^2 (R^2=0.920 at nu=1e-5, 0.947 at nu=1e-3), recovering viscous dissipation scaling without physics supervision.
- Freezing S from a nu=1e-5 model and fine-tuning the rest gives ~6x convergence speedup and 18% lower final error at N=50 on nu=1e-3 data; transfer at N=50 matches scratch at N=100.
- FNO is more accurate within the training horizon (relative L2 0.16 vs 0.24 at nu=1e-5), while LGN-KM energy stays bounded (~0.28) over 200 steps where FNO energy diverges to ~1e18.
Surprising findings
- Independently trained models at different viscosities learn different raw S matrices (cosine similarity 0.023) yet match gauge-invariant singular value profiles (R^2=0.941).
- Unconstrained generator yields unstable eigenvalues at every epoch (max Re up to +0.35), while the S-D version has similar test error (0.240 vs 0.247).
Limitations
- Less accurate than FNO within the training horizon (relative L2 0.24 vs 0.16 at nu=1e-5).
- Restricted to 2D periodic domains via Fourier-mode factorization; not demonstrated in 3D or non-periodic settings.
- Matrix exponential cost O(r^3) per mode limits scaling to large latent dimensions.
Experimental setup
Datasets: 2D Navier-Stokes benchmark (Li et al.) 2D FitzHugh-Nagumo simulated trajectories
Benchmarks: 2D Navier-Stokes turbulence (nu=1e-5, nu=1e-3) 2D FitzHugh-Nagumo
Metrics: relative L2 error eigenvalue spectra R^2 of dissipation scaling R^2 of singular value profiles wall time enstrophy over long horizon
Baselines: FNO-2D SGNO unconstrained generator S-only ablation D-only ablation scratch training
Builds on: Fourier Neural Operator Koopman operator / deep Koopman LGN for linear system identification CT-KAE
Closest papers by meaning
- Deep-Koopman-KANDy: Dictionary Discovery for Deep-Koopman Operators with Kolmogorov-Arnold Networks for Dynamics (NeurIPS 2026 · similarity 0.86)
- ResKoopNet: Learning Koopman Representations for Complex Dynamics with Spectral Residuals (ICML 2025 · similarity 0.86)
- Stable Long-Horizon PDE Forecasting via Latent Structured Spectral Propagators (NeurIPS 2026 · similarity 0.86)
- KoNODE: Koopman-Driven Neural Ordinary Differential Equations with Evolving Parameters for Time Series Analysis (ICML 2025 · similarity 0.86)
- ControlSynth Neural ODEs: Modeling Dynamical Systems with Guaranteed Convergence (NeurIPS 2024 · similarity 0.86)
- Balanced Neural ODEs: nonlinear model order reduction and Koopman operator approximations (ICLR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
