Research map / Learning theory and algorithms / Matrix and tensor methods
Efficient Learning of PDEs via Taylor Expansion and Sparse Decomposition into Value and Fourier Domains
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes REEL, which accelerates learning of PDE models by decomposing updates into sparse value- and Fourier-domain components, Taylor-expanding nonlinear terms into decomposable form, and compressing with random projection.
Problem
Learning PDE parameters from data via simulation-based gradient training is expensive, and prior random-projection acceleration (RAPID-PDE) only applies to decomposable PDEs with value-domain sparsity.
Approach
Split dense system updates into a sparse value-domain part and a sparse frequency-domain part via a Fourier threshold, use Taylor expansion to make non-decomposable PDE terms decomposable, then randomly project both parts to compress learning; theory gives a constant-factor loss approximation with poly-logarithmic projected dimensions.
Key results
- REEL reduces sintering training time by 70%-98% when data is compressed to 1% of original size.
- For nanovoid, about 70% training time reduction without compression, and REEL at 10% compression captures void shrinking while RAPID-PDE disintegrates the void.
- MSE of phi and T for REEL at 1% compression is small and comparable to the uncompressed baseline.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use REEL for PDE learning | Sintering PDE model · Solid-state selective laser sintering | training time: 70−98% reduction | Helped |
| Use REEL without compression | Nanovoid PDE model · Nanovoid evolution | training time: ≈70% reduction | Helped |
| Compress data to 1% of original dimension (ablation) | REEL · Solid-state selective laser sintering | MSE | No clear effect |
| Compress data to 10% of original dimension (ablation) | REEL · Nanovoid evolution | void evolution dynamics | Helped |
| Use RAPID-PDE with compression to 10% instead of REEL | Nanovoid PDE model · Nanovoid evolution | void evolution dynamics | Hurt |
Limitations
- Code stated to be released only in future; no public release at submission.
- Decomposition threshold chosen empirically on few signal samples.
- Theoretical guarantee relies on sparsity after decomposition and sub-exponential assumptions.
Experimental setup
Datasets: synthetic sintering phase-field simulations synthetic nanovoid phase-field simulations
Benchmarks: solid-state laser sintering phase-field simulation nanovoid evolution phase-field simulation
Metrics: training time mean squared error of phase field and temperature fields simulation visual comparison
Baselines: RAPID-PDE REEL without random projection
Builds on: RAPID-PDE physics-informed neural networks Taylor series expansion
Closest papers by meaning
- Active Learning with Selective Time-Step Acquisition for PDEs (ICML 2025 · similarity 0.88)
- CALM-PDE: Continuous and Adaptive Convolutions for Latent Space Modeling of Time-dependent PDEs (NeurIPS 2025 · similarity 0.87)
- Active Learning for Neural PDE Solvers (ICLR 2025 · similarity 0.87)
- P$^2$C$^2$Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics (NeurIPS 2024 · similarity 0.86)
- Collapsing Taylor Mode Automatic Differentiation (NeurIPS 2025 · similarity 0.86)
- Mechanistic PDE Networks for Discovery of Governing Equations (ICML 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
