Research map / Probabilistic and scientific modeling / Differential equations and PDEs
HyPINO: Multi-Physics Neural Operators via HyperPINNs and the Method of Manufactured Solutions
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes HyPINO, a Swin-Transformer hypernetwork that maps 2D linear PDE specifications to PINN weights, trained on mixed MMS-supervised and physics-only samples, with residual-driven iterative refinement for zero-shot solving.
Problem
Zero-shot generalization of neural operators across diverse parametric linear 2D PDEs (varying operators, source terms, geometries, mixed Dirichlet/Neumann boundaries) without task-specific fine-tuning, while avoiding dependence on large labeled simulation datasets.
Approach
A hypernetwork (Swin Transformer encoder with FiLM operator conditioning and attention pooling) generates the full weights of a target PINN from a grid-based PDE parameterization, trained with a hybrid of MMS-supervised samples and physics-informed unlabeled samples; residuals of the generated PINN are fed back as a "delta PDE" to produce corrective PINNs that are summed into an ensemble.
Key results
- HyPINO^10 achieves the best MSE on most benchmarks (e.g., HT 8.0e-5 vs PINO 1.4e-2 zero-shot baseline), with state-of-the-art on all but two benchmarks after 10 refinement rounds.
- Zero-shot HyPINO average rank 2.00 versus 3.00 for U-Net, 2.86 for Poseidon, and 2.14 for PINO.
- HyPINO-initialized PINNs converge faster and to lower final error than random and Reptile initializations on 4 of 7 benchmarks, matched on 2, and underperformed on 1.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add three residual-refinement rounds (ablation) | HyPINO · HT | MSE: 2.3e-2 -> 4.9e-4 | Helped |
| add three residual-refinement rounds (ablation) | HyPINO · HZ | MSE: 5.7e-3 -> 2.7e-3 | Helped |
| add three residual-refinement rounds (ablation) | HyPINO · HZ-G | MSE: 1.3e-1 -> 1.6e-2 | Helped |
| add three residual-refinement rounds (ablation) | HyPINO · PS-C | MSE: 5.6e-2 -> 3.4e-3 | Helped |
| add three residual-refinement rounds (ablation) | HyPINO · PS-L | MSE: 1.7e-4 -> 1.9e-4 | Hurt |
| add three residual-refinement rounds (ablation) | HyPINO · PS-G | MSE: 1.8e-1 -> 6.6e-3 | Helped |
| add three residual-refinement rounds (ablation) | HyPINO · WV | MSE: 2.9e-1 -> 2.3e-1 | Helped |
| add ten residual-refinement rounds (ablation) | HyPINO · HT | MSE: 2.3e-2 -> 8.0e-5 | Helped |
| add ten residual-refinement rounds (ablation) | HyPINO · HZ | MSE: 5.7e-3 -> 1.6e-3 | Helped |
| add ten residual-refinement rounds (ablation) | HyPINO · HZ-G | MSE: 1.3e-1 -> 1.9e-2 | Helped |
| add ten residual-refinement rounds (ablation) | HyPINO · PS-C | MSE: 5.6e-2 -> 2.3e-3 | Helped |
| add ten residual-refinement rounds (ablation) | HyPINO · PS-L | MSE: 1.7e-4 -> 2.7e-4 | Hurt |
Surprising findings
- Iterative residual refinement also improves PINO (PINO^3, PINO^10), suggesting it is a generic test-time enhancement.
- Zero-shot HyPINO (single pass) is not uniformly better than baselines; it underperforms PINO on several benchmarks such as PS-C and WV before refinement.
Limitations
- Restricted to linear 2D PDEs with spatially uniform coefficients.
- Unsupervised physics-only samples may be ill-posed; well-posedness is only heuristically ensured.
- Output space is less structured than grid-based baselines, and zero-shot performance trails on some benchmarks (e.g., HZ-G, WV).
Experimental setup
Datasets: synthetic MMS-generated PDEs synthetic unsupervised physics-informed PDEs PINN benchmark problems (DeepXDE, PINNacle)
Benchmarks: HT HZ HZ-G PS-C PS-L PS-G WV
Metrics: MSE SMAPE average rank relative error vs refinement iterations steps to reach target MSE in fine-tuning
Baselines: U-Net Poseidon-B PINO PINO^3 PINO^10 Reptile
Builds on: HyperPINN Poseidon PINO Reptile Swin Transformer
Closest papers by meaning
- RoPINN: Region Optimized Physics-Informed Neural Networks (NeurIPS 2024 · similarity 0.89)
- Neuro-Spectral Architectures for Causal Physics-Informed Networks (NeurIPS 2025 · similarity 0.88)
- RIGNO: A Graph-based Framework For Robust And Accurate Operator Learning For PDEs On Arbitrary Domains (NeurIPS 2025 · similarity 0.88)
- Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks (NeurIPS 2026 · similarity 0.88)
- Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective (NeurIPS 2025 · similarity 0.88)
- PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs (NeurIPS 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
