Research map / Probabilistic and scientific modeling / Molecules and proteins
Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Introduces PubChemQH, a larger Kohn-Sham Hamiltonian dataset of 40-100 atom molecules, a wavefunction alignment loss (WALoss) and the WANet architecture to make learned Hamiltonians physically applicable for SCF and total energy prediction.
Problem
Learned Kohn-Sham Hamiltonian predictors trained with elementwise MAE/MSE losses give small Hamiltonian errors but large total-energy errors on large molecules, limiting scalability and applicability of DFT acceleration.
Approach
A physics-motivated loss that projects the predicted Hamiltonian onto the ground-truth eigenvectors (after simultaneous reduction of the H/S pair) and penalizes deviation from orbital energies, with increased weight on occupied orbitals plus LUMO; combined with WANet (eSCN convolution, sparse long-short-range MoE pair head, many-body MACE-style diagonal head).
Key results
- On PubChemQH, WANet w/ WALoss reduces system energy MAE from 63579.233 kcal/mol (WANet) to 47.193 kcal/mol, and relative SCF iterations to 82% versus 334% for WANet without WALoss.
- WALoss lowers HOMO MAE from 60.14 to 0.7122 for WANet, while Hamiltonian MAE rises slightly on QH9 (0.0502 to 0.0914 for WANet w/ WALoss).
- Compared with property-regression baselines, WANet w/ WALoss achieves 88.88% lower LUMO MAE and 58.81% lower gap MAE than Equiformer V2 regression.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add WALoss to WANet | WANet · PubChemQH | System Energy MAE: 63579.233 -> 47.193 | Helped |
| add WALoss to WANet | WANet · PubChemQH | relative SCF Iterations: 334% -> 82% | Helped |
| add WALoss | WANet · QH9 stable | Hamiltonian MAE: 0.0502 -> 0.0914 | Hurt |
| add WALoss | WANet · QH9 stable | occupied energy MAE: 0.5231 -> 0.4587 | Helped |
| add WALoss | WANet · QH9 dynamic | occupied energy MAE: 0.2614 -> 0.2500 | Helped |
| use naive eigenvalue loss instead of WALoss (ablation) | WANet · PubChemQH | System Energy MAE: 47.193 -> 13562.7 | Hurt |
| remove eigenvalue reweighting from WALoss (ablation) | WANet · PubChemQH | System Energy MAE: 47.193 -> 55.492 | Hurt |
| add an initial guess without WALoss (ablation) | WANet · PubChemQH | Hamiltonian MAE: 0.6274 -> 0.0379 | Helped |
| add an initial guess without WALoss (ablation) | WANet · PubChemQH | System Energy MAE: 63579.233 -> 60078.633 | Helped |
| remove Many Body while retaining SO(2) and LSR-MoE (ablation) | WANet · PubChemQH | Hamiltonian MAE: 0.4744 -> 0.5895 | Hurt |
| remove LSR-MoE while retaining SO(2) and Many Body (ablation) | WANet · PubChemQH | Hamiltonian MAE: 0.4744 -> 0.4883 | Hurt |
| remove SO(2) while retaining LSR-MoE and Many Body (ablation) | WANet · PubChemQH | Hamiltonian MAE: 0.4744 -> 0.4792 | Hurt |
Surprising findings
- Lower elementwise Hamiltonian MAE does not translate into lower total energy error: the initial guess (Hamiltonian MAE 0.5512) yields much lower system energy error (374 kcal/mol) than the trained WANet (63579 kcal/mol at MAE 0.6274).
- WALoss increases Hamiltonian MAE on QH9 while improving occupied orbital energy and eigenvector similarity.
Limitations
- Generating the large training set is computationally costly (about one month on 128 V100 GPUs).
- Hamiltonian MAE is worse than some baselines with WALoss, so the trade-off between elementwise accuracy and physical utility is not fully resolved.
- Evaluation is limited to molecular systems with a single DFT functional/basis set (B3LYP/def2-TZVP) and the PubChemQH dataset does not appear to be released.
Experimental setup
Datasets: PubChemQH QH9 PubChemQC
Benchmarks: PubChemQH QH9 stable QH9 dynamic elongated alkanes scalability test
Metrics: Hamiltonian MAE HOMO MAE LUMO MAE HOMO-LUMO gap MAE occupied orbital energy MAE orbital energy MAE eigenvector cosine similarity system energy MAE relative SCF iterations dipole moment MAE
Baselines: QHNet PhisNet Equiformer V2 UniMol+ UniMol 2 minao initial guess
Builds on: QHNet PhisNet eSCN MACE Gumbel-softmax mixture of experts
Closest papers by meaning
- Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction (ICML 2024 · similarity 0.90)
- Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Models (NeurIPS 2024 · similarity 0.90)
- High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Prediction (NeurIPS 2025 · similarity 0.89)
- Learning the Electronic Hamiltonian of Large Atomic Structures (ICML 2025 · similarity 0.89)
- $\nabla^2$DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentials (NeurIPS 2024 · similarity 0.88)
- EDBench: Large-Scale Electron Density Data for Molecular Modeling (NeurIPS 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
