Research map / Probabilistic and scientific modeling / Molecules and proteins
Offline Materials Optimization with CliqueFlowmer
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes CliqueFlowmer, a transformer autoencoder with clique-structured latent space, trained jointly with a property predictor, that optimizes materials offline via evolution-strategies gradient search and decodes them with an autoregressive atom-type decoder and flow-matching geometry decoder.
Problem
Generative models for computational materials discovery mainly reproduce the training distribution and do not actively optimize a target property; offline model-based optimization is hard for irregular, hybrid discrete-continuous materials structures.
Approach
Encode materials into a fixed-dimensional latent with a transformer encoder, impose a clique-chain decomposition on the latent for the property predictor, optimize latents with rank-based evolution strategies plus weight decay, and decode back to atom types (autoregressive + beam search) and geometry (conditional flow matching).
Key results
- Optimized formation energy per atom reaches -0.81 (CliqueFlowmer) and -0.99 (CliqueFlowmer-Top) vs. 0.59-0.71 for generative baselines.
- Band gap reduced to 0.03 (CliqueFlowmer) and 0.07 (-Top) vs. 0.48-0.63 for baselines, with S.U.N. 61.3% and 69.4%.
- Under DFT re-evaluation on 100 structures, S.U.N. rates drop sharply (e.g., 2% strictly S.U.N. for CliqueFlowmer), showing sensitivity to ML oracle bias.
Surprising findings
- Under DFT evaluation the S.U.N. rates of CliqueFlowmer fall far below the ML-oracle estimates, while property optimization advantage persists.
- Backpropagation through the property predictor diverges; rank-based evolution strategies with weight decay work instead.
Limitations
- Property oracles are ML surrogates (M3GNet, MEGNet) and formation energy/band gap are synthetic targets; stability metrics are sensitive to oracle bias.
- Stability and S.U.N. evaluated with approximate M3GNet relaxation; DFT check limited to 100 structures.
- Lower stable and metastable rates for formation-energy optimization (e.g., 14.5% stable vs. 19.8% for DiffCSP++).
Experimental setup
Datasets: MP-20
Benchmarks: MP-20
Metrics: formation energy per atom (M3GNet) band gap (MEGNet) stability (energy above hull) S.U.N. rate metastable rate novelty uniqueness DFT formation energy and band gap (HSE)
Baselines: CrystalFormer DiffCSP DiffCSP++ MatterGen
Builds on: Cliqueformer flow matching AdaLN Cliqueformer clique decomposition AdamW
Closest papers by meaning
- MatExpert: Decomposing Materials Discovery By Mimicking Human Experts (ICLR 2025 · similarity 0.87)
- FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributions (NeurIPS 2024 · similarity 0.87)
- MADE: Benchmark Environments for Closed-Loop Materials Discovery (ICML 2026 · similarity 0.87)
- A Denoising Pre-training Framework for Accelerating Novel Material Discovery (AAAI 2025 · similarity 0.87)
- Open Materials Generation with Stochastic Interpolants (ICML 2025 · similarity 0.86)
- Generative Hierarchical Materials Search (NeurIPS 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
