atlas

Research map / Large language models / Agents, code and math

Domain-Agnostic Molecular Generation with Chemical Feedback

ICLR 2024 · Large language models › Agents, code and math · approach: LLMs for scientific discovery · 17 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces MolGen, a SELFIES-based pre-trained molecular language model with domain-agnostic prefix tuning and a rank-loss chemical feedback stage to generate valid, property-optimized molecules across synthetic and natural product domains.

Problem

Pre-trained molecular language models built on SMILES generate many syntactically or chemically invalid strings, focus narrowly on synthetic molecules, and produce "molecular hallucinations" (valid but non-functional molecules) when optimizing properties without external data.

Approach

Pre-train a BART-style seq2seq model on over 100M SELFIES (guaranteed valid), share domain-agnostic prefix vectors across synthetic and natural-product domains, then align sequence likelihoods with property rankings via a rank loss (chemical feedback) combined with label-smoothed cross-entropy.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Apply chemical feedback during molecule optimization (ablation)MolGen · Synthetic moleculesProperty scoresHelped
Remove chemical feedback (ablation)MolGen · Synthetic and natural product moleculesProperty scoresHurt
Add domain-agnostic molecular prefixes (ablation)MolGen · Molecular substructure attentionSubstructure Attention LevelHelped
Use MolGen instead of MolDQNSynthetic molecule discovery, output length limit · Synthetic moleculesPenalized logP (1st): 11.80 -> 30.51Helped
Use MolGen instead of MARSSynthetic molecule discovery, no output length limit · Synthetic moleculesPenalized logP (1st): 44.99 -> 80.30Helped
Use MolGen instead of LIMOMolecular distribution learning · Natural product moleculesFrag: .9826 -> .9994Helped
Use MolGen instead of ChemformerMolecular distribution learning · Synthetic moleculesFCD: .0061 -> .0015Helped
Use MolGen instead of LIMOBinding affinity optimization · ESR1Binding affinity (K_D): 0.72 -> 0.13Helped
Use MolGen instead of LIMOBinding affinity optimization · ACAA1Binding affinity (K_D): 37 -> 3.36Helped
Use MolGen instead of GraphAFConstrained p-logP optimization · δ=0.6Mean p-logP improvement: 4.98 -> 12.08Helped
Use MolGen instead of RetMolConstrained p-logP optimization · δ=0.4Mean p-logP improvement: 11.55 -> 12.35Helped

Surprising findings

Limitations

Experimental setup

Datasets: ZINC-15 MOSES ZINC250K NPASS PubChem

Benchmarks: MOSES ZINC250K NPASS natural products penalized logP optimization QED optimization ESR1 and ACAA1 docking

Metrics: validity Frag Scaf SNN IntDiv FCD Novelty penalized logP QED binding affinity (K_D)

Baselines: JT-VAE GCPN MolDQN MARS GraphAF GraphDF LIMO Chemformer RetMol RT AAE LatentGAN

Builds on: BART Chemformer prefix-tuning SELFIES JT-VAE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy