atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Instructor-inspired Machine Learning for Robust Molecular Property Prediction

NeurIPS 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Contrastive representation theory · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes InstructMol, a semi-supervised proxy-labeling method where an instructor model predicts pseudo-label reliability to reweight the target molecular model's loss, improving molecular property prediction under scarce labels and OOD shift.

Problem

Molecular property prediction suffers from scarce labeled data and distribution shift; existing proxy-labeling methods rely on classification probabilities and fail for regression, and pretraining benefits can vanish under distribution gaps.

Approach

An instructor network g judges whether each (input, label) pair is a true label or a pseudo-label, and its confidence p_j reweights the target model's loss via (2p_j - 1) weighting over all unlabeled data, enabling regression-compatible proxy labeling without multi-domain knowledge transfer.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add InstructMol to GEMGEM · MoleculeNet BBBPROC-AUC: 72.4(0.4) -> 73.3(0.8)Helped
Add InstructMol to GEMGEM · MoleculeNet FreeSolvRMSE: 1.877(0.094) -> 1.604(0.043)Helped
Use InstructMol instead of ERMGOOD-HIV scaffold OOD · GOOD-HIV scaffold OODperformance: 69.58 -> 72.10Helped
Use InstructMol instead of ERMGOOD-PCBA size OOD · GOOD-PCBA size OODperformance: 17.86 -> 19.20Helped
Add unlabeled molecular data (ablation)InstructMol · MoleculeNet downstream tasksperformanceHelped
Use InstructMol rather than supervised-only predictionLogP prediction · ZINC15RMSE: 5.63 -> 0.63Helped
Use InstructMol for drug Ki predictionInstructMol · ZA202303678A 5-HT1A compoundsKi prediction errorHelped

Surprising findings

Limitations

Experimental setup

Datasets: MoleculeNet ZINC15 GOOD-HIV GOOD-PCBA CHEMBL214_Ki Kaggle LogP dataset

Benchmarks: MoleculeNet GOOD-HIV GOOD-PCBA

Metrics: ROC-AUC RMSE

Baselines: GIN GAT GCN Semi-GAN pi-model UPS GROVER Uni-Mol GEM MolCLR GraphMVP IRM

Builds on: UPS pi-model Mean Teacher GEM Semi-GAN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy