atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

S-MolSearch: 3D Semi-supervised Contrastive Learning for Bioactive Molecule Search

NeurIPS 2024 · Label-efficient and robust learning › Semi-supervised learning · approach: Self-training theory · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes S-MolSearch, a semi-supervised contrastive learning framework for ligand-based virtual screening that combines ChEMBL affinity-labeled pairs with ~19M unlabeled molecules, using smooth optimal transport to generate soft labels from a teacher encoder.

Problem

Ligand-based virtual screening is limited by scarce, noisy binding affinity labels covering a small chemical space, and standard data augmentation does not preserve molecular activity for 3D molecules.

Approach

Two Uni-Mol-initialized encoders: a supervised encoder trained with InfoNCE on affinity-defined clusters from ChEMBL, and a full-data encoder trained on soft labels obtained by smooth optimal transport over the supervised encoder's similarity matrix, motivated by an inverse optimal transport view of contrastive learning.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use a 0.9 rather than 0.4 similarity threshold for ChEMBL filteringS-MolSearch · DUD-E zero-shotBEDROC (%): 54.22 -> 75.37Helped
Use a 0.9 rather than 0.4 similarity threshold for ChEMBL filteringS-MolSearch · LIT-PCBA zero-shotAUROC (%): 57.34 -> 61.78Helped
Add IOT soft labels instead of using hard similarity labels (ablation)S-MolSearch · DUD-EEF 1%: 30.73 -> 34.60Helped
Add IOT soft labels instead of using hard similarity labels (ablation)S-MolSearch · LIT-PCBAEF 1%: 6.19 -> 6.28Helped
Add KoLeo regularizer (ablation)S-MolSearch · DUD-EEF 1%: 33.32 -> 34.60Helped
Add KoLeo regularizer (ablation)S-MolSearch · LIT-PCBAEF 1%: 5.24 -> 6.28Helped
Use Uni-Mol pretrained checkpoint instead of random initialization (ablation)S-MolSearch · DUD-EEF 1%: 31.86 -> 34.60Helped
Use Uni-Mol pretrained checkpoint instead of random initialization (ablation)S-MolSearch · LIT-PCBAEF 1%: 5.24 -> 6.28Helped
Use semi-supervised S-MolSearch instead of scaffold-cluster self-supervised learning (ablation)S-MolSearch · DUD-EEF 1%: 20.13 -> 34.60Helped
Use semi-supervised S-MolSearch instead of scaffold-cluster self-supervised learning (ablation)S-MolSearch · LIT-PCBAEF 1%: 3.26 -> 6.28Helped
Use semi-supervised S-MolSearch instead of self-supervised pretraining followed by supervised finetuning (ablation)S-MolSearch · DUD-EEF 1%: 29.20 -> 34.60Helped
Use semi-supervised S-MolSearch instead of self-supervised pretraining followed by supervised finetuning (ablation)S-MolSearch · LIT-PCBAEF 1%: 5.71 -> 6.28Helped

Surprising findings

Limitations

Experimental setup

Datasets: ChEMBL v33 Uni-Mol unlabeled molecule corpus (~19M) DUD-E LIT-PCBA

Benchmarks: DUD-E LIT-PCBA

Metrics: AUROC BEDROC EF 0.5% EF 1% EF 5%

Baselines: ROCS Phase Shape LIGSIFT SHAFTS Glide-SP Vina Pafnucy OnionNet Planet DrugCLIP Gnina DeepDTA

Builds on: Uni-Mol InfoNCE inverse optimal transport KoLeo regularizer DrugCLIP

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy