AI Paper Atlas

Research map / Graph learning / Graph self-supervised learning

Rethinking Tokenizer and Decoder in Masked Graph Modeling for Molecules

Zhiyuan Liu, Yaorui Shi, An Zhang, Enzhi Zhang, Kenji Kawaguchi, Xiang Wang, Tat-Seng Chua

NeurIPS 2023 · Graph learning › Graph self-supervised learning · approach: Molecular graph pretraining · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SimSGT pretraining rather than the strongest listed baselineGINE · MoleculeNet (8 datasets)ROC-AUC (%) average: 74.0 -> 74.4Improved
Use SimSGT pretraining rather than the strongest listed baselineGraphTrans · MoleculeNet (8 datasets)ROC-AUC (%) average: 73.4 -> 75.8Improved
Use SimSGT rather than the strongest listed baselineGTS encoder · QM7MAE: 78.4 -> 75.4Improved
Use SimSGT rather than the strongest listed baselineGTS encoder · QM8MAE: 0.0200 -> 0.0183Improved
Use SimSGT rather than the strongest listed baselineGTS encoder · QM9MAE: 5.75 -> 5.53Improved
Use SimSGT rather than GraphMAE for pretrainingGTS encoder on ZINC15 · ZINC15, 100 pretraining epochspretraining time: 527 min -> 645 minHurt
Use SimSGT rather than Mole-BERT for pretrainingGTS encoder on ZINC15 · ZINC15, 100 pretraining epochspretraining time: 2199 min -> 645 minImproved
replace SimSGT pooling with mean pooling (ablation)SimSGT · MoleculeNet (8 datasets), GTS encoderROC-AUC (%) average: 75.8 -> 75.2Hurt
replace SimSGT pooling with max pooling (ablation)SimSGT · MoleculeNet (8 datasets), GTS encoderROC-AUC (%) average: 75.8 -> 74.5Hurt
replace SimSGT pooling with sum pooling (ablation)SimSGT · MoleculeNet (8 datasets), GTS encoderROC-AUC (%) average: 75.8 -> 74.8Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy