atlas

Research map / Label-efficient and robust learning / OOD and anomaly detection

EGonc : Energy-based Open-Set Node Classification with substitute Unknowns

NeurIPS 2024 · Label-efficient and robust learning › OOD and anomaly detection · approach: Robust fine-tuning for OOD generalization · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes EGonc, an energy-based open-set node classifier that generates substitute unknown nodes via manifold mixup on graph boundaries and learns an energy-logit OOD class without real open-set data.

Problem

Open-set node classification on graphs: classify known classes and reject unknown-class nodes, where softmax confidence is overconfident on OOD nodes and thresholds are hard to tune.

Approach

Generate substitute unknown nodes by mixing up boundary nodes (inter-class pairs and peripheral nodes with inverted class centers) in GNN hidden space, propagate energy scores over the graph, and train an explicit (C+1)-th unknown logit with cross-entropy, a tailored complement entropy loss, and an energy regularization loss, avoiding threshold tuning.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add EGonc’s full methodGCN open-set node classifier · Near open-set (average of five datasets, u=1, inductive)accuracy: 74.7 -> 76.5Helped
add energy regularization loss l3 (ablation)EGonc with l1 and l2 · Near open-set (average of five datasets, u=1, inductive)macro-F1: 67.6 -> 69.1Helped
add tailored complement entropy loss l2 (ablation)EGonc with l1 · Near open-set (average of five datasets, u=1, inductive)macro-F1: 62.6 -> 67.6Helped
use real far-OOD samples Xfar instead of designed substitutes (ablation)EGonc · Near open-set (average of five datasets, u=1, inductive)accuracy: 76.5 -> 71.2Hurt
generate substitutes with random parent-node mixup Xrand (ablation)EGonc · Near open-set (average of five datasets, u=1, inductive)accuracy: 76.5 -> 73.1Hurt
use inter-class substitutes only, omitting external substitutes (ablation)EGonc · Near open-set (average of five datasets, u=1, inductive)accuracy: 76.5 -> 74.1Hurt
use external substitutes only, omitting inter-class substitutes (ablation)EGonc · Near open-set (average of five datasets, u=1, inductive)accuracy: 76.5 -> 73.6Hurt
use EGonc instead of G2PxyGCN open-set node classifier · Near open-set (average of five datasets, u=1, inductive)accuracy: 74.7 -> 76.5Helped
use EGonc instead of G2PxyGCN open-set node classifier · Far open-set (average: Co_Ci, Ci_DB, DB_Pub)accuracy: 85.1 -> 85.7Helped

Surprising findings

Limitations

Experimental setup

Datasets: Cora Citeseer DBLP PubMed Ogbn_arxiv

Benchmarks: Cora Citeseer DBLP PubMed Ogbn_arxiv

Metrics: accuracy macro-F1

Baselines: GCN_soft GCN_sig GCN_soft_τ GCN_sig_τ Openmax DOC PROSER OpenWGL GNNSAFE G2Pxy

Builds on: GNNSAFE G2Pxy Manifold mixup Complement entropy GCN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy