atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

EvoluNet: Advancing Dynamic Non-IID Transfer Learning on Graphs

ICML 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Statistical transfer learning · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes EvoluNet, a framework and generalization bound for dynamic non-IID transfer learning on graphs, combining transformer-based multi-resolution temporal encoding with dual GRL-based domain unification to predict target graph labels at the next timestamp.

Problem

Transfer learning from label-rich dynamic source graphs to label-scarce dynamic target graphs, predicting node labels on the target graph at the incoming timestamp T+1 under evolving domain discrepancy.

Approach

Derives a generalization bound using the minimum historical empirical error and a dynamic Wasserstein graph discrepancy, and implements it as EvoluNet: a transformer temporal encoder with continuous-timestamp positional encoding plus spatial and temporal gradient-reversal domain-invariant losses.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add EvoluNet's dynamic temporal encoding and dual-divergence transfer frameworknode classification on the six graph-transfer benchmarks · Benchmarks 1–6AUC: up to 12.1%Helped
Add pre-training (ablation)EvoluNet · Benchmark 1AUC: $0.5907$ -> $0.6527$Helped
Add pre-training (ablation)EvoluNet · Benchmark 5AUC: $0.7661$ -> $0.7975$Helped
Add pre-training (ablation)EvoluNet · Benchmark 6AUC: $0.7234$ -> $0.8046$Helped
Add module 1 (multi-resolution temporal encoding and attention) (ablation)EvoluNet · Benchmark 1AUC: 0.6487 -> 0.6527Helped
Add module 1 (multi-resolution temporal encoding and attention) (ablation)EvoluNet · Benchmark 5AUC: 0.7682 -> 0.7975Helped
Add module 1 (multi-resolution temporal encoding and attention) (ablation)EvoluNet · Benchmark 6AUC: 0.7303 -> 0.8046Helped
Add spatial unification loss (ablation)EvoluNet · Benchmark 1AUC: 0.6367 -> 0.6527Helped
Add spatial unification loss (ablation)EvoluNet · Benchmark 5AUC: 0.7939 -> 0.7975Helped
Add spatial unification loss (ablation)EvoluNet · Benchmark 6AUC: 0.7985 -> 0.8046Helped
Add temporal unification loss (ablation)EvoluNet · Benchmark 1AUC: 0.6341 -> 0.6527Helped
Add temporal unification loss (ablation)EvoluNet · Benchmark 5AUC: 0.7966 -> 0.7975Helped

Surprising findings

Limitations

Experimental setup

Datasets: DBLP-3 DBLP-5 HCP

Benchmarks: DBLP-3 DBLP-5 HCP

Metrics: AUC

Baselines: GCN GAT GIN GraphSAGE DCRNN DyGrEncoder EvolveGCN TGCN DANN UDAGCN GRADE

Builds on: Wu et al. non-IID transfer learning on graphs (graph discrepancy) dynamic transfer learning bound DANN GRADE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy