atlas

Research map / Graph learning / Knowledge and temporal graphs

Less is More: One-shot Subgraph Reasoning on Large-scale Knowledge Graphs

ICLR 2024 · Graph learning › Knowledge and temporal graphs · approach: Logical query answering and rule reasoning · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes one-shot-subgraph link prediction on large KGs: a non-parametric PPR sampler extracts one query-dependent subgraph, then a GNN predictor (DRUM/NBFNet/RED-GNN design space) runs on it, with bi-level BO-based configuration search.

Problem

Structural link prediction models on knowledge graphs do not scale because they propagate over the whole KG for each query, which is infeasible on large KGs and not fixed by vanilla sampling.

Approach

Decouple prediction into one-shot extraction of a single query-dependent subgraph using Personalized PageRank from the query entity, then predict on that subgraph with a GNN; jointly search sampler and predictor configurations via Bayesian optimization with a random forest surrogate.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use one-shot-subgraph prediction instead of the strongest reported baselinelink prediction · WN18RRMRR: 0.551 -> 0.567Helped
use one-shot-subgraph prediction instead of the strongest reported baselinelink prediction · NELL-995MRR: 0.543 -> 0.547Helped
use one-shot-subgraph prediction instead of the strongest reported baselinelink prediction · YAGO3-10MRR: 0.559 -> 0.606Helped
use one-shot-subgraph prediction instead of the strongest reported baselinelink prediction · OGBL-BIOKG testMRR: 0.8348 -> 0.8430Helped
use one-shot-subgraph prediction instead of the strongest reported baselinelink prediction · OGBL-WIKIKG2 testMRR: 0.5794 -> 0.6755Helped
use 8 layers instead of 6 layers, with 10% of entities (ablation)one-shot-subgraph · WN18RRMRR: 0.566 -> 0.567Helped
use 8 layers instead of 4 layers, with 10% of entities (ablation)one-shot-subgraph · WN18RRMRR: 0.523 -> 0.567Helped
use 10% of entities instead of all entities, with 6 layers (ablation)one-shot-subgraph · WN18RRMRR: 0.543 -> 0.566Helped
use PPR sampling instead of Random Walk sampling (ablation)one-shot-subgraph · WN18RRMRR: 0.507 -> 0.567Helped
use PPR sampling instead of BFS sampling (ablation)one-shot-subgraph · WN18RRMRR: 0.543 -> 0.567Helped
add one-shot-subgraph sampling with 10% entities (ablation)NBFNet · WN18RRMRR: 0.551 -> 0.554Helped
add one-shot-subgraph sampling with 10% entities (ablation)RED-GNN · YAGO3-10MRR: 0.559 -> 0.606Helped

Surprising findings

Limitations

Experimental setup

Datasets: WN18RR NELL-995 YAGO3-10 OGBL-BIOKG OGBL-WIKIKG2

Benchmarks: WN18RR NELL-995 YAGO3-10 OGBL-BIOKG OGBL-WIKIKG2

Metrics: MRR Hits@1 Hits@10 training time GPU memory

Baselines: ConvE QuatE RotatE MINERVA DRUM RNNLogic CompGCN DPMPN NBFNet RED-GNN

Builds on: NBFNet RED-GNN DRUM AdaProp NodePiece

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy