atlas

Research map / Graph learning / GNN architectures

PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication

ICLR 2022 · Graph learning › GNN architectures · approach: Deep graph convolution and simplification · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pipeline inter-partition feature and gradient communication with computationDistributed full-graph GCN training · Reddit, ogbn-products, Yelptraining throughput: 1.72$\times$$\sim$2.16$\times$ across all datasets and different number of partitionsHelped
Pipeline communication without smoothingDistributed full-graph GCN training · Reddit and Yelptest score: 97.11$\pm$0.02 -> 97.12$\pm$0.02; 65.26$\pm$0.02 -> 65.27$\pm$0.01No clear effect
Pipeline communication without smoothingDistributed full-graph GCN training · ogbn-productstest accuracy: 79.14$\pm$0.35 -> 79.06$\pm$0.42Hurt
Add feature-gradient smoothing (ablation)PipeGCN · Reddit (2 partitions)test accuracy: 97.12$\pm$0.02 -> 97.14$\pm$0.03No clear effect
Add feature smoothing (ablation)PipeGCN · ogbn-products (5 partitions)test accuracy: 79.06$\pm$0.42 -> 79.36$\pm$0.38Helped
Add feature smoothing (ablation)PipeGCN · ogbn-products (10 partitions)test accuracy: 78.91$\pm$0.65 -> 79.21$\pm$0.31Helped
Add feature and feature-gradient smoothing together (ablation)PipeGCN · ogbn-products (5 partitions)test accuracy: 79.06$\pm$0.42 -> 78.86$\pm$0.34Hurt
Add smoothing to boundary features or feature gradients (ablation)PipeGCN · training convergenceconvergence speedHelped
Use large smoothing decay rates ($0.7$/$0.95$) (ablation)PipeGCN-GF · ogbn-productstest accuracy over training: $0.7$/$0.95$Hurt
Use a small smoothing decay rate ($0$ to $0.5$) (ablation)PipeGCN-GF · ogbn-productstest accuracy: $0$ $\sim$ $0.5$Helped
Use too-small smoothing decay rate (e.g., 0) (ablation)PipeGCN-GF · ogbn-productsconvergence speed: 0Hurt
Pipeline training with stale boundary features and feature gradientsPipeGCN · ogbn-papers100M (32 GPUs)total training time: 38\%Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy