atlas

Research map / Optimization / Distributed and compressed

Exponential Quantum Communication Advantage in Distributed Inference and Learning

NeurIPS 2024 · Optimization › Distributed and compressed · approach: Gradient quantization and sparsification · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Shows that distributed inference and gradient estimation for a class of quantum-encoded (pipelined) models, including a quadratic graph neural network variant, admit exponential quantum communication advantage over classical randomized communication, and reports SIGN-based experiments on node and graph classification.

Problem

Reducing communication cost of distributed inference and gradient-based training for large models split across devices, by using quantum communication instead of classical bits.

Approach

Encodes data into quantum states passed between parties in a pipelined parameterized quantum circuit; gradient estimation reduces to shadow tomography with threshold search, giving polylogarithmic qubit communication, while classical lower bounds from communication complexity (Hidden Matching-type and boolean hidden partition problems) show an exponential gap for quadratic graph networks.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace PReLU with a degree-2 polynomial (ablation)SIGN · ogbn-products node classificationaccuracy: 79.48 $\pm$ 0.07 -> 78.51 $\pm$ 0.05Hurt
replace PReLU with a degree-2 polynomial (ablation)SIGN · Reddit node classificationaccuracy: 96.55 $\pm$ 0.02 -> 96.31 $\pm$ 0.03Hurt
replace PReLU with a degree-2 polynomial (ablation)SIGN · Cora node classificationaccuracy: 78.84 $\pm$ 0.37 -> 78.69 $\pm$ 0.26Hurt
replace PReLU with a degree-2 polynomial (ablation)SIGN · ogbn-products decision problemaccuracy: 84.39 $\pm$ 1.73 -> 83.70 $\pm$ 1.48Hurt
replace PReLU with a degree-2 polynomial (ablation)SIGN · Reddit decision problemaccuracy: 90.33 $\pm$ 0.33 -> 89.37 $\pm$ 0.60Hurt
replace PReLU with a degree-2 polynomial (ablation)SIGN · Cora decision problemaccuracy: 88.10 $\pm$ 5.61 -> 87.14 $\pm$ 3.92Hurt

Surprising findings

Limitations

Experimental setup

Datasets: ogbn-products Reddit Cora MUTAG PTC NCI1 PROTEINS COLLAB IMDB-BINARY IMDB-MULTI REDDIT-BINARY REDDIT-MULTI

Benchmarks: ogbn-products Reddit Cora MUTAG PTC NCI1 PROTEINS COLLAB IMDB-M REDDIT-M

Metrics: test accuracy validation accuracy

Baselines: GIN DropGIN DGCNN U2GNN HGP-SL WKPI SIGN (PReLU)

Builds on: SIGN shadow tomography parameter shift rule pipelining

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy