AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Graph Reinforcement Learning for Network Control via Bi-Level Optimization

Daniele Gammelli, James Harrison, Kaidi Yang, Marco Pavone, Filipe Rodrigues, Francisco C. Pereira

ICML 2023 · Reinforcement learning › Visual and representation RL · approach: RL for combinatorial routing · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Bi-level formulation (RL outputs desired next state, LCP computes flows) instead of end-to-end RL (ablation)SCIM and DVR problems · SCIM 1F2S, 1F3S, 1F10S; DVR New York, Shenzhen% of oracle profit: e.g. 1F2S 96.8% vs 95.8% (GNN end-to-end); DVR NY 94.9% vs 17.2%Improved
Use MPNN (max aggregation) backbone instead of GCN/GAT/MLP within bi-level policy (ablation)Minimum cost flow · Minimum cost flow, all scenarios% of oracle performance: MPNN 89.7% vs GCN 31.3% on 2-hops; avg 86.7% vs othersImproved
Distance term to desired next state included in inner problem (vs greedy one-step argmin of reward only) (ablation)SCIM and DVR · SCIM 1F2S/1F3S/1F10S; DVR NY/Shenzhenreward / served demand: SCIM 1F2S reward -102,919 to 192; DVR NY served demand 1,357 to 1,824Improved
Bi-level MPNN policy vs S-type order-up-to heuristicSCIM · SCIM 1F2S, 1F3S, 1F10S% of oracle profit: 96.8% vs 75.5% (1F2S); 96.0% vs 84.2% (1F3S); 99.5% vs 86.4% (1F10S)Improved
Bi-level graph-RL vs evenly-balanced domain heuristic for vehicle rebalancingDVR · New York, Shenzhen% of oracle profit: 94.9% vs 71.6% (NY); 83.8% vs 50.1% (Shenzhen)Improved
GNN-based backbone vs MLP in bi-level policy, dynamic topology (ablation)Minimum cost flow dynamic topology · Dynamic topology% of oracle performance: MPNN 83.9% vs GCN 53.4%; MLP-RL not applicable (N/A)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy