AI Paper Atlas

Research map / Optimization / Optimizers

GR-Gauge: Cost-efficient Training Configuration By Gauging the Gradient Redundancy

Guanjie Wang, Chen Chen

CVPR 2026 · Optimization › Optimizers · approach: Memory-efficient LLM optimizers

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add GR-guided early termination, config search and state reuse together (vs prior HPO)GR-Gauge · ResNet18 CIFAR-10time to 85% accuracy: saves 63.6% vs BOHBImproved
GR-Gauge vs HPO baselines at fixed budgetGR-Gauge · BERT SQuAD, 20000sF1 (%): 87.47 vs below 75Improved
GR-Gauge vs BOHB on small budgets for NeuMF and LlamaGR-Gauge · NeuMF 200s, Llama3 low targetsvalidation / time to target: NeuMF 200s: 36.18 vs BOHB 56.94Mixed
add state reuse (ablation)GR-Gauge · ResNet18, BERT, NeuMFtime to target: no-R 1.17x / 3.39x / 1.27x vs 1xImproved
add GR-guided configuration search (ablation)GR-Gauge · ResNet18 / BERT / NeuMFtime to target: no-RS 1.46x / 4.45x / 2.16x vs 1xImproved
add GR-guided early termination (ablation)GR-Gauge · ResNet18 / BERT / NeuMFtime to target: no-RT 1.96x / 7.95x / 2.70x vs 1xImproved
reuse aborted training state instead of restarting from scratch (ablation)GR-Gauge · ResNet18 final accuracyaccuracy (%): 90.75 -> 89.51Hurt
reuse aborted training state instead of restarting from scratch (ablation)GR-Gauge · Llama3 final performancevalidation performance (%): 60.54 -> 60.81No clear effect
check metrics too often (k=1) or too rarely (k=50) (ablation)GR-Gauge · ResNet/NeuMF/Bertrelative GPU timeHurt
compute GR metrics on sampled parameters and per-device GRSGR-Gauge · all five modelsoverhead share of total time: overheads commonly less than 4%Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy