Research map / Optimization / Distributed and compressed
BML: A High-performance, Low-cost Gradient Synchronization Algorithm for DML Training
Songtao Wang, Dan Li, Yang Cheng, Jinkun Geng, Yanshu Wang, Shuai Wang, Shu-Tao Xia, Jianping Wu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| run BML on BCube instead of PS on Fat-Tree | LeNet-5 distributed training · MNIST, sub-minibatch 128-1024 | job completion time: 18.7%∼56.4% reduction | Improved |
| run BML on BCube instead of PS on Fat-Tree | VGG-19 distributed training · ImageNet, sub-minibatch 4-64 | job completion time: 29.2%∼52.1% reduction | Improved |
| smaller sub-minibatch size per server | BML vs Fat-Tree · LeNet-5 | JCT gap between BML and Fat-Tree | Improved |
Closest papers by meaning
- AutoSync: Learning to Synchronize for Data-Parallel Distributed Deep Learning (NeurIPS 2020 · similarity 0.87)
- A Quadratic Synchronization Rule for Distributed Deep Learning (ICLR 2024 · similarity 0.87)
- HyperPrism: An Adaptive Non-linear Aggregation Framework for Distributed Machine Learning over Non-IID Data and Time-varying Communication Links (NeurIPS 2024 · similarity 0.85)
- Towards a Better Theoretical Understanding of Independent Subnetwork Training (ICML 2024 · similarity 0.84)
- Fault Tolerant ML: Efficient Meta-Aggregation and Synchronous Training (ICML 2024 · similarity 0.84)
- Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training (NeurIPS 2025 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
