AI Paper Atlas

Research map / Optimization / Optimizers

MuonBP: Faster Muon via Block-Periodic Orthogonalization

Ahmed Khaled, Kaan Ozkara, Tao Yu, Mingyi Hong, Youngsuk Park

ICLR 2026 · Optimization › Optimizers · approach: Adam convergence and adaptive learning rates · 33 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add periodic full orthogonalization to BlockMuon (MuonBP) (ablation)BlockMuon · 960M validation perplexityvalidation perplexity: 20.29 -> 15.12Improved
add periodic full orthogonalization to BlockMuon (MuonBP) (ablation)BlockMuon · 8B large LRvalidation perplexity: 24.68 -> 12.97Improved
block-periodic orthogonalization instead of full each stepMuon · 1.2Bvalidation perplexity: 14.13 -> 13.78Improved
block-periodic orthogonalization instead of full each stepMuon · 8Bvalidation perplexity: 12.90 -> 12.77Improved
block-periodic orthogonalization instead of full each stepMuon · 8B throughputthroughput (TFLOP/s/GPU): 105.09 -> 113.37Improved
block-periodic orthogonalization instead of full each stepMuon · 960M throughputthroughput (TFLOP/s/GPU): 112.97 -> 113.54No clear effect
use Muon instead of AdamWAdamW · 960Mvalidation perplexity: 22.51 -> 15.33Improved
use Muon instead of AdamWAdamW · 8Bvalidation perplexity: 14.47 -> 12.90Improved
decrease the block period (ablation)MuonBP · 280M FineWeb across TP degreesvalidation lossImproved
use MuonBP instead of DionDion · 160M FineWebmin validation loss: 3.37 -> 3.34Improved
use MuonBP instead of DionDion · 160M throughputthroughput (TFLOP/s/GPU): 45.64 -> 51.40Improved
use MuonBP instead of MuonMuon · 160M FineWebmin validation loss: 3.36 -> 3.34Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy