Research map / Architectures and efficiency / Attention and transformers
BEAT: Tokenizing and Generating Symbolic Music by Uniform Temporal Steps
Lekai Qian, Haoyu Gu, Jingwei Zhao, Ziyu Wang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use one-beat step instead of half-beat step (ablation) | BEAT · Piano continuation (LMD+MuseScore) | JS_GC / FMD: 0.060 -> 0.039 JS_GC; 464.4 -> 436.7 FMD | Improved |
| use one-beat step instead of two-beat step (ablation) | BEAT · Piano continuation (LMD+MuseScore) | JS_GC / JS_SC: 0.145 -> 0.039 JS_GC; 0.086 -> 0.021 JS_SC | Improved |
| use relative pitch intervals with descending order instead of descending + absolute (ablation) | BEAT · Piano continuation (LMD+MuseScore) | JS_GC: 0.103 -> 0.039 | Improved |
| use descending instead of ascending order (relative) (ablation) | BEAT · Piano continuation (LMD+MuseScore) | JS_GC: 0.049 -> 0.039 | Improved |
| use deterministic ordering instead of random order (ablation) | BEAT · Piano continuation (LMD+MuseScore) | FMD: 459.5 -> 436.7 | Improved |
| use BEAT sparse pattern encoding instead of naive 128-pitch piano-roll grid (ablation) | BEAT grid · Piano continuation (LMD+MuseScore) | FMD: 582.3 -> 436.7 | Improved |
| replace REMI with BEAT tokenization | 150M Transformer · Stepwise transposition (synthetic) | sequence accuracy (%): 28.28 -> 91.92 | Improved |
| replace REMI with BEAT tokenization | 150M Transformer · Time-shift reconstruction, 2 beats | onset precision (%): 78.0 -> 94.2 | Improved |
| replace REMI with BEAT tokenization | 150M Transformer · Beat interleaving Mixed | sequence accuracy (%): 7.37 -> 10.31 | Improved |
| replace REMI+ with BEAT tokenization | 150M Transformer · Multi-track continuation | JS_SC: .008 -> .009 | No clear effect |
| replace REMI with BEAT tokenization | 150M Transformer · Piano continuation | FMD: 550.9 -> 436.7 | Improved |
| replace AMT-L with BEAT tokenization | 150M Transformer · POP909 (out-of-distribution) | FMD: 402.5 -> 365.9 | Improved |
Closest papers by meaning
- Unifying Symbolic Music Arrangement: Track-Aware Reconstruction and Structured Tokenization (NeurIPS 2025 · similarity 0.89)
- MuPT: A Generative Symbolic Music Pretrained Transformer (ICLR 2025 · similarity 0.89)
- Efficient Fine-Grained Guidance for Diffusion Model Based Symbolic Music Generation (ICML 2025 · similarity 0.87)
- Rubato: Transcribing Piano Music with Timestamps (NeurIPS 2026 · similarity 0.87)
- MIDI-GPT: A Controllable Generative Model for Computer-Assisted Multitrack Music Composition (AAAI 2025 · similarity 0.87)
- Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music Modeling (ICLR 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
