AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

Rainbow Padding: Mitigating Early Termination in Instruction-Tuned Diffusion LLMs

BumJun Kim, Dongjae Jeon, Dueun Kim, Wonje Jeung, Albert No

ICLR 2026 · Large language models › Language, safety and interpretability · approach: Parallel and early-exit decoding · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use Rainbow Padding instead of eos paddingLLaDA-Base SFT · MATH (max_length 1024, 1 block)accuracy: 0.9 -> 34.3Improved
use Rainbow Padding instead of eos paddingLLaDA-Base SFT · GSM8K (max_length 1024, 1 block)accuracy: 40.2 -> 79.6Improved
use Rainbow Padding instead of eos paddingDream-Base SFT · GSM8K (max_length 1024)accuracy: 9.1 -> 77.3Improved
use Rainbow Padding instead of eos paddingLLaDA-Base SFT with 16 blocks · HumanEvalaccuracy: 41.5 -> 39.6Hurt
use Rainbow Padding instead of eos paddingLLaDA-Base SFT · MMLUaccuracy: 64.8 -> 65.3No clear effect
use Rainbow Padding instead of eos paddingLLaDA-Base SFT · HellaSwagaccuracy: 62.5 -> 61.3No clear effect
increase number of semi-AR blocks from 1 to 16 for eos padding (ablation)eos padding LLaDA-Base · MATHaccuracy: 0.9 -> 25.7Improved
increase number of semi-AR blocks from 1 to 16 for Rainbow Padding (ablation)Rainbow Padding LLaDA-Base · MATHaccuracy: 34.3 -> 34.3No clear effect
add single-epoch LoRA Rainbow Padding adaptationLLaDA instruct · MATHaccuracy: 0.1 -> 21.9Improved
add single-epoch LoRA Rainbow Padding adaptationLLaDA instruct · GSM8Kaccuracy: 3.0 -> 72.7Improved
add single-epoch LoRA Rainbow Padding adaptationDream instruct · MATHaccuracy: 0.0 -> 32.4Improved
use 7 pad tokens instead of 1 (ablation)Rainbow Padding LLaDA-Base · GSM8Kaccuracy: 15.9 -> 79.6Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy