AI Paper Atlas

Research map / Label-efficient and robust learning / Knowledge distillation

Weak-to-Strong Generalization via Bregman Bias–Variance Decomposition

Gengze Xu, Wei Yao, Ziqiao Wang, Yong Liu

ICML 2026 · Label-efficient and robust learning › Knowledge distillation · approach: Teacher properties and robustness · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
switch CE to confidence-adaptive CE (CACE)W2S training · HH-RLHF, Qwen-1.8B -> Qwen-14Btest accuracy (%): 66.03 -> 69.20Improved
switch CE to CACEW2S training · HH-RLHF, Qwen-7B -> Qwen-14Btest accuracy (%): 67.90 -> 69.78Improved
switch CE to CACEW2S training · CAI-Harmless, GPT2 -> GPT2-Mediumtest accuracy (%): 93.05 -> 93.44Improved
switch CE to CACEW2S training · CAI-Harmless, Qwen-1.8B -> Qwen-14Btest accuracy (%): 96.03 -> 96.08No clear effect
switch CE to RCEW2S training · CAI-Harmless, Qwen-1.8B -> Qwen-14Btest accuracy (%): 96.03 -> 94.93Hurt
switch CE to RCEW2S training · HH-RLHF, Qwen-7B -> Qwen-14Btest accuracy (%): 67.90 -> 69.13Improved
switch CE to RCEW2S training · CAI-Harmless, GPT2 -> GPT2-Largetest accuracy (%): 93.88 -> 94.55Improved
switch CE to RCE under heavily smoothed (near random) teacher labels, alpha=0.001W2S training · Amazon Polarity label smoothingaccuracyImproved
average multiple weak teachers (ensemble) instead of a single teacherW2S training · Amazon PolarityCE test lossImproved
scale up the strong student capacityW2S training · Amazon Polarity, GPT2 and Qwen familiesbias and variance of CE lossImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy