AI Paper Atlas

Research map / Large language models / Instruction and fine-tuning

PriFT: Prior-Support Guided Token Reweighting for Supervised Fine-Tuning

Ke Wang, Shuangqi Li, Mathieu Salzmann, Pascal Frossard

NeurIPS 2026 · Large language models › Instruction and fine-tuning · approach: Fine-tuning for reasoning data

Read the paper

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes PriFT, a token-reweighted SFT method that uses prior (pretrained-model) support to weight training tokens, aiming to improve SFT generalization toward RL-level performance.

Problem

SFT fits fixed demonstrations token by token, including targets poorly aligned with the pretrained model's distribution, leading to weaker generalization than RL.

Approach

Uses prior-support information from the pretrained model to reweight tokens during SFT, extending recent token-reweighted SFT methods that assign larger weights to tokens the model already favors.

Experimental setup

Baselines: standard SFT token-reweighted SFT methods reinforcement learning

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy