AI Paper Atlas

Research map / Large language models / Instruction and fine-tuning

LAMDAS: LLM as an Implicit Classifier for Domain-specific Data Selection

Jian Wu, Hang Yu, Bingchang Liu, Yang Wenjie, Peng Di, Jianguo Li, Yue Zhang

AAAI 2026 · Large language models › Instruction and fine-tuning · approach: Fine-tuning generalization and delta compression · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
select CPT data with LAMDAS instead of training on the full 100B-token dataQwen2.5-7B · CPT code benchmarksavg pass@1 (%): 28.7 -> 35.8 (+24.7%)Improved
select CPT data with LAMDAS instead of DsDm (second best)Qwen2.5-7B · CPT code benchmarksavg pass@1 (%): 34.5 -> 35.8Improved
select CPT data with LAMDAS instead of random 15B tokensQwen2.5-0.5B · CPT code benchmarksavg pass@1 (%): 15.4 -> 23.5Improved
use full CPT data instead of random 15B subsetQwen2.5-7B · CPT code benchmarksavg pass@1 (%): 29.6 -> 28.7Hurt
select SFT data with LAMDAS instead of full 1800K dataQwen2.5-32B-Instruct · SFT code benchmarksavg pass@1 (%): 57.5 -> 69.0 (+20.0%)Improved
select SFT data with LAMDAS instead of LESSQwen2.5-32B-Instruct · SFT code benchmarksavg pass@1 (%): 66.2 -> 69.0Improved
select SFT data with LAMDAS instead of DSIR (n-gram similarity)Qwen2.5-7B-Instruct · SFT code benchmarksavg pass@1 (%): 37.6 -> 44.6Improved
use random 750K SFT subset instead of base modelQwen2.5-7B-Instruct · SFT code benchmarksavg pass@1 (%): 29.8 -> 35.0 vs LAMDAS 44.6; relative to Full 37.3, -0.6%Hurt
use selection threshold tau=1 (ablation)LAMDAS · data selection sensitivitydownstream performanceImproved
use prefix length 30 (ablation)LAMDAS · data selection sensitivitydownstream performanceImproved
use small classifier LLM (0.5B) for selection (ablation)LAMDAS · data selection efficiencyselection time: 5s/100 samples vs DsDm 7s/100, LESS 12.5s/100Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy