AI Paper Atlas

Research map / Architectures and efficiency / Pruning and efficient tuning

Low-Rank Ternary Adaptation for Fine-Tuning Transformers

Alexandru-Dragos Manolache, Yunqiang Li, Jan van Gemert

ECCV 2026 · Architectures and efficiency › Pruning and efficient tuning · approach: Efficient ViT adaptation · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add ternary multiplicative Kronecker adapter to ternary SpinQuant backboneLlama-3.2-1B · 9-task zero-shot averageaverage accuracy: 33.2 -> 35.3Improved
add ternary multiplicative adapter to ternary SpinQuant backboneLlama-3.2-1B · WikiText-2perplexity: 86.5 -> 44.6Improved
add ternary multiplicative adapter to ternary SpinQuant backboneLlama-3.2-3B · 9-task zero-shot averageaverage accuracy: 31.9 -> 38.3Improved
add ternary multiplicative adapter to ternary SpinQuant backboneLlama-3.2-3B · WikiText-2perplexity: 45.6 -> 22.3Improved
native ternary adapter versus QLoRA merged and requantized to 1.58-bitLlama-3.2-3B ternary · 9-task zero-shot averageaverage accuracy: 37.5 -> 38.3Improved
native ternary adapter versus QLoRA merged and requantized to 1.58-bitLlama-3.2-3B ternary · WikiText-2perplexity: 22.9 -> 22.3Improved
native ternary adapter versus QLoRA merged and requantized to ternaryternary ViT-B/16 · ImageNet-100top-1 accuracy: 78.9 -> 83.0Improved
merge and requantize QLoRA adapters to ternary instead of keeping 16-bit adapters (ablation)QLoRA on ternary ViT-B/16 · ImageNet-100top-1 accuracy: 85.3 -> 78.9Hurt
add ternary adapter to pre-trained ternary model fine-tuned on GSM8KBitNet b1.58 2B4T · GSM8Kexact match: 60.1 -> 63.0Improved
add ternary adapter to pre-trained ternary model fine-tuned on GSM8KFalcon-E-1B-Instruct · GSM8Kexact match: 52.0 -> 55.1Improved
add ternary adapter to pre-trained ternary model fine-tuned on GSM8KFalcon-E-3B-Instruct · GSM8Kexact match: 65.4 -> 66.4Improved
use balanced initialization instead of normalized initialization (ablation)ternary adapter · Llama-3.2-1B WikiText-2perplexity: 52.0 -> 44.6Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy