AI Paper Atlas

Research map / Vision-language and multimodal / CLIP and zero-shot

$\pi$-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation

Chengyue Wu, Teng Wang, Yixiao Ge, Zeyu Lu, Ruisong Zhou, Ying Shan, Ping Luo

ICML 2023 · Vision-language and multimodal › CLIP and zero-shot · approach: Parameter-efficient visual tuning · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Interpolate target adapter with experts retrieved from similar tasksAdapter · Vision tasks (8 datasets), 16-shotAVG accuracy: +4.55%Improved
Interpolate target adapter with experts retrieved from similar tasksAdapter · GLUE, zero-shotAVG: +6.05Improved
Interpolate similar-task adaptersAdapter · GLUE, full data on T5-BaseAVG: +1.75Improved
Use π-tuning with prompt expertsPrompt Tuning · RefCOCO, RefCOCO+, and RefCOCOgaccuracy: +1.94% average accuracyImproved
Use π-tuning with LoRA expertsLoRA · RefCOCO, RefCOCO+, and RefCOCOgaccuracy: +4.20% average accuracyImproved
Randomly initialize auxiliary experts instead of initializing from trained similar-task experts (ablation)π-Adapter · RefCOCO valACC@0.5: 89.95 vs 90.49Hurt
Tune only interpolation weights instead of tuning both expert parameters and weights (ablation)π-Adapter · RefCOCO valACC@0.5: 90.67 vs 90.49Hurt
Increase the number of auxiliary experts beyond the best-performing count (ablation)π-Tuning · RefCOCO, RefCOCO+, and RefCOCOgaccuracyMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy