Research map / Vision-language and multimodal / CLIP and zero-shot
Knowledge-Aware Prompt Tuning for Generalizable Vision-Language Models
Baoshuo Kan, Teng Wang, Wenpeng Lu, Xiantong Zhen, Weili Guan, Feng Zheng
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add knowledge-aware prompts to CoOp baseline (ablation) | CoOp · Base-to-new avg (ViT-B/32) | new-class accuracy (%): 64.02 -> 67.24 | Improved |
| add knowledge-aware prompts to CoOp baseline (ablation) | CoOp · Base-to-new avg (ViT-B/32) | base-class accuracy (%): 79.41 -> 77.70 | Hurt |
| add adaptation head to baseline (ablation) | CoOp · Base-to-new avg (ViT-B/32) | harmonic mean accuracy (%): 70.88 -> 72.11 | Improved |
| combine knowledge prompts with adaptation head (ablation) | KAPT · Base-to-new avg (ViT-B/32) | harmonic mean accuracy (%): 70.88 -> 74.26 | Improved |
| use both discrete and continuous knowledge prompts instead of one (ablation) | KAPT · Unseen classes avg | new-class accuracy (%): 67.53 -> 70.52 (continuous only) | Improved |
| use full KAPT instead of continuous-only prompts (ablation) | KAPT · Unseen classes, per dataset | new-class accuracy (%) | Mixed |
| replace CoCoOp with KAPT on cross-dataset transfer and domain generalization | KAPT · Distribution shift | accuracy (%): 61.25 -> 61.50 (ImageNet source) | No clear effect |
| replace CoCoOp with KAPT | KAPT · Base-to-new, ResNet-50 backbone | harmonic mean accuracy (%): 69.39 -> 69.94 | Improved |
Closest papers by meaning
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024 · similarity 0.92)
- Learning to Learn Better Visual Prompts (AAAI 2024 · similarity 0.91)
- Concept-Guided Prompt Learning for Generalization in Vision-Language Models (AAAI 2024 · similarity 0.91)
- CoPL: Contextual Prompt Learning for Vision-Language Understanding (AAAI 2024 · similarity 0.91)
- PromptKD: Unsupervised Prompt Distillation for Vision-Language Models (CVPR 2024 · similarity 0.90)
- ProAPO: Progressively Automatic Prompt Optimization for Visual Classification (CVPR 2025 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
