atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Learning Token-Based Representation for Image Retrieval

AAAI 2022 · Vision-language and multimodal › Human and embodied modeling · approach: Composed and text-based image retrieval · 20 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use token-based local feature aggregation with refinementR101-Ours · ROxf, ROxf+R1M, RPar, and RPar+R1M, Medium and HardmAP: 82.28 vs. 81.78; 70.52 vs. 70.17; 89.34 vs. 88.63; 76.66 vs. 76.04; 66.57 vs. 64.77; 55.90 vs. 53.69; 78.56 vs. 76.80; 5Helped
Add a tokenizer to the spatial-pooling baseline (ablation)R101-SPoC baseline · ROxf MediummAP: 77.0 -> 79.8Helped
Add LFSA to the tokenizer model (ablation)Tokenizer model · ROxf MediummAP: 79.8 -> 80.4Helped
Add refinement to the tokenizer model (ablation)Tokenizer model · ROxf MediummAP: 79.8 -> 81.3Helped
Add tokenizer, LFSA, and refinement (ablation)R101-SPoC baseline · ROxf MediummAP: 77.0 -> 82.3Helped
Add self-attention and cross-attention in the refinement block (ablation)Tokenized model · ROxf MediummAP: 80.4 -> 82.3Helped
Add self-attention while retaining cross-attention (ablation)Tokenized model · ROxf MediummAP: 80.9 -> 82.3Helped
Add cross-attention while retaining self-attention (ablation)Tokenized model · ROxf MediummAP: 81.3 -> 82.3Helped
Replace attention tokenizer with VQ-based tokens (ablation)Tokenized model · ROxf MediummAP: 82.3 -> 79.4Hurt
Replace attention tokenizer with learned tokens (ablation)Tokenized model · ROxf MediummAP: 82.3 -> 81.1Hurt
Set the token count to 1, 2, or 3 instead of 4 (ablation)Attention-tokenized model · ROxf MediummAP: 82.3 -> 79.8; 82.3 -> 80.3; 82.3 -> 81.6Hurt
Set the token count to 6 or 8 instead of 4 (ablation)Attention-tokenized model · ROxf MediummAP: 82.3 -> 81.0; 82.3 -> 79.3Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy