Research map / Vision-language and multimodal / Cross-modal learning
ST-Bridge: Bridging Sketch and Text with Large Language Models for Coarse-to-Fine Image Retrieval
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes ST-Bridge, a coarse-to-fine sketch-text image retrieval method that uses large language models to bridge sketch and text modalities.
Problem
Sketch-text image retrieval, which must combine free-hand sketches and text descriptions to find natural images; difficult due to large representational gaps between modalities and matching fine details in complex scenes.
Approach
Uses large language models to bridge sketch and text representations in a coarse-to-fine retrieval pipeline, in contrast to prior simple feature fusion or global alignment approaches.
Closest papers by meaning
- Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex Interactions (AAAI 2024 · similarity 0.90)
- You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval (CVPR 2024 · similarity 0.90)
- ARNet: Self-Supervised FG-SBIR with Unified Sample Feature Alignment and Multi-Scale Token Recycling (AAAI 2025 · similarity 0.88)
- Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers (CVPR 2024 · similarity 0.87)
- O3SLM: Open Weight, Open Data, and Open Vocabulary Sketch-Language Model (AAAI 2026 · similarity 0.87)
- How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval? (CVPR 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
