AI Paper Atlas

Research map / Vision-language and multimodal / CLIP and zero-shot

Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting

Chuhui Xue, Wenqing Zhang, Yu Hao, Shijian Lu, Philip H. S. Torr, Song Bai

ECCV 2022 · Vision-language and multimodal › CLIP and zero-shot · approach: CLIP training recipes and data curation · 43 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add oCLIP weak pretraining on LSVTDB · ICDAR2019-LSVT detectionF-score: 73.4 -> 75.8Improved
add oCLIP weak pretraining on LSVTPSENet · ICDAR2019-LSVT detectionF-score: 74.6 -> 77.1Improved
add oCLIP weak pretraining on LSVTMask TextSpotter-V3 · ICDAR2019-LSVT spottingE2E F-score: 27.7 -> 32.5Improved
pretrain with oCLIP instead of no pretrainingPSENet · Total-TextF-score: 78.3 -> 85.5Improved
use oCLIP pretraining instead of SynthText-trained baselinePSENet · Total-TextF-score: 82.6 -> 85.5Improved
use oCLIP instead of STKM pretraining on the same dataPSENet · Total-TextF-score: 82.2 -> 85.5Improved
use oCLIP instead of STKM pretraining on the same dataPSENet · CTW1500F-score: 81.5 -> 82.8Improved
pretrain on 40M automatically extracted web images instead of SynthTextPSENet+oCLIP · Total-TextF-score: 85.5 -> 87.0Improved
annotate 100% instead of 25% of text instances in pretraining (ablation)PSENet+oCLIP · Total-TextF-score: 84.8 -> 85.5No clear effect
add oCLIP pretrainingDB-RN50 · Total-TextF-score: 78.2 -> 84.1Improved
add oCLIP pretrainingDB-RN50 · ICDAR2015F-score: 80.9 -> 85.4Improved
add oCLIP pretrainingMask TextSpotter-V3 · ICDAR2015 spotting (G lexicon)E2E accuracy: 74.2 -> 74.3No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy