AI Paper Atlas

Research map / Video / Video-language understanding

End-to-End Video Text Spotting with Transformer

Weijia Wu, Yuanqiang Cai, Chunhua Shen, Debing Zhang, Ying Fu, Hong Zhou, Ping Luo

IJCV 2024 · Video › Video-language understanding · approach: Dense video captioning · 34 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add multi-oriented box matching (cosine loss) (ablation)TransDETR · ICDAR2015 video detectionF-measure: 61.5 -> 75.0 (+13.5%)Improved
add multi-oriented box matching (cosine loss) (ablation)TransDETR · ICDAR2015 video trackingIDF1: 41.1 -> 65.5 (+24.4%)Improved
add multi-oriented box matching (cosine loss) (ablation)TransDETR · ICDAR2015 video trackingMOTA: 18.4 -> 47.7Improved
use cosine angle loss instead of L1 angle loss (ablation)TransDETR · ICDAR2015 videoIDF1: 63.3 -> 65.5Improved
use cosine angle loss instead of L1 angle loss (ablation)TransDETR · ICDAR2015 videoMOTP: 76.1 -> 74.1Hurt
use query-based temporal tracking loss instead of IoU-based association (ablation)Deformable-DETR text tracker · ICDAR2015 videoIDF1: 56.3 -> 65.5Improved
use query-based temporal tracking loss instead of transcription-based association (ablation)Deformable-DETR text tracker · ICDAR2015 videoIDF1: 56.9 -> 65.5 (+8.6%)Improved
use query-based temporal tracking loss instead of IoU association (ablation)Deformable-DETR text tracker · ICDAR2015 videoMOTP: 75.8 -> 74.1No clear effect
increase input video sequence length from 3 to 6 frames (ablation)TransDETR · ICDAR2015 video trackingIDF1: 61.2 -> 65.5 (4.3%)Improved
increase input video sequence length from 3 to 6 frames (ablation)TransDETR · ICDAR2015 video trackingM-Lost: 34.5 -> 32.1Improved
increase number of decoder layers up to 6 (ablation)TransDETR · ICDAR2015 videoaccuracyImproved
shrink image shorter side below 500 pixels (ablation)TransDETR · ICDAR2015 videoaccuracy: drops at least 5%Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy