AI Paper Atlas

Research map / Vision-language and multimodal / CLIP and zero-shot

Towards the Unseen: Iterative Text Recognition by Distilling From Errors

Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song

ICCV 2021 · Vision-language and multimodal › CLIP and zero-shot · approach: Recaptioning and text-supervised pretraining · 24 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add iterative CVAE feedback (t=2)Shi et al. · IAM (disjoint setup)word recognition accuracy: 54.3 -> 64.8Improved
add iterative CVAE feedback (t=2)Shi et al. · RIMES (disjoint setup)word recognition accuracy: 59.7 -> 70.5Improved
add iterative CVAE feedback (t=2)Shi et al. · IC15 (conventional setup)word recognition accuracy: 75.9 -> 78.8Improved
add iterative CVAE feedback (t=2)Show, Attend and Read · IC15 (disjoint setup)word recognition accuracy: 68.4 -> 74.8Improved
add iterative CVAE feedback (t=2)SCATTER · IC15 (disjoint setup)word recognition accuracy: 71.8 -> 77.7Improved
run a third feedback iteration (t=3 instead of t=2) (ablation)Shi et al. + CVAE-Feedback · IC15 (disjoint setup)word recognition accuracy: 72.6 -> 72.5No clear effect
use CVAE feedback instead of deterministic feedbackShi et al. · IC15 (disjoint setup)word recognition accuracy: 70.4 -> 72.6Improved
add auxiliary decoder and error-distribution data to feedback (vs L_C only) (ablation)CVAE-Feedback · IAM (disjoint setup)word recognition accuracy: 59.8 -> 64.8Improved
add monotonically decreasing constraint L_C (ablation)CVAE-Feedback · IAM (disjoint setup)word recognition accuracy: 59.3 -> 64.8Improved
add error distribution data G (ablation)CVAE-Feedback · IAM (disjoint setup)word recognition accuracy: 59.9 -> 64.8Improved
use local instead of global feedback transformation (block 3) (ablation)CVAE-Feedback · IC15 (disjoint setup)word recognition accuracy: 71.4 -> 72.6Improved
apply feedback at ResNet block 3 rather than block 1 (ablation)CVAE-Feedback · IAM (disjoint setup)word recognition accuracy: 61.0 -> 64.8Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy