AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacy

Zhibo Yang, Jun Tang, Zhaohai Li, Pengfei Wang, Jianqiang Wan, Humen Zhong, Xuejing Liu, Mingkun Yang, Peng Wang, Shuai Bai, Lianwen Jin, Junyang Lin

ICCV 2025 · Vision-language and multimodal › Multimodal LLMs · approach: Interleaved image-text generation with MLLMs · 78 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
generalist LMMs versus specialist OCR modelsMulti-Scene OCR track · CC-OCR Multi-Scene OCRtotal score: 83.25 (Gemini-1.5-Pro) vs 61.00 (best specialist GOT)Improved
evaluate natural scenes instead of documentsLMMs · CC-OCR Multi-Scene OCRscore: about 15% lowerHurt
rotate images by 0, 90, 180 or 270 degreesLMMs · CC-OCR Multi-Scene OCRtotal score: Gemini-1.5-Pro 83.25 -> 79.45; InternVL2-76B 76.92 -> 38.00Hurt
ask for text grounding output instead of recognition onlyLMMs · CC-OCR English multi-scene subsetsscore: Gemini-1.5-Pro 60.98; others below 50Hurt
evaluate multilingual instead of English and Chinese textLMMs · CC-OCR Multilingual OCRscoreHurt
evaluate Arabic, Japanese, Korean, Vietnamese instead of Latin-script languagesLMMs · CC-OCR Multilingual OCRscoreHurt
require structured output (parsing, KIE) instead of plain text recognitionLMMs · CC-OCR Document Parsing and KIEscore: best parsing 62.37, best KIE 71.76Hurt
evaluate handwritten formulasLMMs · CC-OCR Document ParsingscoreHurt
evaluate Chinese instead of English documentsLMMs · CC-OCR Document Parsingscore: Gemini-1.5-Pro about 5% lower on Chinese tablesHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy