AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generation

Zechen Bai, Yuta Nakashima, Noa Garcia

ICCV 2021 · Image generation › Text-to-image diffusion · approach: Layout-to-image control · 51 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add topic-parallel decoder instead of topic-conditional decoder (ablation)Ours · SemArt testBLEU-4: 0.9 -> 8.8Improved
add masked-sentence generation and knowledge filling to the topic decoder (vs MScap stylized captioning)Ours (Conditional decoder) · SemArt testBLEU-4: 0.4 -> 8.8Improved
add retrieved Wikipedia knowledge and topic decoder over SAT baselineSAT · SemArt human evaluationRelevance: 1.94 -> 2.29Improved
add retrieved Wikipedia knowledge and topic decoder over SAT baselineSAT · SemArt human evaluationVeracity: 1.30 -> 1.56Improved
add retrieved Wikipedia knowledge and topic decoder over SAT baselineSAT · SemArt human evaluationUnderstandability: 3.62 -> 2.71Hurt
add topic decoder to SAT baselineSAT · SemArt human evaluationForm existence: 0.05 -> 0.33Improved
use original SemArt comment (oracle knowledge) instead of retrieved Wikipedia (ablation)Ours · SemArt human evaluationVeracity: 1.56 -> 1.72Improved
use retrieved SemArt comments instead of retrieved Wikipedia as knowledge source (ablation)Ours · SemArt human evaluationRelevance: 2.29 -> 2.02Hurt
use semi-supervised Guided-LDA topic labels instead of unsupervised LDA (ablation)topic decoder · SemArt topic labelstopic label accuracy: 43.3 -> 51.6Improved
add generated masked sentences to the retrieval query (ablation)knowledge retriever · SemArt knowledge retrieval (150 paintings)Recall@10 (all articles): 45.5 -> 17.5Hurt
add generated masked sentences to the retrieval query (ablation)knowledge retriever · SemArt knowledge retrieval (150 paintings)Recall@1 (all articles): 13.8 -> 5.0Hurt
add parallel-decoder multi-topic method over classic captioningNIC/SAT/Att2in · SemArt testCIDEr: 38.6 -> 9.1Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy