AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Learning Structural Representations for Recipe Generation and Food Retrieval

Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao

TPAMI 2022 · Vision-language and multimodal › Cross-modal learning · approach: Probabilistic embeddings for cross-modal retrieval · 35 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add SGN tree structure to non-pretrained modelNon-pretrained recipe generator · Recipe1M recipe generationBLEU: 7.23 -> 9.09Improved
add SGN tree structure to TIRG modelTIRG recipe generator · Recipe1M recipe generationBLEU: 7.95 -> 9.24Improved
add SGN tree structure to VAL modelVAL recipe generator · Recipe1M recipe generationBLEU: 8.83 -> 10.43Improved
add SGN tree structure to pretrained BERT modelPretrained recipe generator · Recipe1M recipe generationBLEU: 9.29 -> 12.75Improved
add SGN to pretrained modelPretrained recipe generator · Recipe1M recipe generationPerplexity: 7.52 -> 6.67Improved
add ingredient features (ablation)Pretrained recipe generator · Recipe1M recipe generationBLEU: 3.72 -> 9.29Improved
add image features (ablation)Pretrained recipe generator · Recipe1M recipe generationBLEU: 5.74 -> 9.29Improved
add SGN to improve generated recipe lengthPretrained recipe generator · Recipe1M recipe generationRecipe average length: 66.9 -> 112.5Improved
add tree structure features to retrieval model (ablation)Retrieval model with self-attention LSTM · Recipe1M image-to-recipe retrieval (1k test)R@1: 52.5 -> 53.5Improved
add tree structure features to transformer recipe encoder (ablation)Retrieval model (transformer) · Recipe1M image-to-recipe retrieval (1k test)R@1: 53.4 -> 54.3Improved
use sentence plus depth node features instead of adjacency matrix projection (ablation)Tree feature GAT · Recipe1M image-to-recipe retrieval (1k test)R@1: 52.7 -> 53.5Improved
replace concatenation with TIRG fusion of tree and text features (ablation)Retrieval model (transformer) · Recipe1M image-to-recipe retrieval (1k test)R@1: 54.3 -> 54.7Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy