AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

NOC-REK: Novel Object Captioning With Retrieved Vocabulary From External Knowledge

Duc Minh Vo, Hong Chen, Akihiro Sugimoto, Hideki Nakayama

CVPR 2022 · Detection and segmentation › Open-set and few-shot detection · approach: Open-vocabulary object detection · 23 citations (OpenAlex)

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use NOC-REK instead of the strongest reported baselineNovel object captioning · Held-out COCO novel classesAvg. F1-score: 57.9 -> 76.3Improved
Use NOC-REK instead of the strongest reported baselineImage captioning · Nocaps validation OverallCIDEr: 94.3 -> 100.9Improved
Use NOC-REK instead of the strongest reported baselineImage captioning · Nocaps test OverallCIDEr: 92.5 -> 93.0Improved
Add second-stage SCST/CIDEr training and the reward for retrieved vocabulary appearing in captions (ablation)NOC-REK* · Held-out COCO novel classesAvg. F1-score: 67.7 -> 76.3Improved
Add second-stage SCST/CIDEr training and the reward for retrieved vocabulary appearing in captions (ablation)NOC-REK* · Held-out COCOCIDEr: 109.3 -> 138.4Improved
Add second-stage SCST/CIDEr training and the reward for retrieved vocabulary appearing in captions (ablation)NOC-REK* · Nocaps validation OverallCIDEr: 82.9 -> 100.9Improved
Add second-stage SCST/CIDEr training and the reward for retrieved vocabulary appearing in captions (ablation)NOC-REK* · Nocaps validation OverallSPICE: 12.0 -> 14.0Improved
Use the full COCO + Nocaps external vocabulary instead of removing 25% at random (ablation)NOC-REK · Nocaps validation OverallCIDEr: 85.8 -> 100.9Improved
Use the full COCO + Nocaps external vocabulary instead of removing 50% at random (ablation)NOC-REK · Nocaps validation OverallCIDEr: 83.0 -> 100.9Improved
Use the full COCO + Nocaps external vocabulary instead of removing 75% at random (ablation)NOC-REK · Nocaps validation OverallCIDEr: 83.2 -> 100.9Improved
Add COCO vocabulary to external knowledge (ablation)NOC-REK without COCO vocabulary · Nocaps validation OverallCIDEr: 82.9 -> 100.9Improved
Add Nocaps vocabulary to external knowledge (ablation)NOC-REK without Nocaps vocabulary · Nocaps validation OverallCIDEr: 82.4 -> 100.9Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy