AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Interaction Compass: Multi-Label Zero-Shot Learning of Human-Object Interactions via Spatial Relations

Dat Huynh, Ehsan Elhamifar

ICCV 2021 · Detection and segmentation › Open-set and few-shot detection · approach: Human-object interaction detection · 12 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add cross-attention (relational directions) on top of visual queries (ablation)ICompass · HICO (Setting 1: A1∪B2)mAP: boosts the performance by 1%Improved
add cross-attention (relational directions) on top of visual queries (ablation)ICompass · HICO (Setting 2: A1)mAP: doubles the improvementsImproved
add visual query refinement shared between action and object queries (vs independent queries in LESA) (ablation)ICompass · HICOmAPImproved
increase input resolution from 224x224 to 544x544ICompass · HICO (Setting 1: A1∪B2) unseenmAP: 19.8 -> 24.4Improved
increase input resolution from 224x224 to 544x544ICompass · HICO (Setting 2: A1) unseenmAP: 8.9 -> 10.8Improved
add relational spatial scores to dual attention (ablation)Dual Attention · HICO (Setting 1: A1∪B2) unseenmAP: 19.1 -> 24.4Improved
add a learned dependency score from concatenated features and locations (Combined Attention) to Dual Attention (ablation)Dual Attention · HICO (Setting 1: A1∪B2) unseenmAP: 19.1 -> 14.3Hurt
replace GCNCL's external-knowledge classifiers with decoupled action/object scoresGCNCL · HICO (Setting 1: A1∪B2) allmAP: 21.4 -> 25.9Improved
replace Fast0Tag with ICompass on unseen interactionsFast0Tag · Visual Genome (Setting 1) unseenR@10: 49.1 -> 57.0Improved
add ICompass relational directions to LESA for localizationLESA · HICO-DET localization (Setting 1, action & object)mAP: 13.0 -> 17.9Improved
use only action-based relational directions (w2 grows to 0.8, object-based w1 to 0.0) (ablation)ICompass · HICO-DETlearned weights: w1 = 0.0, w2 = 0.8No clear effect
compare ICompass to Fast0Tag on all interactions in Visual GenomeICompass · Visual Genome (Setting 1) allmAP: 7.8 -> 8.8Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy