atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Hyp-OW: Exploiting Hierarchical Structure Learning with Hyperbolic Distance Enhances Open World Object Detection

AAAI 2024 · Detection and segmentation › Open-set and few-shot detection · approach: Open-set and unknown object detection · 16 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Hyp-OW, which learns a hierarchical known-class embedding in hyperbolic space with a SuperClass regularizer and uses hyperbolic centroid distances to relabel unmatched proposals as unknown in open world object detection.

Problem

Open world object detection struggles to identify unknown objects because there is no clear definition of "unknown" and models ignore semantic/hierarchical relations between known and unknown classes, leading to bias toward known labels and confusion with background.

Approach

Learn a hyperbolic embedding of known-class queries with a contrastive loss plus a SuperClass regularizer that groups classes by category, then relabel unmatched proposals as unknown when their hyperbolic distance to a known class centroid is below an adaptive threshold derived from matched known items in the batch.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Hyp-OW instead of PROBDeformable DETR · Hierarchical Split Task 1U-Recall: 29.4 -> 34.9Helped
Use Hyp-OW instead of PROBDeformable DETR · Hierarchical Split Task 2U-Recall: 43.9 -> 47.5Helped
Use Hyp-OW instead of PROBDeformable DETR · Hierarchical Split Task 3mAP: 41.3 -> 44.3Helped
Use Hyp-OW instead of PROBDeformable DETR · OW-DETR Split Task 1U-Recall: +6.3Helped
Use Hyp-OW instead of PROBDeformable DETR · OWOD Split Task 1U-Recall: +4.1Helped
Replace hyperbolic distance with cosine distance (c=0) (ablation)Hyp-OW · Hierarchical Split Task 1U-Recall: 34.9 -> 32.8Hurt
Replace hyperbolic distance with cosine distance (c=0) (ablation)Hyp-OW · Hierarchical Split Task 1mAP: 49.9 -> 49.0Hurt
Vary curvature coefficient to c=0.2 or c=0.5 (ablation)Hyp-OW · Hierarchical Split Task 1U-Recall: 34.9 -> 33.3; 32.3Hurt
Remove the SuperClass Regularizer (ablation)Hyp-OW · Hierarchical Split Task 1U-Recall: 34.9 -> 32.0Hurt
Remove the SuperClass Regularizer (ablation)Hyp-OW · Hierarchical Split Task 1mAP: 49.9 -> 50.0Mixed
Remove Adaptive Relabeling and classify all unmatched queries as unknown (ablation)Hyp-OW · Hierarchical Split Task 1mAP: 49.9 -> 41.2Hurt
Remove Adaptive Relabeling and classify all unmatched queries as unknown (ablation)Hyp-OW · Hierarchical Split Task 1U-Recall: 34.9 -> 34.7No clear effect

Surprising findings

Limitations

Experimental setup

Datasets: PASCAL VOC 2007/2012 MS-COCO OWOD Split OW-DETR Split

Benchmarks: OWOD Split OW-DETR Split Hierarchical Split

Metrics: U-Recall mAP A-OSE

Baselines: ORE-EBUI OW-DETR PROB UC-OWOD OCPL 2B-OCD

Builds on: Deformable DETR OW-DETR PROB DINO Poincare embeddings

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy