atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Domain Separation Graph Neural Networks for Saliency Object Ranking

CVPR 2024 · Detection and segmentation › Open-set and few-shot detection · approach: Cross-domain translation and pose · 6 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DSGNN, a domain-separation graph neural network for saliency object ranking that builds separate shape and texture object graphs with multi-dimensional edges and a cross-image saliency subspace, reaching SOTA on ASSR and IRSR.

Problem

Saliency object ranking (SOR) needs to rank the saliency degrees of multiple objects in an image, but prior methods do not explicitly model saliency-related relationships between objects' shapes and textures, nor share saliency structure across images, and use single-value graph edges.

Approach

Separately extract shape and texture graphs over object queries, disentangle saliency-relevant from irrelevant subspaces via GNN encoders with difference/similarity/reconstruction losses (STGDS), add a cross-image graph module (CIGDS) for a unified saliency-level representation, and learn multi-dimensional edge features with GGCN.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use DSGNN with Swin-L instead of IRSRDSGNN · IRSR testSA-SOR: 0.565 -> 0.606Helped
Add texture information to shape-only features (ablation)DSGNN · ASSR ablationSOR: 0.835 -> 0.836Helped
Add the STGDS shape branch (ablation)DSGNN · ASSR ablationSA-SOR: 0.744 -> 0.755Helped
Add the STGDS texture branch (ablation)DSGNN · ASSR ablationSA-SOR: 0.744 -> 0.758Helped
Add the CIGDS module (ablation)DSGNN · ASSR ablationSA-SOR: 0.759 -> 0.761Helped
Combine similarity, difference, and reconstruction losses (ablation)STGDS · ASSR ablationSA-SOR: 0.753 -> 0.761Helped
Combine similarity and difference losses (ablation)STGDS · ASSR ablationSA-SOR: 0.746 -> 0.758Helped
Combine similarity and reconstruction losses (ablation)STGDS · ASSR ablationSA-SOR: 0.746 -> 0.756Helped
Combine difference and reconstruction losses (ablation)STGDS · ASSR ablationSA-SOR: 0.750 -> 0.753Helped
Combine similarity and difference losses (ablation)CIGDS · ASSR ablationMAE: 0.050 -> 0.047Helped
Replace MLP with GGCN (ablation)DSGNN graph modules · ASSR ablationMAE: 0.052 -> 0.049Helped
Use multi-dimensional edges instead of standard GGCN edges (ablation)GGCN · ASSR ablationMAE: 0.049 -> 0.047Helped

Surprising findings

Limitations

Experimental setup

Datasets: ASSR IRSR MS-COCO SALICON

Benchmarks: ASSR IRSR

Metrics: MAE SOR SA-SOR

Baselines: RSDNet ASSR IRSR SOR OCOR S4Net BASNet CPD-R SCRN

Builds on: Mask2Former GGCN ASSR IRSR Domain Separation Networks

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy