atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

Correlation-Induced Label Prior for Semi-Supervised Multi-Label Learning

ICML 2024 · Label-efficient and robust learning › Semi-supervised learning · approach: Confidence-based pseudo-label selection

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes PCLP, a pseudo-labeling method for semi-supervised multi-label learning that uses a structural causal model as a correlation-induced label prior inside a variational label enhancement framework trained with a GAN-style discriminator.

Problem

Semi-supervised multi-label learning with very few labeled multi-label images; reliable label correlation is hard to estimate from minimal labeled data, so prior SSMLL methods fail to exploit inter-label correlation for pseudo-labeling.

Approach

Model the joint label prior with a nonlinear structural causal model over a DAG (edges from chain-rule ordering of labels) and integrate it into a variational label enhancement objective so that pseudo-labels for unlabeled images conform to the learned correlated prior, optimized jointly on labeled and unlabeled data.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use PCLP instead of the strongest reported baselineSSMLL with ResNet-50 · VOC, p=0.05, 0.10, 0.15, 0.20mAP: 75.90 -> 77.25; 81.83 -> 82.21; 83.10 -> 83.72; 84.32 -> 84.59Helped
use PCLP instead of the strongest reported baselineSSMLL with ResNet-50 · COCO, p=0.05, 0.10, 0.15, 0.20mAP: 62.88 -> 64.43; 67.18 -> 69.02; 68.99 -> 70.86; 70.43 -> 71.52Helped
use PCLP instead of the strongest reported baselineSSMLL with ResNet-50 · NUS, p=0.05, 0.10, 0.15, 0.20mAP: 44.99 -> 46.39; 48.70 -> 48.83; 49.99 -> 50.57; 51.37 -> 52.45Helped
add variational inference (VI) for pseudo-label generation (ablation)PCLP · VOC, COCO, and NUS; p=0.05, 0.10, 0.15, 0.20mAP: VOC p=0.05: 75.18 -> 76.38; COCO p=0.05: 62.17 -> 63.38; NUS p=0.05: 44.61 -> 45.44Helped
add SCM-correlated label prior to VI pseudo-label generation (ablation)PCLP · VOC, COCO, and NUS; p=0.05, 0.10, 0.15, 0.20mAP: VOC p=0.05: 76.38 -> 77.25; COCO p=0.05: 63.38 -> 64.43; NUS p=0.05: 45.44 -> 46.39Helped
increase the weight of the unlabeled-data regularization termPCLP · VOC, COCO, and NUSmAPHelped

Surprising findings

Limitations

Experimental setup

Datasets: Pascal VOC 2012 MS-COCO 2014 NUS-WIDE

Benchmarks: Pascal VOC 2012 MS-COCO 2014 NUS-WIDE

Metrics: mAP

Baselines: BCE ASL IAT-1 IAT-K IAT LL-R LL-CT LL-CP PLC ADSH FreeMatch DRML

Builds on: variational label enhancement structural causal model (Yu et al., 2019) FreeMatch CAP instance-aware threshold (IAT)

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy