atlas

Research map / Video / Video segmentation and tracking

Cross-video Identity Correlating for Person Re-identification Pre-training

NeurIPS 2024 · Video › Video segmentation and tracking · approach: Self-supervised video representation learning · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CION, a cross-video identity-correlating pre-training framework for person ReID that denoises tracklets from internet videos into identities and pre-trains with identity-guided self-distillation, and releases the ReIDZoo model zoo of 32 models.

Problem

Person re-identification pre-training on person images from internet videos is limited to instance-level or single-video tracklet-level invariance, ignoring identity consistency of the same person across different videos.

Approach

Defines a noise concept combining intra-identity consistency and inter-identity discrimination, seeks cross-video identity correlation via progressive multi-level denoising (single-tracklet, short-range single-video, and long-range cross-video with a sliding range and linking relations), then applies an identity-guided DINO-style self-distillation loss contrasting augmented views of images from th

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CION pre-training instead of ISR pre-trainingResNet50-IBN · Market1501 supervised ReIDmAP: 1.0%Helped
Use CION pre-training instead of ISR pre-trainingResNet50-IBN · MSMT17 supervised ReIDmAP: 2.8%Helped
Add identity-level correlating to pre-training (ablation)ResNet50-IBN with CION-AL and MGN · Market1501mAP: 91.4 -> 93.3; 90.9 -> 93.3Helped
Add identity-level correlating to pre-training (ablation)ResNet50-IBN with CION-AL and MGN · MSMT17mAP: 68.2 -> 74.3; 66.7 -> 74.3Helped
Add single-tracklet denoising (ablation)CION progressive multi-level denoising · Market1501 and MSMT17mAPHelped
Add single-video denoising after single-tracklet denoising (ablation)CION progressive multi-level denoising · Market1501 and MSMT17mAPHelped
Add cross-video denoising after single-video denoising (ablation)CION progressive multi-level denoising · Market1501mAP: +0.6%Helped
Add cross-video denoising after single-video denoising (ablation)CION progressive multi-level denoising · MSMT17mAP: +1.9%Helped

Surprising findings

Limitations

Experimental setup

Datasets: SYNTH-PEDES LUPerson UFine6926 Market1501 MSMT17

Benchmarks: Market1501 MSMT17

Metrics: mAP Rank-1

Baselines: LUP LUP-NL PASS ISR DINO TranSSL SOLIDER C-Contrast

Builds on: DINO LUP TransReID ISR PLIP

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy