atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

BigGait: Learning Gait Representation You Want by Large Vision Models

CVPR 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Dense features and foundation priors · 58 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes BigGait, which replaces task-specific supervised upstream models in gait recognition with a frozen self-supervised DINOv2 and a Gait Representation Extractor (mask, appearance, denoising branches) feeding a modified GaitBase.

Problem

Gait recognition relies on task-specific supervised upstream models (segmentation, parsing, pose, SMPL) that are costly to annotate and introduce error accumulation, restricting gait representations to predetermined forms.

Approach

Derive implicit gait representations directly from all-purpose features of a frozen self-supervised large vision model (DINOv2) using unsupervised mask learning, a parsing-like appearance branch, and a denoising branch with smoothness and diversity soft constraints, instead of supervised silhouettes or parsing.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use BigGait instead of SkeletonGait++CCPG · CCPGrank-1 accuracy (mean): 83.7 -> 87.2Helped
Add Pad-and-Resize (ablation)BigGait · CCPGrank-1 accuracy (CL): 70.5 -> 76.0Helped
Add the GRE module (ablation)BigGait · CCPGrank-1 accuracy (CL): 55.6 -> 76.0Helped
Add the mask branch (ablation)BigGait · CCPGrank-1 accuracy (CL): 70.5 -> 76.0Helped
Add the denoising branch (ablation)BigGait · CCPGrank-1 accuracy (CL): 66.1 -> 76.0Helped
Add the appearance branch (ablation)BigGait · CCPGrank-1 accuracy (CL): 65.1 -> 76.0Helped
Use the GRE branches instead of feeding the foreground mask directly (ablation)BigGait · CCPGrank-1 accuracy (CL): 36.7 -> 76.0Helped
Add smoothness and diversity losses to the denoising branch (ablation)BigGait · CCPGrank-1 accuracy (CL): 69.1 -> 76.0Helped
Add the diversity loss (ablation)BigGait denoising branch with smoothness loss · CCPGrank-1 accuracy (CL): 68.8 -> 76.0Helped
Add the smoothness loss (ablation)BigGait denoising branch with diversity loss · CCPGrank-1 accuracy (CL): 74.5 -> 76.0Helped
Increase denoising branch dimension from 8 to 16 (ablation)BigGait · CCPGrank-1 accuracy (CL): 72.8 -> 76.0Helped
Reduce denoising branch dimension from 32 to 16 (ablation)BigGait · CCPGrank-1 accuracy (CL): 68.5 -> 76.0Helped

Surprising findings

Limitations

Experimental setup

Datasets: CCPG CASIA-B* SUSTech1K

Benchmarks: CCPG CASIA-B* SUSTech1K

Metrics: rank-1 accuracy

Baselines: GaitSet GaitBase GaitPart DeepGaitV2 SkeletonGait++ GaitEdge AP3D PSTA PiT Gait-TR

Builds on: DINOv2 GaitBase GaitSet SAM

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy