atlas

Research map / 3D vision / Face and shape

Doubly Hierarchical Geometric Representations for Strand-based Human Hairstyle Generation

NeurIPS 2024 · 3D vision › Face and shape · approach: Textured mesh generation · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a doubly hierarchical strand-hair representation (DCT low-pass guide curves sampled by k-medoids, then densification and high-frequency DCT refinement) and a VAE-based generator for strand hairstyles.

Problem

Generating realistic strand-based 3D hairstyles, where existing methods sample guide strands on a scalp UV grid and rely on pretrained strand codecs, losing hairstyle detail and suffering from Gibbs oscillations under Fourier decomposition.

Approach

Separate low-frequency guide structure from high-frequency curl/noise using DCT on strand derivatives, select guide strands as k-medoids centres of dense low-pass strands (proven to minimise bidirectional chamfer distance), and train a PVCNN-style dual-branch VAE plus graph-based implicit densification end-to-end.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use k-medoids guide sampling instead of grid sampling, FPS, or k-means + projectionGuide curve extraction · Guide curve extractionbidirectional chamfer distance (CD ×10−4): 0.683; 0.139; 0.116 -> 0.101Helped
Use the proposed representation and off-the-grid architecture instead of grid-based representationsGuide curve VAE · Guide curve reconstructionCD to input sampled strands (×10−4): 1.521; 1.597 -> 0.906Helped
Use learned densification instead of nearest-neighbour upsamplingDensification · VAE-reconstructed guide curvesCD to GT dense hair (×10−4): 0.311 -> 0.209Helped
Generate hairstyles with the proposed method instead of HAARHairstyle generation · All hairstylessubjective rating (1 to 10): 6.106 ± 0.254 -> 6.933 ± 0.237Helped
Use randomly sampled strands instead of k-medoids guide strands (ablation)Guide curve VAE and densification · Low-frequency guide curves and densificationguide-to-GT guide CD (×10−4): 0.906 -> 0.997Hurt
Represent low-pass curves in frequency space instead of spatial space (ablation)Guide curve VAE and densification · Low-frequency guide curves and densificationguide-to-GT guide CD (×10−4): 0.906 -> 1.152Hurt
Use a pretrained off-the-shelf strand codec (ablation)Guide curve VAE and densification · Low-frequency guide curves and densificationguide-to-GT guide CD (×10−4): 0.906 -> 0.966Hurt
Remove graph aggregation from densification (ablation)Densification · Low-frequency guide curves and densificationdense-to-GT dense CD (×10−4): 0.209 -> 0.214Hurt
Use an off-the-shelf strand codec for high-frequency reconstruction (ablation)High-frequency VAE · High-frequency reconstructionMAE: 0.137 -> 0.145Hurt
Set the low-pass frequency threshold to 4 instead of 8 (ablation)Hierarchical hair representation · VAE reconstructionCD (×10−4): 1.010 -> 1.494Hurt
Set the low-pass frequency threshold to 6 instead of 8 (ablation)Hierarchical hair representation · VAE reconstructionCD (×10−4): 1.010 -> 1.122Hurt
Set the low-pass frequency threshold to 10 instead of 8 (ablation)Hierarchical hair representation · VAE reconstructionCD (×10−4): 1.010 -> 1.014No clear effect

Surprising findings

Limitations

Experimental setup

Datasets: 343 synthetic hairstyles from mesh hair cards 26 Blender particle hair projects augmented to 315

Benchmarks: 30 held-out test hairstyles (in-house)

Metrics: bidirectional chamfer distance mean absolute error on high-frequency DCT coefficients user-rated realism score (1-10)

Baselines: GroomGen HAAR Grid-based + strand codec Grid-based sampling Farthest point sampling k-means + projection Nearest-neighbour upsampling

Builds on: PVCNN PointNet SetVAE Strand codec VAE (Wang et al. 2022) Spectral bias / frequency principle

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy