AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Instant 3D Human Avatar Generation using Image Diffusion Models

Nikos Kolotouros, Thiemo Alldieck, Enric Corona, Eduard Gabriel Bazavan, Cristian Sminchisescu

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Multi-subject personalization · 16 citations (OpenAlex)

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
feed dense GHUM body pose and shape rendering into the 3D reconstruction network (ablation)AvatarPopUp 3D reconstruction · 100 prompts with random pose and shapeChamfer distance to GHUM mesh: 8.6 -> 1.4Improved
fine-tune only encoder convolutional layers instead of the whole diffusion network (ablation)Latent Diffusion text-to-image model · text prompts with unseen garmentsdiversity and text alignment (qualitative)Improved
generate a back view with a diffusion model before 3D liftingsingle-image 3D reconstruction · held-out scansFID color back: 40.8 -> 20.0 vs retrained PHORHUMImproved
use AvatarPopUp instead of retrained PHORHUM on 3D geometry metricssingle-image 3D reconstruction · held-out scansChamfer distance: 0.84 -> 0.91No clear effect
use feed-forward AvatarPopUp instead of optimization-based text-to-3DDreamHuman and TADA · text-to-3D human generationCLIP R-Precision and runtime: runtime 8h -> ~10s; R-Prec 0.68 -> 0.62Mixed
use 5 DDIM steps and 256^3 marching cubes instead of 50 steps and 512^3 (ablation)AvatarPopUp · text-to-3D human generationCLIP R-Precision (Color): 0.62 -> 0.58; runtime ~10s -> ~2sMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy