Research map / 3D vision / Face and shape
3D Guided Fine-Grained Face Manipulation
Zhenglin Geng, Chen Cao, Sergey Tulyakov
Check your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use the proposed 3D-guided, disentangled texture-and-shape approach rather than GANimation | Face manipulation · FaceWarehouse test set | ACD: 0.5595 -> 0.5107 | Improved |
| Use the proposed 3D-guided, disentangled texture-and-shape approach rather than StarGAN | Face manipulation · FaceWarehouse test set | ACD: 0.5981 -> 0.5107 | Improved |
| Use the proposed 3D-guided, disentangled texture-and-shape approach rather than texture mapping | Face manipulation · FaceWarehouse test set | ACD: 0.6194 -> 0.5107 | Improved |
| Use the proposed method rather than texture mapping | Face manipulation · FaceWarehouse test set | User preference: 69.8 / 30.2 | Improved |
| Use the proposed method rather than StarGAN | Face manipulation · FaceWarehouse test set | User preference: 86.8 / 13.2 | Improved |
| Use the proposed method rather than GANimation | Face manipulation · FaceWarehouse test set | User preference: 86.2 / 13.8 | Improved |
| Compare synthesized images with ground-truth images | Face manipulation · Ground-truth comparison | User preference: 53.4 / 46.6 | Mixed |
| Add the learned shape branch to the linear blendshape mesh (ablation) | Face mesh generation · Face mesh | RMSE (mm): 2.2158 -> 1.7619 | Improved |
| Condition on spatial geometry maps instead of directly appending expression coefficients (ablation) | Texture branch · Rare facial expressions in CFD | Appearance fidelity | Improved |
| Add the pair-consistency and identity losses (ablation) | Texture branch · Face texture synthesis | Texture fidelity | Improved |
| Add the perceptual loss (ablation) | Texture branch · Face texture synthesis | Texture fidelity | Improved |
Closest papers by meaning
- PuppetGAN: Cross-Domain Image Manipulation by Demonstration (ICCV 2019 · similarity 0.88)
- MaskGAN: Towards Diverse and Interactive Facial Image Manipulation (CVPR 2020 · similarity 0.87)
- Text-conditional Attribute Alignment across Latent Spaces for 3D Controllable Face Image Synthesis (CVPR 2024 · similarity 0.87)
- Text-Guided 3D Face Synthesis - From Generation to Editing (CVPR 2024 · similarity 0.86)
- Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularization (ICML 2024 · similarity 0.86)
- LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example (CVPR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
