AI Paper Atlas

Research map / 3D vision / 3D generation

UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generation

Zexiang Liu, Yangguang Li, Youtian Lin, Xin Yu, Sida Peng, Yan-Pei Cao, Xiaojuan Qi, Xiaoshui Huang, Ding Liang, Wanli Ouyang

ECCV 2024 · 3D vision › 3D generation · approach: Text-to-3D scene generation · 40 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train a diffusion model on albedo and normal maps and generate PBR materials with fixed albedo (UniDream) instead of RGB-based text-to-3DUniDream · Text-to-3D (68 prompts)CLIP Score: 75.7 -> 77.9 (vs MVDream)Improved
use UniDream pipeline instead of MVDreamUniDream · Text-to-3D (68 prompts)CLIP R-Precision R@1 (%): 76.8 -> 80.3Improved
use UniDream instead of MVDream in user studyUniDream · Text-to-3D user studypreference (%): 32.1 -> 50.3Improved
add normal supervision in SDS and reconstruction modelUniDream · qualitativegeometry completenessImproved
optimize roughness and metallic with fixed albedo and normal, using Stable Diffusion SDS and learnable ambient light, instead of Fantasia3DPBR stage · qualitativelight-texture disentanglementImproved
train multi-view diffusion on albedo and normal instead of RGB (AN-MVM vs MVDream)multi-view diffusion · qualitativelight/texture disentangling and normal consistencyImproved
mix 30% 2D LAION-Aesthetics data into multi-view trainingAN-MVM · text-image semantic alignmentsemantic alignmentImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy