atlas

Research map / 3D vision / 3D generation

Wired Perspectives: Multi-View Wire Art Embraces Generative AI

CVPR 2024 · 3D vision › 3D generation · approach: Feed-forward 3D asset generation and editing · 7 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DreamWire, which optimises 3D Bezier wire curves via score distillation from Stable Diffusion/ControlNet with an MST connectivity loss to generate multi-view wire art from text or scribbles.

Problem

Creating multi-view wire art (static 3D sculptures that show different 2D images from different viewpoints) is hard for novices and prior methods are rule-based, fail to generalise, and need manual conflict resolution; the task also suffers from scarce training examples.

Approach

Represent wire art as cubic 3D Bezier curves rendered via a 2D differentiable Bezier renderer (DiffVG) by projecting control points, optimise them with multi-view score distillation sampling from a latent diffusion model (ControlNet for scribble conditions), and enforce connectivity with a Prim's minimum-spanning-tree loss.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use DreamWire Our-V instead of ShadowArt for visual controlVisual control target sketches · Visual control target sketchesDINO-V2-Base similarity (%): 79.62 -> 69.08Hurt
use DreamWire Our-V instead of MVWA for visual controlVisual control target sketches · Visual control target sketchesDINO-V2-Giant similarity (%): 78.86 -> 72.76Hurt
use DreamWire Our-T for text control instead of ShadowArtText control · Text controlCLIP Score (%): 34.37 -> 37.21Helped
add MST regularization (ablation)DreamWire · Text controlCLIP Score (%): 37.21 -> 36.52Hurt
increase λ in MST regularization (ablation)DreamWire · Text controlCLIP Score and R-PrecisionHurt
increase λ in MST regularization (ablation)DreamWire · Text controlwire connectivity budgetHelped
replace MST regularization with one Bézier curve containing 150 segments (ablation)DreamWire · a simple drawing of a bicyclevisual succinctnessHurt

Surprising findings

Limitations

Experimental setup

Datasets: QuickDraw

Benchmarks: Visual control input sets from ShadowArt and MVWA baselines QuickDraw-derived text prompts

Metrics: CLIP score R-Precision DINO-V2 similarity MST wire budget

Baselines: ShadowArt MVWA (Wire art rule-based method)

Builds on: DreamFusion VectorFusion DiffVG ControlNet SketchDreamer

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy