atlas

Research map / 3D vision / 3D generation

MV2Cyl: Reconstructing 3D Extrusion Cylinders from Multi-View Images

NeurIPS 2024 · 3D vision › 3D generation · approach: Learning 3D reconstruction from images · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Reconstructs sketch-extrude CAD models (extrusion cylinders) directly from multi-view images by learning 2D U-Net segmentation priors for surfaces and curves, lifting them into TensoRF-based neural fields, and recovering CAD parameters.

Problem

Recovering sketch-extrude CAD structure (extrusion cylinders with 2D sketches and extrusion parameters) from multi-view images rather than raw 3D point clouds, which prior methods require as input.

Approach

Combine 2D U-Net segmentation of extrusion surfaces (instance and start/end/barrel) and base-curve segmentation, integrate both into separate neural fields (TensoRF-based density and semantic fields), and jointly use surface and curve information to estimate axis, sketch, height, and center, since surfaces give robust axes and curves handle occlusion and sketches.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add curve-field reconstruction to surface-only reconstruction (ablation)MV2Cyl · Fusion360Fit Glob.: 0.0353 -> 0.0212Helped
Add surface-field reconstruction to curve-only reconstruction (ablation)MV2Cyl · Fusion360Fit Glob.: 0.0232 -> 0.0212Helped
Use a shared U-Net instead of separate curve and surface U-Nets (ablation)MV2Cyl · Fusion360Fit Glob.: 0.0212 -> 0.0200Helped
Reduce input views from 50 to fewer views (ablation)MV2Cyl · Fusion360Fit Glob.: 0.0212 -> 0.0218; 0.0259; 0.0364Hurt
Change curve-map line width from 5 pixels to 2.5 or 7.5 pixels (ablation)MV2Cyl · Fusion360Fit Glob.: 0.0212 -> 0.0216; 0.0225Mixed
Use both surface and curve representations rather than either alone (ablation)MV2Cyl · Fusion360Fit Cyl.: 0.0984 -> 0.0284; 0.0310 -> 0.0284Helped
Reduce the number of input images from 50 to 25, 15, or 10 (ablation)MV2Cyl · Fusion360E.A. (°): 1.3939 -> 1.4631; 2.1548; 2.2585Hurt
Use 2.5-pixel or 7.5-pixel curve-map line width instead of 5 pixels (ablation)MV2Cyl · Fusion360E.A. (°): 1.3939 -> 1.4886; 1.4375Mixed

Surprising findings

Limitations

Experimental setup

Datasets: Fusion360 DeepCAD

Benchmarks: Fusion360 DeepCAD

Metrics: extrusion axis error extrusion center error extrusion height error per-cylinder fitting loss global fitting loss

Baselines: Point2Cyl NeuS2+Point2Cyl Curve+Point2Cyl SECAD-Net

Builds on: Point2Cyl NEF TensoRF NeuS2 IGR

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy