atlas

Research map / 3D vision / 3D generation

C^2RV: Cross-Regional and Cross-View Learning for Sparse-View CBCT Reconstruction

CVPR 2024 · 3D vision › 3D generation · approach: 2D-to-3D pretrained representations · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes C2RV, a DIF-Net-based implicit-field framework for sparse-view CBCT reconstruction that adds multi-scale 3D volumetric features and scale-view cross-attention to aggregate voxel- and pixel-aligned features.

Problem

Sparse-view cone-beam CT reconstruction from few 2D projections performs poorly on complicated anatomies, because prior implicit-neural-representation methods use only local pixel-aligned features and treat all views equally.

Approach

Back-project multi-scale 2D encoder features into explicit 3D volumes (MS-3DV) to enable cross-regional learning, and aggregate multi-scale voxel-aligned and multi-view pixel-aligned features with a scale-view cross-attention module that adaptively weights views and scales.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace DIF-Net with C2RVDIF-Net · LUNA16 chest CT, 6-ViewPSNR (dB): 25.55 -> 29.23Helped
replace DIF-Net with C2RVDIF-Net · LUNA16 chest CT, 8-ViewPSNR (dB): 26.09 -> 29.95Helped
replace DIF-Net with C2RVDIF-Net · LUNA16 chest CT, 10-ViewPSNR (dB): 26.67 -> 30.70Helped
replace DIF-Net with C2RVDIF-Net · Lin et al. knee CBCT, 6-ViewPSNR (dB): 27.12 -> 29.73Helped
replace DIF-Net with C2RVDIF-Net · Lin et al. knee CBCT, 8-ViewPSNR (dB): 28.31 -> 30.68Helped
replace DIF-Net with C2RVDIF-Net · Lin et al. knee CBCT, 10-ViewPSNR (dB): 29.33 -> 31.55Helped
add MS-3DV (ablation)DIF-Net · LUNA16 chest CT, 6-ViewPSNR (dB): 25.55 -> 26.62Helped
replace MLP aggregation with SVC-Att (ablation)DIF-Net · LUNA16 chest CT, 6-ViewPSNR (dB): 25.55 -> 27.84Helped
add MS-3DV and SVC-Att (ablation)DIF-Net · LUNA16 chest CT, 6-ViewPSNR (dB): 25.55 -> 29.23Helped
use 1 scale instead of 3 (ablation)C2RV · LUNA16 chest CT, 6-ViewPSNR (dB): 29.23 -> 28.98Hurt
use 2 scales instead of 3 (ablation)C2RV · LUNA16 chest CT, 6-ViewPSNR (dB): 29.23 -> 29.09Hurt
use decoder output as F1 instead of encoder output (ablation)C2RV · LUNA16 chest CT, 6-ViewPSNR (dB): 29.23 -> 28.57Hurt

Surprising findings

Limitations

Experimental setup

Datasets: LUNA16 Knee CBCT dataset (Lin et al. 2023)

Benchmarks: LUNA16 Knee CBCT dataset

Metrics: PSNR SSIM Dice ASD

Baselines: FDK SART NAF NeRP FBPConvNet FreeSeed BBDM PixelNeRF DIF-Net

Builds on: DIF-Net PixelNeRF U-Net multi-head cross-attention

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy