Research map / 3D vision / NeRF and radiance fields
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields
Yuedong Chen, Qianyi Wu, Chuanxia Zheng, Tat-Jen Cham, Jianfei Cai
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add region-aware encoder (Swin-T instead of pSp CNN encoder) (ablation) | Sem2NeRF · CelebAMask-HQ | small-region mask sensitivity (qualitative) | Improved |
| add region-aware ray sampling in decoder (ablation) | Sem2NeRF · CelebAMask-HQ | region sensitivity and image quality (qualitative) | Improved |
| add contour and distance-field input augmentation (ablation) | Sem2NeRF · CelebAMask-HQ | edge sharpness (qualitative) | Improved |
| add random-pose GAN loss with discriminator (ablation) | Sem2NeRF · CelebAMask-HQ | artifacts across views (qualitative) | Improved |
| use Sem2NeRF instead of pSp | mask-to-NeRF baseline · CelebAMask-HQ @128x128 | FID: 55.56 -> 41.52 | Improved |
| use Sem2NeRF instead of pix2pixHD with inversion | mask-to-NeRF baseline · CelebAMask-HQ @128x128 | runtime (s): 161.59 -> 0.18 | Improved |
Closest papers by meaning
- CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesis (AAAI 2025 · similarity 0.89)
- Mask-Based Modeling for Neural Radiance Fields (ICLR 2024 · similarity 0.89)
- GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding (CVPR 2024 · similarity 0.89)
- GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding (CVPR 2024 · similarity 0.88)
- SIGNeRF: Scene Integrated Generation for Neural Radiance Fields (CVPR 2024 · similarity 0.88)
- NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs (CVPR 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
