Research map / Vision-language and multimodal / Multimodal LLMs
Spatially-aware Weights Tokenization for NeRF-Language Models
Andrea Amaduzzi, Pierluigi Zama Ramirez, Giuseppe Lisanti, Samuele Salti, Luigi Di Stefano
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a spatially-aware tokenization of NeRF MLP weights for language models that operate directly on NeRF parameters.
Problem
Understanding NeRFs with natural language by having multimodal LLMs process NeRF MLP weights; prior approaches rely on a global representation of the weights, which the abstract indicates is limiting.
Approach
Tokenize NeRF MLP weights in a spatially-aware way rather than through a single global weight representation, so an MLLM can consume the NeRF's parameters as structured tokens.
Closest papers by meaning
- LLaNA: Large Language and NeRF Assistant (NeurIPS 2024 · similarity 0.95)
- HyperFields: Towards Zero-Shot Generation of NeRFs from Text (ICML 2024 · similarity 0.88)
- Grounding Everything in Tokens for Multimodal Large Language Models (CVPR 2026 · similarity 0.88)
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules (ICLR 2024 · similarity 0.87)
- NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs (CVPR 2024 · similarity 0.87)
- GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding (CVPR 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
