Research map / Vision-language and multimodal / Human and embodied modeling
Beyond 3 Million Tokens: A Multi-Modal Foundation Model for Full-Resolution Heliophysics
Sujit Roy, Johannes Schmude, Ata A Asanjan, Thorsten Kurth, Rohit Lal, Kshitiz Mandal, Vishal Gaur, Harris Abdul Majid, Nikolaos Dionelis, Berkay Aydin, Himanshu Patil, Andres Munoz-Jaramillo and 4 more
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a multi-modal foundation model for heliophysics that handles full-resolution (4096x4096) solar imagery with contexts beyond 3 million tokens.
Problem
Vision foundation models rarely exceed 1M tokens, forcing downsampling of high-resolution heliophysics solar observations (native 4096x4096) and losing fine-grained spatial detail.
Approach
Scales context length beyond 3M tokens for vision foundation models so full-disk solar observations can be processed at native resolution without downsampling; details beyond the abstract are not available.
Closest papers by meaning
- A systematic evaluation of vision-language models for observational astronomical reasoning tasks (NeurIPS 2026 · similarity 0.83)
- AstroCompress: A benchmark dataset for multi-purpose compression of astronomical data (ICLR 2025 · similarity 0.83)
- Phaedra: Learning High-Fidelity Discrete Tokenization for the Physical Sciences (NeurIPS 2026 · similarity 0.82)
- Learning What's Real: Disentangling Signals and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics (NeurIPS 2026 · similarity 0.82)
- The Multimodal Universe: Enabling Large-Scale Machine Learning with 100 TB of Astronomical Scientific Data (NeurIPS 2024 · similarity 0.82)
- FluxFlow: Conservative Flow-Matching for Astronomical Image Super-Resolution (NeurIPS 2026 · similarity 0.82)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
