Research map / Vision-language and multimodal / Human and embodied modeling
The OMG dataset: An Open MetaGenomic corpus for mixed-modality genomic language modeling
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Presents the Open MetaGenomic (OMG) corpus, a 3.1T base-pair metagenomic pretraining dataset for genomic language models.
Problem
Metagenomic data offers large biological diversity but has been underused for pretraining biological language models due to accessibility, quality filtering, and deduplication challenges.
Approach
Builds an open metagenomic pretraining corpus of 3.1T base pairs and 3.3B protein-coding sequences, addressing quality filtering and deduplication for mixed-modality genomic language modeling.
Key results
- The OMG corpus totals 3.1T base pairs and 3.3B protein-coding sequences.
Experimental setup
Datasets: OMG corpus
Closest papers by meaning
- Training Compute-Optimal Protein Language Models (NeurIPS 2024 · similarity 0.87)
- DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomes (ICLR 2024 · similarity 0.86)
- BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks (ICLR 2024 · similarity 0.86)
- Multi-modal Transfer Learning between Biological Foundation Models (NeurIPS 2024 · similarity 0.86)
- CellVerse: Do Large Language Models Really Understand Cell Biology? (NeurIPS 2025 · similarity 0.86)
- Omni-Mol: Multitask Molecular Model for Any-to-any Modalities (NeurIPS 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.