Research map / Architectures and efficiency / Attention and transformers
PanFoMa: A Lightweight Foundation Model and Benchmark for Pan-Cancer
Xiaoshui Huang, Tianlin Zhu, Yifan Zuo, Xue Xia, Zonghan Wu, Jiebin Yan, Dingli Hua, Zongyi Xu, Yuming Fang, Jian Zhang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace Transformer or Mamba baselines with hybrid local Transformer encoder plus Bi-Mamba decoder | single-cell foundation model · PanFoMaBench pan-cancer diagnosis | accuracy: 0.9124 -> 0.9474 | Improved |
| replace Transformer or Mamba baselines with PanFoMa | single-cell foundation model · PanFoMaBench pan-cancer diagnosis | Macro-F1: 0.8851 -> 0.9250 | Improved |
| use PanFoMa instead of GeneMamba | cell type annotation · MS | accuracy: 0.6825 -> 0.8563 | Improved |
| use PanFoMa instead of GeneMamba | cell type annotation · Myeloid | accuracy: 0.6607 -> 0.6515 | Hurt |
| use PanFoMa instead of scGPT | batch integration · PBMC12k | Avg bio: 0.9018 -> 0.8631 | Hurt |
| use PanFoMa instead of GeneMamba | batch integration · BMMC | Avg bio: 0.7628 -> 0.8021 | Improved |
| use PanFoMa instead of scGPT | multi-omic integration · 10x Multiome PBMC | Avg bio: 0.758 -> 0.789 | Improved |
| use PanFoMa instead of scGPT | multi-omic integration · ASAP PBMC | Avg bio: 0.587 -> 0.579 | Hurt |
Closest papers by meaning
- A Simple and Comprehensive Benchmark for Single-Cell Transcriptomics (AAAI 2025 · similarity 0.85)
- CellVerse: Do Large Language Models Really Understand Cell Biology? (NeurIPS 2025 · similarity 0.83)
- A versatile informative diffusion model for single-cell ATAC-seq data generation and analysis (NeurIPS 2024 · similarity 0.83)
- Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images (NeurIPS 2026 · similarity 0.83)
- Cell ontology guided transcriptome foundation model (NeurIPS 2024 · similarity 0.83)
- CellPLM: Pre-training of Cell Language Model Beyond Single Cells (ICLR 2024 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
