Research map / Large language models / Language, safety and interpretability
BigBio: A Framework for Data-Centric Biomedical Natural Language Processing
Jason Alan Fries, Leon Weber, Natasha Seelam, Gabriel Altay, Debajyoti Datta, Samuele Garda, Myungsun Kang, Ruisi Su, Wojciech Kusa, Samuel Cahyawijaya, Fabio Barth, Simon Ott and 31 more
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use T0++ (more prompted pretraining tasks) instead of T0 | T0 family · BioASQ zero-shot | accuracy avg: 76.1 -> 89.0 | Improved |
| use T0-family prompted multitask training instead of GPT/T5/SciFive | zero-shot biomedical prompts · BioASQ zero-shot | accuracy avg: 40.4 -> 76.1 | Improved |
| pretraining on PMC biomedical text | GPT-Neo/GPT-J/SciFive · zero-shot biomedical tasks | accuracy | No clear effect |
| add task-specific fine-tuning to the 107-task MTL model | BioLinkBERT-base MTL · NCBI-Disease | F1: 80.2 -> 87.5 ± 0.9 | Improved |
| add task-specific fine-tuning to the 107-task MTL model | BioLinkBERT-base MTL · ChemProt | F1: 66.4 -> 74.3 ± 0.1 | Improved |
| add task-specific fine-tuning to the 107-task MTL model | BioLinkBERT-base MTL · BC5CDR-Chemical | F1: 92.2 -> 94.4 ± 0.3 | Improved |
| large-scale MTL pre-finetuning then fine-tuning vs LinkBERT-base alone | BioLinkBERT-base · BLURB subsets | F1: ChemProt 77.6 vs 74.3 ± 0.1 | Mixed |
Closest papers by meaning
- LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understanding (CVPR 2026 · similarity 0.87)
- CellVerse: Do Large Language Models Really Understand Cell Biology? (NeurIPS 2025 · similarity 0.86)
- RedPajama: an Open Dataset for Training Large Language Models (NeurIPS 2024 · similarity 0.86)
- Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-World Multi-Turn Dialogue (AAAI 2024 · similarity 0.86)
- BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models (CVPR 2025 · similarity 0.86)
- SeqGPT: An Out-of-the-Box Large Language Model for Open Domain Sequence Understanding (AAAI 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
