Research map / Architectures and efficiency / Attention and transformers
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Evaluating the Zero-shot Robustness of Instruction-tuned Language Models (ICLR 2024 · similarity 0.89)
- Language Models as Zero-shot Lossless Gradient Compressors: Towards General Neural Parameter Prior Models (NeurIPS 2024 · similarity 0.88)
- Agent Instructs Large Language Models to be General Zero-Shot Reasoners (ICML 2024 · similarity 0.88)
- Zero-Shot Robustification of Zero-Shot Models (ICLR 2024 · similarity 0.88)
- Learning to Route Among Specialized Experts for Zero-Shot Generalization (ICML 2024 · similarity 0.87)
- On the Generalization Ability of Next-Token-Prediction Pretraining (ICML 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.