Research map / Architectures and efficiency / RNNs and normalization
What Scales in Cross-Entropy Scaling Law?
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- On the Entropy Calibration of Language Models (NeurIPS 2025 · similarity 0.91)
- A Hitchhiker's Guide to Scaling Law Estimation (ICML 2025 · similarity 0.90)
- Language models scale reliably with over-training and on downstream tasks (ICLR 2025 · similarity 0.89)
- Scaling Law with Learning Rate Annealing (NeurIPS 2025 · similarity 0.89)
- Cut Your Losses in Large-Vocabulary Language Models (ICLR 2025 · similarity 0.88)
- Resolving Discrepancies in Compute-Optimal Scaling of Language Models (NeurIPS 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.