Research map / Benchmarks / CoLA
CoLA leaderboard
29 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on CoLA. Best Matthews correlation: 68.5 (SIFT, ICML 2024).
Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.
Matthews correlation 16 accuracy 13 CoLA · Matthews correlation
16 papers, each with its best reported number for its own method; higher is better.
6 more papers on this leaderboard , the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all
CoLA · accuracy
13 papers, each with its best reported number for its own method; higher is better.
# accuracy ↑ Method Paper Topic 1 86.77 GP-filterQwen3-14B target, Qwen3-8B proxy Advanced Black-Box Tuning of Large Language Models with Limited API Calls AAAI 2026 · Table 1 Language, safety and interpretability 2 85.8 StructBERT BaseBERT Base StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding ICLR 2020 · Ablation over pre-training obj Language, safety and interpretability 3 83.8 LayerIF Top 25% LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions NeurIPS 2025 · Expert allocation results tabl Language, safety and interpretability 4 83.61 Flat-LoRAT5-Base Flat-LoRA: Low-Rank Adaptation over a Flat Loss Landscape ICML 2025 · Table: Comparison with other L Pruning and efficient tuning 5 82.04 LoRA-OneT5 base LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently ICML 2025 · Table: Accuracy comparison on Optimizers 6 81 CoTACS k=3, 13B, 1000 examplesLlama-2 13B Learning to Reason via Program Generation, Emulation, and Search NeurIPS 2024 · main results table Agents, code and math 7 73.8 LSH-MoEGPT-MoE (52B) LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 · GLUE results table Mixture of experts 8 72 CasMoE (EAP + EAM, eps=0.3)Mixtral-8x7B (mixed quantization) CasMoE: A Cascaded Framework for Efficient MoE Inference on Resource-constrained Devices AAAI 2026 · Table 3 Mixture of experts 9 72 G-fair-Prompting (Greedy)LLaMA-65B Fairness-guided Few-shot Prompting for Large Language Models NeurIPS 2023 · Table 2 Language, safety and interpretability 10 71.1 Mistral-7B (+ T_pF_o)Mistral-7B Language Models Represent Beliefs of Self and Others ICML 2024 · Table: Model performance compa Language, safety and interpretability
3 more papers on this leaderboard , the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all
Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com .