AI Paper Atlas

Research map / Benchmarks / FOLIO

FOLIO leaderboard

18 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on FOLIO. Best accuracy: 95.6 (HBLR, AAAI 2026).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

FOLIO · accuracy

18 papers, each with its best reported number for its own method; higher is better.

#accuracy ↑MethodPaperTopic
195.6HBLR
DeepSeek-R1
From Hypothesis to Premises: LLM-based Backward Logical Reasoning with Selective Symbolic Translation
AAAI 2026 · Table 3
Agents, code and math
289+LogicReward
Qwen3-8B
LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervision
ICLR 2026 · Table 1
Reasoning and chain of thought
388PACS
Llama 3.3 70B
Abductive Reasoning with Probabilistic Commonsense
ICML 2026 · Table 1
Agents, code and math
486.27Ours (w/ sparse)
GPT-4
Enhancing Complex Symbolic Logical Rea­soning of Large Language Models via Sparse Multi-Agent Debate
ICLR 2026 · Table 2
LLM agents
583.2SIPDO
GPT-4o
SIPDO: Closed-Loop Prompt Optimization via Synthetic Data Feedback
ICLR 2026 · Table 3
Language, safety and interpretability
682.26BCCSBelief-Calibrated Multi-Agent Consensus Seeking for Complex NLP Tasks
NeurIPS 2025 · Supplementary Table
LLM agents
778.9MoT training, MoT inference
Gemma-2-9B-It
Learning to Reason via Mixture-of-Thought for Logical Reasoning
ICLR 2026 · Table 1
Reasoning and chain of thought
878.8CLOVER
gpt-4o
Divide and Translate: Compositional First-Order Logic Translation and Verification for Complex Logical Reasoning
ICLR 2025 · Table 1
Agents, code and math
973.21Gemini Flash 2.0 Lite SMT
Gemini Flash 2.0 Lite
Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Tasks
NeurIPS 2025 · Benchmarking accuracy table
Agents, code and math
1072.9Satori-Qwen-7B (Round 2)
Qwen-2.5-Math-7B
Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search
ICML 2025 · Table: Results on Out-of-domai
Reasoning and chain of thought
8 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.