AI Paper Atlas

Research map / Benchmarks / MultiArith

MultiArith leaderboard

32 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on MultiArith. Best accuracy: 99.8 (Complex CoT + Vote Complex, ICLR 2023).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

MultiArith · accuracy

32 papers, each with its best reported number for its own method; higher is better.

#accuracy ↑MethodPaperTopic
199.8Complex CoT + Vote Complex
Code-davinci-002
Complexity-Based Prompting for Multi-step Reasoning
ICLR 2023 · Main results table
Reasoning and chain of thought
299.7Promptbreeder zero-shot
PaLM 2-L
Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution
ICML 2024 · Table 1
Reasoning and chain of thought
399.3Self-consistency
PaLM-540B
Self-Consistency Improves Chain of Thought Reasoning in Language Models
ICLR 2023 · Table 1
Reasoning and chain of thought
499.22MAGENavigating the Energy Landscape of Collaboration: Multi-Agent Communication Graph Generation via Score-Based Diffusion
ICML 2026 · Table 1
LLM agents
599.21Few-Shot CoT + RCI
gpt-3.5-turbo
Language Models can Solve Computer Tasks
NeurIPS 2023 · Chain-of-Thought comparison ta
Reasoning and chain of thought
699.2CE-Graph
gpt-4o-mini
Failure-Driven Workflow Refinement
ICML 2026 · Table 1
Graph algorithms and clustering
799.2OccamLlama 8B
Llama 3 8B Instruct
OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step
NeurIPS 2024 · Appendix, reasoning tasks tabl
Agents, code and math
898.93ARG-Designer
gpt-4o-2024-08-06
Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation
AAAI 2026 · Table 2
LLM agents
998.81RADAR
gpt-4o-mini
RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation
ICML 2026 · Table 1
LLM agents
1098.8MaAS
gpt-4o-mini
Multi-agent Architecture Search via Agentic Supernet
ICML 2025 · Performance comparison table
LLM agents
22 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.