AI Paper Atlas

Research map / Large language models / Agents, code and math

Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages

Maria Ivanova, Pavel Zadorozhny, Rodion Levichev, Ivan Petrov, Adamenko Pavel, Ivan Lopatin, Alexey Kutalev, Dmitrii Babaev

ICLR 2026 · Large language models › Agents, code and math · approach: Code generation benchmarks · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Evaluate in other languages instead of PythonOpenReasoning-Nemotron-32B · Multi-LCB v6Pass@1: 64.4 -> 22.7 (avg of 12 languages)Hurt
Evaluate in Rust instead of PythonOpenCodeReasoning-Nemotron-1.1-32B · Multi-LCB v6Pass@1: 56.0 -> 1.1Hurt
Switch from Python to average over 12 languagesGPT-OSS-120B (Medium) · Multi-LCB v6Pass@1: 71.1 -> 67.8Hurt
Switch from Python to RustQwen3-235B-A22B-Thinking-2507 · Multi-LCB v6Pass@1: 74.0 -> 47.7Hurt
Use GPT-OSS-120B instead of Qwen3-235B-Thinking-2507 on RustGPT-OSS-120B · Multi-LCB v6, RustPass@1: 47.7 -> 70.5Improved
Increase reasoning effort from Low to MediumGPT-OSS-120B · Multi-LCB v6, averagePass@1: 53.1 -> 67.8Improved
Use thinking variant instead of Instruct variantQwen3-235B-A22B-2507 · Multi-LCB v6, averagePass@1: 37.5 -> 64.0Improved
Evaluate on pre-cutoff instead of post-cutoff problemsTop-10 models · Multi-LCB monthly Pass@1Pass@1Improved
Convert LCB Python tasks to STDIN/STDOUT multi-language pipeline (reproduction vs original)Qwen3-235B-A22B-Thinking-2507 · LCB v6 PythonPass@1: 74.1 -> 74.0No clear effect
Change language from Python to ScalaAll models (mean) · Multi-LCB v6Pass@1: 0.482 -> below 0.29Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy