AI Paper Atlas

Research map / Large language models / Agents, code and math

A Benchmark for Deep Information Synthesis

Debjit Paul, Daniel Murphy, Milan Gritta, Ronald Cardenas, Victor Prokhorov, Lena Sophia Bolliger, Aysim Toker, Roy Miles, Andreea-Maria Oncescu, Jasivan Alex Sivakumar, Philipp Borchert, Ismail Elezi and 5 more

ICLR 2026 · Large language models › Agents, code and math · approach: Long-horizon LLM agents · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add search toolkit to OWL (ablation)OWL (GPT-4.1) · DeepSynthF1: 3.60 -> 5.41Improved
add web browsing toolkit to OWL (ablation)OWL (GPT-4.1) · DeepSynthF1: 4.80 -> 5.41Improved
add document processing toolkit to OWL (ablation)OWL (GPT-4.1) · DeepSynthF1: 4.90 -> 5.41Improved
add code execution toolkit to OWL (ablation)OWL (GPT-4.1) · DeepSynthF1: 4.82 -> 5.41Improved
provide gold intermediate reasoning steps (ablation)GPT-4.1 · DeepSynthF1: 3.46 -> 9.36Improved
provide gold intermediate reasoning steps (ablation)Smolagent (GPT-4.1) · DeepSynthF1: 3.75 -> 10.50Improved
provide gold intermediate reasoning steps (ablation)o3 · DeepSynthF1: 3.29 -> 12.87Improved
add web search and code interpreter (deep research agent) to o3o3 · DeepSynthF1: 3.29 -> 8.97Improved
wrap GPT-4.1 in smolagents frameworkGPT-4.1 · DeepSynthF1: 3.46 -> 3.75Improved
use reasoning models instead of general-purpose LLMsLLMs · DeepSynthF1No clear effect
majority voting (N=5) instead of Best@5Smolagents (GPT-4.1) · DeepSynth-DevLLM judge accuracy: 27.5 -> 5Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy