AI Paper Atlas

Research map / Large language models / Agents, code and math

BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation

Xin Guo, Rongjunchen Zhang, Guilong Lu, Xuntao Guo, Jia Shuai, Zhi Yang, Liwen Zhang

ICML 2026 · Large language models › Agents, code and math · approach: Mathematical and structural reasoning benchmarks · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use chain-of-thought prompting instead of zero-shot (ablation)Claude-Sonnet-4 · BizFinBench.v2 averageaccuracy (%): 39.5 -> 13.7Hurt
use chain-of-thought prompting instead of zero-shot (ablation)GPT-5 · BizFinBench.v2 averageaccuracy (%): 61.5 -> 54.6Hurt
use chain-of-thought prompting instead of zero-shot (ablation)Gemini-3 · BizFinBench.v2 averageaccuracy (%): 61.3 -> 56.5Hurt
use chain-of-thought prompting instead of zero-shot (ablation)DeepSeek-R1 · BizFinBench.v2 averageaccuracy (%): 41.5 -> 50.4Improved
use chain-of-thought prompting instead of zero-shot (ablation)21 evaluated LLMs · BizFinBench.v2accuracy (%)Hurt
use financial-domain fine-tuned LLM instead of general model of same scaleDianjin-R1 32B vs Qwen3-32B · BizFinBench.v2 average (zero-shot)accuracy (%): 41.3 -> 35.7Hurt
use larger commercial LLM for portfolio allocation vs quantitative strategiesLLM investment simulation · Portfolio Asset Allocationtotal return: DeepSeek-R1 +47.34% vs Momentum Top5 101.71%Mixed
compare best LLM with financial expertsGPT-5 · BizFinBench.v2 averageaccuracy (%): 61.5 vs 84.8Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy