AI Paper Atlas

Research map / Time series / Foundation models for time series

TFRBench: A Reasoning Benchmark for Evaluating Forecasting Systems

Md Atik Ahamed, Mihir Parmar, Palash Goyal, Yiwen Song, Long T. Le, Qiang Cheng, Chun-Liang Li, Hamid Palangi, Jinsung Yoon, Tomas Pfister

ICML 2026 · Time series › Foundation models for time series · approach: LLM-based time series forecasting · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
prompt LLMs with verified reasoning traces instead of direct numerical prediction (ablation)LLM forecasters · TFRBench (avg. over datasets)forecasting success rate / accuracy (%): ~40.2% -> 56.6%Improved
add reasoning-guided forecasting on Solar (ablation)LLM forecaster · Solarsuccess rate (MASE<1) (%): 30.7% -> 70.4%Improved
add reasoning-guided forecasting on Hierarchical Sales (ablation)LLM forecaster · Hierarchical Salessuccess rate (MASE<1) (%): 54.7% -> 78.5%Improved
add CoT reasoning in pattern-rich domain Solar (ablation)Gemini-3-Pro · SolarMASE: 1.037 -> 0.834Improved
add CoT reasoning in Car Parts (ablation)Gemini-3-Pro · Car PartsMASE: 0.821 -> 0.672Improved
add CoT reasoning in stochastic Finance domain (ablation)Gemini-3-Pro · Amazon PricingMASE: 0.715 -> 1.114Hurt
add event forecasting and external search to reasoning (Energy) (ablation)Gemini-2.5-Pro · ElectricityMASE: 2.853 -> 1.327Improved
add event forecasting to reasoning (Transportation) (ablation)Claude-Sonnet-4.5 · TrafficMASE: 1.458 -> 1.285Improved
add event-aware reasoning in Web/CloudOps (ablation)Claude-Sonnet-4.5 · Bitbrains Fast StorageMASE: 0.938 -> 5.469Hurt
add event forecasting to reasoning (ablation)Gemini-2.5-Flash · SolarMASE: 1.168 -> 0.896Improved
use larger model Gemini-3-Pro instead of Gemini-2.5-Pro for reasoningLLM reasoning · SolarLLM judge average score: 2.977 -> 3.825Improved
add verifier feedback loop for initially failed forecasts (ablation)TFRBench data generation pipeline · 10 datasetsrescue rate (% of MASE>=1 fixed): ~6.5% to ~52.4% across datasetsImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy