AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

VITA: Variational Pretraining of Transformers for Climate-Robust Crop Yield Forecasting

Adib Hasan, Mardavij Roozbehani, Munther A. Dahleh

AAAI 2026 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Disentangled and discrete latent models · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add variational pretraining objective (vs MSE reconstruction) with standard normal prior (ablation)VITA transformer encoder · Corn Belt corn, 5 extreme yearsR2: 0.660 -> 0.706Improved
use seasonality-aware sinusoidal prior instead of standard normal prior (ablation)VITA · Corn Belt corn, 5 extreme yearsR2: 0.706 -> 0.729Improved
use sinusoidal prior instead of standard normal prior (ablation)VITA · Corn Belt soybean, 5 extreme yearsR2: 0.698 -> 0.722Improved
add pretraining on weather grids excluding continental US (ablation)VITA (Std. Normal prior) · Corn Belt corn, 27 hyperparameter configsR2: 0.463 -> 0.632Improved
add full Americas pretraining (vs random init) (ablation)VITA (Std. Normal prior) · Corn Belt corn, 27 hyperparameter configsR2: 0.463 -> 0.706Improved
add full Americas pretraining (vs random init) (ablation)VITA (Sinusoidal prior) · Corn Belt soybean, 27 hyperparameter configsR2: 0.569 -> 0.698Improved
add pretraining (vs random init) to T-BERT (ablation)T-BERT · Corn Belt corn and soybeanR2: +10.8% corn, +5.0% soybeanImproved
replace VITA with Chronos-Bolt-tiny (4.5x larger, general-purpose pretraining)yield forecasting model · Corn Belt corn, 5 extreme yearsR2: 0.729 -> 0.525Hurt
replace VITA with SimMTM temporal masking pretrainingyield forecasting model · Corn Belt corn, 5 extreme yearsR2: 0.729 -> 0.642Hurt
add soil data to non-pretrained models (XGBoost, CNN-RNN, GNN-RNN)baselines vs VITA without soil · Corn Belt corn, 5 extreme yearsR2: GNN-RNN 0.564 vs VITA-Sinusoidal 0.729 without soilNo clear effect
truncate weather at end of July (week 30) (ablation)VITA-Sinusoidal · Corn Belt soybean, extreme yearsR2: 0.722 -> 0.560Hurt
truncate weather at end of July (week 30) (ablation)VITA-Sinusoidal · Corn Belt corn, extreme yearsR2: 0.729 -> 0.689Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy