Research map / Video / Video segmentation and tracking
MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformer
Fudong Lin, Summer Crawford, Kaleb Guillot, Yihe Zhang, Yan Chen, Xu Yuan, Li Chen, Shelby Williams, Robert Minvielle, Xiangming Xiao, Drew Gholson, Nicolas Ashwell and 5 more
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add long-term meteorological data (ablation) | MMST-ViT · Corn | RMSE: 14.5 -> 10.5 | Improved |
| add Temporal Transformer instead of average pooling (ablation) | MMST-ViT · Corn | RMSE: 15.7 -> 10.5 | Improved |
| add Spatial Transformer instead of average pooling (ablation) | MMST-ViT · Corn | RMSE: 13.5 -> 10.5 | Improved |
| add remote sensing imagery to the multi-modal transformer (ablation) | MMST-ViT · Soybean | RMSE: 6.8 -> 3.9 | Improved |
| add short-term meteorological data (ablation) | MMST-ViT · Corn | RMSE: 13.6 -> 10.5 | Improved |
| fuse visual remote sensing with meteorological data instead of GNN-RNN using meteorology only | crop yield prediction · Cotton 2021 | RMSE: 58.5 -> 42.4 | Improved |
| predict one year ahead instead of in-season | MMST-ViT · Corn, cotton, soybean, winter wheat | RMSE: degraded by 8.6%, 15.5%, 17.0%, 14.6% | Hurt |
Later papers that compared with this method
1 later accepted paper reports MMST-ViT as a baseline in their results tables; 1 of them report a better number on most of the results they share with it.
- PhenoYieldNet: Learning Crop-Aware Phenological Responses for Multi-Crop Yield Prediction (CVPR 2026 · better on 3 of 3 shared results)
Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.
Closest papers by meaning
- Multi-modal Learning for Geospatial Vegetation Forecasting (CVPR 2024 · similarity 0.85)
- Combining Deep Learning and Street View Imagery to Map Smallholder Crop Types (AAAI 2024 · similarity 0.85)
- Exact: Exploring Space-Time Perceptive Clues for Weakly Supervised Satellite Image Time Series Semantic Segmentation (CVPR 2025 · similarity 0.85)
- Can Large Multimodal Models Understand Agricultural Scenes? Benchmarking with AgroMind (NeurIPS 2025 · similarity 0.85)
- AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark (NeurIPS 2025 · similarity 0.84)
- DroughtSet: Understanding Drought Through Spatial-Temporal Learning (AAAI 2025 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
