AI Paper Atlas

Research map / Time series / Foundation models for time series

Time Series, Vision, and Language: Exploring the Limits of Alignment in Contrastive Representation Spaces

Pratham Yashwante, Rose Yu

ICML 2026 · Time series › Foundation models for time series · approach: Time series representation learning · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
scale up total encoder size (ablation)trimodal contrastive alignment · CaTSTS-TXT cosine margin vs size (Pearson r): TS-IMG r=0.28, TS-TXT r=0.67, IMG-TXT r=0.53Improved
train on captions with more than double the information density (ablation)trimodal contrastive alignment · CaTScosine margin, Procrustes, mutual kNN: TS-TXT cosine margin 0.57 -> 0.56No clear effect
increase caption information density from sparse to original (ablation)trimodal contrastive alignment · CaTSProcrustes, mutual kNN: siglip + t5 + timesfm TS-TXT Procrustes 1.6072 -> 0.5827 (1-phrase to dense)Improved
add image modality to TS-TXT contrastive training (trimodal vs bimodal) (ablation)TS-TXT alignment · CaTSalignment metricsImproved
add third modality to TS-IMG training (ablation)TS-IMG alignment · CaTSalignment metricsHurt
use jointly pretrained VL model with a time series encoder (ablation)VL-TS configurations · CaTSIMG-TXT ProcrustesImproved
scramble temporal order of line plots (ablation)TS-IMG alignment · CaTS (DINOv2 configs)cosine similarity / Procrustes: cosine -79.5%, Procrustes +210.7%Hurt
richer annotated plots instead of generic plots (ablation)TS-IMG alignment · TRUCEcosine similarityImproved
use clinical reports (indirect text) instead of direct captions (ablation)TS-TXT alignment · MIMIC vs CaTScosine similarity, ProcrustesHurt
switch report language from English to German (ablation)trimodal alignment · MIMIC vs PTB-XLcosine margin, ProcrustesHurt
use code instead of natural language as text for time series (ablation)TS-TXT alignment · CaTSalignment metricsMixed
larger batch size and higher-capacity projection head (ablation)trimodal alignment · CaTSalignment metricsImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy