Research map / Label-efficient and robust learning / Self-supervised and contrastive
UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Builds WorldTrace, a 2.45M-trajectory global GPS dataset from OSM traces, and UniTraj, an encoder-decoder trajectory foundation model pre-trained with adaptive resampling and masked trajectory reconstruction, evaluated on recovery, prediction and classification.
Problem
Existing trajectory models are task-specific, region-dependent and sensitive to data quality, and no large, globally diverse trajectory dataset or universal trajectory foundation model exists.
Approach
Pre-train a masked autoencoder on lat/lon/time only (no POI or road network) over a worldwide trajectory corpus, using logarithmic length-dependent resampling and four masking strategies (random, block, key-points, last-N) so one backbone serves multiple tasks zero-shot or after fine-tuning.
Key results
- Trajectory recovery: fine-tuned UniTraj reaches MAE 6.94 m on WorldTrace versus 47.64 for the best baseline TrajFM, and 23.23 vs 34.53 for TrajBERT on GeoLife.
- Trajectory prediction: zero-shot UniTraj MAE 49.85 on WorldTrace, a 10.49% improvement over the best baseline; fine-tuning gives 30.10.
- Classification: zero-shot 71.3% accuracy on GeoLife and 79.3% after fine-tuning on Grab-Posisi.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| fine-tune the pretrained UniTraj model | UniTraj · trajectory recovery across WorldTrace, Chengdu, Xi'an, GeoLife, Grab-Posisi, and Porto | MAE: 10.22 -> 6.94 (WorldTrace); 11.98 -> 6.92 (Chengdu); 8.93 -> 6.50 (Xi'an); 37.21 -> 23.23 (GeoLife); 114.07 -> 48.95 (Gr | Helped |
| fine-tune the pretrained UniTraj model | UniTraj · trajectory prediction across WorldTrace, Chengdu, and GeoLife | MAE: 49.85 -> 30.10 (WorldTrace); 42.75 -> 28.78 (Chengdu); 108.35 -> 90.97 (GeoLife) | Helped |
| add Dynamic Multi-scale Resampling (ablation) | UniTraj · trajectory recovery across datasets, especially GeoLife and Grab-Posisi | MAE: 499.95 -> 37.21 (GeoLife); 426.80 -> 10.22 (WorldTrace) | Helped |
| add Interval Consistent Resampling (ablation) | UniTraj · trajectory recovery, especially Porto and WorldTrace | MAE: 1724.12 -> 78.28 (Porto); 21.30 -> 10.22 (WorldTrace); 21.30 -> 11.98 (Chengdu) | Mixed |
| add Key Points Masking (ablation) | UniTraj · trajectory recovery across datasets | MAE: 14.46 -> 11.98 (Chengdu); 25.49 -> 10.22 (WorldTrace); 45.94 -> 37.21 (GeoLife) | Mixed |
| add Block Masking (ablation) | UniTraj · trajectory recovery across datasets | MAE: 48.59 -> 37.21 (GeoLife); 198.41 -> 78.28 (Porto); 7.79 -> 10.22 (WorldTrace); 9.22 -> 11.98 (Chengdu) | Mixed |
| increase encoder blocks from 2 to 8 (ablation) | UniTraj · trajectory recovery | MAE | Helped |
| increase encoder depth beyond 8 blocks (ablation) | UniTraj · trajectory recovery | MAE | No clear effect |
| use a 50% masking ratio (ablation) | UniTraj · trajectory recovery | MAE | Helped |
| use low masking ratios (5%-10%) (ablation) | UniTraj · trajectory recovery | MAE | Hurt |
| use a high masking ratio (75%) (ablation) | UniTraj · trajectory recovery | MAE | Hurt |
| train on the full WorldTrace set rather than 1 million trajectories (ablation) | UniTraj · WorldTrace in-domain test set | MAE | Hurt |
Surprising findings
- Removing block masking gives the best MAE on WorldTrace, Chengdu, Xi'an and Grab-Posisi, and removing key-points masking improves Porto, so individual strategies do not uniformly help.
- Increasing WorldTrace from 1M to 2.45M trajectories slightly increased MAE, attributed to added noise, while a 1M high-quality subset performed better.
Limitations
- Excludes region-bound context (POI, road network) by design, so baselines relying on such information were not compared.
- Dataset noise: the full 2.45M set degrades performance relative to a curated subset.
- Trajectories are restricted to motorized movement from OSM traces.
Experimental setup
Datasets: WorldTrace Chengdu Xi'an GeoLife Grab-Posisi Porto
Benchmarks: WorldTrace Chengdu Xi'an GeoLife Grab-Posisi Porto
Metrics: MAE RMSE accuracy
Baselines: Linear DHTR Transformer DeepMove TrajBERT TrajFM
Builds on: masked autoencoder rotary position encoding Ramer-Douglas-Peucker algorithm
Closest papers by meaning
- STraj: Self-training for Bridging the Cross-Geography Gap in Trajectory Prediction (AAAI 2025 · similarity 0.86)
- Trajectory World Models for Heterogeneous Environments (ICML 2025 · similarity 0.86)
- TransferTraj: A Vehicle Trajectory Learning Model for Region and Task Transferability (NeurIPS 2025 · similarity 0.85)
- GTR: A General, Multi-View, and Dynamic Framework for Trajectory Representation Learning (ICML 2025 · similarity 0.85)
- TrajAgent: An LLM-Agent Framework for Trajectory Modeling via Large-and-Small Model Collaboration (NeurIPS 2025 · similarity 0.84)
- SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model (CVPR 2024 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
