Research map / Architectures and efficiency / CNN design
Scaling Recurrent Models via Orthogonal Approximations in Tensor Trains
Ronak Mehta, Rudrasis Chakraborty, Yunyang Xiong, Vikas Singh
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use orthogonal tensor train (OTT) instead of Riemannian SGD on TT | tensorized weight learning · Synthetic least squares | time per iteration: 10x | Improved |
| use OTT instead of Riemannian SGD on TT | tensorized weight learning · Synthetic least squares | convergence speed (MSE) | Improved |
| use OTT layers instead of TT layers | LSTM/GRU · Hollywood2 | mean average precision | No clear effect |
| use OTT instead of TT | LSTM/GRU · Hollywood2 | parameter count: 3104 -> 1864 | Improved |
| use OTT instead of TT | RNN on ADNI · ADNI RAVLT regression | validation loss convergence | Improved |
| use OTT instead of TT | RNN on ADNI · ADNI RAVLT regression | 95% interval width (MC Dropout) | Improved |
| use lower OTT ranks (higher compression) (ablation) | OTT-RNN · ADNI gray matter prediction | reconstruction quality | Hurt |
Closest papers by meaning
- Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods (NeurIPS 2024 · similarity 0.88)
- Tensor Programs VI: Feature Learning in Infinite Depth Neural Networks (ICLR 2024 · similarity 0.87)
- Coarse-To-Fine Tensor Trains for Compact Visual Representations (ICML 2024 · similarity 0.87)
- Factor Augmented Tensor-on-Tensor Neural Networks (AAAI 2025 · similarity 0.86)
- Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation (NeurIPS 2024 · similarity 0.86)
- Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Models (ICML 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
