Research map / Learning theory and algorithms / Prediction and decision losses
The Contextual Lasso: Sparse Linear Models via Deep Neural Networks
Ryan Thompson, Amir Dezfouli, Robert Kohn
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use contextual lasso instead of lasso | contextual lasso · Energy consumption | relative loss: 0.690 -> 0.356 | Improved |
| use contextual lasso instead of lasso | contextual lasso · Energy consumption | average sparsity: 11.6 -> 2.8 | Improved |
| use contextual lasso instead of lassonet | contextual lasso · Energy consumption | relative loss: 0.423 -> 0.356 | Improved |
| add contextual group lasso over lassonet | contextual group lasso · Parkinson's telemonitoring | relative loss: 0.263 -> 0.113 | Improved |
| use group lasso instead of lasso | group lasso · Parkinson's telemonitoring | relative loss: 0.885 -> 0.710 | Improved |
| use contextual lasso instead of contextual linear model | contextual lasso · House pricing | relative loss: 0.505 -> 0.498 | Improved |
| use contextual lasso instead of lasso | contextual lasso · House pricing | relative loss: 0.892 -> 0.498 | Improved |
| use contextual lasso instead of lassonet | contextual lasso · News popularity | relative loss: 0.894 -> 0.906 | No clear effect |
| use contextual lasso instead of lasso | contextual lasso · News popularity | average sparsity: 22.4 -> 12.6 | Improved |
| add relaxation (polishing, tuned gamma) to contextual lasso (ablation) | contextual lasso · synthetic regression | prediction loss | No clear effect |
| add relaxation (polishing, tuned gamma) to contextual lasso (ablation) | contextual lasso · synthetic regression | sparsity and selection F1 | Improved |
| increase sample size n | contextual lasso · synthetic regression | prediction, sparsity, F1 | Improved |
Closest papers by meaning
- From Flat to Hierarchical: Extracting Sparse Representations with Matching Pursuit (NeurIPS 2025 · similarity 0.88)
- Explainable Neural Networks with Guarantee: A Sparse Estimation Approach (AAAI 2025 · similarity 0.88)
- Projecting Assumptions: The Duality Between Sparse Autoencoders and Concept Geometry (NeurIPS 2025 · similarity 0.86)
- How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression (NeurIPS 2024 · similarity 0.86)
- Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries (ICLR 2025 · similarity 0.86)
- How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model (ICML 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
