Research map / Architectures and efficiency / Attention and transformers
Towards Hybrid-grained Feature Interaction Selection for Deep Sparse Network
Fuyuan Lyu, Xing Tang, Dugang Liu, Chen Ma, Weihong Luo, Liang Chen, xiuqiang He, Xue Liu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add value-level selection on top of field-level (hybrid granularity) (ablation) | OptFeature-f · Avazu | AUC: 0.7920 -> 0.7925 | Improved |
| Add field-level selection on top of value-level (hybrid) (ablation) | OptFeature-v · KDD12 | AUC: 0.7981 -> 0.7982 | Improved |
| Use value-level instead of field-level selection (ablation) | OptFeature · Criteo | AUC: 0.8115 -> 0.8116 | No clear effect |
| Use value-level instead of field-level selection (ablation) | OptFeature · KDD12 | AUC: 0.7978 -> 0.7981 | Improved |
| Use OptFeature selection algorithm instead of AutoFIS at field level | OptFeature-f · Criteo | AUC: 0.8089 -> 0.8115 | Improved |
| Use sparsification-based selection instead of PROFIT progressive selection | OptFeature-f · Criteo | Logloss: 0.4406 -> 0.4404 | Improved |
| Use outer product instead of inner product for interactions (ablation) | OptFeature · Avazu | AUC: 0.7925 -> 0.7899 | Hurt |
| Use outer product instead of inner product for interactions (ablation) | OptFeature · KDD12 | AUC: 0.7982 -> 0.7961 | Hurt |
| Use outer product instead of inner product for interactions (ablation) | OptFeature · Criteo | AUC: 0.8116 -> 0.8115 | No clear effect |
| Increase selection dimension d-hat (ablation) | OptFeature · Criteo | AUC | No clear effect |
| Increase selection dimension d-hat (ablation) | OptFeature · Avazu and KDD12 | AUC | Improved |
| Add third-order interactions to second-order (ablation) | OptFeature-f · KDD12 | AUC | Improved |
Closest papers by meaning
- SAND: One-Shot Feature Selection with Additive Noise Distortion (ICML 2025 · similarity 0.84)
- On the Joint Interaction of Models, Data, and Features (ICLR 2024 · similarity 0.83)
- Foundation Model Insights and a Multi-Model Approach for Superior Fine-Grained One-shot Subset Selection (ICML 2025 · similarity 0.83)
- Balancing Feature Similarity and Label Variability for Optimal Size-Aware One-shot Subset Selection (ICML 2024 · similarity 0.83)
- Exploring the cloud of feature interaction scores in a Rashomon set (ICLR 2024 · similarity 0.83)
- Infinite-Dimensional Feature Interaction (NeurIPS 2024 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
