Research map / Architectures and efficiency / Neural architecture search
Theory-Inspired Path-Regularized Differential Network Architecture Search
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace DARTS softmax operation weighting with group-structured sparse binary gates plus path-depth-wise regularization (PR-DARTS) | DARTS (second-order) · CIFAR10 test | test error (%): 2.76 -> 2.32 | Helped |
| replace DARTS with PR-DARTS | DARTS (second-order) · CIFAR100 test | test error (%): 17.54 -> 16.45 | Helped |
| replace DARTS with PR-DARTS | DARTS (second-order) · ImageNet top-1 | top-1 error (%): 26.7 -> 24.1 | Helped |
| replace DARTS with PR-DARTS (random two-op update, sparsity pruning) | DARTS (second-order) · CIFAR10 search | search cost (GPU-days): 4.0 -> 0.17 | Helped |
| add group-structured sparse binary gates (alone) to DARTS (ablation) | PR-DARTS · CIFAR10 search, selected cell composition | skip-connection dominance | Helped |
| add path-depth-wise regularization to the gated search (ablation) | PR-DARTS · CIFAR10 search, selected cell depth | cell-selection bias to shallow cells | Helped |
| vary regularization weights lambda1 in [1e-2,1], lambda2 in [10^-4.5,10^-2.5], lambda3 in [1e-4,10^-1.5] (ablation) | PR-DARTS · CIFAR10 | test error (%) | No clear effect |
Closest papers by meaning
- PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search (ICLR 2020 · similarity 0.90)
- iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients (ICML 2021 · similarity 0.89)
- b-DARTS: Beta-Decay Regularization for Differentiable Architecture Search (CVPR 2022 · similarity 0.89)
- Differentiable Architecture Search With Random Features (CVPR 2023 · similarity 0.89)
- EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration (AAAI 2024 · similarity 0.87)
- IS-DARTS: Stabilizing DARTS through Precise Measurement on Candidate Importance (AAAI 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.