atlas

Research map / Optimization / Optimizers

Understanding approximate and unrolled dictionary learning for pattern recovery

ICLR 2022 · Optimization › Optimizers · approach: Surrogate losses and robust solvers · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Disable steps learning (ablation)Stochastic Deep CDL · MEG, minibatch 5 and 20 s windowmean correlation: 0.845 -> 0.83Hurt
Disable steps learning (ablation)Stochastic Deep CDL · MEG, minibatch 5 and 20 s windowtime: 110 s -> 57 sHelped
Shorten the time window from 20 s to 10 s (ablation)Stochastic Deep CDL with steps learning enabled and minibatch 5 · MEGmean correlation: 0.845 -> 0.825Hurt
Shorten the time window from 20 s to 10 s (ablation)Stochastic Deep CDL with steps learning enabled and minibatch 5 · MEGtime: 110 s -> 56 sHelped
Increase minibatch size from 5 to 20 (ablation)Stochastic Deep CDL with steps learning enabled and 10 s window · MEGmean correlation: 0.825 -> 0.80Hurt
Increase minibatch size from 5 to 20 (ablation)Stochastic Deep CDL with steps learning enabled and 10 s window · MEGtime: 56 s -> 163 sHurt
Use unrolled dictionary learning instead of alternating minimization at small depthsDictionary learning · Synthetic data and image patchesgradient direction estimation: up to 20%Helped
Use too many unrolled iterations or back-propagation too deeplyDeep Dictionary Learning · Synthetic data and image patchesgradient direction estimationHurt
Use 20 FISTA iterations for approximate dictionary learning instead of standard dictionary learningImage denoising dictionary learning · Noisy imagetime: 600 seconds -> 80 secondsHelped
Use stochastic DDL instead of Online dictionary learningDictionary recovery · Synthetic data, smaller lambdatime to reach recovery score 0.95Helped
Use stochastic Deep CDL for MEG pattern learning instead of alphacscMEG pattern learning · MEGmean correlation: 80% -- 90% average correlation; around 100 sec. compared to around 1400 sec.Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy