atlas

Research map / Optimization / Optimizers

Learning a Gradient-free Riemannian Optimizer on Tangent Spaces

AAAI 2021 · Optimization › Optimizers · approach: Differentiating through inner loops · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the learned gradient-free tangent-space optimizer instead of Gao et al.'s manifold optimizerRiemannian optimization · YaleB face recognitionaccuracy (%): 89.0 -> 90.2Helped
Use the learned gradient-free tangent-space optimizer instead of Gao et al.'s manifold optimizerRiemannian optimization · Kylberg texture clusteringaccuracy (%): 85.2 -> 86.1Helped
Use the learned tangent-space optimizer rather than hand-designed Riemannian optimizersRiemannian optimization · YaleB face recognitionaccuracy (%): 78.0 -> 90.2Helped
Use the learned tangent-space optimizer rather than hand-designed Riemannian optimizersRiemannian optimization · Kylberg texture clusteringaccuracy (%): 80.3 -> 86.1Helped
Learn updates on tangent spaces and avoid differentiating through manifold optimizationRiemannian meta-optimizer · PCA on MNISTtraining time (seconds): 1876.6 -> 208.4Helped
Learn updates on tangent spaces and avoid differentiating through manifold optimizationRiemannian meta-optimizer · YaleB face recognitiontraining time (seconds): 2508.6 -> 272.8Helped
Learn updates on tangent spaces and avoid differentiating through manifold optimizationRiemannian meta-optimizer · Kylberg texture clusteringtraining time (seconds): 11979.2 -> 1419.0Helped
Increase the inner-loop steps from 5 to 20 (ablation)Ours optimizer · Kylberg texture clusteringmeta-gradient mean: 0.92 -> 2.13 × 10^1Mixed
Increase the inner-loop steps from 5 to 20 (ablation)Ours optimizer · Kylberg texture clusteringmeta-gradient variance: 1.10 -> 1.25 × 10^3Mixed
Increase the inner-loop steps from 5 to 20 (ablation)Ours optimizer · PCA on MNISTtraining time (seconds): 61.3 -> 208.4Hurt
Increase the inner-loop steps from 5 to 20 (ablation)Ours optimizer · YaleB face recognitiontraining time (seconds): 71.5 -> 272.8Hurt
Increase the inner-loop steps from 5 to 20 (ablation)Ours optimizer · Kylberg texture clusteringtraining time (seconds): 1365.6 -> 1419.0Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy