AI Paper Atlas

Research map / Optimization / Optimizers

Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens

Junbin Qiu, Zhaowei Hong, Renzhe Xu, Yao Shu

ICML 2026 · Optimization › Optimizers · approach: Zeroth-order training methods · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add query reuse (N = 4 instead of N = 1) to the proposed estimator (ablation)Proposed estimator · Black-box adversarial attack (MNIST CNN)iterations to successful attack: 536 -> 403Improved
add query reuse (N = 6) to the proposed estimator on synthetic functions (ablation)Proposed estimator · Hessian error, synthetic functions (d=5000)Frobenius norm Hessian errorImproved
use proposed estimator (N = 1) instead of central-difference estimatorCentral-difference Hessian estimator · Hessian error, Quadratic and Rosenbrock (d=5000)Frobenius norm Hessian error: 8x accuracy improvementImproved
use proposed estimator (N = 1) instead of central-difference estimatorCentral-difference Hessian estimator · Hessian error, Styblinski-Tang (d=5000)Frobenius norm Hessian error: 3.4xImproved
use proposed estimator (N = 4) instead of central-difference estimatorCentral-difference Hessian estimator · Hessian error, MNIST CNN Fc2.weightFrobenius norm Hessian error: 9x error reductionImproved
use proposed Hessian optimizer instead of Vanilla ZOOVanilla ZOO · Synthetic optimization (Quadratic, Levy, Rosenbrock, Ackley)convergence speed: 22x average speedupImproved
use proposed estimator (N = 4) instead of HiZOOHiZOO · Black-box adversarial attack (MNIST CNN)iterations to successful attack: 1045 -> 403Improved
use proposed estimator (N = 4) instead of ZOAR (N = 4)ZOAR · Black-box adversarial attack (MNIST CNN)iterations to successful attack: 538 -> 403Improved
use proposed estimator (N = 1, no reuse) instead of ZOAR (N = 4)ZOAR · Black-box adversarial attack (MNIST CNN)iterations to successful attack: 538 -> 536No clear effect
use HiZOO instead of Vanilla ZOOVanilla ZOO · Black-box adversarial attack (MNIST CNN)iterations to successful attack: 1629 -> 1045Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy