atlas

Research map / Learning theory and algorithms / Kernels and regression theory

Generalization Bounds for Uniformly Stable Algorithms

NeurIPS 2018 · Learning theory and algorithms › Kernels and regression theory · approach: Information-theoretic generalization bounds · 31 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace the previous second-moment analysis with the new stability-based boundUniformly stable data-dependent functions · Uniformly stable data-dependent functionssecond moment of estimation error: O(\gamma + 1/n) -> O(\gamma^2 +1/n)Helped
Use the new high-probability analysis instead of the previous uniform-stability boundUniformly stable data-dependent functions · Uniformly stable data-dependent functionshigh-probability estimation-error bound: O((\gamma +1/n) \sqrt{n \log(1/\delta)}) -> O(\sqrt{(\gamma + 1/n) \log(1/\delta)})Helped
Apply the new second-moment bound to strongly convex ERMStrongly convex ERM · Strongly convex ERMexcess loss bound: \frac{4}{\delta \lambda n} -> c_1 \left( \frac{1}{\sqrt{\delta} \lambda n} + \frac{1}{\sqrt{n}} \right)Helped
Choose regularization using the new second-moment boundRegularized convex ERM · Regularized convex ERMexcess loss bound: \frac{4}{\sqrt{\delta n}}\cdot \left(1 + \frac{8}{\delta n}\right) -> \frac{c_1}{\delta^{1/4}\sqrt{n}}Helped
Choose regularization using the new high-probability boundRegularized convex ERM · Regularized convex ERMexcess loss bound: O(1/\sqrt{\delta n}) -> \frac{c_2 \sqrt{\ln (1/\delta)}}{n^{1/3}}Helped
Apply the new second-moment bound to projected gradient descentProjected gradient descent on smooth convex functions · Projected gradient descent on smooth convex functionsexcess loss bound: \frac{c_1}{\delta^{1/4}\sqrt{n}}Helped
Apply the new high-probability bound to projected gradient descentProjected gradient descent on smooth convex functions · Projected gradient descent on smooth convex functionsexcess loss bound: \frac{c_2 \sqrt{\ln (1/\delta)}}{n^{1/3}}Helped
Apply the new stability bounds to the expected loss of a differentially private predictorDifferentially private prediction · Differentially private predictionestimation-error bounds: 16(e^\eps-1)^2 + \frac{2}{n}; 8 \sqrt{\left(2(e^\eps-1) + \frac{1}{n}\right) \cdot \ln (8/\delta)}Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy