atlas

Research map / Label-efficient and robust learning / Noisy labels

Understanding Instance-Level Label Noise: Disparate Impacts and Treatments

ICML 2021 · Label-efficient and robust learning › Noisy labels · approach: Instance-dependent noise modeling · 8 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Memorize noisy labels for an instanceOver-parameterized model · Instance-level generalizationindividual excessive generalization error: Ω( \frac{l^2}{n^2} \cdot \textsf{weight}(...) \cdot \sum_{k \neq y} \tilde{\mathbb{P}}[\tilde{y}=k|x])Hurt
Apply loss correction instead of memorizing noisy labelsLoss correction · High-frequency instancesindividual excessive generalization error: w.p. at least 1-e^{-2l (1/2-e_{sgn(y)}(x))^2}; Ω( \frac{l^2}{n^2} \cdot \textsf{weight}(...) )Helped
Apply loss correction instead of memorizing noisy labelsLoss correction · Low-frequency instancesprediction error: w.p. at least \frac{1}{\sqrt{2l}} \cdot e^{-l \cdot D_{\text{KL}}\left(\frac{1}{2}\|e_{sgn(y)}(x)\right)}Hurt
Use label smoothing instead of loss correctionLabel smoothing · Instance-level binary classificationprediction errorMixed
Apply peer loss instead of memorizing noisy labelsPeer loss · High-frequency instancesindividual excessive generalization error: w.p. at least 1-e^{ \frac{-2l}{p^2_{sgn(-y)}\cdot \left(1-e_+-e_-\right)^2}}; Ω( \frac{l^2}{n^2} \textsf{weight}(...) \cHelped
Apply peer loss instead of memorizing noisy labelsPeer loss · Low-frequency instancesprediction error: w.p. at least \frac{1}{\sqrt{2l}}e^{-l \cdot D_{\text{KL}}\left(\frac{1}{2}\| e_{sgn(y)}\right)}Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy