AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Hidden Tails: Certifying Tail-Risk Claims under Selective Labels

El Mustapha Mansouri

NeurIPS 2026 · Label-efficient and robust learning › Recognition and long-tail · approach: Group-robust classification · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Studies certifying conditional value-at-risk (CVaR) tail-risk claims for predictors evaluated only on selectively observed labels, showing non-identifiability even under overlap.

Problem

High-stakes prediction systems are evaluated only on labels revealed by past decisions, so selective observation can hide the losses that determine full-population tail risk, making safe-looking predictors possibly unsafe in their worst compatible failures.

Approach

Proves that CVaR is non-identifiable under selective labels even with overlap, so tail-risk claims must be certified via bounds over the set of outcome distributions compatible with the observed data.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
increase sample size from 10^3 to 10^5 (ablation)oracle outer certificate · Synthetic finite-cell, Gamma=2, alpha=.75mean outer width: .614 -> .147Improved
increase sample size from 10^3 to 10^5 (ablation)exact population (identification) width · Synthetic finite-cell, Gamma=2, alpha=.75mean exact population width: .0949 constantNo clear effect
increase sample size from 10^3 to 10^5 (ablation)cross-fitted endpoint estimator · Synthetic finite-cell, Gamma=2, alpha=.75upper-endpoint RMSE: .0361 -> .0027Improved
assume Gamma=1 (conditional ignorability) instead of Gamma=2 sensitivitydefault-weighted logistic regression vs others · LendingClub 2012, alpha=.95pairwise model ordering: two of three pairwise orderings reverse; .661 accepted-only -> .813 applicantHurt
add fold-variability enlargement to plug-in intervals (ablation)plug-in CVaR intervals · Masked issued loans, Gamma0=3coverage of reference CVaR (of 20 masks): 11-14 -> 19-20Improved
use Gamma=1 ordering rule instead of Gamma=3 interval separation (ablation)predictor comparison · Masked issued loans, both tail levelsordering errors: 16 errors out of 120 declared orderings (vs 37 correct, 23 unresolved at Gamma=3)Hurt
use TIV per-cost targeted acquisition instead of random (ablation)fixed-threshold audit, boosting · Masked issued loans, alpha=.95, Gamma=3median fraction of initial gap removed: 16% -> 61%Improved
use TIV acquisition instead of random in sequential retraining (ablation)boosting · Masked issued loans, alpha=.95, Gamma=3terminal median held-out CVaR: .8682 -> .8541Improved
use TIV acquisition instead of random in sequential retraining (ablation)boosting · Masked issued loans, alpha=.95, Gamma=3mean Brier loss: .1347 -> .1362Hurt
sequential TIV acquisition with retrainingboosting · Masked issued loans, alpha=.95, Gamma=3median estimated retained width: .097 -> .035Improved

Surprising findings

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy