AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Class-Conditional Conformal Prediction with Many Classes

Tiffany Ding, Anastasios Nikolas Angelopoulos, Stephen Bates, Michael Jordan, Ryan Tibshirani

NeurIPS 2023 · Label-efficient and robust learning › Recognition and long-tail · approach: Learning from unlabeled and positive-unlabeled data · 15 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Cluster classes with similar score distributions and calibrate at the cluster level instead of using one global or one per-class thresholdConformal prediction with softmax scores · ImageNet, n_avg=20CovGap: 5.2 (0.0) -> 3.9 (0.0)Improved
Cluster classes with similar score distributions and calibrate at the cluster level instead of using one global or one per-class thresholdConformal prediction with softmax scores · CIFAR-100, n_avg=20CovGap: 4.0 (0.0) -> 3.6 (0.1)Improved
Cluster classes with similar score distributions and calibrate at the cluster level instead of using one global or one per-class thresholdConformal prediction with softmax scores · Places365, n_avg=20CovGap: 4.5 (0.0) -> 3.9 (0.1)Improved
Cluster classes with similar score distributions and calibrate at the cluster level instead of using one global or one per-class thresholdConformal prediction with softmax scores · iNaturalist, n_avg=20CovGap: 7.0 (0.1) -> 6.4 (0.1)Improved
Use classwise rather than clustered calibrationConformal prediction with softmax scores · ImageNet, n_avg=20AvgSize: 2.7 (0.1) -> 23.0 (0.9)Hurt
Use classwise rather than clustered calibrationConformal prediction with softmax scores · iNaturalist, n_avg=20AvgSize: 3.4 (0.1) -> 364.0 (1.4)Hurt
Increase the average calibration examples per classClasswise conformal · ImageNet, softmaxCovGap: 7.7 (0.0) -> 2.8 (0.0)Improved
Increase the average calibration examples per classStandard conformal · ImageNet, softmaxCovGap: 5.2 (0.0) -> 5.2 (0.0)No clear effect
Use APS rather than softmax scoresStandard conformal · ImageNetCovGap: 5.2 (0.0) -> 2.6 (0.0)Improved
Use RAPS rather than APS scoresStandard conformal · ImageNetAvgSize: 25.8 (0.1) -> 5.1 (0.0)Improved
Randomize the conformal quantile to target exact rather than at-least nominal coverageClasswise conformal · All evaluated datasets and scoresCovGapImproved
Randomize the conformal quantile to target exact rather than at-least nominal coverageStandard and clustered conformal · All evaluated datasets and scoresCovGapNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy