Research map / Learning theory and algorithms / Kernels and regression theory
On the Bayes Inconsistency of Disagreement Discrepancy Surrogates
Neil G Marchant, Andrew Craig Cullen, Feng Liu, Sarah Monazam Erfani
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace existing disagreement discrepancy surrogates (RG23, GLK23) with the proposed consistent surrogate | error-bound disagreement discrepancy maximization · 130 shift/model combinations, 11 vision benchmarks | share of instances reaching maximum disagreement discrepancy: almost 80% of instances reach the maximum; Wilcoxon p = 1.8 × 10^-11 | Improved |
| use the proposed surrogate instead of RG23 and GLK23 under adversarially chosen target data | error-bound disagreement discrepancy maximization · Adversarial target data, f from 0% to 50% | share of instances with highest estimate: 87.5% for f = 0% -> 100% for f = 50% | Improved |
| use the proposed surrogate in the Detectron harmful-shift test instead of GLK23 | Detectron shift detection with XGBoost critics · UCI Heart Disease, 5 classes, N in {10,20,50} | AUC: 95% confidence intervals for the AUC do not overlap for any N | Improved |
| use the proposed surrogate for error-bound calibration instead of RG23's | error bound calibration · 11 vision benchmarks | calibration of error bounds across delta | Mixed |
Closest papers by meaning
- (Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy (NeurIPS 2023 · similarity 0.88)
- Demystifying Disagreement-on-the-Line in High Dimensions (ICML 2023 · similarity 0.88)
- Combating Noisy Labels with Sample Selection by Mining High-Discrepancy Examples (ICCV 2023 · similarity 0.84)
- DARC: Disagreement-Aware Alignment via Risk-Constrained Decoding (ICML 2026 · similarity 0.84)
- Mitigating Spurious Correlations via Disagreement Probability (NeurIPS 2024 · similarity 0.83)
- BayesJudge: Uncertainty-Aware Bayesian Meta-Evaluation of Human and LLM Judgments (NeurIPS 2026 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
