AI Paper Atlas

Research map / Learning theory and algorithms / Fairness

Auditing Fairness by Betting

Ben Chugg, Santiago Cortes-Gomez, Bryan Wilder, Aaditya Ramdas

NeurIPS 2023 · Learning theory and algorithms › Fairness · approach: Fairness auditing and regularization · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use sequential betting test instead of fixed-time permutation test with batches and no level correction (M1)Betting audit (Algorithm 1) · Credit default, US census, insurancefalse positive rate: > 0.5Improved
Use sequential betting test instead of Bonferroni-corrected batch permutation test (M2)Betting audit (Algorithm 1) · Credit default and US censusstopping time under H1 at fixed FPRImproved
Increase batch size k of permutation testsPermutation test baselines · Credit defaultstopping time: k = 1,500 gives tau = 1,500 minimumHurt
Switch from fair model to unfair random forest at time 400 (distribution shift)Betting audit · Census datatype-I error control and rejection timeNo clear effect
Apply batch permutation test M2 under distribution shiftPermutation test M2 · Census data with shiftfalse positive rate: FPR higher than 0.1Hurt
Collect audit data with randomized region-based policies pi1, pi2, pi3 instead of uniform samplingBetting audit with weighted payoff (7) · Insurance datarejection timeHurt
Use betting with randomized policies instead of permutation tests on uniform dataBetting audit under policies pi1-pi3 · Insurance datarejection timeImproved
Increase difference in means Delta between groupsBetting wealth process · Simulated Bernoulli streamswealth growth and rejection speedImproved
Add randomized final check K_tau >= U/alpha when budget runs outBetting audit (Algorithm 1) · TheorypowerImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy