Research map / Learning theory and algorithms / Fairness
Optimal Fair Aggregation of Crowdsourced Noisy Labels using Demographic Parity Constraints
Gabriel Singer, Samuel Gruffaz, Olivier VO VAN, Nicolas Vayatis, Argyris Kalogeratos
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use FairCrowd post-processing instead of Post_TD | crowd aggregation (Maj, Bayes, DS) · synthetic, Crowd Judgement, Jigsaw | F1 under demographic parity constraint | Improved |
| use FairCrowd on Majority Vote instead of FairTD | FairTD · synthetic, Crowd Judgement | F1 under demographic parity constraint | Improved |
| use FairCrowd instead of FairTD in runtime | FairTD · Jigsaw and Hate Speech | runtime: 30 hours -> 2 seconds | Improved |
| use Bayes aggregation instead of Majority Vote with reliable annotators | Majority Vote · Jigsaw | F1 | Hurt |
| enforce epsilon-fairness via FC on Majority Vote | Majority Vote · Crowd Judgement | F1 | No clear effect |
| increase number of annotators R | Majority Vote · synthetic, annotators skill U([0.5,1] / [0.6,1]) | fairness gap vs ground truth | Improved |
| use globally adversarial annotators (skills U([0.2,0.6])) | Majority Vote · synthetic | fairness gap convergence | Hurt |
Closest papers by meaning
- Max-Margin Majority Voting for Learning from Crowds (TPAMI 2018 · similarity 0.89)
- Towards a Foundation Model for Crowdsourced Label Aggregation (ICLR 2026 · similarity 0.88)
- Learning to Aggregate Ordinal Labels by Maximizing Separating Width (ICML 2017 · similarity 0.87)
- Label Aggregation for Composite Crowd Tasks by Worker Ability Constraint Satisfaction (AAAI 2025 · similarity 0.86)
- Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification (AAAI 2024 · similarity 0.86)
- Fairness without Harm: An Influence-Guided Active Sampling Approach (NeurIPS 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
