Research map / Detection and segmentation / Open-set and few-shot detection
FACET: Fairness in Computer Vision Evaluation Benchmark
Laura Gustafson, Chloe Rolland, Nikhila Ravi, Quentin Duval, Aaron Adcock, Cheng-Yang Fu, Melissa Hall, Candace Ross
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| compare detection performance across perceived skin tone (lightest to darkest) | Faster R-CNN R50-FPN · FACET person detection | mAR: 75.5 -> 72.6 (MST 1 vs MST 10) | Hurt |
| compare localization-strict recall across skin tone | Faster R-CNN R50-FPN · FACET person detection | AR@0.75: 85.0 -> 80.4 (MST 1 vs MST 10) | Hurt |
| intersect hair type with skin tone: dreads, lighter vs darker | Faster R-CNN R50-FPN · FACET person detection | AR@0.75: 94.8 -> 85.7 | Hurt |
| intersect hair type with skin tone: straight hair | Faster R-CNN R50-FPN · FACET person detection | mAR: 75.6 -> 76.1 | No clear effect |
| compare detection vs instance segmentation across gender presentation | Mask R-CNN R50-FPN · FACET | AR@0.75: box 88.0 -> mask 84.6 (male attributes) | Mixed |
| evaluate Mask R-CNN segmentation for people outside the gender binary | Mask R-CNN R50-FPN · FACET | mAR (mask): 77.0 -> 63.0 (box vs mask) | Hurt |
| compare open-vocabulary detection across perceived age group for backpacker | Detic · FACET | mAR: 45.4 -> 29.8 (young vs older) | Hurt |
| compare visual grounding across perceived age group for nurse and gardener | OFA · FACET | mAR: 11.9 -> 27.9 (gardener, young vs older) | Hurt |
| compare zero-shot classification across perceived gender presentation | CLIP ViT-B/32 · FACET classification | recall difference: dancer F-M 21.7; gardener M-F 16.4 | Mixed |
Closest papers by meaning
- Consensus and Subjectivity of Skin Tone Annotation for ML Fairness (NeurIPS 2023 · similarity 0.89)
- Leveraging Diffusion Perturbations for Measuring Fairness in Computer Vision (AAAI 2024 · similarity 0.88)
- Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation (CVPR 2020 · similarity 0.87)
- Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluation (ICCV 2023 · similarity 0.87)
- Towards causal benchmarking of bias in face analysis algorithms (ECCV 2020 · similarity 0.87)
- AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmark (CVPR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
