AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluation

Hao Liang, Pietro Perona, Guha Balakrishnan

ICCV 2023 · Label-efficient and robust learning › Recognition and long-tail · approach: Fair and quality-aware face recognition · 24 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
compare pairs from same demographic group versus different groups (ablation)face recognition models (ArcFace ResNet-34 on MS1MV3 and Glint360k, SphereFace SFNet-20 on VGGFace2) · synthetic EG3D face pairsidentity similarityHurt
increase pose angle away from 0 degrees (ablation)ResNet34-MS1MV3 ArcFace · synthetic face pairssimilarity scoreHurt
test on Black and East Asian faces versus White facesall three face recognition models · synthetic benchmark (FNMR vs FMR)FNMR at fixed FMRHurt
test on Black Female facesModel 3 (ResNet34 Glint360k) · pose changesFNMR vs FMRHurt
vary lighting (ablation)face recognition models · synthetic benchmarkFNMR vs FMR across demographic groupsNo clear effect
vary age and expression instead of lighting (ablation)face recognition models · synthetic benchmarksimilarityMixed
remove hair via segmentation from images (ablation)face recognition evaluation · synthetic benchmarkbias trendsNo clear effect
change human identity threshold t_hcic to 0.2 or 0.4 (ablation)FNMR vs FMR evaluation · synthetic benchmarkbias trendsNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy