Research map / Label-efficient and robust learning / Recognition and long-tail
Let the Prototype Guide You: Robust Aggregation of Sparse Multi-Class Annotations via Annotator Prototype Learning
Ju Chen, Jun Feng, Shenyu Zhang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace per-annotator confusion matrices with annotator-specific mixtures over class-specific prototypes | DS / truth inference · 10 crowdsourcing datasets (avg) | accuracy (%): 68.73 -> 74.11 | Improved |
| make prototypes class-specific (CPBCC instead of PTBCC) (ablation) | PTBCC · 10 crowdsourcing datasets (avg) | accuracy (%): 72.40 -> 74.11 | Improved |
| make prototypes class-specific (CPBCC instead of PTBCC) (ablation) | PTBCC · Val5 | accuracy (%): 56.00 -> 50.00 | Hurt |
| use CPBCC instead of DS on Val7 | DS · Val7 | accuracy (%): 22.00 -> 48.00 | Improved |
| increase diagonal prior b from 3 to 5 (ablation) | CPBCC · Val7 | accuracy (%): 34.00 -> 48.00 | Improved |
| vary d from 0.15 to 0.45 (ablation) | CPBCC · 10 datasets (avg) | accuracy (%): 73.80 -> 74.11 | No clear effect |
| increase number of prototypes S from 4 to 10 (random init) (ablation) | CPBCC · 10 datasets (avg) | accuracy (%): 71.51 -> 70.24 | Hurt |
| increase number of prototypes S from 3 to 8 (random init) (ablation) | PTBCC · 10 datasets (avg) | accuracy (%): 69.94 -> 68.95 | Hurt |
| increase PTBCC initial diagonal strength f from 2 to 5 (ablation) | PTBCC · 10 datasets (avg) | accuracy (%): 71.12 -> 72.40 | Improved |
| use CPBCC instead of GOVERN on Adult | GOVERN · Adult | accuracy (%): 69.52 -> 77.78 | Improved |
| use CPBCC instead of IBCC on Web | IBCC · Web | accuracy (%): 70.41 -> 85.11 | Improved |
Closest papers by meaning
- A General Model for Aggregating Annotations AcrossSimple, Complex, and Multi-object Annotation Tasks (Abstract Reprint) (AAAI 2024 · similarity 0.86)
- Prototype-Anchored Learning for Learning with Imperfect Annotations (ICML 2022 · similarity 0.86)
- Collaborative Refining for Learning from Inaccurate Labels (NeurIPS 2024 · similarity 0.85)
- Class-Attribute Priors: Adapting Optimization to Heterogeneity and Fairness Objective (AAAI 2024 · similarity 0.84)
- Coupled Confusion Correction: Learning from Crowds with Sparse Annotations (AAAI 2024 · similarity 0.84)
- Rethinking Epistemic and Aleatoric Uncertainty for Active Open-Set Annotation: An Energy-Based Approach (CVPR 2025 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
