Research map / Label-efficient and robust learning / Recognition and long-tail
An Interactive Multi-Label Consensus Labeling Model for Multiple Labeler Judgments
Ashish Kulkarni, Narasimha Raju Uppalapati, Pankaj Singh, Ganesh Ramakrishnan
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation) | consensus model · Scene* corrected ground truth | micro-F1: .869 -> .907 | Improved |
| add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation) | consensus model · Scene (original ground truth) | micro-F1: .682 -> .679 | No clear effect |
| add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation) | consensus model · Flags | micro-F1: .934 -> .933 | No clear effect |
| model label-label correlation and consensus (MLCMur vs majority vote) | consensus labeling · Scene* corrected ground truth | micro-F1: .846 -> .907 | Improved |
| consensus model vs majority vote | consensus labeling · Flags | micro-F1: .934 -> .933 | No clear effect |
| influence-based sampling instead of random sampling | active multi-label learning · Enron/Medical/Slashdot/Corel/Mediamill/Flags/Scene | micro-F1 | Improved |
| influence-based instead of uncertainty-based sampling | active multi-label learning · 7 datasets | micro-F1 | Improved |
| smaller sampling batch size (ablation) | active learning · Medical dataset | micro-F1 | Improved |
| add labeler reliability to consensus in active learning (ablation) | Rand-R/Unc-R/Inf-R · active learning | micro-F1 | Improved |
Closest papers by meaning
- Addressing Multi-Label Learning with Partial Labels: From Sample Selection to Label Selection (AAAI 2025 · similarity 0.88)
- Enhancing Multi-Label Classification via Dynamic Label-Order Learning (AAAI 2024 · similarity 0.86)
- Multi-Instance Multi-Label Classification from Crowdsourced Labels (AAAI 2025 · similarity 0.86)
- Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations (NeurIPS 2024 · similarity 0.86)
- Partial Multi-View Multi-Label Classification via Semantic Invariance Learning and Prototype Modeling (ICML 2024 · similarity 0.86)
- Unbiased Multi-Label Learning from Crowdsourced Annotations (ICML 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
