AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

An Interactive Multi-Label Consensus Labeling Model for Multiple Labeler Judgments

Ashish Kulkarni, Narasimha Raju Uppalapati, Pankaj Singh, Ganesh Ramakrishnan

AAAI 2018 · Label-efficient and robust learning › Recognition and long-tail · approach: Partial and multi-label learning · 13 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation)consensus model · Scene* corrected ground truthmicro-F1: .869 -> .907Improved
add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation)consensus model · Scene (original ground truth)micro-F1: .682 -> .679No clear effect
add labeler-reliability weighting (MLCMur vs MLCM-r) (ablation)consensus model · Flagsmicro-F1: .934 -> .933No clear effect
model label-label correlation and consensus (MLCMur vs majority vote)consensus labeling · Scene* corrected ground truthmicro-F1: .846 -> .907Improved
consensus model vs majority voteconsensus labeling · Flagsmicro-F1: .934 -> .933No clear effect
influence-based sampling instead of random samplingactive multi-label learning · Enron/Medical/Slashdot/Corel/Mediamill/Flags/Scenemicro-F1Improved
influence-based instead of uncertainty-based samplingactive multi-label learning · 7 datasetsmicro-F1Improved
smaller sampling batch size (ablation)active learning · Medical datasetmicro-F1Improved
add labeler reliability to consensus in active learning (ablation)Rand-R/Unc-R/Inf-R · active learningmicro-F1Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy