AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling

Benedikt Boecking, Willie Neiswanger, Eric Xing, Artur Dubrawski

ICLR 2021 · Label-efficient and robust learning › Recognition and long-tail · approach: Partial and multi-label learning · 8 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use IWS-LSE instead of active learning with sample-label queriesDownstream classifier · Six text classification taskstest-set AUCImproved
Use IWS-LSE instead of SnubaDownstream classifier · Six text classification taskstest-set AUCMixed
Use IWS-AS with human feedback rather than simulated-oracle feedbackIWS-AS · Amazon and IMDBtest-set AUCNo clear effect
Use IWS-AS LF queries instead of active-learning sample queriesAmazon · Amazonqueries to match mean test AUC: 200 iterations vs. about 600 iterationsImproved
Use IWS-AS LF queries instead of active-learning sample queriesIMDB · IMDBqueries to match mean test AUC: 200 iterations vs. more than 1000 iterationsImproved
Use IWS-LSE on COCO image tasksDownstream image classifier · COCO image taskstest-set AUCImproved
Use higher-order n-gram LFs instead of unigram LFs (ablation)Text LF family · Text classification taskstest-set performanceNo clear effect
Vary the IWS-LSE accuracy threshold r across a broad range above chance (ablation)IWS-LSE-a and IWS-LSE-ac · Text datasetstest-set performanceNo clear effect
Set the IWS-LSE accuracy threshold too close to 1.0 (ablation)IWS-LSE-a and IWS-LSE-ac · Text datasetstest-set performanceHurt
Vary the IWS-LSE-ac final-set-size parameter m̃ from 50 to 200 (ablation)IWS-LSE-ac · Text datasetstest-set performance: 50 to 200No clear effect
Use real-user LF feedback instead of sample labelingIWS-AS user study · Amazonmedian response time: 4.2s vs. 7.9sImproved
Use real-user LF feedback instead of sample labelingIWS-AS user study · IMDBmedian response time: 3.2s vs. 19.sImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy