Research map / Label-efficient and robust learning / Recognition and long-tail
Understanding Programmatic Weak Supervision via Source-aware Influence Function
Jieyu Zhang, Haonan Wang, Cheng-Yu Hsieh, Alexander Ratner
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use source-aware influence scores to identify LF mislabels instead of KNN discrepancy scores | PWS with Majority Voting · 13 datasets, Avg. | AP: 0.640 -> 0.842 | Improved |
| Use source-aware reweighting influence instead of ordinary IF when selecting training components to remove | PWS with Majority Voting · 13 datasets, Avg. | test loss: 0.660 -> 0.506 | Improved |
| Use source-aware reweighting influence instead of ordinary IF when selecting training components to remove | PWS with Dawid-Skene · 13 datasets, Avg. | test loss: 0.648 -> 0.565 | Improved |
| Use source-aware reweighting RelatIF instead of ordinary RelatIF when selecting training components to remove | PWS with Snorkel · 13 datasets, Avg. | test loss: 0.666 -> 0.499 | Improved |
| Use source-aware RelatIF instead of source-aware IF for LF mislabel identification (ablation) | PWS with Majority Voting · 13 datasets, Avg. | AP: 0.842 -> 0.881 | Improved |
| Use weight-moving rather than reweighting for source-aware IF (ablation) | PWS · 13 datasets, Avg. | test loss: MV: 0.506 vs 0.544; DS: 0.565 vs 0.588; Snorkel: 0.508 vs 0.559 | Mixed |
Closest papers by meaning
- Characterizing the Impacts of Semi-supervised Learning for Weak Supervision (NeurIPS 2023 · similarity 0.89)
- Weak Supervision Performance Evaluation via Partial Identification (NeurIPS 2024 · similarity 0.88)
- End-to-End Weak Supervision (NeurIPS 2021 · similarity 0.88)
- AutoWS-Bench-101: Benchmarking Automated Weak Supervision with 100 Labels (NeurIPS 2022 · similarity 0.88)
- Theoretical Analysis of Weak-to-Strong Generalization (NeurIPS 2024 · similarity 0.86)
- A General Framework for Learning from Weak Supervision (ICML 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
