Research map / Large language models / Language, safety and interpretability
Next Generation Active Learning: Mixture of LLMs in the Loop
Yuanyuan Qi, Xiaohao Yang, Jueqing Lu, Guoxiang Guo, Joanne Enticott, Gang Liu, Lan Du
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add pseudo-labeling to MoLAM (ablation) | MoLAM annotator · TREC | annotation accuracy: 0.7924 -> 0.8040 | Improved |
| add pseudo-labeling to MoLAM (ablation) | MoLAM annotator · AG News | annotation accuracy: 0.8819 -> 0.8887 | Improved |
| add pseudo-labeling to MoLAM (ablation) | MoLAM annotator · IMDB | annotation accuracy: 0.9534 -> 0.9538 | No clear effect |
| use trained MoLAM instead of vote-based ensemble | LLM annotation · TREC | annotation accuracy: 0.7320 -> 0.8040 | Improved |
| use trained MoLAM instead of best single LLM (Yi) | LLM annotation · AG News | annotation accuracy: 0.8349 -> 0.8887 | Improved |
| use MoLAM instead of vocabulary-level data augmentation DA | annotator · TREC | annotation accuracy: 0.4186 -> 0.8040 | Improved |
| add negative learning to active learning (ablation) | MoLLIA · active learning micro-F1 | micro-F1 | Improved |
| add annotation discrepancy weighting (ablation) | MoLLIA · active learning micro-F1 | micro-F1 | Improved |
| use negative labels from MoLAM (ablation) | MoLLIA · AG News | false negative label proportion: 0.0030 | No clear effect |
Closest papers by meaning
- Active Evaluation Acquisition for Efficient LLM Benchmarking (ICML 2025 · similarity 0.87)
- Efficient Evaluation of LLM Performance with Statistical Guarantees (NeurIPS 2026 · similarity 0.87)
- $\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild (NeurIPS 2024 · similarity 0.87)
- Rethinking LLM Ensembling from the Perspective of Mixture Models (ICML 2026 · similarity 0.87)
- Fixing It in Post: A Comparative Study of LLM Post-Training Data Quality and Model Performance (NeurIPS 2025 · similarity 0.86)
- Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning (ICLR 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
