AI Paper Atlas

Research map / Learning theory and algorithms / Prediction and decision losses

Diversity Enhanced Active Learning with Strictly Proper Scoring Rules

Wei Tan, Lan Du, Wray Buntine

NeurIPS 2021 · Learning theory and algorithms › Prediction and decision losses · approach: Active learning and subset selection · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
batch acquisition with k-Means diversity instead of top-B scores (CoreMSE_top) (ablation)batch CoreMSE · PUBMED/SST-5/AG NEWS/IMDBF1 learning curveImproved
batch acquisition with k-Means diversity instead of top-B scores (CoreLog_top) (ablation)batch CoreLog · PUBMED/SST-5/AG NEWS/IMDBF1 learning curveImproved
cluster expected-score-change vectors instead of DistilBERT last-layer embeddings (Pretrained_LM) (ablation)batch CoreMSE/CoreLog · text classification datasetslearning curveImproved
use batch of size 5 or 10 instead of 50 or 100batch CoreMSE · PUBMED, SST-5learning curveImproved
use batch of size 5 or 10 instead of no-batch (B=1)CoreMSE · PUBMED, SST-5learning curveImproved
dynamic validation set versus 30 epochs without validation set (ablation)batch CoreMSE · PUBMED, SST-5, AG NEWSlearning curveMixed
dynamic validation set versus fixed-length (1000) validation set (ablation)batch CoreMSE · PUBMED, SST-5, AG NEWSlearning curveImproved
dynamic validation set versus constant validation set shared across ensemble (ablation)batch CoreMSE · PUBMED, SST-5, AG NEWSlearning curveImproved
use BEMPS CoreMSE instead of WMOCU/Max-Entropy/BALD (batch size one)active learning · SST-5, PUBMEDweighted F1Improved
use batch WMOCU with our batch algorithm versus BADGE and ALPSbatch WMOCU · four text datasetslearning curveImproved
increase unlabelled pool from 10k to 100kBADGE · AG NEWSrunning time (s): 76 -> 2904Hurt
increase unlabelled pool from 10k to 100kCoreMSE · AG NEWSrunning time (s): 65 -> 654No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy