AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Active Feature Selection for the Mutual Information Criterion

Shachar Schnapp, Sivan Sabato

AAAI 2021 · Label-efficient and robust learning › Recognition and long-tail · approach: Deep active learning · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use AFS to actively choose examples to label rather than RANDOM, CORESET, or DWUSMutual-information feature selection · Benchmark datasets, including MUSK, MNIST, and RELATHEmutual information gapImproved
Use the entropy-targeted I-CP allocation instead of the other single-feature allocation strategiesSingle-feature conditional entropy estimation · Synthetic and Adult experimentsabsolute entropy estimation errorImproved
Use single-feature allocation scores rather than selecting examples by one random feature (ablation)AFS · Feature-selection datasets, k in {5,10,20}mutual information gapMixed
Add the pairwise sampling-bias correction term (ablation)AFS · Feature-selection datasets, k in {5,10,20}mutual information gapImproved
Choose examples using the selected feature subset F^(t) rather than averaging scores over all features (ablation)AFS · Feature-selection datasets, k in {5,10,20}mutual information gapImproved
Add the safeguard that switches remaining labels to random selection when the top-k estimate stops changing (ablation)AFS · Feature-selection datasetsmutual information gapImproved
Replace the aggregation function ℓ1 with ℓ2 (ablation)AFS · Feature-selection datasetsmutual information gapNo clear effect
Replace the aggregation function ℓ1 with ℓ∞ (ablation)AFS · Feature-selection datasetsmutual information gapHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy