AI Paper Atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

Distributed Estimation on Semi-Supervised Generalized Linear Model

Jiyuan Tu, Weidong Liu, Xiaojun Mao

JMLR 2024 · Label-efficient and robust learning › Semi-supervised learning · approach: Safe and realistic semi-supervised learning

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add more local unlabeled samples (n* 100 -> 500) (ablation)one-step SSDANE · Linear regression, m=100, n=100l2-error: 0.593 -> 0.161Improved
add more local unlabeled samples (n* 300 -> 900) (ablation)one-step SSDANE · Logistic regression, m=100, n=300l2-error: 0.634 -> 0.285Improved
average local estimators from all machines (SSDANE-Avg(1)) instead of master only (ablation)SSDANE · Linear regression, m=100, n=100, n*=100l2-error: 0.593 -> 0.178Improved
average local estimators from all machines (SSDANE-Avg(1)) instead of master only (ablation)SSDANE · Logistic regression, m=100, n=300, n*=300l2-error: 0.634 -> 0.204Improved
increase averaging fraction from 0.2 to 1 (ablation)SSDANE-Avg · Linear regression, m=100, n=100, n*=100l2-error: 0.199 -> 0.178Improved
increase number of machines m from 20 to 100 (ablation)SSDANE-Avg(1) · Linear regression, n=100, n*=500l2-error: 0.142 -> 0.069Improved
run 5 steps instead of 1 step under random initialization (ablation)SSDANE-Avg · Linear regression, m=100, n=100, n*=500l2-error: 0.307 -> 0.056Improved
run 5 steps instead of 1 step under random initialization with few unlabeled samples (ablation)SSDANE · Linear regression, m=100, n=100, n*=100l2-error: 3.492 -> 33.780Hurt
use semi-supervised surrogate loss with 5 steps instead of naive semi-supervised loss Lss (ablation)SSDANE · Linear regression, gradient covariance trace, m=100, n*=500rescaled trace of gradient covariance: 18.367 -> 0.998Improved
replace supervised DANE with semi-supervised SSDANEdistributed Newton · Linear and logistic regressionl2-error over iterationsImproved
add imputation of unlabeled data (DANEimp-Avg) instead of SSDANE-AvgDANE-Avg · Linear and logistic regression, CelebAl2-error / classification errorHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy