AI Paper Atlas

Research map / Learning theory and algorithms / Sample complexity

Least Squares Model Averaging for Distributed Data

Haili Zhang, Zhaobo Liu, Guohua Zou

JMLR 2023 · Learning theory and algorithms › Sample complexity · approach: Optimal mean estimation and subsampling

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
average over candidate models with Mallows weights instead of selecting one by AICsimple aggregated estimator · Airline data (K=1000 subsets)Mean MSPE (x10^-2): 6.263 -> 6.255Improved
use doubly simple aggregation (dMMA) instead of simple aggregation (MMA)Mallows model averaging · Airline data (K=1000 subsets)Mean MSPE (x10^-2): 6.255 -> 6.253Improved
use dMMA instead of MMA at large KMallows model averaging · Airline data (K=500 subsets)Mean MSPE (x10^-2): 6.209 -> 6.206Improved
use dMMA instead of MMA at K=100Mallows model averaging · Airline data (K=100 subsets)Mean MSPE (x10^-2): 6.159 -> 6.160Hurt
use dMMA instead of AIC for optimal ratedistributed model averaging · Airline data (K=1000 subsets)Optimal rate: 0.260 -> 0.382Improved
increase number of subsets K from 1 to 100all nine methods · Airline dataMean MSPEImproved
increase number of subsets K from 100 to 1000all nine methods · Airline dataMean MSPE: 6.159 -> 6.255 (MMA)Hurt
use BIC-type selection or averaging instead of AIC/Mallows typeBIC, SBIC, dSBIC · Simulation (infinite order regression)riskHurt
use model averaging instead of model selectionSAIC, SBIC, MMA vs AIC, BIC, Mallows · Simulation in-sample risk (n=50, 150)normalized riskImproved
use doubly simple aggregation instead of simple aggregationmodel averaging estimators · Simulation out-of-sample risknormalized riskImproved
increase sample size n to 10000dMMA versus MMA · Simulation in-sample risknormalized riskNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy