AI Paper Atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

Deconstructing the Ladder Network Architecture

ICML 2016 · Label-efficient and robust learning › Semi-supervised learning · approach: Holistic semi-supervised pipelines · 64 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add lateral connections to the encoder-decoder architecture (ablation)Ladder Network · PI MNIST, semi-supervised (100 and 1000 labels)AER (%): 100 labels: 1.086 vs 16.390; 1000 labels: 1.017 vs 5.251Helped
Inject noise at every layer rather than only the first layer (ablation)Ladder Network · PI MNIST, 100 and 1000 labelsAER (%): 100 labels: 1.856 -> 1.086; 1000 labels: 1.381 -> 1.017Helped
Retain reconstruction penalties beyond the first layer (ablation)Ladder Network · PI MNIST, 100 labelsAER (%): 1.691 -> 1.086Helped
Retain reconstruction penalties beyond the first layer (ablation)Ladder Network · PI MNIST, 1000 and 60000 labelsAER (%): 1000 labels: 1.053 -> 1.017; 60000 labels: 0.608 -> 0.608No clear effect
Keep noise injection and reconstruction at layers beyond the first (ablation)Ladder Network · PI MNIST, 100 and 60000 labelsAER (%): 100 labels: 1.856 -> 1.086; 60000 labels: 0.732 -> 0.608Helped
Keep noise injection and reconstruction at layers beyond the first (ablation)Ladder Network · PI MNIST, 1000 labelsAER (%): 1.058 -> 1.017No clear effect
Retain sigmoid nonlinearity in the vanilla combinator (ablation)Ladder Network · PI MNIST, all label countsAER (%): 100 labels: 1.608 -> 1.086; 1000 labels: 1.223 -> 1.017; 60000 labels: 0.633 -> 0.608Helped
Retain the multiplicative term in the vanilla combinator (ablation)Ladder Network · PI MNIST, all label countsAER (%): 100 labels: 3.041 -> 1.086; 1000 labels: 1.735 -> 1.017; 60000 labels: 0.674 -> 0.608Helped
Use a nonlinear combinator rather than simple linear addition (ablation)Ladder Network · PI MNIST, all label countsAER (%): 100 labels: 5.027 -> 1.086; 1000 labels: 2.769 -> 1.017; 60000 labels: 0.849 -> 0.608Helped
Use the vanilla lateral-first initialization rather than random initialization (ablation)Ladder Network · PI MNIST, all label countsAER (%): 100 labels: 1.232 -> 1.086; 1000 labels: 1.011 -> 1.017; 60000 labels: 0.614 -> 0.608Helped
Use the vanilla lateral-first initialization rather than reverse initialization (ablation)Ladder Network · PI MNIST, all label countsAER (%): 100 labels: 1.305 -> 1.086; 1000 labels: 1.031 -> 1.017; 60000 labels: 0.631 -> 0.608Helped
Replace the vanilla combinator with an unconstrained Gaussian combinatorLadder Network · PI MNIST, 100 and 1000 labelsAER (%): 100 labels: 1.086 -> 1.064; 1000 labels: 1.017 -> 0.983Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy