atlas

Research map / Label-efficient and robust learning / Knowledge distillation

Unsupervised Deep Learning for Phase Retrieval via Teacher-Student Distillation

AAAI 2023 · Label-efficient and robust learning › Knowledge distillation · approach: Few-shot and metric distillation · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use teacher-student distillation instead of testing with the teacher model alone (ablation)Unsupervised PR model · Uniform CDPs, J=1, γ=9, prDeep12PSNR (dB): 35.21 -> 35.94Helped
Use the noise-resistant self-expressive loss LT rather than the measurement-fitting loss (ablation)Teacher-student PR model · Uniform CDPs, J=1, γ=9, prDeep12PSNR (dB): 35.22 -> 35.94Helped
Add noise injection when preparing student training data (ablation)Teacher-student PR model · Uniform CDPs, J=1, γ=9, prDeep12PSNR (dB): 35.62 -> 35.94Helped
Reuse intermediate teacher estimates for student training (ablation)Teacher-student PR model · Uniform CDPs, J=1, γ=9, prDeep12PSNR (dB): 35.76 -> 35.94Helped
Add image data augmentation to student training data preparation (ablation)Teacher-student PR model · Uniform CDPs, J=4, γ=9, prDeep12PSNR (dB): 40.81 -> 41.09Helped
Add condition-aware blocks (ablation)Unfolding PR network · Uniform CDPs, J=4, γ=9, prDeep12PSNR (dB): 40.66 -> 41.09Helped
Use ConvLSTM cells for cross-stage feature delivery instead of convolutional layers (ablation)Unfolding PR network · Uniform CDPs, J=4, γ=9, prDeep12PSNR (dB): 40.55 -> 41.09Helped
Train without paired ground-truth data, using the proposed unsupervised scheme rather than supervised MSE (ablation)Teacher-student PR model · Uniform CDPs, J=4, γ=9, prDeep12PSNR (dB): 41.02 -> 41.09No clear effect
Use the proposed unsupervised method rather than DPUNet on compressive uniform CDPsPR models · Compressive uniform CDPs, ρ=0.50, prDeep12PSNR (dB): 33.18 -> 33.19; 28.63 -> 28.86Mixed
Use the proposed unsupervised method rather than the strongest listed baselinePR models · Holographic and ptychographic patternsPSNR (dB): 33.13 -> 33.81; 29.58 -> 30.28; 25.12 -> 25.68; 23.30 -> 24.08Helped
Apply the method with mismatched rather than matched noise statisticsUnsupervised PR model · CDPs, J=4, prDeep12PSNR (dB): 28.61 -> 28.12Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy