Research map / Label-efficient and robust learning / Knowledge distillation
Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- SEED: Self-supervised Distillation For Visual Representation (ICLR 2021 · similarity 0.91)
- Revisiting Self-Supervised Visual Representation Learning (CVPR 2019 · similarity 0.89)
- Robust Knowledge Transfer via Hybrid Forward on the Teacher-Student Model (AAAI 2021 · similarity 0.88)
- Big Self-Supervised Models are Strong Semi-Supervised Learners (NeurIPS 2020 · similarity 0.88)
- SigLino: Efficient Multi-Teacher Distillation for Agglomerative Vision Foundation Models (CVPR 2026 · similarity 0.88)
- Boost Self-Supervised Dataset Distillation via Parameterization, Predefined Augmentation, and Approximation (ICLR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.