atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Lossy Compression for Lossless Prediction

NeurIPS 2021 · Label-efficient and robust learning › Recognition and long-tail · approach: Contrastive representation theory · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CLIP+EB instead of JPEGzero-shot image classification compressor · ImageNetrate gain vs JPEG: $1104\times$Helped
Use CLIP+EB instead of JPEGzero-shot image classification compressor · 8 zero-shot datasetsclassification accuracyNo clear effect
Add an entropy bottleneck to CLIP representations (ablation)CLIP compressor · ImageNetbit-rate per image: 1.52e4 -> 1.35e3Helped
Increase entropy-bottleneck β from the standard setting to high β (ablation)CLIP compressor · ImageNettest accuracy (%): 76.5 -> 76.6No clear effect
Use low β for the entropy bottleneck (ablation)CLIP compressor · ImageNettest accuracy (%): 76.5 -> 76.0Hurt
Train BINCE end-to-end rather than staggered (ablation)BINCE on augmented MNIST · augmented MNISTbit-rate: 358 to 131 bitsHelped
Predict from representations rather than reconstructions (ablation)VIC · VIC downstream predictionaccuracy: +9%Helped
Predict from representations rather than reconstructions (ablation)VC · VC downstream predictionaccuracy: -12%Hurt
Use text-image invariance (CLIP) instead of standard image augmentations (SimCLR) (ablation)SSL compressor · ImageNetbit-rate per image: $2811$ -> $2108$Helped
Use VIC rather than standard neural compressionneural image compressor · Banana sourceAURD: $48.1 { \pm 0.3}$ -> $35.8 { \pm 4.2}$Helped
Use stronger information-discarding augmentations while preserving labels (ablation)VIC on MNIST · MNISTrate: 185.3, 79.0, and 5.7 bitsHelped
Use BINCE instead of PNG lossless compressionSTL10 classifier compressor · STL10bit-rate gain: 121×Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy