AI Paper Atlas

Research map / Label-efficient and robust learning / Self-supervised and contrastive

ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders

Carlos Hinojosa, Shuming Liu, Bernard Ghanem

ECCV 2024 · Label-efficient and robust learning › Self-supervised and contrastive · approach: Masked autoencoder pretraining · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace random masking with band-pass (Green) filtered noise masks (ablation)MAE ViT-B · ADE20K, 800 epochsmIoU: 46.46 -> 49.18Improved
replace random masking with Green masks (ablation)MAE ViT-B · ImageNet-1K Top-1, 800 epochsTop-1 accuracy: 83.17 -> 83.57Improved
replace random masking with Green masks (ablation)MAE ViT-L · ADE20K, 800 epochsmIoU: 50.29 -> 51.46Improved
replace random masking with Blue (high-pass) masks (ablation)MAE ViT-B · ADE20K, 800 epochsmIoU: 46.46 -> 44.81Hurt
replace random masking with Red (low-pass) masks (ablation)MAE ViT-B · ADE20K, 800 epochsmIoU: 46.46 -> 44.78Hurt
replace random masking with Purple (band-stop) masks (ablation)MAE ViT-B · ADE20K, 800 epochsmIoU: 46.46 -> 45.96Hurt
Green masking at short pre-training (100 epochs) (ablation)MAE ViT-B · ImageNet-1K Top-1, 100 epochsTop-1 accuracy: 81.69 -> 81.82No clear effect
Green masking at 300 epochs (ablation)MAE ViT-B · COCO detection, 300 epochsAP bbox: 48.50 -> 48.70Improved
use more complex void-and-cluster blue noise generation (ablation)ColorMAE · downstream tasksaccuracyNo clear effect
use white noise instead of uniform noise for random masks (ablation)MAE · pre-training and fine-tuningaccuracyNo clear effect
Blue masking lowers reconstruction loss (ablation)MAE · pretraining loss vs downstreamdownstream performanceNo clear effect
Green masking on COCO detection vs MAE random at 1600 epochs (224px comparison)MAE · COCO AP bboxAP bbox: 50.6 -> 50.1Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy