atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

NightCC: Nighttime Color Constancy via Adaptive Channel Masking

CVPR 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Geometric alignment and synthetic-to-real adaptation · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes an unsupervised domain adaptation mean-teacher framework for nighttime color constancy that uses adaptive channel masking and pixel-wise light uncertainty to learn from unlabeled night images with labeled daytime data.

Problem

Color constancy (illuminant estimation) under nighttime conditions with multiple colored light sources and low-light sensor noise, where models trained on daytime/indoor data generalize poorly and pixel-level nighttime labels are costly.

Approach

Combines mean-teacher semi-supervised learning with (1) adaptive channel masking, which identifies feature channels whose covariance is insensitive to Night Augmentation (simulated multi-light colors and sensor read noise) and masks them in the student, and (2) light uncertainty, a pixel-wise confidence map from a two-pass teacher prediction used to weight the unsupervised loss.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use NightCC instead of MIMTNighttime color constancy · Nighttime datasetmean MAE: 6.14 -> 4.82Helped
Use NightCC instead of MIMTNighttime color constancy · Nighttime datasetmedian MAE: 5.84 -> 4.69Helped
Use NightCC with 10% labeled and 90% unlabeled training data instead of MIMTColor constancy · LSMI testmean MAE: 2.48 -> 3.04Hurt
Add unlabeled nighttime data (ablation)NightCC · Nighttime datasetmean MAE: 7.36 -> 6.95Helped
Add light uncertainty (ablation)NightCC with unlabeled nighttime data · Nighttime datasetmean MAE: 6.95 -> 5.40Helped
Add adaptive channel masking (ablation)NightCC with light uncertainty · Nighttime datasetmean MAE: 5.40 -> 4.82Helped
Add unlabeled nighttime data (ablation)NightCC · Nighttime datasetmedian MAE: 6.65 -> 6.21Helped
Add light uncertainty (ablation)NightCC with unlabeled nighttime data · Nighttime datasetmedian MAE: 6.21 -> 4.97Helped
Add adaptive channel masking (ablation)NightCC with light uncertainty · Nighttime datasetmedian MAE: 4.97 -> 4.69Helped
Use unlabeled training data in addition to 10% labeled data (ablation)NightCC · LSMI testmean MAE: 5.71 -> 3.04Helped

Surprising findings

Limitations

Experimental setup

Datasets: Sony daytime dataset NUS-8 LSMI nighttime dataset (720 unlabeled, 64 labeled)

Benchmarks: Nighttime dataset (own) LSMI

Metrics: mean angular error median angular error

Baselines: CLCC Quasi-U AngularGAN MIMT MSCC FFCC FC4 Gray-Pixel Gray-Index White-Patch

Builds on: mean teacher U-Net AngularGAN Quasi-U

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy