Research map / Label-efficient and robust learning / Domain adaptation and generalization
Towards Unsupervised Domain Bridging via Image Degradation in Semantic Segmentation
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes DiDA, a plug-and-play UDA plugin that builds continuous intermediate domains via forward-diffusion-style image degradation and compensates semantic shift with a diffusion encoder trained to reconstruct degraded inputs.
Problem
Self-training UDA for semantic segmentation overlooks explicit modeling of domain-shared feature extraction; naive degradation-based augmentation causes semantic shift (loss of discriminative features).
Approach
Treat incremental image degradation (Gaussian noise, blur, masking) as a diffusion forward process to create intermediate domains, and add a time-conditioned diffusion encoder with a reconstruction head whose residual features compensate the semantic shift, so the segmentation encoder learns domain-invariant features across degradation levels.
Key results
- On GTA->CS, DiDA on MIC reaches 76.8 mIoU (vs 75.5 reproduced MIC baseline), a new SOTA reported by the authors.
- DiDA on DAFormer improves GTA->CS from 68.3 to 70.3 mIoU (+2.0) and on CS->ACDC from 55.4 to 59.1 mIoU.
- Gains reported across DAFormer, HRDA, MIC (Transformer) and CNN-based MIC, ranging 0.8% to 3.7% mIoU.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add DiDA to DAFormer | DAFormer · GTA→CS | mIoU: 68.3 -> 70.3 | Helped |
| add DiDA to HRDA | HRDA · GTA→CS | mIoU: 73.8 -> 75.4 | Helped |
| add DiDA to MIC | MIC · GTA→CS | mIoU: 75.5 -> 76.8 | Helped |
| add DiDA to DAFormer | DAFormer · SYN→CS | mIoU: 60.9 -> 63.1 | Helped |
| add DiDA to HRDA | HRDA · SYN→CS | mIoU: 65.8 -> 67.8 | Helped |
| add DiDA to MIC | MIC · SYN→CS | mIoU: 67.3 -> 68.6 | Helped |
| add DiDA to DAFormer | DAFormer · CS→ACDC | mIoU: 55.4 -> 59.1 | Helped |
| add DiDA to HRDA | HRDA · CS→ACDC | mIoU: 68.0 -> 70.7 | Helped |
| add DiDA to MIC | MIC · CS→ACDC | mIoU: 69.8 -> 72.1 | Helped |
| remove time embedding (ablation) | DiDA with DAFormer · GTA→CS | mIoU | Hurt |
| remove reconstruction loss L^R (ablation) | DiDA with DAFormer · GTA→CS | mIoU | Hurt |
| remove degraded image consistency loss L^D (ablation) | DiDA with DAFormer · GTA→CS | mIoU | Hurt |
Surprising findings
- Naive time-embedding-only degradation augmentation (g_time without compensation) performs heavily worse, attributed to semantic shift from excessive degradation.
Limitations
- Moderate training overhead from the diffusion encoder and extra forward passes on degraded inputs.
- Degradation operations and their combinations are manually chosen heuristically.
- Mask-based extension gives smaller gains than the default noise version.
Experimental setup
Datasets: GTAV SYNTHIA Cityscapes ACDC ImageNet-1k
Benchmarks: GTAV->Cityscapes SYNTHIA->Cityscapes Cityscapes->ACDC
Metrics: mIoU per-class IoU
Baselines: DAFormer HRDA MIC FST DiGA DTS ADFormer CoPT TransDA DACS ProDA DAP
Builds on: DACS DAFormer HRDA MIC Denoising Diffusion Probabilistic Models cold diffusion
Closest papers by meaning
- Universal Domain Adaptation for Semantic Segmentation (CVPR 2025 · similarity 0.91)
- Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation (NeurIPS 2022 · similarity 0.91)
- Unsupervised Domain Adaptation for Semantic Segmentation by Content Transfer (AAAI 2021 · similarity 0.90)
- Unsupervised Model Adaptation for Continual Semantic Segmentation (AAAI 2021 · similarity 0.90)
- Balanced Learning for Domain Adaptive Semantic Segmentation (ICML 2025 · similarity 0.90)
- Open-Set Domain Adaptation for Semantic Segmentation (CVPR 2024 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
