atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

One-to-Multiple: A Progressive Style Transfer Unsupervised Domain-Adaptive Framework for Kidney Tumor Segmentation

NeurIPS 2024 · Label-efficient and robust learning › Domain adaptation and generalization · approach: Cross-modality medical segmentation adaptation · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes PSTUDA, a one-to-multiple unsupervised domain adaptation framework for kidney tumor segmentation across multi-sequence MRI, using a multi-level style dictionary and cascaded style fusion with point-wise instance normalization, and releases the MSKT dataset.

Problem

Annotation burden for kidney and tumor segmentation across multiple MRI sequences; existing UDA methods are one-to-one and inefficient for multi-target transfer.

Approach

A single shared generator translates a labeled source domain into multiple target MRI sequences using learnable per-domain multi-level style dictionaries and cascaded style fusion modules that recombine content and style per pixel via Point-wise Instance Normalization (PIN), with the generated images then used to train a U-Net segmenter.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Apply PSTUDA rather than CycleGANKidney tumor segmentation using T1c→FS T2W adaptation · MSKT: T1c→FS T2Waverage DSC (%): 80.25 -> 81.33Helped
Apply PSTUDA rather than MUNITKidney tumor segmentation using T1c→T2W adaptation · MSKT: T1c→T2Waverage DSC (%): 62.06 -> 65.52Helped
Apply PSTUDA rather than CycleGANKidney tumor segmentation using T1c→DWI adaptation · MSKT: T1c→DWIaverage DSC (%): 79.74 -> 80.61Helped
Apply PSTUDA rather than CycleGANKidney tumor segmentation using CT→DWI adaptation · KiTS19→MSKT: CT→DWIaverage DSC (%): 84.40 -> 82.54Hurt
Add Progressive Style Transfer (PST) (ablation)StarGAN v2 baseline · MSKT: T1c→FS T2Waverage DSC (%): 66.71 -> 81.34Helped
Add Multi-Scale Discriminator (MS_D) (ablation)StarGAN v2 baseline with PST · MSKT: T1c→T2Waverage DSC (%): 61.48 -> 65.52Helped
Replace Mapping Network and Style Encoder with M_SD (ablation)StarGAN v2 baseline · MSKT: T1c→FS T2Waverage DSC (%): 66.71 -> 77.62Helped
Add Point-wise Instance Normalization (PIN) (ablation)Baseline with M_SD · MSKT: T1c→T2Waverage DSC (%): 48.14 -> 61.48Helped
Replace PIN with AdaIN (ablation)PSTUDA · MSKT: T1c→FS T2Waverage DSC (%): 81.33 -> 73.58Hurt
Replace PIN with BIN (ablation)PSTUDA · MSKT: T1c→T2Waverage DSC (%): 65.52 -> 61.58Hurt
Set M_SD depth to 16384 instead of 4096 (ablation)PSTUDA · MSKT: T1c→FS T2Waverage DSC (%): 81.33 -> 75.69Hurt
Set M_SD depth to 16384 instead of 4096 (ablation)PSTUDA · MSKT: T1c→T2Waverage DSC (%): 65.52 -> 67.56Helped

Surprising findings

Limitations

Experimental setup

Datasets: MSKT KiTS19 abdominal multi-organ MR/CT dataset

Benchmarks: MSKT KiTS19

Metrics: DSC HD95

Baselines: CycleGAN MUNIT SIFA DEPL StarGAN v2 Supervised training W/o adaptation

Builds on: StarGAN v2 CycleGAN AdaIN U-Net

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy