atlas

Research map / Image generation / Image restoration

Underwater Organism Color Fine-Tuning via Decomposition and Guidance

AAAI 2024 · Image generation › Image restoration · approach: Reflection removal · 23 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CECF, a disentangled (color code / content code) underwater image enhancement network whose color codes can be fused with guidance images to fine-tune organism color in a controllable way.

Problem

Underwater organisms' colors are distorted by wavelength-dependent attenuation, and existing UIE methods output a single fixed-color result because paired ground truth is hard to obtain, so they cannot produce diverse or controllable colors.

Approach

Decompose the enhancement network into a color code and a content code, learn content invariance via self- and cross-reconstruction (style/content disentanglement after Huang et al. 2018), and fine-tune color by fusing the color code of a guidance image (long-wavelength colored image) with the distorted image's color code using a controllable parameter alpha.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add Structural Loss (ablation)CECF · UIEB testSSIM: 0.883 -> 0.894Helped
add Structural Loss (ablation)CECF · EUVP-I testSSIM: 0.856 -> 0.856No clear effect
increase color code length from 8 to 16 (ablation)CECF · UIEB and EUVP-I testPSNR: -0.1148; -0.0294Mixed
increase color code length from 8 to 16 (ablation)CECF · UIEB and EUVP-I testSSIM: 0.0017; 0.0002No clear effect
increase color code length from 8 to 16 (ablation)CECF · UIEB and EUVP-I testUIQM: -0.0185; 0.0318Mixed
vary color guidance and increase α (ablation)CECF color controller · underwater and natural guidance imagesUIQMMixed
vary the ratio λ1:λ2 from 10 to 2, 4, 6, or 8 (ablation)CECF · UIEB testPSNR: -0.282; -0.307; -0.065; -0.288Hurt

Surprising findings

Limitations

Experimental setup

Datasets: UIEB EUVP-I (Underwater ImageNet subset of EUVP) EUVP-S (Underwater Scenes subset of EUVP)

Benchmarks: UIEB EUVP-I

Metrics: PSNR SSIM UIQM UCIQE

Baselines: ADMNet FUnIE MLLE URes HLRP WaterNet PhyNN SMBL UWNet UGAN SGUIE

Builds on: MUNIT (Huang et al. 2018) Structural Loss (Zhao et al. 2016) GAN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy