atlas

Research map / Image generation / Fast diffusion sampling

MDFL: Multi-Domain Diffusion-Driven Feature Learning

AAAI 2024 · Image generation › Fast diffusion sampling · approach: Diffusion models as perception tools · 18 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes MDFL, a diffusion-driven multi-domain (spectral, spatial, frequency) feature learning network with a feature reuse module, evaluated for multimodal HSI+LiDAR/DSM land-cover classification on Houston2013, Trento and MUUFL.

Problem

Classifying high-dimensional multimodal remote sensing images (HSI with LiDAR/DSM) is limited by single-domain (spatial) feature learning and by fusion approaches that treat multimodal fusion as a black box, which ignores spectral, spatial and frequency information.

Approach

Uses a U-Net diffusion model trained to predict multi-noise-level inputs (t=0,50,100,200,400) with spectral-spatial attention and a frequency-domain learnable filter, plus a feature reuse module that fuses shallow and deep features across the two modalities before an MLP classifier.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use MDFL instead of the strongest listed baseline, MFTRemote-sensing multimodal classification · Houston2013OA (%): 89.80 -> 99.16Helped
Use MDFL instead of the strongest listed baseline, CrossRemote-sensing multimodal classification · Houston2013AA (%): 92.70 -> 96.72Helped
Use MDFL instead of the strongest listed baseline, CNN-2DRemote-sensing multimodal classification · Houston2013κ (×100): 91.65 -> 94.09Helped
Use MDFL instead of CNN-2DRemote-sensing multimodal classification · TrentoOA (%): 98.65 -> 99.43Helped
Use MDFL instead of CrossRemote-sensing multimodal classification · TrentoAA (%): 97.35 -> 96.13Hurt
Use MDFL instead of CNN-2DRemote-sensing multimodal classification · Trentoκ (×100): 98.19 -> 94.41Hurt
Use MDFL instead of MFTRemote-sensing multimodal classification · MuuflOA (%): 94.34 -> 96.96Helped
Use MDFL instead of MFTRemote-sensing multimodal classification · MuuflAA (%): 81.48 -> 82.63Helped
Use MDFL instead of MFTRemote-sensing multimodal classification · Muuflκ (×100): 92.51 -> 94.63Helped
Add joint frequency-domain analysis (ablation)MDFL · Three-dataset averageOA (%): 97.75 -> 98.51Helped
Add original information to feature reuse (ablation)MDFL · Three-dataset averageOA (%): 98.10 -> 98.51Helped
Fuse multiple noise time steps rather than use single-step training (ablation)MDFL · Houston2013, Trento, and Muuflclassification performanceHelped

Limitations

Experimental setup

Datasets: Houston2013 Trento MUUFL

Benchmarks: Houston2013 Trento MUUFL

Metrics: overall accuracy average accuracy kappa coefficient

Baselines: RNN Cross CNN-2D CALC ViT MFT

Builds on: denoising diffusion probabilistic models U-Net multi-head self-attention

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy