atlas

Research map / Image generation / Image restoration

Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approach

CVPR 2024 · Image generation › Image restoration · approach: Low-light image enhancement · 45 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces the SDE dataset of over 30K spatio-temporally aligned real-world image-event pairs captured with a robotic arm, and EvLight, an event-guided low-light image enhancement network using SNR-guided regional feature selection and holistic-regional fusion.

Problem

Event-guided low-light image enhancement is limited by the lack of large-scale, real-world, spatio-temporally aligned image-event datasets, and existing fusion methods ignore region-wise noise discrepancies between images and events.

Approach

Capture aligned low/normal-light image-event pairs with a UR5 robotic arm following non-linear trajectories plus a matching temporal alignment strategy, and fuse modalities holistically (attention UNet) and regionally, using an SNR map to select image features in high-SNR regions and event features in low-SNR regions.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use EvLight instead of the strongest baselineLow-light image enhancement · SDE-inPSNR: 21.79 -> 22.44Helped
use EvLight instead of the strongest baselineLow-light image enhancement · SDE-outPSNR: 22.92 -> 23.21Helped
use EvLight instead of the strongest baselineLow-light image enhancement · SDSD-inPSNR: 27.58 -> 28.52Helped
use EvLight instead of the strongest baselineLow-light image enhancement · SDSD-outPSNR: 26.08 -> 26.67Helped
add events to the Base model (ablation)Base model · SDE-inPSNR: +0.23 dBHelped
add SNR-guided regional feature selection instead of no regional selection (ablation)Base model · SDE-inPSNR: 21.58 -> 22.44; 0.86 dB increaseHelped
use regional feature selection with an all-ones matrix instead of no selection (ablation)Base model · SDE-inPSNR: 21.58 -> 21.86; 0.28 dB increaseHelped
add image-regional feature selection (IRFS) (ablation)EvLight · SDE-inPSNR: 21.58 -> 21.92; 0.34 dB increaseHelped
add event-regional feature selection (ERFS) (ablation)EvLight · SDE-inPSNR: 21.58 -> 22.18; 0.60 dB increaseHelped
add both IRFS and ERFS (ablation)Base model · SDE-inPSNR: 21.58 -> 22.44; 0.86 dB increaseHelped

Surprising findings

Limitations

Experimental setup

Datasets: SDE (new) SDSD

Benchmarks: SDE dataset (SDE-in, SDE-out) SDSD (in/out) CED MVSEC

Metrics: PSNR PSNR* SSIM

Baselines: E2VID+ SNR-Net Uformer LLFlow-L-SKF Retinexformer ELIE eSL-Net Liu et al. (AAAI'23)

Builds on: Retinexformer SNR-Net ELIE v2e E2VID

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy