atlas

Research map / Architectures and efficiency / CNN design

TinyLUT: Tiny Look-Up Table for Efficient Image Restoration at the Edge

NeurIPS 2024 · Architectures and efficiency › CNN design · approach: Dense matching and estimation CNNs · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes TinyLUT, a LUT-based image restoration framework that uses a separable mapping strategy and dynamic discretization mechanism to cut LUT storage by orders of magnitude while improving super-resolution and denoising accuracy on edge devices.

Problem

LUT-based image restoration suffers exponential LUT storage growth with convolution kernel size, which blocks deployment of CNN-mapped LUTs on resource-constrained edge devices.

Approach

Separable mapping strategy decomposes n×n convolutions and pointwise convolutions into many 1×1 sub-operations mapped to 1D LUTs whose outputs are averaged, turning storage from exponential to linear in kernel size; dynamic discretization splits 8-bit activations into learnable-clipped MSB and LSB branches to further shrink LUTs.</303>

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add separable mapping strategy (SMS) (ablation)TinyLUT-S · Set5, ×4 SISRPSNR: 29.82 -> 30.24Helped
Add separable mapping strategy (SMS) (ablation)TinyLUT-S · Set5, ×4 SISRLUT size: 1.274MB -> 164KBHelped
Add dynamic discretization mechanism (DDM) (ablation)TinyLUT-S · Set5, ×4 SISRPSNR: 30.24 -> 30.22No clear effect
Add dynamic discretization mechanism (DDM) (ablation)TinyLUT-S · Set5, ×4 SISRLUT size: 164KB -> 37KBHelped
Use TinyLUT-F instead of MuLUT-SDY-X2×4 SISR · Set5PSNR: 30.60 -> 31.18Helped
Use TinyLUT-F instead of MuLUT-SDY-X2×4 SISR · Set5storage: 4159KB -> 171KBHelped
Use TinyLUT-S instead of SRLUT-S×4 SISR · Set5PSNR: 29.82 -> 30.22Helped
Use TinyLUT-F instead of FSRCNN×4 SISR on Raspberry 4B · SISRruntime: 2143ms -> 387msHelped
Use TinyLUT-F instead of SPF-LUT+DFC×4 SISR · Set5storage: 2066KB -> 171KBHelped
Use TinyLUT-F instead of DnCNNimage denoising · Set12 and BSD68, noise levels 15/25/50average PSNR: 29.61 -> 28.93Hurt
Use TinyLUT-F instead of ARCNNimage deblocking · Classic5, JPEG quality factor 10PSNR-B: 28.76 -> 28.74Hurt
Use TinyLUT-F instead of ARCNNimage deblocking · LIVE1, JPEG quality factor 10PSNR-B: 28.77 -> 28.67Hurt

Surprising findings

Limitations

Experimental setup

Datasets: DIV2K

Benchmarks: Set5 Set14 Urban100 BSD100 Manga109 Set12 BSD68 Classic5 LIVE1

Metrics: PSNR SSIM PSNR-B latency storage

Baselines: SRLUT MuLUT SPLUT RCLUT SPF-LUT FSRCNN VDSR CARN-M DnCNN SRCNN

Builds on: SRLUT MuLUT SPLUT DnCNN depthwise separable convolutions

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy