atlas

Research map / Image generation / Super-resolution

APISR: Anime Production Inspired Real-World Anime Super-Resolution

CVPR 2024 · Image generation › Super-resolution · approach: Efficient lightweight super-resolution · 14 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes APISR, an image-based real-world anime super-resolution method trained on a curated I-frame image dataset (API) with a prediction-oriented compression degradation model, hand-drawn line enhancement for pseudo-GT, and a balanced twin perceptual loss combining anime (ResNet50) and photorealistic (VGG) features.

Problem

Real-world anime super-resolution methods rely on video networks/datasets and photorealistic-domain techniques, leading to faint/distorted hand-drawn lines and unwanted color artifacts in GAN-based outputs.

Approach

Exploit anime production traits: select least-compressed I-frames ranked by image complexity assessment to build an image dataset, simulate video compression on single frames via prediction-oriented compression, enhance hand-drawn lines in pseudo-GT, and use a balanced twin perceptual loss mixing an anime-trained ResNet50 with VGG features.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use APISR instead of VQD-SRAnime super-resolution · AVC-RealLQNIQE: 8.202 -> 6.719Helped
Use APISR instead of VQD-SRAnime super-resolution · AVC-RealLQMANIQA: 0.464 -> 0.514Helped
Use APISR instead of VQD-SRAnime super-resolution · AVC-RealLQCLIPIQA: 0.567 -> 0.711Helped
Use API instead of AVC-Train for training (ablation)APISR · AVC-RealLQNIQE: 7.681 -> 6.719Helped
Use API instead of randomly selected training images (ablation)APISR · AVC-RealLQNIQE: 8.006 -> 6.719Helped
Select I-Frames using ICA instead of IQA (ablation)APISR training dataset · AVC-RealLQNIQE: 7.876 -> 6.912Helped
Add 720P rescaling to I-Frame + ICA selection (ablation)APISR training dataset · AVC-RealLQNIQE: 6.912 -> 6.719Helped
Add prediction-oriented compression instead of High-Order degradation (ablation)APISR degradation model · AVC-RealLQMANIQA: 0.483 -> 0.506Helped
Add prediction-oriented compression instead of Random Order degradation (ablation)APISR degradation model · AVC-RealLQMANIQA: 0.491 -> 0.506Helped
Add shuffled resize to prediction-oriented compression (ablation)APISR degradation model · AVC-RealLQNIQE: 7.133 -> 6.719Helped
Add hand-drawn line enhancement and twin perceptual loss (ablation)APISR · AVC-RealLQCLIPIQA: 0.689 -> 0.711Helped
Add twin perceptual loss after hand-drawn line enhancement (ablation)APISR · AVC-RealLQNIQE: 7.182 -> 6.835Helped

Surprising findings

Limitations

Experimental setup

Datasets: API (Anime Production-oriented Image) dataset Danbooru AVC-Train

Benchmarks: AVC-RealLQ

Metrics: NIQE MANIQA CLIPIQA parameter count

Baselines: Real-ESRGAN BSRGAN RealBasicVSR AnimeSR VQD-SR

Builds on: Real-ESRGAN AnimeSR VQD-SR GRL BSRGAN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy