AI Paper Atlas

Research map / Video / Video segmentation and tracking

Learning Spatio-Temporal Downsampling for Effective Video Upscaling

Xiaoyu Xiang, Yapeng Tian, Vijay Rengarajan, Lucas D. Young, Bo Zhu, Rakesh Ranjan

ECCV 2022 · Video › Video segmentation and tracking · approach: Video restoration with temporal priors · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
learned STAA downsampler instead of nearest in time (ablation)upscaling network · Vimeo-90k (2x time, 1x space)PSNR: 38.22 -> 46.75Improved
learned STAA_quant instead of Gaussian pre-filter (ablation)upscaling network · Vimeo-90k (2x time, 2x space)PSNR: 37.44 -> 40.42Improved
Gaussian pre-filter instead of nearest-bicubic (ablation)upscaling network · Vimeo-90k (2x time, 2x space)PSNR: 28.88 -> 37.44Improved
softmax constraint on STAA filter weights (ablation)STAA downsampler · Vimeo-90k (2x time, 2x space)PSNR: 39.44 -> 40.40Improved
differentiable quantization layer (ablation)STAA downsampler · Vimeo-90k (2x time, 2x space)PSNR: 40.40 -> 40.42No clear effect
content-adaptive filter weights (ablation)STAA downsampler · Vimeo-90k (2x time, 2x space)PSNR: 40.40 -> 38.13Hurt
3D RDB instead of naive 3D conv in upsampler (ablation)upsampler · Upsampler module ablationPSNR: 28.67 -> 31.35Improved
deformable temporal modeling (DTM) instead of naive 3D conv (ablation)upsampler · Upsampler module ablationPSNR: 28.67 -> 31.55Improved
add DTM to 3D RDB upsampler (ablation)upsampler · Upsampler module ablationPSNR: 31.35 -> 32.00Improved
STAA downsampled input instead of nearest-bicubic (ablation)ZSM · Vimeo-90k (4x space, 2x time)PSNR: 33.48 -> 35.62Improved
our upsampler instead of FLAVR upsampler (ablation)STAA framework · Vimeo-90k (2x time)PSNR: 44.72 -> 46.59Improved
add adaptive filter vs unconstrained STAA filter (ablation)STAA downsampler · Vimeo-90k (2x time, 1x space)PSNR: 46.50 -> 45.32Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy