AI Paper Atlas

Research map / Video / Video segmentation and tracking

Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting

Kaidong Zhang, Jialun Peng, Jingjing Fu, Dong Liu

TPAMI 2024 · Video › Video segmentation and tracking · approach: Learned optical flow estimation · 23 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add global tokens to local window attention (ablation)FGT++ spatial transformer · DAVIS (square masks)PSNR: 31.37 -> 31.62Improved
add TD-MHSA (ablation)FGT++ temporal transformer · DAVIS (square masks)PSNR: 31.62 -> 31.87Improved
add FGFP module (ablation)FGT++ · DAVIS (square masks)PSNR: 31.62 -> 32.36Improved
add FGFI module (ablation)FGT++ · DAVIS (square masks)PSNR: 31.62 -> 31.82Improved
combine flow completion with deformable convolution in FGFP (ablation)FGT++ FGFP · DAVIS (square masks)PSNR: 31.76 -> 32.36Improved
use FGFI instead of simple concatenation (ablation)FGT++ · DAVIS (square masks)PSNR: 31.68 -> 31.82Improved
integrate FGFI in more than the first spatial transformer (ablation)FGT++ · DAVIS (square masks)PSNR: 31.82 -> 31.87No clear effect
use 4 TD-MHSA blocks instead of 1 (ablation)FGT++ · DAVIS (square masks)PSNR: 31.66 -> 31.87Improved
add FGFP to blocks beyond encoder+3 (ablation)FGT++ · DAVIS (square masks)PSNR: 32.36 -> 32.34No clear effect
add local aggregation to flow completion (ablation)LAFC · DAVIS (square masks)EPE: 0.546 -> 0.524Improved
add edge loss to flow completion (ablation)LAFC · DAVIS (square masks)EPE: 0.524 -> 0.511Improved
add amplitude loss (ablation)FGT++ · DAVIS (square masks)PSNR: 32.62 -> 33.01Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy