AI Paper Atlas

Research map / Video / Video segmentation and tracking

A Perceptual Quality Metric for Video Frame Interpolation

Qiqi Hou, Abhijay Ghildyal, Feng Liu

ECCV 2022 · Video › Video segmentation and tracking · approach: Video frame interpolation · 24 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use spatio-temporal video metric instead of per-frame image metric LPIPSVFI perceptual metric · VFIPS validation2AFC: 0.808 -> 0.830Improved
use spatio-temporal video metric instead of per-frame LPIPSVFI perceptual metric · BVI-VFI testSROCC: 0.628 -> 0.794Improved
use our metric instead of strongest video baselineVFI perceptual metric · VFIPS validation and BVI-VFI2AFC / SROCC / PLCC / KROCC: 0.025 in terms of 2AFC, 0.180 in SROCC, 0.188 in PLCC, 0.161 in KROCCImproved
use our metric on large-motion 4K videosVFI perceptual metric · X-TEST 4K2AFC: 0.748 -> 0.789Improved
use 2D per-frame extractor instead of AlexNet (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.761 -> 0.794Improved
use 2D extractor instead of I3D (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.659 -> 0.794Improved
use 2D extractor instead of Conv3D variant (Ours-3D) (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.728 -> 0.794Improved
add spatio-temporal module (Conv3D) over no module (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.617 -> 0.761Improved
use LN-free compact Swin ST module instead of Conv3D (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.761 -> 0.794Improved
remove LayerNorm layers from Swin block (ablation)VFI perceptual metric · BVI-VFI testSROCC / PLCC / KROCC: 0.070 on SROCC, 0.124 on PLCC, and 0.089 on KROCCImproved
use original Swin block instead of Conv3D (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.761 -> 0.728Hurt
add automatic LPIPS annotations to human annotations (ablation)VFI perceptual metric · BVI-VFI testSROCC: 0.719 -> 0.794Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy