AI Paper Atlas

Research map / Video / Video segmentation and tracking

Mining Relations among Cross-Frame Affinities for Video Semantic Segmentation

Guolei Sun, Yun Liu, Hao Tang, Ajad Chhatkuli, Le Zhang, Luc Van Gool

ECCV 2022 · Video › Video segmentation and tracking · approach: Video semantic and panoptic segmentation · 38 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add more reference frames (3 refs at -9,-6,-3 vs single ref at -3) (ablation)MRCFA MiT-B1 · VSPW valmIoU: 38.1 -> 38.9Improved
add more reference frames (3 refs vs single ref at -6) (ablation)MRCFA MiT-B1 · VSPW valmVC8: 85.1 -> 88.8Improved
add a single reference frame to SegFormer baseline (-3) (ablation)SegFormer MiT-B1 · VSPW valmIoU: 36.5 -> 38.1Improved
keep all tokens (p=100%) instead of selecting 50% (ablation)MRCFA MiT-B1 · VSPW valmIoU: 38.9 -> 39.4 mIoU; memory 903 -> 1068, FPS 40.1 -> 32.9Mixed
reduce token selection ratio to 10% (ablation)MRCFA MiT-B1 · VSPW valmIoU: 38.9 -> 35.9Hurt
use three feature scales instead of last stage only (ablation)MRCFA MiT-B1 · VSPW valmIoU: 37.5 -> 38.9Improved
use three feature scales instead of two (ablation)MRCFA MiT-B1 · VSPW valmIoU: 38.1 -> 38.9Improved
add MAA to SAR in the affinity decoder (ablation)Affinity Decoder MiT-B1 · VSPW valmIoU: 37.8 -> 38.9Improved
add SAR to MAA in the affinity decoder (ablation)Affinity Decoder MiT-B1 · VSPW valmIoU: 37.4 -> 38.9Improved
replace Feature Pyramid with affinity decoder (ablation)MRCFA MiT-B1 · VSPW valmIoU: 37.8 -> 38.9Improved
replace SegFormer with MRCFASegFormer MiT-B5 · VSPW valmIoU: 48.2 -> 49.9Improved
replace SegFormer with MRCFASegFormer MiT-B1 · Cityscapes valmIoU: 74.1 -> 75.1Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy