Research map / Video / Video segmentation and tracking
Learning Video Object Segmentation With Visual Memory
Pavel Tokmakov, Karteek Alahari, Cordelia Schmid
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add appearance stream (DeepLab fc6 features) (ablation) | visual memory model · DAVIS val | mean IoU: 43.5 -> 70.1 | Improved |
| use DeepLab features instead of raw RGB (ablation) | visual memory model · DAVIS val | mean IoU: 58.3 -> 70.1 | Improved |
| pretrain appearance net on PASCAL VOC segmentation instead of ImageNet only (ablation) | visual memory model · DAVIS val | mean IoU: 64.1 -> 70.1 | Improved |
| add motion stream (ablation) | visual memory model · DAVIS val | mean IoU: 59.6 -> 70.1 | Improved |
| add ConvGRU memory module (ablation) | visual memory model · DAVIS val | mean IoU: 64.1 -> 70.1 | Improved |
| use ConvGRU instead of ConvRNN (ablation) | memory module · DAVIS val | mean IoU: 68.7 -> 70.1 | Improved |
| use ConvGRU instead of ConvLSTM (ablation) | memory module · DAVIS val | mean IoU: 68.9 -> 70.1 | No clear effect |
| use bidirectional instead of unidirectional processing (ablation) | ConvGRU · DAVIS val | mean IoU: 67.2 -> 70.1 | Improved |
| use fc7 instead of fc6 features (ablation) | appearance stream · DAVIS val | mean IoU: 70.1 -> 69.8 | No clear effect |
| use conv5 instead of fc6 features (ablation) | appearance stream · DAVIS val | mean IoU: 70.1 -> 67.7 | Hurt |
| train on real DAVIS instead of synthetic FT3D with LDOF flow (ablation) | visual memory model · DAVIS val | mean IoU: 59.6 -> 70.1 | Improved |
| add CRF post-processing | visual memory model · DAVIS val | mean IoU: 70.1 -> 75.9 | Improved |
Closest papers by meaning
- Learning to Segment Moving Objects (IJCV 2018 · similarity 0.95)
- A Survey on Deep Learning Technique for Video Segmentation (TPAMI 2022 · similarity 0.92)
- Video Object Segmentation Using Space-Time Memory Networks (ICCV 2019 · similarity 0.92)
- Video Object Segmentation with Episodic Graph Memory Networks (ECCV 2020 · similarity 0.92)
- Learning Segmentation from Point Trajectories (NeurIPS 2024 · similarity 0.89)
- LiVOS: Light Video Object Segmentation with Gated Linear Matching (CVPR 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
