AI Paper Atlas

Research map / Video / Video segmentation and tracking

Learning Temporally and Semantically Consistent Unpaired Video-to-Video Translation through Pseudo-Supervision from Synthetic Optical Flow

Kaihong Wang, Kumar Akash, Teruhisa Misu

AAAI 2022 · Video › Video segmentation and tracking · approach: Learned optical flow estimation · 11 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace estimated motion guidance with consistent synthetic optical flowUnpaired video-to-video translation · Viper-to-Cityscapeswarping error: 0.039703 -> 0.035984Improved
Add unsupervised recycle and spatial losses together (ablation)Video-to-labels translation · VipermIoU: 0.16 -> 9.89Improved
Add unsupervised recycle loss to the spatial loss (ablation)Video-to-labels translation · VipermIoU: 0.16 -> 9.89Improved
Add video domain regularization suppression (ablation)UR + US video-to-labels model · Viper labels-to-videoMP: 29.50 -> 37.93Improved
Add cycle loss (ablation)Video-to-labels model with UR, US, and VDRS · Viper video-to-labelsmIoU: 9.53 -> 12.29Improved
Add cycle loss (ablation)Viper-to-Cityscapes translation with UR and US · Viper-to-Cityscapeswarping error: 0.049261 -> 0.047391Improved
Add content loss (ablation)Viper-to-Cityscapes translation with UR and US · Viper-to-Cityscapeswarping error: 0.049261 -> 0.035984Improved
Replace synthetic flow with estimated optical flow (ablation)Proposed translation method · Viper-to-Cityscapeswarping error: 0.035984 -> 0.048983Hurt
Use translation-only synthetic flow (ablation)Proposed translation method · Viper-to-Cityscapeswarping error: 0.035984 -> 0.050842Hurt
Use scaling-only synthetic flow (ablation)Proposed translation method · Viper-to-Cityscapeswarping error: 0.035984 -> 0.037798Hurt
Remove Gaussian noise from synthetic future-frame generation (ablation)Proposed translation method · Viper video-to-labelsmIoU: 12.29 -> 0.16Hurt
Use mismatched synthetic flows across source and target domains (ablation)Proposed translation method · Viper video-to-labelsmIoU: 12.29 -> 0.46Hurt

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 1 of 1 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy