Research map / Video / Video segmentation and tracking
FFNet: Video Fast-Forwarding via Reinforcement Learning
Shuyue Lan, Rameswar Panda, Qi Zhu, Amit K. Roy-Chowdhury
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use FFNet's reinforcement-learning fast-forward policy instead of the supervised baseline | video fast-forwarding · Tour20, hit number 10 | segment-level coverage: 0.685 -> 0.893 | Improved |
| Use FFNet's reinforcement-learning fast-forward policy instead of the supervised baseline | video fast-forwarding · TVSum, hit number 10 | segment-level coverage: 0.526 -> 0.941 | Improved |
| Select frames with FFNet rather than the compared baselines | video fast-forwarding · Tour20 | human rating: 8.49 -> 8.70 | Improved |
| Select frames with FFNet rather than the compared baselines | video fast-forwarding · TVSum | human rating: 8.10 -> 8.95 | Improved |
| Process only selected frames with FFNet rather than processing every video frame | video fast-forwarding · All tested videos | frames processed: 100% -> 18.67% | Improved |
| Use online Q-learning fast-forwarding instead of Spectral Clustering | video fast-forwarding · TVSum random subset, hit number 10 | coverage: 58% -> 97% | Improved |
| Vary the reward's Gaussian window size among 2, 3, and 4 (ablation) | FFNet · TVSum | segment-level coverage | No clear effect |
Later papers that compared with this method
2 later accepted papers report FFNet as a baseline in their results tables; 2 of them report a better number on most of the results they share with it.
- BEVSync: Asynchronous Data Alignment for Camera-based Vehicle-Infrastructure Cooperative Perception Under Uncertain Delays (AAAI 2025 · better on 6 of 6 shared results)
- Straight to the Point: Fast-Forwarding Videos via Reinforcement Learning Using Textual Data (CVPR 2020 · better on 3 of 3 shared results)
Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.
Closest papers by meaning
- SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generation (ICLR 2025 · similarity 0.84)
- FastVID: Dynamic Density Pruning for Fast Video Large Language Models (NeurIPS 2025 · similarity 0.84)
- VEDIT: Latent Prediction Architecture For Procedural Video Representation Learning (ICLR 2025 · similarity 0.84)
- Optical-Flow Guided Prompt Optimization for Coherent Video Generation (CVPR 2025 · similarity 0.84)
- From Slow Bidirectional to Fast Autoregressive Video Diffusion Models (CVPR 2025 · similarity 0.84)
- EvoGround: Self-Evolving Video Agents for Video Temporal Grounding (NeurIPS 2026 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
