Research map / Video / Video segmentation and tracking
Decompose the Sounds and Pixels, Recompose the Events
Varshanth R. Rao, Md Ibrahim Khalil, Haoda Li, Peng Dai, Juwei Lu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use EDRNet instead of PSP | AVE localization · O-AVE WSEL | accuracy (%): 72.80 -> 73.86 | Improved |
| use EDRNet instead of PSP | AVE localization · O-AVE SEL | accuracy (%): 76.84 -> 77.93 | Improved |
| add B2ILC (ablation) | EDRNet · O-AVE SEL | accuracy (%): 76.10 -> 76.58 | Improved |
| add B2ILC (ablation) | EDRNet · O-AVE WSEL | accuracy (%): 72.98 -> 73.86 | Improved |
| add LSS loss (ablation) | EDRNet + B2ILC · O-AVE SEL | accuracy (%): 76.58 -> 77.10 | Improved |
| add SMB video fusion (ablation) | EDRNet + B2ILC + LSS loss · O-AVE SEL | accuracy (%): 77.10 -> 77.93 | Improved |
| remove positional encoding (ablation) | EDRNet · O-AVE WSEL | accuracy (%): 73.86% -> 72.88% (↓0.98%) | Hurt |
| remove positional encoding (ablation) | EDRNet · O-AVE SEL | accuracy (%): 77.93% -> 77.09% (↓0.84%) | Hurt |
| add the AV decomposition branch to audio-only (ablation) | EDRNet audio branch · O-AVE SEL | accuracy (%): 65.84 -> 76.11 | Improved |
| add the AV decomposition branch to visual-only (ablation) | EDRNet visual branch · O-AVE SEL | accuracy (%): 66.93 -> 75.26 | Improved |
| enable audio and visual branches with late fusion, without the AV branch (ablation) | EDRNet · O-AVE SEL | accuracy (%): 75.88 | Improved |
| enable audio, visual, and AV decomposition branches (ablation) | EDRNet · O-AVE SEL | accuracy (%): 75.88 -> 77.93 | Improved |
Closest papers by meaning
- Audio-Visual Event Localization in Unconstrained Videos (ECCV 2018 · similarity 0.89)
- Dense Audio-Visual Event Localization Under Cross-Modal Consistency and Multi-Temporal Granularity Collaboration (AAAI 2025 · similarity 0.88)
- Towards Open-Vocabulary Audio-Visual Event Localization (CVPR 2025 · similarity 0.87)
- Weakly-Supervised Audio-Visual Video Parsing with Prototype-based Pseudo-Labeling (CVPR 2024 · similarity 0.86)
- Audio-Visual Semantic Graph Network for Audio-Visual Event Localization (CVPR 2025 · similarity 0.86)
- Adapting to the Unknown: Training-Free Audio-Visual Event Perception with Dynamic Thresholds (CVPR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
