AI Paper Atlas

Research map / Graph learning / Knowledge and temporal graphs

Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection

Kyle Min, Sourya Roy, Subarna Tripathi, Tanaya Guha, Somdeb Majumdar

ECCV 2022 · Graph learning › Knowledge and temporal graphs · approach: Temporal graph neural architectures · 50 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add audio negative-sampling augmentation (ablation)feature encoder · AVA-ActiveSpeaker valmAP: 80.2 -> 82.6Improved
add TSM to the visual encoder (ablation)SPELL · AVA-ActiveSpeaker valmAP: 82.6 -> 88.0Improved
add context-reasoning GNN with undirected graph (ablation)SPELL · AVA-ActiveSpeaker valmAP: 88.0 -> 92.4Improved
add forward/backward graphs (Bi-dir) (ablation)SPELL · AVA-ActiveSpeaker valmAP: 92.4 -> 93.9Improved
add spatial features of face location (ablation)SPELL · AVA-ActiveSpeaker valmAP: 93.9 -> 94.2Improved
use only visual features (remove audio) (ablation)SPELL · AVA-ActiveSpeaker valmAP: 94.2 -> 84.9Hurt
use only audio features (remove visual) (ablation)SPELL · AVA-ActiveSpeaker valmAP: 94.2 -> 55.6Hurt
increase filter dimension from 64 to 128 (ablation)SPELL · AVA-ActiveSpeaker valmAP: 94.2 -> 94.1No clear effect
increase filter dimension from 64 to 256 (ablation)SPELL · AVA-ActiveSpeaker valmAP: 94.2 -> 94.1No clear effect
decrease filter dimension from 64 to 16 (ablation)SPELL · AVA-ActiveSpeaker valmAP: 94.2 -> 93.5Hurt
connect too distant face-crops (larger tau) (ablation)SPELL · AVA-ActiveSpeaker valmAPHurt
use a larger number of graph nodes (ablation)SPELL · AVA-ActiveSpeaker valmAPNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy