AI Paper Atlas

Research map / Video / Action recognition

Semantically Guided Representation Learning For Action Anticipation

Anxhelo Diko, Danilo Avola, Bardh Prenkaj, Federico Fontana, Luigi Cinque

ECCV 2024 · Video › Action recognition · approach: Disentangled action recognition · 8 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add semantic prototype learning with cosine attention head (ablation)baseline ViT-B anticipation model · EK100 val (RGB)Action Top-5 recall: 15.2 -> 17.8Improved
add TCA block (ablation)baseline ViT-B anticipation model · EK100 val (RGB)Action Top-5 recall: 15.2 -> 16.7Improved
add TCA to PA + Sem to form full S-GEAR (ablation)S-GEAR · EK100 val (RGB)Action Top-5 recall: 18.0 -> 18.3Improved
learn visual prototypes instead of aligning to fixed language prototypes (ablation)S-GEAR · EK100 val (RGB)Action Top-5 recall: 17.4 -> 18.3Improved
use STSB sentence encoder instead of BERT for prototypes (ablation)S-GEAR · EK100Top-5 recallImproved
use only 10% of prototypes for relative positions (ablation)S-GEAR · EK100 val (RGB)Action Top-5 recall: 18.3 -> 17.8No clear effect
late-fuse two ViT-B models (224 and 384 input)S-GEAR · EK100 val (RGB)Action Top-5 recall: 18.3 -> 19.6Improved
late-fuse RGB and object modalitiesS-GEAR · EK100 valAction Top-5 recall: 18.9 -> 19.9Improved
increase anticipation time beyond training valueS-GEAR on EGTEA Gaze+ · EGTEA Gaze+Top-5 accuracyHurt
use ViT-B backbone vs TSN or irCSN featuresS-GEAR · EK100 val (RGB)Action Top-5 recall: 14.9 -> 18.3Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy