AI Paper Atlas

Research map / Video / Action recognition

Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation

Nadine Behrmann, S. Alireza Golestaneh, Zico Kolter, Jürgen Gall, Mehdi Noroozi

ECCV 2022 · Video › Action recognition · approach: Temporal action segmentation · 108 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add frame-wise loss on the encoder to the vanilla Transformer (ablation)UVAST · Breakfast split 1Edit: 52.9 -> 76.5Improved
add alignment decoder for implicit duration instead of explicit MSE duration (ablation)UVAST · Breakfast split 1Acc: 59.0 -> 71.7Improved
add cross-attention loss for the transcript decoder (ablation)UVAST (L_frame + L_segment) · 50Salads split 1Edit: 45.3 -> 65.5Improved
add cross-attention loss for the transcript decoder (ablation)UVAST (L_frame + L_segment) · Breakfast split 1Edit: 73.4 -> 74.5Improved
add frame-wise loss to the segment-wise loss (ablation)UVAST · Breakfast split 1Edit: 55.6 -> 73.4Improved
add group-wise losses on top of cross-attention loss (ablation)UVAST · 50Salads split 1Edit: 65.5 -> 78.4Improved
add both group-wise losses without cross-attention loss (ablation)UVAST (L_frame + L_segment) · 50Salads split 1Edit: 45.3 -> 42.4Hurt
use proposed encoder instead of ASFormer encoder (ablation)UVAST · Breakfast split 1Edit: 74.6 -> 76.1Improved
add split-segment training (ablation)UVAST · GTEA split 1Edit: 88.2 -> 93.4Improved
change split-segment value from 0.05 to 0.17 (ablation)UVAST · Breakfast split 1Edit: 74.9 -> 76.1Improved
use temporal continuity constraint in k-medoids (ablation)k-medoids pseudo-segmentation · BreakfastEdit: 12.3 -> 100.0Improved
add Viterbi post-processingUVAST · 50Salads fully supervisedAcc: 79.5 -> 87.4Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy