AI Paper Atlas

Research map / Video / Action recognition

End-to-End Joint Semantic Segmentation of Actors and Actions in Video

Jingwei Ji, Shyamal Buch, Alvaro Soto, Juan Carlos Niebles

ECCV 2018 · Video › Action recognition · approach: Temporal action segmentation · 32 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use decoupled end-to-end model instead of single-frame Mask R-CNN on cross-product labels (ablation)actor-action segmentation · A2Djoint actor-action mIoU: 19.1 -> 36.9Improved
add mask head end-to-end instead of two-stage boxes plus SharpMask (ablation)actor-action segmentation · A2Djoint actor-action mIoU: 32.4 -> 36.9Improved
add temporal 3D conv layers (ablation)actor-action segmentation · A2Daction mIoU: 45.5 -> 46.3Improved
add optical flow stream (ablation)actor-action segmentation · A2Daction mIoU: 36.8 -> 46.3Improved
add flow stream to actor segmentation (ablation)actor-action segmentation · A2Dactor mIoU: 66.5 -> 66.4No clear effect
train actor and action branches jointly instead of separately (ablation)actor-action segmentation · A2Djoint actor-action mIoU: 33.6 -> 36.9Improved
use end-to-end joint model instead of TSMT + SMactor-action segmentation · A2Djoint actor-action mIoU: 29.7 -> 36.9Improved
use end-to-end model instead of TSMT for detectionactor-action detection · A2D spatial detectionjoint actor-action mAP: 48.9 -> 55.5Improved
use appearance-only RoIs instead of appearance plus motion RoIsRPN · A2DRoI qualityImproved
use mid-level fusion instead of late fusion of appearance and motiontwo-stream action recognition · A2DsegmentationImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy