AI Paper Atlas

Research map / Video / Action recognition

Actor and Observer: Joint Modeling of First and Third-Person Videos

Gunnar A. Sigurdsson, Abhinav Gupta, Cordelia Schmid, Ali Farhadi, Karteek Alahari

CVPR 2018 · Video › Action recognition · approach: Disentangled action recognition · 142 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use learned frame weights to select the 10% highest-weight test examplesActorObserverNet · Charades-Ego, same personcorrespondence classification accuracy (%): 50.0 -> 97.2Improved
Use learned frame weights to select the 10% highest-weight test examplesActorObserverNet · Charades-Ego, different personscorrespondence classification accuracy (%): 50.0 -> 98.8Improved
Jointly learn a first/third-person representationActorObserverNet · Charades-Ego, same personmedian alignment error (seconds): 6.5 -> 5.2Improved
Jointly learn a first/third-person representationActorObserverNet · Charades-Ego, different personsmedian alignment error (seconds): 7.0 -> 6.1Improved
Transfer third-person action knowledge using the joint representationActorObserverNet · Charades-Ego test, zero-shot first-person action recognitionvideo-level mAP: 22.7 -> 25.9Improved
Share parameters between the two first-person fully connected streams (ablation)ActorObserverNet · Mapping third-person to first-personcorrespondence classification accuracyNo clear effect
Share parameters between the two first-person fully connected streams (ablation)ActorObserverNet · Alignment and localization; zero-shot action recognitionperformanceImproved
Constrain the Tanh selector scale to be positive (ablation)ActorObserverNet · Alignment and localization; zero-shot action recognitionperformanceImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy