AI Paper Atlas

Research map / Video / Action recognition

In the Eye of the Beholder: Gaze and Actions in First Person Video

Yin Li, Miao Liu, James Matthew Rehg

TPAMI 2021 · Video › Action recognition · approach: Disentangled action recognition · 102 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add probabilistic (sampled) gaze modeling instead of deterministic Gaze MLE (ablation)gaze-aware I3D · EGTEA Gaze+ all splitsaction accuracy and gaze F1: 1.0% for action recognition and 6.9% for gaze estimationImproved
add human gaze supervision (vs uniform prior) (ablation)probabilistic gaze model · EGTEA Gaze+ Split1gaze F1: 11.63 -> 34.01Improved
add human gaze supervision (vs uniform prior) (ablation)probabilistic gaze model · EGTEA Gaze+ Split1action accuracy: 56.50 -> 57.20Improved
add probabilistic attention without gaze supervision to I3D (ablation)I3D joint · EGTEA Gaze+action accuracy: +0.4%Improved
pool features directly with human gaze (ablation)I3D joint · EGTEA Gaze+ Split1action accuracy: 55.76 -> 53.74Hurt
use center prior as attention map (ablation)I3D joint · EGTEA Gaze+ Split1action accuracy: 55.76 -> 52.48Hurt
add egocentric cue stream (EgoConv) (ablation)I3D joint · EGTEA Gaze+ Split1action accuracy: 55.76 -> 54.19Hurt
use joint training of RGB and flow streams instead of RGB only (ablation)I3D · EGTEA Gaze+ Split1action accuracy: 50.08 -> 55.76Improved
use flow stream instead of RGB stream (ablation)I3D · EGTEA Gaze+ Split1action accuracy: 50.08 -> 45.78Hurt
use KL loss instead of cross entropy for gaze (ablation)gaze estimation · EGTEA Gaze+ Split1gaze F1: 31.33 -> 34.46Improved
add dropout 0.7 and longer training (ablation)I3D joint and our model · EGTEA Gaze+ Split1action accuracy: 49.79 -> 53.55Improved
add dropout and longer training (ablation)our model · EGTEA Gaze+ Split1gaze F1: 32.66 -> 36.01Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy