AI Paper Atlas

Research map / Video / Video-language understanding

Do You See What I Am Pointing At? Gesture-Based Egocentric Video Question Answering

Yura Choi, Roy Miles, Rolandos Alexandros Potamias, Ismail Elezi, Jiankang Deng, Stefanos Zafeiriou

CVPR 2026 · Video › Video-language understanding · approach: Egocentric video understanding · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add supervised fine-tuning on the gesture training data (ablation)InternVL3-8B · Reference taskaccuracy: 66.1 -> 68.5Improved
add Hand Intent Token on top of SFT (ablation)InternVL3-8B · Reference taskaccuracy: 68.5 -> 75.0Improved
add Hand Intent Token on top of SFT (ablation)InternVL3-8B · Temporal taskaccuracy: 60.7 -> 66.1Improved
add synthetic videos to real training data (ablation)HINT InternVL3-8B · Reference taskaccuracy: 67.3 -> 75.0Improved
add real videos to synthetic-only training data (ablation)HINT InternVL3-8B · Reference taskaccuracy: 69.0 -> 75.0Improved
replace visual keypoint overlay with learned keypoint encoder (HINT) (ablation)InternVL3-8B · Reference taskaccuracy: 57.1 -> 75.0Improved
draw visual keypoints on frames (ablation)SFT InternVL3-8B · Reference taskaccuracy: 68.5 -> 57.1Hurt
replace text keypoint input with learned keypoint encoder (ablation)InternVL3-8B · Reference taskaccuracy: 69.0 -> 75.0Improved
raise hand detection threshold from 0.5 to 0.7 (ablation)HINT InternVL3-8B · Reference taskaccuracy: 75.0 -> 64.9Hurt
use oracle keyframes instead of uniform 32 frames (ablation)InternVL3-8B · Reference taskaccuracy: 66.1 -> 61.3Hurt
remove the pointing hand from video (ablation)HINT InternVL3-8B · Reference taskaccuracy: 75.0 -> 41.7Hurt
scale InternVL3 from 8B to 78BInternVL3 · Reference taskaccuracy: 66.1 -> 71.4Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy