Research map / Video / Video segmentation and tracking
Towards End-to-end Video-based Eye-Tracking
Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add screen content to the refinement network (ablation) | GazeRefineNet · EVE test | gaze direction error (deg): 3.00 -> 2.49 | Improved |
| add offset augmentation (ablation) | GazeRefineNet static · EVE test | gaze direction error (deg): 3.33 -> 2.80 | Improved |
| add a refinement network without screen content or offset augmentation (ablation) | EyeNet GRU baseline · EVE test | gaze direction error (deg): 3.48 -> 3.41 | No clear effect |
| add offset augmentation without screen content (ablation) | refinement network · EVE test | gaze direction error (deg): 3.41 -> 3.00 | Improved |
| add temporal recurrence (GRU) to GazeRefineNet (ablation) | GazeRefineNet · EVE test | gaze direction error (deg): 2.80 -> 2.51 | Improved |
| add skip connections (ablation) | GazeRefineNet RNN · EVE test | gaze direction error (deg): 2.67 -> 2.57 | Improved |
| add skip connections (ablation) | GazeRefineNet static · EVE test | gaze direction error (deg): 2.80 -> 2.87 | Hurt |
| add skip connections (ablation) | GazeRefineNet LSTM · EVE test | gaze direction error (deg): 2.49 -> 2.53 | Hurt |
| add skip connections (ablation) | GazeRefineNet GRU · EVE test | gaze direction error (deg): 2.51 -> 2.49 | No clear effect |
| add recurrent cells (GRU) to EyeNet (ablation) | EyeNet static · EVE test (left eye) | gaze direction error (deg): 4.54 -> 4.11 | Mixed |
| replace saliency-based alignment with GazeRefineNet GRU | saliency-based (scale + bias) · EVE Wikipedia stimuli | PoG error (px): 198.3 -> 116.3 | Improved |
| train GazeRefineNet on images only, test on Wikipedia (ablation) | GazeRefineNet GRU · EVE cross-stimuli | gaze direction error (deg): 3.04 -> 4.74 | Hurt |
Closest papers by meaning
- RGBE-Gaze: A Large-Scale Event-Based Multimodal Dataset for High Frequency Remote Gaze Tracking (TPAMI 2024 · similarity 0.90)
- EV-Eye: Rethinking High-frequency Eye Tracking through the Lenses of Event Cameras (NeurIPS 2023 · similarity 0.89)
- Eye Tracking for Everyone (CVPR 2016 · similarity 0.89)
- EyeGraph: Modularity-aware Spatio Temporal Graph Clustering for Continuous Event-based Eye Tracking (NeurIPS 2024 · similarity 0.88)
- ST-DiffEye: Diffusion-based Continuous Gaze Generation via Joint Scanpath-Trajectory Modeling (NeurIPS 2026 · similarity 0.87)
- Toward Semantic Gaze Target Detection (NeurIPS 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
