AI Paper Atlas

Research map / 3D vision / Human pose estimation

egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks

Björn Braun, Rayan Armani, Manuel Meier, Max Moebus, Christian Holz

ICCV 2025 · 3D vision › Human pose estimation · approach: Physics and sensor-based motion capture · 14 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add motion-informed temporal attention (MITA) using IMU (ablation)PulseFormer · egoPPG-DB (5-fold, 60s windows)HR MAE (bpm): 8.82 -> 7.67Improved
add spatial attention (SA) modules (ablation)PulseFormer · egoPPG-DB (5-fold, 60s windows)HR MAE (bpm): 10.49 -> 7.67Improved
add MITA, dancing activity (ablation)PulseFormer · egoPPG-DB (5-fold, 60s windows), activity: DancingHR MAE (bpm): 10.54 -> 7.85Improved
add MITA, walking activity (ablation)PulseFormer · egoPPG-DB (5-fold, 60s windows), activity: WalkingHR MAE (bpm): 8.29 -> 8.23No clear effect
use skin region instead of eye region as input (ablation)signal-processing baseline · egoPPG-DB (5-fold, 60s windows)HR MAE (bpm): 14.60 -> 12.40Improved
use eye tracking video at 10 fps instead of 30 fps (ablation)PulseFormer · egoPPG-DB (frame rate study)HR MAE (bpm): 7.67 -> 11.13Hurt
upsample 10 fps video to 30 fps by interpolation (ablation)PulseFormer · egoPPG-DB (frame rate study)HR MAE (bpm): 11.13 -> 10.18Improved
replace FactorizePhys with PulseFormer architecturerPPG HR estimation · egoPPG-DB (5-fold, 60s windows)HR MAE (bpm): 10.07 -> 7.67Improved
add predicted HR features to egocentric videoTimeSFormer · EgoExo4D proficiency estimation (overall)top-1 accuracy (%): 39.69 -> 45.29Improved
add predicted HR features to exocentric videoTimeSFormer · EgoExo4D proficiency estimation (overall)top-1 accuracy (%): 34.75 -> 37.67Improved
add predicted HR features to ego+exo videoTimeSFormer · EgoExo4D proficiency estimation (overall)top-1 accuracy (%): 39.00 -> 43.94Improved
add predicted HR, cooking egocentricTimeSFormer · EgoExo4D proficiency estimation (Cooking, Ego)top-1 accuracy (%): 20.00 -> 40.00Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy