Research map / 3D vision / Depth and stereo
E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit Regularization
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Unsupervised joint estimation of event-camera optical flow (neural implicit flow field) and 6-DoF egomotion (cubic B-spline) using a contrast-maximization loss plus a depth-free differential epipolar geometric constraint.
Problem
Estimating optical flow and 6-DoF egomotion jointly from event camera data is ill-posed due to lack of long-term data association; prior methods either add explicit smoothness regularizers that bias results or add depth parameters that cause local minima.
Approach
Model flow as a coordinate-based MLP (implicit neural representation) integrated via neural ODE for event warping, model egomotion as a cubic B-spline, and couple them through a depth-free differential epipolar constraint so that implicit smoothness and geometric consistency regularize the solution without explicit depth or smoothness terms.
Key results
- On MVSEC optical flow (dt=1), E-MoFlow achieves average EPE 0.450 and %Out 0.328, best among unsupervised methods and second overall behind MultiCM-V2 (0.348 EPE).
- On MVSEC 6-DoF egomotion without depth priors, average RMS angular error 4.062 and linear error 0.285, versus 8.900 and 1.680 for MultiCM-V2.
- On DSEC, E-MoFlow performs comparably to unsupervised baselines (average EPE 3.14) but trails supervised methods such as TMA (0.74).
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add differential geometric constraint (ablation) | E-MoFlow · MVSEC indoor_flying1, dt=4 | EPE: 1.84 -> 1.58 | Helped |
| add differential geometric constraint (ablation) | E-MoFlow · MVSEC indoor_flying2, dt=4 | EPE: 2.27 -> 2.04 | Helped |
| add differential geometric constraint (ablation) | E-MoFlow · MVSEC indoor_flying3, dt=4 | EPE: 2.27 -> 1.84 | Helped |
| add differential geometric constraint (ablation) | E-MoFlow · MVSEC outdoor_day1, dt=4 | EPE: 1.67 -> 1.63 | Helped |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying1, dt=4 | EPE: 1.58 -> 1.61 | Hurt |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying2, dt=4 | EPE: 2.04 -> 2.09 | Hurt |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying3, dt=4 | EPE: 1.84 -> 1.90 | Hurt |
| enable early stopping (ablation) | E-MoFlow · MVSEC outdoor_day1, dt=4 | EPE: 1.63 -> 1.68 | Hurt |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying1, dt=4 | training time: 9.30s -> 4.21s | Helped |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying2, dt=4 | training time: 9.41s -> 4.30s | Helped |
| enable early stopping (ablation) | E-MoFlow · MVSEC indoor_flying3, dt=4 | training time: 9.50s -> 4.87s | Helped |
| enable early stopping (ablation) | E-MoFlow · MVSEC outdoor_day1, dt=4 | training time: 10.77s -> 4.56s | Helped |
Surprising findings
- The method's 6-DoF estimation is reported to match ground-truth-motion supervision on some MVSEC sequences (e.g., indoor_flying2 and indoor_flying3 at dt=4).
- Early stopping gives 2.2x training speedup at only about 2-3% EPE cost.
Limitations
- Performance on DSEC lags supervised methods, attributed to complex driving motion, illumination changes and unstructured depth.
- May produce errors at edges in scenes with complex textures and drastic depth changes.
- Per-segment optimization (1k iterations per short event segment) rather than a feedforward model.
Experimental setup
Datasets: MVSEC DSEC
Benchmarks: MVSEC DSEC
Metrics: EPE AE %Out RMSE angular velocity RMSE linear velocity
Baselines: MultiCM-V2 MotionPriorCMax Paredes et al. EV-FlowNet E-RAFT TMA ADM-Flow AEmin PEME
Builds on: contrast maximization neural ODE NeRF differential epipolar constraint
Closest papers by meaning
- EgoFlow: Gradient-Guided Flow Matching for Egocentric 6DoF Object Motion Generation (CVPR 2026 · similarity 0.91)
- Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations (CVPR 2025 · similarity 0.87)
- Full-DoF Egomotion Estimation for Event Cameras Using Geometric Solvers (CVPR 2025 · similarity 0.86)
- FlowFeat: Pixel-Dense Embedding of Motion Profiles (NeurIPS 2025 · similarity 0.86)
- H-Flow: Self-supervised Human Scene Flow via Physics-inspired Joint Multi-modal Learning (NeurIPS 2026 · similarity 0.86)
- EDCFlow: Exploring Temporally Dense Difference Maps for Event-based Optical Flow Estimation (CVPR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
