Research map / 3D vision / 3D generation
Hoi! - A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation
Tim Engelbracht, René Zurbrügg, Matteo Wohlrapp, Martin Büchner, Abhinav Valada, Marc Pollefeys, Hermann Blum, Zuria Bauer
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use projected (motion-aligned) forces instead of raw force-torque readings (ablation) | ForceSight zero-shot · Hoi! visual force estimation | force RMSE (N): 2.57 -> 2.23 | Improved |
| evaluate ForceSight on Hoi! instead of its original dataset | ForceSight · force RMSE | force RMSE (N): 0.404 -> 2.57 | Hurt |
| use DINOv2 instead of DINO decoder (ablation) | Sparsh · Hoi! tactile force estimation | combined force RMSE (N): 3.86 -> 4.11 | Hurt |
| move from lab/controlled to in-the-wild setting | ArtiPoint · articulation estimation (Arti4D vs Hoi!) | prismatic axis angle error (deg): 14.54 -> 47.06 | Hurt |
| use GPT-5 for articulation type prediction from single RGB view | articulation type recognition · Hoi! articulation estimation | revolute type recall (%): 57.10 -> 89.7 | Improved |
| use exocentric instead of egocentric view for GPT-5 (ablation) | GPT-5 · Hoi! articulation estimation | prismatic type recall (%): 71.9 -> 65.6 | Hurt |
Closest papers by meaning
- HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction (NeurIPS 2025 · similarity 0.89)
- InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation (CVPR 2025 · similarity 0.89)
- FlowHOI: Flow-based Semantics-Grounded Generation of Hand-Object Interactions for Dexterous Robot Manipulation (NeurIPS 2026 · similarity 0.88)
- HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awareness (NeurIPS 2024 · similarity 0.87)
- HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editing (NeurIPS 2026 · similarity 0.87)
- OpenHOI: Open-World Hand-Object Interaction Synthesis with Multimodal Large Language Model (NeurIPS 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
