AI Paper Atlas

Research map / 3D vision / Human pose estimation

MySign: A High-Fidelity Motion-Capture Dataset for 3D Sign Generation in Bahasa Isyarat Malaysia

Jiayu Shen, Kalin Stefanov, Lay-Ki Soon, Vee Yee CHONG, Alpha A Gopalai, KokSheik Wong

NeurIPS 2026 · 3D vision › Human pose estimation · approach: Physics and sensor-based motion capture · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces MySign, a motion-capture dataset of 5,000 3D isolated sign samples covering 1,000 glosses in Bahasa Isyarat Malaysia, performed by five Deaf native signers.

Problem

Fine-grained 3D sign generation is limited by the scarcity of high-fidelity 3D sign language data, especially for under-resourced languages such as Bahasa Isyarat Malaysia (BIM).

Approach

A motion-capture dataset of isolated BIM signs with 5,000 3D samples over 1,000 glosses, recorded from five Deaf native signers, positioned as higher fidelity than prior sign datasets.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train on MoCap-grounded SMPL-X instead of RGB-fitted pseudo-labels (ablation)wSignGen · MySignFID to MoCap-real: 51.400 -> 42.800Improved
train on MoCap-grounded instead of RGB-fitted supervision (ablation)wSignGen · MySignAcc: 0.704 -> 0.747Improved
use sign-specific generator (wSignGen) instead of adapted general motion model (MotionDiffuse)MotionDiffuse · MySignFID: 83.564 -> 41.465Improved
pretrain on MySign before fine-tuning on ASL3DWord (ablation)SignAvatar · ASL3DWord testFID: 71.809 -> 63.831Improved
pretrain on ASL3DWord before fine-tuning on MySign (ablation)SignAvatar · MySign testFID: 54.166 -> 65.037Hurt
pretrain on ASL3DWord before fine-tuning on MySign (ablation)SignAvatar · MySign testAcc: 0.727 -> 0.581Hurt
apply hand ROM clamping to retargeted motion (ablation)ST-GCN evaluator · MySign testTop-1 (%): 85.0 -> 85.7No clear effect
stronger SLR model (SignBERT+ vs ST-GCN)Recognition baselines · MySignTop-1 (%): 85.70 -> 92.90Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy