AI Paper Atlas

Research map / Video / Video generation

TLControl: Trajectory and Language Control for Human Motion Synthesis

Weilin Wan, Zhiyang Dou, Taku Komura, Wenping Wang, Dinesh Jayaraman, Lingjie Liu

ECCV 2024 · Video › Video generation · approach: Text-to-motion diffusion · 81 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use part-based VQ-VAE instead of unsplit full-body VQ-VAE (ablation)TLControl · HumanML3D test (all joints control)FID: 0.066 -> 0.032Improved
use part-based VQ-VAE instead of unsplit VQ-VAE (ablation)TLControl · HumanML3D testruntime: 27.3% decreaseImproved
optimize in latent space instead of joint-level IK (ablation)TLControl · HumanML3D root control, 50% maskedFID: 0.675 -> 0.311Improved
add latent test-time optimization to MTT output (ablation)TLControl · HumanML3D root control, 0% maskFID: 0.343 -> 0.271Improved
apply joint-level IK on top of MTT output for left hand control (ablation)TLControl · HumanML3D left hand control, 0% maskFID: 0.226 -> 0.383Hurt
tighten optimization accuracy criterion from 1E-4 to 1E-8 (ablation)TLControl · HumanML3D all jointsAverage error (cm): 6.72 -> 0.54 (runtime 3.48 s -> 127.90 s per batch)Improved
increase trajectory masking rate for root trajectory (ablation)TLControl · HumanML3DMModality: 0.994 -> 1.982Improved
replace multi-step diffusion sampling with feed-forward MTT plus latent optimizationTLControl vs OmniControl · HumanML3Dtime (s/frame): 0.606 -> 0.015Improved
TLControl versus OmniControl on foot-joint FIDTLControl · HumanML3D left foot controlFID: 0.280 -> 0.368Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy