Research map / 3D vision / Face and shape
Fabric Material Recovery from Video Using Multi-Scale Geometric Auto-Encoder
Junbang Liang, Ming Lin
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use LSTM temporal modelling instead of single-frame CNN, image features (ablation) | Image-only model · Fabric material classification | mean accuracy (%): 5.11% -> 45.27% | Improved |
| add garment latent features to image features (LSTM) (ablation) | Image-only LSTM · Fabric material classification | mean accuracy (%): 45.27% -> 70.14% | Improved |
| add image features to garment-only features (LSTM) (ablation) | Garment-only LSTM · Fabric material classification | mean accuracy (%): 65.16% -> 70.14% | Improved |
| add LSTM instead of CNN on image+garment features (ablation) | Image + Garment · Fabric material classification | mean accuracy (%): 12.62% -> 70.14% | Improved |
| replace AtlasNet with the two-level auto-encoder (ablation) | Garment auto-encoder · Ablation (auto-encoder) | material accuracy (%): 54.20% -> 70.14% | Improved |
| replace parallel separate estimation with joint closed-loop body-garment estimation (ablation) | Single-frame estimator · Ablation (human and garment estimation) | material accuracy (%): 49.15% -> 70.14% | Improved |
| use learned model instead of optimization-simulation baseline | Material estimation · Mid-day/Sunset test scenes | accuracy (%) and speed: T-shirt 80.2 -> 86.5, Skirt 83.3 -> 81.6; 4-6 hours -> 8.7 sec | Mixed |
| use our garment model instead of MGN without fine-tuning | Garment reconstruction · Multi-Garment Net dataset | reconstruction error (mm): T-shirt 11.97 -> 3.08 | Improved |
Closest papers by meaning
- Learning-Based Cloth Material Recovery From Video (ICCV 2017 · similarity 0.90)
- DeepCloth: Neural Garment Representation for Shape and Style Editing (TPAMI 2022 · similarity 0.90)
- Garment4D: Garment Reconstruction from Point Cloud Sequences (NeurIPS 2021 · similarity 0.89)
- Learning 3D Garment Animation from Trajectories of A Piece of Cloth (NeurIPS 2024 · similarity 0.88)
- SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes (CVPR 2024 · similarity 0.88)
- Garment Recovery with Shape and Deformation Priors (CVPR 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
