Research map / Video / Video generation
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection
Joanna Hong, Minsu Kim, Yong Man Ro
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| increase speech-visage selection heads from 1 to 6 (ablation) | VisageSynTalk · GRID (multi-speaker independent) speaker verification | EER of f_id (%): 29.44% -> 16.90% | Improved |
| increase speech-visage selection heads from 1 to 6 (ablation) | VisageSynTalk · GRID (multi-speaker independent) speaker verification | EER of f_sc (%): 33.84% -> 46.48% | Improved |
| add speech-visage feature selection with visual and audio identification learning (ablation) | VisageSynTalk · GRID (multi-speaker independent) | STOI/ESTOI/PESQ | Improved |
| use 6 selection heads instead of single selection (ablation) | VisageSynTalk · GRID (multi-speaker independent) | STOI/ESTOI/PESQ | Improved |
| use 9 speech selective masks instead of one (ablation) | VisageSynTalk · GRID (multi-speaker dependent) | STOI/ESTOI/PESQ | Improved |
Closest papers by meaning
- From Faces to Voices: Learning Hierarchical Representations for High-quality Video-to-Speech (CVPR 2025 · similarity 0.91)
- Faces that Speak: Jointly Synthesising Talking Face and Speech from Text (CVPR 2024 · similarity 0.88)
- FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio (CVPR 2024 · similarity 0.86)
- Let There Be Sound: Reconstructing High Quality Speech from Silent Videos (AAAI 2024 · similarity 0.86)
- Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation (AAAI 2024 · similarity 0.86)
- MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes (NeurIPS 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
