AI Paper Atlas

Research map / Image generation / Autoregressive and latent generation

Taming Data and Transformers for Audio Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Vicente Ordóñez

IJCV 2026 · Image generation › Autoregressive and latent generation · approach: Diffusion audio synthesis · 36 citations (OpenAlex)

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add CLAP embedding (ablation)AutoCap · AudioCaps testCIDEr: 80.7 -> 83.2Improved
add stage 2 BART fine-tuning (ablation)AutoCap · AudioCaps testCIDEr: 75.6 -> 83.2Improved
add stage 1 pretraining (ablation)AutoCap · AudioCaps testCIDEr: 59.6 -> 83.2Improved
unfreeze BART word embeddings in stage 2 (ablation)AutoCap · AudioCaps testCIDEr: 83.2 -> 82.6Hurt
add metadata (text) to audio inputAutoCap · AudioCaps testCIDEr / SPICE: CIDEr 80.4 -> 83.2; SPICE 19.0 -> 18.2Mixed
replace UNet backbone with FIT (ablation)GenAU-S · OOD evaluationIS: 13.55 -> 15.76Improved
replace DiT backbone with FIT (ablation)GenAU-S · OOD evaluationIS: 13.96 -> 15.76Improved
recaption with AutoCap instead of WavCaps captions (ablation)GenAU-S · OOD evaluationIS: 11.83 -> 15.76Improved
scale training data from AudioCaps to AutoReCap (ablation)GenAU-L · OOD evaluationIS: 12.14 -> 18.98Improved
scale model from GenAU-S to GenAU-L (ablation)GenAU · OOD evaluationIS: 15.76 -> 18.98Improved
train on full 10-second AutoReCap-XL subsetGenAu-Large · AudioCaps testIS / FAD: IS 11.75 -> 12.56; FAD 1.21 -> 1.71Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy