AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

Towards Building ASR Systems for the Next Billion Users

AAAI 2022 · Large language models › Language, safety and interpretability · approach: Speech and audio language models · 50 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
pretrain rather than train the acoustic model from scratch (ablation)IndicWav2Vec BASE · MSR GujaratiWER: 46.0 -> 22.8Helped
use the larger, more diverse pretraining corpus rather than EkStep pretraining data (ablation)IndicWav2Vec BASE · MUCS GujaratiWER: 30.3 -> 29.4Helped
use LARGE rather than BASE (ablation)IndicWav2Vec · MUCS GujaratiWER: 29.4 -> 26.2Helped
add a transcript-trained language model (ablation)IndicWav2Vec M3 · MUCS GujaratiWER: 26.2 -> 18.0Helped
train the language model on IndicCorp as well as transcripts (ablation)IndicWav2Vec M4 · MUCS GujaratiWER: 18.0 -> 17.2Helped
augment the task lexicon with frequent IndicCorp words (ablation)IndicWav2Vec M5 · MUCS GujaratiWER: 17.2 -> 14.8Helped
augment the task lexicon with frequent IndicCorp words (ablation)IndicWav2Vec M5 · MSR GujaratiWER: 11.7 -> 12.3Hurt
rescore hypotheses with an external Transformer language model (ablation)IndicWav2Vec M6 · MUCS GujaratiWER: 14.8 -> 14.3Helped
use multilingual fine-tuning with one shared softmax (ablation)IndicWav2Vec M6 · MUCS MarathiWER: 12.2 -> 30.3Hurt
use multilingual fine-tuning with separate per-language softmax layers instead of one shared softmax (ablation)IndicWav2Vec · MUCS MarathiWER: 30.3 -> 11.7Helped
add iterative pseudo-labeling (ablation)IndicWav2Vec M6 · MUCS GujaratiWER: 14.8 -> 15.1Hurt
increase fine-tuning data from 1 hour to 40 hours (ablation)IndicWav2Vec · MSR GujaratiWER: 35.9 -> 20.9Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy