AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

UBAR: Towards Fully End-to-End Task-Oriented Dialog System with GPT-2

AAAI 2021 · Large language models › Language, safety and interpretability · approach: Faithfulness of LLM explanations · 123 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Model whole dialog sessions with belief states, database results, acts, and responses in sequenceUBAR · MultiWOZ 2.0, generated belief and actCombined: 95.7 -> 105.1Helped
Generate responses using generated dialog context rather than ground-truth response context (ablation)UBAR · MultiWOZ 2.0, end-to-endInform: 82.6 -> 91.2Helped
Use generated responses in turn-level dialog history (ablation)URUR · MultiWOZ 2.0, end-to-endCombined: 94.8 -> 101.8Helped
Use only belief states, database results, and system acts instead of only user utterances and responses (ablation)UBAR · MultiWOZ 2.0, end-to-endCombined: 95.9 -> 101.9Helped
Use belief states and system acts in session history (ablation)UBAR · MultiWOZ 2.0, end-to-endCombined: 94.8 -> 105.1Helped
Use all previous turns rather than only the previous turn (ablation)UBAR · MultiWOZ 2.0, generated belief and actCombined: 101.6 -> 105.1Helped
Use ground-truth belief states in prior-turn context (ablation)UBAR · MultiWOZ 2.0, all previous turnsCombined: 105.1 -> 106.1No clear effect
Use ground-truth acts and responses in context instead of the system's generated content (ablation)UBAR · MultiWOZ 2.0, end-to-endCombined: 105.1 -> 100.1Hurt
Use only user utterances and generated responses in context (ablation)UBAR · MultiWOZ 2.0, end-to-endCombined: 101.9 -> 95.9Hurt
Fine-tune the held-out-domain model on 100 sessions from the new domain (ablation)UBAR base model · New domain, held-out-domain transferCombinedHelped
Fine-tune on 100 new-domain sessions (ablation)UBAR base model · Original four domains after held-out-domain adaptationCombinedHurt
Use session-level UBAR with non-delexicalized responses for DSTDST-UBAR · MultiWOZ 2.0Joint Accuracy (%): 51.44 -> 52.59Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy