atlas

Research map / Large language models / Language, safety and interpretability

Uni-MIS: United Multiple Intent Spoken Language Understanding via Multi-View Intent-Slot Interaction

AAAI 2024 · Large language models › Language, safety and interpretability · approach: Sign and cross-lingual translation · 11 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Uni-MIS, a joint multi-intent SLU model that fuses utterance-, chunk-, and token-level intent-slot interaction over a RoBERTa encoder with chunk-level intent detection and adaptive intent-slot graph slot filling, and evaluates ChatGPT on the task.

Problem

Multi-intent spoken language understanding requires joint intent detection and slot filling, but prior token-level intent-slot interaction underuses intent information at other granularities and suffers from error propagation.

Approach

Models intent-slot interaction at three views (utterance [CLS] intent, chunk-level sliding-window intent, token-level intent), fuses them with BiLSTM before adaptive intent-slot graph interaction for slot filling, and jointly trains with chunk-level intent detection.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Uni-MIS instead of CLID (RoBERTa)Multi-intent SLU · MixATISOverall accuracy: 3.1%Helped
Use Uni-MIS instead of CLID (RoBERTa)Multi-intent SLU · MixATISSlot F1: 2.4%Helped
Use Uni-MIS instead of CLID (RoBERTa)Multi-intent SLU · MixSNIPSOverall accuracy: 1.2%Helped
Use Uni-MIS instead of CLID (RoBERTa)Multi-intent SLU · MixSNIPSSlot F1: 0.2%Helped
Use Uni-MIS instead of CLID (RoBERTa)Multi-intent SLU · MixSNIPSIntent accuracy: 0.4%Helped
add utterance intent-slot interaction (ablation)Uni-MIS · MixATISOverall accuracy: decrease of 1.4%Helped
add utterance intent-slot interaction (ablation)Uni-MIS · MixSNIPSOverall accuracy: decrease of 1.3%Helped
add chunk intent-slot interaction (ablation)Uni-MIS · MixATISOverall accuracy: reduction of 0.6%Helped
add chunk intent-slot interaction (ablation)Uni-MIS · MixSNIPSOverall accuracy: reduction of 1.3%Helped
add token intent-slot interaction (ablation)Uni-MIS · MixATISOverall accuracy: decline of 1.0%Helped
add token intent-slot interaction (ablation)Uni-MIS · MixSNIPSOverall accuracy: decline of 1.3%Helped

Surprising findings

Limitations

Experimental setup

Datasets: MixATIS MixSNIPS

Benchmarks: MixATIS MixSNIPS

Metrics: slot F1 intent accuracy overall accuracy

Baselines: Bi-Model Slot-Gated SF-ID Stack-Propagation AGIF GL-GIN SDJN CLID CLID (Roberta)

Builds on: CLID AGIF GL-GIN Stack-Propagation

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy