AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

Who Did They Respond to? Conversation Structure Modeling Using Masked Hierarchical Transformer

Henghui Zhu, Feng Nan, Zhiguo Wang, Ramesh Nallapati, Bing Xiang

AAAI 2020 · Architectures and efficiency › Attention and transformers · approach: Efficient language transformers · 37 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use ancestral conversation context with ancestor masking instead of pairwise utterance classificationReddit-small parent prediction · Reddit-smallGraph accuracy: 55.86% -> 60.53%Improved
Use ancestral conversation context with ancestor masking instead of pairwise utterance classificationReddit-small conversation reconstruction · Reddit-smallConversation accuracy: 17.78% -> 20.61%Improved
Use ancestral conversation context with ancestor masking instead of pairwise utterance classificationReddit-large parent prediction · Reddit-largeGraph accuracy: 39.48% -> 42.87%Improved
Use ancestral conversation context with ancestor masking instead of selecting the title commentReddit-large conversation reconstruction · Reddit-largeConversation accuracy: 0.06% -> 0.13%Improved
Add hand-crafted features to the masked hierarchical transformerUbuntu IRC parent prediction · Ubuntu IRC test setGraph F1: 52.8 -> 70.6Improved
Add hand-crafted features to the masked hierarchical transformerUbuntu IRC conversation reconstruction · Ubuntu IRC test setConversation F1: 10.3 -> 34.2Improved
Add ancestor masking so utterances attend to ancestors rather than all utterances (ablation)Masked Hierarchical Transformer · Reddit-smallGraph accuracy: 46.43% -> 60.53%Improved
Add ancestor masking so utterances attend to ancestors rather than all utterances (ablation)Masked Hierarchical Transformer · Reddit-smallConversation accuracy: 15.14% -> 20.61%Improved
Increase the allowed ancestor depth (ablation)Masked Hierarchical Transformer · Reddit-smallGraph accuracyImproved
Use temporal-only masking rather than ancestor-based masking (ablation)Masked Hierarchical Transformer · Reddit-smallGraph accuracyHurt
Increase temporal depth in temporal-only masking (ablation)Masked Hierarchical Transformer · Reddit-smallGraph accuracyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy