atlas

Research map / Large language models / Language, safety and interpretability

Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-training

AAAI 2022 · Large language models › Language, safety and interpretability · approach: Task vectors and steering · 52 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pre-train Pattern on sentiment-labeled Wikipedia stance examplesPattern · 15 cross-lingual datasets, 32 shotsmacro-average F1: 39.17 -> 45.09 (enWiki); 39.17 -> 45.88 (mWiki)Helped
Pre-train on multilingual rather than English sentiment-labeled Wikipedia dataPattern · 15 cross-lingual datasets, all training examplesmacro-average F1: 54.82 -> 57.40Helped
Pre-train on English stance datasets rather than use Pattern without pre-trainingPattern · 15 cross-lingual datasets, 32 shotsmacro-average F1: 39.17 -> 50.38Helped
Combine multi-dataset training with multilingual sentiment-based pre-trainingPattern · 15 cross-lingual datasets, all training examplesmacro-average F1: 53.43 -> 62.25Helped
Train jointly on multiple datasets without pre-trainingPattern · 15 cross-lingual datasets, few-shotmacro-average F1: 39.17 -> 40.76 (32 shots); 53.43 -> 61.81 (all)Mixed
Add two negative samples (ablation)Pattern training · Few-shot stance detectionmacro-average F1No clear effect
Mask some of the input tokens (ablation)Pattern training · Few-shot stance detectionmacro-average F1No clear effect
Pre-train on multilingual sentiment-based stance examples rather than English-only examplesPattern · dast and rustancemacro F1Hurt
Train on 32 examples from English stance pre-training rather than use zero-shot inferenceenstance · 15 cross-lingual datasetsmacro-average F1: 35.2 -> 50.4Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy