atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Modeling Adaptive Inter-Task Feature Interactions via Sentiment-Aware Contrastive Learning for Joint Aspect-Sentiment Prediction

AAAI 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Multilingual language representation pretraining · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes AIFI, a contrastive-learning alignment method for joint aspect-sentiment prediction whose temperature is adaptively set by a learned inter-task correlation network, reporting state-of-the-art F1 on three ALSA datasets.

Problem

Joint aspect prediction and sentiment prediction suffer from negative transfer when inter-task feature interactions are fixed by rigid regularization alignment, and the correlation strength between aspect and sentiment features varies across sentences.

Approach

Align AP-specific and SP-specific representations of the same sentence as positives with InfoNCE over in-batch negatives, and predict per-sentence correlation strength with a feature correlation network whose output sets the InfoNCE temperature (smaller for strongly correlated sentences), trained on a count of non-neutral aspect sentiments.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use AIFI instead of HI-ASAjoint aspect-sentiment prediction · DRF1: 0.7879 -> 0.7991Helped
use AIFI instead of HI-ASAjoint aspect-sentiment prediction · DLF1: 0.6871 -> 0.6963Helped
use AIFI instead of HI-ASAjoint aspect-sentiment prediction · DTF1: 0.6004 -> 0.6130Helped
add contrastive learning (ablation)AIFI · DRF1: 0.7931 -> 0.7991Helped
add contrastive learning (ablation)AIFI · DLF1: 0.6602 -> 0.6963Helped
add contrastive learning (ablation)AIFI · DTF1: 0.5887 -> 0.6130Helped
add adaptive temperature to contrastive learning (ablation)AIFI · DRF1: 0.7955 -> 0.7991Helped
add adaptive temperature to contrastive learning (ablation)AIFI · DLF1: 0.6847 -> 0.6963Helped
add adaptive temperature to contrastive learning (ablation)AIFI · DTF1: 0.6086 -> 0.6130Helped

Surprising findings

Limitations

Experimental setup

Datasets: DR (SemEval 2014/2015/2016 restaurant) DL (SemEval 2014 laptop) DT (Twitter)

Benchmarks: DR DL DT

Metrics: precision recall F1 accuracy

Baselines: SPAN-BERT DOER S-AESC SPRM HI-ASA ChatGPT

Builds on: InfoNCE HI-ASA multi-gate mixture-of-experts BERT

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy