atlas

Research map / Architectures and efficiency / Attention and transformers

Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction

AAAI 2020 · Architectures and efficiency › Attention and transformers · approach: Long-context KV and memory attention · 76 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use SeG instead of PCNN+ATTNYT relation extraction · NYT held-out test, all bagsP@N mean (%): 72.2 -> 89.3Helped
use SeG instead of PCNN+BAG-ATTNYT relation extraction · NYT held-out test, all bagsP@N mean (%): 84.8 -> 89.3Helped
use SeG instead of PCNN+HATTNYT relation extraction · NYT held-out testAUC: 0.42 -> 0.51Helped
use SeG instead of PCNN+ATTNYT relation extraction · NYT one-sentence bagsAUC: 0.35 -> 0.48Helped
add entity-aware embedding (ablation)SeG · NYT held-out test, all bagsP@N mean (%): 79.0 -> 89.3Helped
add entity-aware embedding (ablation)SeG · NYT held-out testAUC: 0.40 -> 0.51Helped
add selective gate aggregation (ablation)SeG · NYT held-out test, all bagsP@N mean (%): 87.7 -> 89.3Helped
add selective gate aggregation (ablation)SeG · NYT held-out testAUC: 0.48 -> 0.51Helped
add self-attention alongside PCNN and selective gate (ablation)SeG · NYT held-out testAUC: 0.47 -> 0.51Helped
replace mean pooling with selective attention (ablation)SeG · NYT held-out test, all bagsP@N mean (%): 89.3 -> 83.6Hurt
replace selective gate aggregation with selective attention (ablation)SeG · NYT held-out testAUC: 0.51 -> 0.47Hurt
stack PCNN and self-attention instead of arranging them in parallel (ablation)SeG · NYT held-out test, all bagsP@N mean (%): 89.3 -> 89.1Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy