atlas

Research map / Large language models / Language, safety and interpretability

e-SNLI: Natural Language Inference with Natural Language Explanations

NeurIPS 2018 · Large language models › Language, safety and interpretability · approach: Faithfulness of LLM explanations · 277 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add explanation-decoder training to InferSentInferSent · SNLI testaccuracy: 84.01% (0.25) -> 83.96% (0.26)No clear effect
Train sentence representations with human explanation supervisionInferSent · SentEval downstream taskstask performance: Significantly outperforms on 4 tasks; significantly outperformed on 1 taskMixed
Add a language generator that reconstructs premise and hypothesis instead of generating explanations (ablation)InferSent · SentEval downstream taskstask performance: Significantly worse on 6 tasks; significantly better on 2 tasksHurt
Generate an explanation first and predict the label from ite-InferSent · SNLI testaccuracy: 83.96% (0.26) -> 81.59% (0.45)Hurt
Add separate attention modules over premise and hypothesis tokens (ablation)ExplainThenPredictSeq2Seq · SNLI testcorrect explanations: 49.8% -> 64.27%Helped
Add separate attention modules over premise and hypothesis tokens (ablation)ExplainThenPredictSeq2Seq · SNLI testaccuracy: 81.59% (0.45) -> 81.71% (0.36)No clear effect
Generate explanations from the hypothesis alonePremiseAgnostic · SNLI test, first 100 examplescorrect explanations: 6.83 correct explanations versus 66 correct labelsHurt
Train an explanation-only label classifierExplanation-only label model · SNLI testaccuracy: 96.83%Helped
Train with explanation supervision and evaluate without fine-tuningInferSent · SICK-Eaccuracy: 53.27 (1.65) -> 53.54 (1.43)No clear effect
Train with explanation supervision and evaluate without fine-tuningInferSent · MultiNLIaccuracy: 57 (0.41) -> 57.16 (0.51)No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy