atlas

Research map / Large language models / Language, safety and interpretability

Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing

NeurIPS 2021 · Large language models › Language, safety and interpretability · approach: Faithfulness of LLM explanations · 16 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Have annotators edit collected explanations rather than create them from scratchNLI data collection · MNLI subsetannotation artifactsHelped
Convert image captions into explanations without human editing or judgingVQA-E · Visual question answeringexplanation plausibilityHurt
Use non-comprehensive human highlights to evaluate comprehensive model highlightsHighlight explanation evaluation · Model-generated highlightsplausibility evaluation validityHurt
Collect comprehensive human highlights when evaluating comprehensive model highlightsHighlight explanation evaluation · Model-generated highlightsplausibility evaluation validityHelped
Collect highlights for examples whose labels cannot be justified by highlightingHighlight explanation datasets · Examples with labels not explainable by selected input spanshighlight sufficiencyHurt
Embrace naturally occurring structure in explanations rather than discard template-like explanationsFree-text explanation collection · Tasks with naturally structured explanationsexplanation informativenessHelped
Use collect-and-edit quality control instead of relying only on initial collectionExNLP dataset collection · Explanation data qualitydata artifactsHelped
Teach and test annotators on the underlying task and label setExNLP dataset collection · Annotation qualitydata qualityHelped
Collect labels and explanations from the same annotators, or check annotator agreement with the assigned labelPost-hoc explanation collection · Explanation-label alignmentalignment with human decisionsHelped
Use a larger and more diverse pool of annotatorsExNLP dataset collection · Annotation representativenessannotator biasHelped
Collect multiple plausible explanations per instanceExNLP datasets with subjective explanations · Explanation evaluationevaluation fairnessHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy