AI Paper Atlas

Research map / Large language models / Agents, code and math

Can an LLM Reason Like a Lawyer? Benchmarking the ability of LLMs to map the facts of a case to the elements of the applicable legal rule

Shounak Paul, Seungeon Lee, Christoph Engel, Krishna Gummadi

NeurIPS 2026 · Large language models › Agents, code and math · approach: Mathematical and structural reasoning benchmarks

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces a benchmark that tests whether LLMs map case facts to the elements of applicable legal rules, built from 375 judgments.

Problem

Legal judgment prediction work evaluates whether models reach correct conclusions, not whether their reasoning maps case facts to the elements of a legal provision.

Approach

A benchmark that scores the fact-to-element mapping step of legal reasoning, rather than only final verdicts, built on 375 judgments.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy