AI Paper Atlas

Research map / Large language models / AI and society

Peer Review of Applied Machine Learning Papers Must Include Code Execution

Lisa-Marie Vortmann

NeurIPS 2026 · Large language models › AI and society · approach: Benchmarking and reproducibility practice

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Position paper arguing that peer review of applied machine learning papers should require executing and verifying submitted code.

Problem

Reproducibility failures in applied ML are widespread across many scientific fields, while current peer review relies on voluntary code submission and self-reported checklists.

Approach

Argues that code execution and verification should be a required part of peer review for applied ML papers, rather than voluntary code sharing and self-reported checklists.

Key results

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy