Research map / Large language models / AI and society
State of the Art: Reproducibility in Artificial Intelligence
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| later publication year (2013/2014 -> 2016) | AI paper documentation · IJCAI/AAAI | R1D (experiment documentation): 0.21 ± 0.02 -> 0.27 ± 0.02 | Helped |
| later publication year | AI paper documentation · IJCAI/AAAI | R2D: 0.23 ± 0.02 -> 0.27 ± 0.03 | No clear effect |
| later publication year | AI paper documentation · IJCAI/AAAI | R3D: 0.26 ± 0.03 -> 0.26 ± 0.03 | No clear effect |
Closest papers by meaning
- The Unreasonable Effectiveness of Open Science in AI: A Replication Study (AAAI 2025 · similarity 0.89)
- What Do Machine Learning Researchers Mean by “Reproducible”? (AAAI 2025 · similarity 0.88)
- Position: Let’s Strengthen Verifiability if We Can’t Enforce Reproducibility (NeurIPS 2026 · similarity 0.84)
- PaperBench: Evaluating AI’s Ability to Replicate AI Research (ICML 2025 · similarity 0.83)
- AAAR-1.0: Assessing AI’s Potential to Assist Research (ICML 2025 · similarity 0.83)
- AI Evaluation Should Require Standardized Item-Level Data Releases (NeurIPS 2026 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.