Research map / Large language models / AI and society
Paper Copilot: Tracking the Evolution of Peer Review in AI Conferences
Jing Yang, Qiyao Wei, Jiaxin Pei
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| higher submission volume (ICLR growth 2017 to 2025) | ICLR decision entropy · ICLR 2017-2025 | decision entropy: 490 -> 11,672 submissions | Mixed |
| rebuttal phase effect on rating dimensions | ICLR 2025 reviews · ICLR 2025 | share of papers with score change: 54.8% overall rating vs ~10-13% other dimensions | Improved |
| discussion progression on reviewer consensus | ICLR reviewers · ICLR 2025 | min-max rating difference | Improved |
Closest papers by meaning
- Position: The Artificial Intelligence and Machine Learning Community Should Adopt a More Transparent and Regulated Peer Review Process (ICML 2025 · similarity 0.89)
- Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards (ICML 2025 · similarity 0.88)
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews (ICML 2024 · similarity 0.87)
- From Replication to Redesign: Exploring Pairwise Comparisons for LLM-Based Peer Review (NeurIPS 2025 · similarity 0.85)
- Dissecting Submission Limit in Desk-Rejections: A Mathematical Analysis of Fairness in AI Conference Policies (ICML 2025 · similarity 0.84)
- CycleResearcher: Improving Automated Research via Automated Review (ICLR 2025 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
