Research map / Learning theory and algorithms / Submodular and game algorithms
Optimal Spot-Checking for Improving Evaluation Accuracy of Peer Grading Systems
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use PASC instead of random spot-checking allocation | spot-checking policy · Synthetic, K=100, l=4 | accuracy rate: 0.577 -> 0.770 | Helped |
| use PASC instead of assignment-oriented greedy ASC | spot-checking policy · Synthetic, K=100, l=16 | accuracy rate: 0.597 -> 0.900 | Helped |
| use PASC instead of ASC when budget exceeds critical budget | spot-checking policy · Synthetic, K=500, l=4 | accuracy rate: 0.956 -> 0.956 | No clear effect |
| add pre-step assignment allocation by reliability groups (AAF) over Random | Random spot-checking · Synthetic, K=100, l=4 | accuracy rate: 0.577 -> 0.581 | Helped |
| increase load l from 4 to 16 | ASC · Synthetic, K=100 | accuracy rate: 0.625 -> 0.597 | Hurt |
| increase load l from 4 to 16 | PASC · Synthetic, K=100 | accuracy rate: 0.770 -> 0.900 | Helped |
Closest papers by meaning
- Stochastically Dominant Peer Prediction (NeurIPS 2025 · similarity 0.81)
- Fairness and Efficiency in Online Class Matching (NeurIPS 2024 · similarity 0.81)
- Achieving Balanced Representation in School Choice with Diversity Goals (AAAI 2025 · similarity 0.80)
- Peer Neighborhood Mechanisms: A Framework for Mechanism Generalization (AAAI 2024 · similarity 0.80)
- Carrot and Stick: Eliciting Comparison Data and Beyond (NeurIPS 2024 · similarity 0.80)
- The Signal is in the Steps: Local Scoring for Reasoning Data Selection (ICML 2026 · similarity 0.80)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.