Research map / Large language models / AI and society
Toward a Perspectivist Turn in Ground Truthing for Predictive Computing
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Train using non-aggregated labels rather than reducing them to one label per object | Supervised ML models · Classification tasks with multiple raters | prediction performance | Helped |
| Jointly learn the majority consensus and individual raters' labels | Multi-task models for medical imaging · Medical imaging classification | classification accuracy | Helped |
Closest papers by meaning
- MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research (NeurIPS 2025 · similarity 0.83)
- Limits to scalable evaluation at the frontier: LLM as judge won’t beat twice the data (ICLR 2025 · similarity 0.82)
- Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track (NeurIPS 2025 · similarity 0.82)
- Prediction-Powered Inference Across Many Tasks for AI Evaluations and Social Science Research (NeurIPS 2026 · similarity 0.82)
- A Closer Look at AUROC and AUPRC under Class Imbalance (NeurIPS 2024 · similarity 0.81)
- Trustworthy and Practical AI for Healthcare: A Guided Deferral System with Large Language Models (AAAI 2025 · similarity 0.81)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.