Research map / Label-efficient and robust learning / Noisy labels
spark-crowd: A Spark Package for Learning from Crowdsourced Big Data
Enrique G. Rodrigo, Juan A. Aledo, José A. Gámez
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use spark-crowd instead of Ceka (1 core) | Majority Voting · binary2 | execution time (s): 15973 -> 11 | Improved |
| use spark-crowd instead of Ceka (1 core) | DawidSkene · binary2 | execution time (s): 49259 -> 60 | Improved |
| use spark-crowd instead of Ceka (1 core) | DawidSkene · binary1 | execution time (s): 57 -> 31 | Improved |
| use spark-crowd instead of Truth-Inf (1 core) | Majority Voting · binary1 | execution time (s): 1 -> 11 | Hurt |
| use spark-crowd instead of Truth-Inf (1 core) | Majority Voting · binary4 | execution time (s): 2908 -> 57 | Improved |
| use spark-crowd instead of Truth-Inf (1 core) | DawidSkene · binary3 | execution time (s): 1705 -> 111 | Improved |
| use spark-crowd instead of Truth-Inf on largest data set | DawidSkene · binary4 | completion: Truth-Inf memory error (M); spark-crowd 703 | Improved |
| run on 3-node Spark cluster (tc) instead of one core (t1) | DawidSkene spark-crowd · binary4 | execution time (s): 703 -> 426 | Improved |
| run on Spark cluster instead of one core | Majority Voting spark-crowd · binary1 | execution time (s): 11 -> 7 | Improved |
| run on Spark cluster instead of one core | DawidSkene spark-crowd · binary1 | execution time (s): 31 -> 32 | No clear effect |
| use spark-crowd instead of other packages | Majority Voting and DawidSkene · binary1-binary3 | accuracy: 0.931 -> 0.931 | No clear effect |
Closest papers by meaning
- Towards a Foundation Model for Crowdsourced Label Aggregation (ICLR 2026 · similarity 0.85)
- Streaming Bayesian Inference for Crowdsourced Classification (NeurIPS 2019 · similarity 0.84)
- Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research (JMLR 2018 · similarity 0.84)
- Efficient Online Crowdsourcing with Complex Annotations (AAAI 2024 · similarity 0.83)
- Label Aggregation for Composite Crowd Tasks by Worker Ability Constraint Satisfaction (AAAI 2025 · similarity 0.82)
- Coupled Confusion Correction: Learning from Crowds with Sparse Annotations (AAAI 2024 · similarity 0.82)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
