AI Paper Atlas

Research map / Architectures and efficiency / RNNs and normalization

Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research

Bernard Koch, Emily Denton, Alex Hanna, Jacob Gates Foster

NeurIPS 2021 · Architectures and efficiency › RNNs and normalization · approach: Dataset distillation and data-efficient training · 19 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Dataset usage became more concentrated over timePWC task communities · 2015-2020Gini: 0.113 increase; median Gini 0.60 in 2020Mixed
NLP task communities had a lower rate of increasing concentrationPWC task communities · NLP tasks, 2015-2020Gini trendMixed
Task communities adopted datasets originating in other tasksPWC parent tasks · Full sample and task categoriesadoption proportion: 57.8%; Computer Vision 71.9%; Methodology 74.1%; NLP 27.4%Mixed
Task communities created datasets specifically for their own taskPWC parent tasks · Full sample and task categoriescreation proportion: 62.5%; Computer Vision 53.3%; Methodology 52.6%; NLP 76.0%Mixed
Model dataset adoption and creation proportions over timePWC task communities · 2015-2020adoption and creation proportionsNo clear effect
Dataset usage was concentrated among a small set of introducing institutionsPWC dataset usages · June 2021share of usages: over 50% attributed to twelve institutionsMixed
Dataset and institutional usage concentration increasedPWC dataset usages · Recent yearsGini: over 0.80Mixed
Use Pielou evenness instead of Gini (ablation)Concentration analysis in task communities · PWC task communities over timeconcentration trend: median Pielou evenness 0.69No clear effect
Include all parent tasks instead of only the 133 largest (ablation)PWC task communities · Analysis 1Gini trend: median Gini 0.72 -> 0.65No clear effect
Include all parent tasks instead of only the 133 largest (ablation)PWC task communities · Analysis 2median adoption proportion: 57.7% -> 69.7%Mixed
Include all 1,025 tasks, including parent and child tasks (ablation)PWC task communities · Analysis 2median adoption proportion: median creation 33%; median adoption 100%Mixed
Relax the requirement for dataset and using-paper task labels to overlap (ablation)PWC-wide concentration analysis · 2011-2020Gini: datasets 0.31 -> 0.86; institutions 0.38 -> 0.80No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy