Research map / Learning theory and algorithms / Prediction and decision losses
LAVA: Data Valuation without Pre-Specified Learning Algorithms
Hoang Anh Just, Feiyang Kang, Tianhao Wang, Yi Zeng, Myeongseob Ko, Ming Jin, Ruoxi Jia
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use LAVA's class-wise Wasserstein data ranking to remove low-value points | CIFAR-10 Trojan Square backdoor detection · CIFAR-10, Trojan Square backdoor | detection rate: at least 80% of poisoned data in the first 20% of removed points | Improved |
| Use LAVA's data ranking to remove low-value points | CIFAR-10 feature-collision poisoning detection · CIFAR-10, feature-collision poisoning | detection rate: 80% detection rate by removing only 11k samples | Improved |
| Use LAVA's data ranking to remove low-value points | CIFAR-10 noisy feature detection · CIFAR-10, noisy features | detection rate: all 12,500 noisy samples by inspecting less than 15,000 samples | Improved |
| Use LAVA's data ranking to remove low-value points | CIFAR-10 mislabeled data detection · CIFAR-10, mislabeled data | detection rate | Improved |
| Use 2K rather than 10K validation data (ablation) | LAVA · CIFAR-10, mislabeled data, removal budget 25K | detection rate: 80% detection rate at data removal budget of 25K; best baseline achieves such a performance with 5 times bigger validati | Improved |
| Use 500 validation examples (ablation) | LAVA · CIFAR-10, mislabeled data detection | detection rate: 500 | Improved |
| Use LAVA's data ranking to remove low-value points | CIFAR-10 irrelevant data detection · CIFAR-10, irrelevant Deer images in Truck class, first 500 inspected | detection rate: 94% | Improved |
| Use LAVA's data ranking to remove low-value points | CIFAR-10 irrelevant data detection · CIFAR-10, irrelevant Cat images in Dog class, first 500 inspected | detection rate: 45% within the top 500 | Mixed |
| Use LAVA's data ranking to remove low-value points | LAVA on GTSRB Hello Kitty blending attack · GTSRB, Blend backdoor | poisoned examples detected: 5000 points ... contain all poisoned data; ... KNN-SV ... around 11,000 samples | Improved |
| Use LAVA's data ranking to remove low-value points | LAVA on MNIST noisy feature detection · MNIST, noisy features | noisy samples detected: all noisy data within first 14,000 samples, which is 5,000 less than the best baseline | Improved |
Later papers that compared with this method
2 later accepted papers report LAVA as a baseline in their results tables; 1 of them report a better number on most of the results they share with it.
- Decision-Focused Learning via Tangent-Space Projection of Prediction Error (ICML 2026 · better on 3 of 4 shared results)
- KAIROS: Scalable Model-Agnostic Data Valuation (NeurIPS 2025 · better on 1 of 2 shared results)
Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.
Closest papers by meaning
- SAVA: Scalable Learning-Agnostic Data Valuation (ICLR 2025 · similarity 0.87)
- Distributionally Robust Data Valuation (ICML 2024 · similarity 0.86)
- Data Distribution Valuation (NeurIPS 2024 · similarity 0.84)
- KAIROS: Scalable Model-Agnostic Data Valuation (NeurIPS 2025 · similarity 0.84)
- What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions (NeurIPS 2025 · similarity 0.83)
- DeRDaVa: Deletion-Robust Data Valuation for Machine Learning (AAAI 2024 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
