Research map / Learning theory and algorithms / Submodular and game algorithms
GIST: Greedy Independent Set Thresholding for Max-Min Diversification with Submodular Utility
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes GIST, a threshold-sweeping bicriteria greedy algorithm for max-min diversification with monotone submodular utility, giving a 1/2-approximation, a 0.5584 hardness bound, and improved 2/3 results for linear utility, with ImageNet data-sampling experiments.
Problem
Selecting a size-at-most-k subset that maximizes a monotone submodular utility plus a max-min diversity term (min pairwise distance) in a metric space.
Approach
Sweep over distance thresholds d and run a greedy maximal independent set routine on the intersection graph at each threshold (greedy submodular selection subject to pairwise distance >= d), returning the best solution; this yields a bicriteria guarantee that gives a 1/2-approximation for the joint objective.
Key results
- GIST achieves a 1/2-approximation for MDMS (and 2/3 for linear utility), with NP-hardness of approximation within 0.5584.
- On ImageNet at 30% budget, GIST-submod reaches 67.24% top-1 vs 66.23% for random and 66.71% for k-center.
- On synthetic data GIST dominates simple, greedy, and random for all k, while greedy performs poorly for k >= 100.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use GIST with margin-based linear utility instead of margin sampling | ImageNet single-shot data sampling · ImageNet (30%, 40%, 50%, 60%, 70%, 80%, and 90% subsets) | top-1 accuracy (%): 65.97 -> 66.90; 69.73 -> 70.51; 72.33 -> 72.69; 73.43 -> 74.34; 74.49 -> 75.41; 75.01 -> 75.96; 75.11 -> 76.12 | Helped |
| Use GIST with submodular utility instead of the submod baseline | ImageNet single-shot data sampling · ImageNet (30%, 40%, 50%, 60%, 70%, 80%, and 90% subsets) | top-1 accuracy (%): 66.52 -> 67.24; 70.71 -> 70.76; 72.69 -> 73.15; 74.20 -> 74.30; 75.24 -> 75.32; 75.91 -> 75.45; 75.84 -> 76.03 | Mixed |
| Use GIST-submod rather than GIST-margin | GIST on ImageNet single-shot data sampling · ImageNet subset sizes | top-1 accuracy (%): 66.90 vs. 67.24; 70.51 vs. 70.76; 72.69 vs. 73.15; 74.34 vs. 74.30; 75.41 vs. 75.32; 75.96 vs. 75.45; 76.12 vs. 76.03 | Mixed |
Surprising findings
- The standard greedy algorithm has no constant-factor approximation guarantee for the joint objective f, since the diversity term can drop when items are added.
- The objective f is not submodular, so classic submodular guarantees do not apply directly.
Limitations
- Gap between the 0.5 approximation and the 0.5584 hardness remains open.
- ImageNet experiments use a small ResNet-56 and a single embedding-based pipeline, with gains of about 1 point over baselines in places.
- GIST requires sweeping many distance thresholds, giving O(nk log(1/eps)/eps) style oracle cost.
Experimental setup
Datasets: ImageNet synthetic Gaussian points with uniform weights
Benchmarks: ImageNet
Metrics: top-1 accuracy objective value f(S)
Baselines: random simple 0.387-approximation greedy margin sampling k-center submod
Builds on: greedy k-center 2-approximation submodular greedy (Nemhauser et al.) margin sampling max-sum diversification
Closest papers by meaning
- Streaming Robust Submodular Maximization: A Partitioned Thresholding Approach (NeurIPS 2017 · similarity 0.87)
- Weakly Submodular Maximization Beyond Cardinality Constraints: Does Randomization Help Greedy? (ICML 2018 · similarity 0.87)
- Non-monotone Submodular Maximization with Nearly Optimal Adaptivity and Query Complexity (ICML 2019 · similarity 0.87)
- Joint M-Best-Diverse Labelings as a Parametric Submodular Minimization (NeurIPS 2016 · similarity 0.86)
- Multinoulli Extension: A Lossless Yet Effective Probabilistic Framework for Subset Selection over Partition Constraints (ICML 2025 · similarity 0.86)
- Practical $0.385$-Approximation for Submodular Maximization Subject to a Cardinality Constraint (NeurIPS 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
