Research map / Learning theory and algorithms / Prediction and decision losses
Conformal Thresholded Intervals for Efficient Regression
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes Conformal Thresholded Intervals (CTI), which thresholds multi-output quantile regression interquantile intervals by length to build small conformal prediction sets for regression with marginal coverage guarantees.
Problem
Conformal regression methods typically produce interval prediction sets that are suboptimal for skewed or non-unimodal conditional distributions, while full conditional density methods are complex to tune; the goal is the smallest valid prediction set with guaranteed coverage.
Approach
Train multi-output quantile regression on K equiprobable quantiles, define interquantile intervals, and keep those with length at most a calibrated threshold t (score = interval length), so that short intervals (high estimated density) are included, approximating the Neyman-Pearson optimal set without estimating the full conditional density.
Key results
- On the synthetic triangular data, theoretical expected set sizes are 0.317 for CTI versus 0.342 for CHR and 0.376 for CQR at alpha=0.1.
- CTI(RF) gives the smallest set size on most real datasets, e.g., meps19 1.760 vs 2.388 for CHR(RF) and 2.923 for CQR, with coverage near 0.90.
- On the small star dataset (n=2161), CQR (0.181) slightly outperforms CTI (0.186 RF), which the authors attribute to limited data for multi-output quantile regression.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · synthetic | Size: 0.375 (0.006) -> 0.345 (0.005) | Helped |
| Use CTI(NN) instead of the strongest non-CTI baseline | Conformal regression · bike | Size: 0.758 (0.047) -> 0.720 (0.028) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · bio | Size: 1.450 (0.023) -> 1.295 (0.018) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · blog | Size: 1.567 (0.074) -> 0.709 (0.031) | Helped |
| Use CTI(NN) instead of the strongest non-CTI baseline | Conformal regression · community | Size: 1.588 (0.100) -> 1.275 (0.095) | Helped |
| Use CTI(NN) instead of the strongest non-CTI baseline | Conformal regression · concrete | Size: 0.619 (0.029) -> 0.473 (0.050) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · facebook1 | Size: 1.379 (0.086) -> 0.766 (0.033) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · facebook2 | Size: 1.382 (0.057) -> 0.735 (0.017) | Helped |
| Use CTI(NN) instead of the strongest non-CTI baseline | Conformal regression · homes | Size: 0.535 (0.010) -> 0.515 (0.008) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · meps19 | Size: 2.388 (0.195) -> 1.760 (0.087) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · meps20 | Size: 2.376 (0.105) -> 1.883 (0.067) | Helped |
| Use CTI(RF) instead of the strongest non-CTI baseline | Conformal regression · meps21 | Size: 2.510 (0.167) -> 1.832 (0.089) | Helped |
Surprising findings
- On the star dataset, plain CQR outperforms both CTI and CHR, showing the method depends on quantile regression quality with small samples.
Limitations
- Current implementation does not guarantee prediction sets are intervals (non-convex sets possible).
- Performance depends on quality of multi-output quantile regression; small datasets hurt performance.
- Theoretical optimality requires accurate quantile estimates and smoothness assumptions; some proofs are informal.
Experimental setup
Datasets: synthetic triangular distribution (n=10000) bike bio blog community concrete facebook1 facebook2 homes meps19 meps20 meps21
Benchmarks: synthetic bike bio blog community concrete facebook1 facebook2 homes meps19 meps20 meps21
Metrics: coverage prediction set size
Baselines: CQR CHR Split conformal
Builds on: conformal quantile regression conformal histogram regression split conformal prediction least ambiguous set classification
Closest papers by meaning
- Co-optimization for Adaptive Conformal Prediction (NeurIPS 2026 · similarity 0.88)
- Rectifying Conformity Scores for Better Conditional Coverage (ICML 2025 · similarity 0.88)
- Probabilistic Conformal Prediction with Approximate Conditional Validity (ICLR 2025 · similarity 0.88)
- Relaxed Quantile Regression: Prediction Intervals for Asymmetric Noise (ICML 2024 · similarity 0.86)
- Backward Conformal Prediction (NeurIPS 2025 · similarity 0.86)
- On Volume Minimization in Conformal Regression (ICML 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
