Research map / Probabilistic and scientific modeling / Treatment effects
Impossibility of Distribution-Free Predictive Inference for Individual Treatment Effects
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Shows that distribution-free valid prediction sets for individual treatment effects under strong ignorability and overlap must be trivial (infinite expected length) when covariates are continuous, and proposes a Split-Pair interval that is valid under an additive model with residual independence assumptions.
Problem
Whether distribution-free predictive inference (valid coverage with informative, finite-length sets) for individual treatment effects is possible under standard causal assumptions (strong ignorability, overlap) with continuous covariates.
Approach
Connects ITE predictive inference to hardness of conditional independence testing with continuous conditioning variables: any uniformly valid ITE prediction set yields a valid test, forcing it to cover every real value and have infinite expected length. Also gives a positive Split-Pair procedure under additive-error and residual-independence assumptions.
Key results
- Split-Pair attains the nominal 0.9 coverage across all four scenarios in the independent-error beta-propensity setting, while Nest-Exact is highly conservative.
- With Corr(eps0, eps1) = -0.5, Split-Pair fails to reach the 0.9 target, as expected since its independence assumption is violated.
- In the checkerboard stress test, all methods, including Naive and Nest-Exact, fall below the identity line in realized coverage.
Surprising findings
- Conservative methods such as Naive and Nest-Exact fail to attain nominal coverage in the checkerboard stress-test design.
- Nest-Inexact fails to reach target coverage even in the simple example with uninformative covariates, with coverage about 0.755 against a 0.9 target.
Limitations
- Positive Split-Pair result requires restrictive additive model with residuals independent of covariates and conditional independence of potential outcomes, which fails under negative correlation.
- Impossibility argument depends on continuous covariates; discrete or no-covariate settings are left open.
Experimental setup
Benchmarks: synthetic simulation designs
Metrics: empirical coverage average interval length
Baselines: Naive Bonferroni Nest-Exact Nest-Inexact DR pseudo-interval IPW
Builds on: conformal prediction Lei and Candès 2021 conformal inference for counterfactuals Alaa et al. 2023 conformal meta-learners Shah and Peters conditional independence testing hardness
Closest papers by meaning
- Conformal Inference of Individual Treatment Effects Using Conditional Density Estimates (AAAI 2025 · similarity 0.91)
- Beyond the Average: Distributional Causal Inference under Imperfect Compliance (NeurIPS 2025 · similarity 0.89)
- Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark (ICLR 2025 · similarity 0.87)
- Conformal Prediction for Causal Effects of Continuous Treatments (NeurIPS 2025 · similarity 0.87)
- Quantifying Aleatoric Uncertainty of the Treatment Effect: A Novel Orthogonal Learner (NeurIPS 2024 · similarity 0.86)
- Doubly robust identification of treatment effects from multiple environments (ICLR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
